Recently tightened test just failed

[ricardoV94]

This line was recently changed in #5366

pymc/pymc/tests/test_sampling.py

Line 511 in 4eecf14

assert pval > 0.01

And now failed in:

https://github.com/pymc-devs/pymc/runs/4963994741?check_suite_focus=true

Given this is a recent change, it suggests to me the new bound may be too strict for the frequency of tests we run.

CC @austereantelope

[austereantelope]

@ricardoV94 After more investigation, we have found that by tightening this bound we do not gain much (only 0.02 increase in mutation score). I think we can revert the test back to pval > 0.001 to keep the original pass rate. Let me know what you think. Thanks!

[ricardoV94]

@austereantelope that sounds good