[Scipy-tickets] [SciPy] #1269: stats test_distributions.py: replace old fuzz tests

SciPy Trac scipy-tickets@scipy....
Wed Oct 13 20:21:30 CDT 2010

#1269: stats test_distributions.py: replace old fuzz tests
 Reporter:  josefpktd    |       Owner:  somebody
     Type:  task         |      Status:  new     
 Priority:  normal       |   Milestone:  0.9.0   
Component:  scipy.stats  |     Version:  0.7.0   
 Keywords:               |  

Comment(by josefpktd):

 the original tests are in "def test_all_distributions():"  in
 They were initially pretty useless because the sample size was to small
 and the required (statistical) accuracy was too low. Now they use a sample
 size of 1000, and are reasonably good.

 The new tests in test_continuous_basic check many more of the methods of
 the distributions and reuse a single random sample for all tests, but test
 only for one (or a few) pre-specified set of parameters. (no random
 selection of parameters - no fuzzing)

 Currently, the new tests skip one part to avoid duplicating tests that are
 tested with the old tests.

         if distname in distmissing:
             alpha = 0.01
             yield check_distribution_rvs, dist, args, alpha, rvs

 I used an extended version of the original test_all_distributions as fuzz
 test over a larger set of parameters, but that file is not in the scipy

 I expect that avoiding to draw random samples twice for some distributions
 should speed up the tests.

 (Most of these tests were written when large parts of the generic methods
 were not working and I just started with numpy and scipy. By now, it would
 be possible to streamline some of the tests.)

Ticket URL: <http://projects.scipy.org/scipy/ticket/1269#comment:2>
SciPy <http://www.scipy.org>
SciPy is open-source software for mathematics, science, and engineering.

More information about the Scipy-tickets mailing list