id,summary,reporter,owner,description,type,status,priority,milestone,component,version,severity,resolution,keywords,cc,lang,patch,platform
420,Test failures and TODO passes with make fulltest on Ubuntu Intrepid i386 at r37197,mikehh,,"Following up on TT#417 and tt#419 by alison

I did a build at r37197

http://smolder.plusthree.com/app/public_projects/report_details/18732

I then ran make fulltest and got the following:

for -b, -g and -f runcores:
{{{
All tests successful.                                                                                                                                                               

Test Summary Report
-------------------
t/compilers/imcc/syn/hll.t           (Wstat: 0 Tests: 2 Failed: 0)
  TODO passed:   2                                                
t/op/exceptions.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   23                                                
t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   26                                                
Files=252, Tests=8417, 287 wallclock secs ( 2.99 usr  0.69 sys + 76.59 cusr 34.28 csys = 114.55 CPU)
Result: PASS                                                                                        

}}}

for the -C runcore an additional TODO passed:
{{{
All tests successful.                                                                                                                                                               

Test Summary Report
-------------------
t/compilers/imcc/syn/hll.t           (Wstat: 0 Tests: 2 Failed: 0)
  TODO passed:   2                                                
t/op/exceptions.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   23                                                
t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   26, 30                                            
Files=252, Tests=8417, 290 wallclock secs ( 2.97 usr  0.83 sys + 77.66 cusr 34.13 csys = 115.59 CPU)
Result: PASS                                                                                        

}}}

then the -j runcore failed, but passes the same TODO's as b, g and f:
{{{
Test Summary Report
-------------------
t/compilers/imcc/syn/hll.t           (Wstat: 0 Tests: 2 Failed: 0)
  TODO passed:   2
t/op/exceptions.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   23
t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   26
t/pmc/fixedintegerarray.t            (Wstat: 256 Tests: 11 Failed: 1)
  Failed test:  7
  Non-zero exit status: 1
t/library/md5.t                      (Wstat: 1536 Tests: 6 Failed: 6)
  Failed tests:  1-6
  Non-zero exit status: 6
t/library/mt19937ar.t                (Wstat: 256 Tests: 10 Failed: 1)
  Failed test:  10
  Non-zero exit status: 1
Files=252, Tests=8118, 280 wallclock secs ( 2.84 usr  0.65 sys + 75.51 cusr 33.53 csys = 112.53 CPU)
Result: FAIL

}}}

At this stage the test exited, so I ran the remaining tests manually.

The make testr failed:
{{{
Test Summary Report
-------------------
t/op/pushaction.t                    (Wstat: 256 Tests: 7 Failed: 1)
  Failed test:  6
  Non-zero exit status: 1
t/pmc/sub.t                          (Wstat: 256 Tests: 64 Failed: 1)
  Failed test:  63
  Non-zero exit status: 1
Files=252, Tests=8417, 333 wallclock secs ( 2.63 usr  0.68 sys + 105.04 cusr 53.34 csys = 161.69 CPU)
Result: FAIL

}}}

The make testS gave the same results as C

make src_tests and make perl_tests were successful.

make codetest gave the following:
{{{
Test Summary Report
-------------------
t/codingstd/c_cppcomments.t  (Wstat: 256 Tests: 1 Failed: 1)
  Failed test:  1                                           
  Non-zero exit status: 1                                   
t/codingstd/pod_syntax.t     (Wstat: 256 Tests: 2 Failed: 1)
  Failed test:  2                                           
  Non-zero exit status: 1                                   
t/codingstd/trailing_space.t (Wstat: 256 Tests: 1 Failed: 1)
  Failed test:  1                                           
  Non-zero exit status: 1                                   
Files=28, Tests=356, 215 wallclock secs ( 0.20 usr  0.08 sys + 202.78 cusr  3.27 csys = 206.33 CPU)
Result: FAIL                                                                                       

}}}

make benchmark_tests gave the following:
{{{
Test Summary Report
-------------------
t/benchmark/benchmarks.t (Wstat: 1024 Tests: 37 Failed: 4)
  Failed tests:  20-23                                    
  Non-zero exit status: 4                                 
Files=1, Tests=37, 683 wallclock secs ( 0.06 usr  0.01 sys + 669.67 cusr  7.89 csys = 677.63 CPU)
Result: FAIL                                                                                     

}}}

make doc_tests had NO TEST.

make manifest_tests was successful.

make examples_tests failed:
{{{
Test Summary Report
-------------------
t/examples/catchall.t (Wstat: 3328 Tests: 159 Failed: 13)
  Failed tests:  40-42, 44, 63, 65, 72-73, 102, 106, 109-110
                112                                         
  Non-zero exit status: 13                                  
t/examples/japh.t     (Wstat: 256 Tests: 5 Failed: 1)       
  Failed test:  2                                           
  Non-zero exit status: 1                                   
t/examples/shootout.t (Wstat: 256 Tests: 20 Failed: 1)      
  Failed test:  3                                           
  Non-zero exit status: 1                                   
Files=11, Tests=265, 268 wallclock secs ( 0.14 usr  0.03 sys + 16.18 cusr  4.37 csys = 20.72 CPU)
Result: FAIL                                                                                     

}}}

and finally make distro_tests failed:
{{{
Test Summary Report
-------------------
t/distro/test_file_coverage.t (Wstat: 256 Tests: 3 Failed: 1)
  Failed test:  1
  Non-zero exit status: 1
Files=4, Tests=13,  5 wallclock secs ( 0.04 usr  0.01 sys +  3.83 cusr  1.47 csys =  5.35 CPU)
Result: FAIL

}}}

",bug,closed,normal,1.0,none,,medium,fixed,,,,,