id	summary	reporter	owner	description	type	status	priority	milestone	component	version	severity	resolution	keywords	cc	lang	patch	platform
420	Test failures and TODO passes with make fulltest on Ubuntu Intrepid i386 at r37197	mikehh		"Following up on TT#417 and tt#419 by alison

I did a build at r37197

http://smolder.plusthree.com/app/public_projects/report_details/18732

I then ran make fulltest and got the following:

for -b, -g and -f runcores:
{{{
All tests successful.                                                                                                                                                               

Test Summary Report
-------------------
t/compilers/imcc/syn/hll.t           (Wstat: 0 Tests: 2 Failed: 0)
  TODO passed:   2                                                
t/op/exceptions.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   23                                                
t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   26                                                
Files=252, Tests=8417, 287 wallclock secs ( 2.99 usr  0.69 sys + 76.59 cusr 34.28 csys = 114.55 CPU)
Result: PASS                                                                                        

}}}

for the -C runcore an additional TODO passed:
{{{
All tests successful.                                                                                                                                                               

Test Summary Report
-------------------
t/compilers/imcc/syn/hll.t           (Wstat: 0 Tests: 2 Failed: 0)
  TODO passed:   2                                                
t/op/exceptions.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   23                                                
t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   26, 30                                            
Files=252, Tests=8417, 290 wallclock secs ( 2.97 usr  0.83 sys + 77.66 cusr 34.13 csys = 115.59 CPU)
Result: PASS                                                                                        

}}}

then the -j runcore failed, but passes the same TODO's as b, g and f:
{{{
Test Summary Report
-------------------
t/compilers/imcc/syn/hll.t           (Wstat: 0 Tests: 2 Failed: 0)
  TODO passed:   2
t/op/exceptions.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   23
t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
  TODO passed:   26
t/pmc/fixedintegerarray.t            (Wstat: 256 Tests: 11 Failed: 1)
  Failed test:  7
  Non-zero exit status: 1
t/library/md5.t                      (Wstat: 1536 Tests: 6 Failed: 6)
  Failed tests:  1-6
  Non-zero exit status: 6
t/library/mt19937ar.t                (Wstat: 256 Tests: 10 Failed: 1)
  Failed test:  10
  Non-zero exit status: 1
Files=252, Tests=8118, 280 wallclock secs ( 2.84 usr  0.65 sys + 75.51 cusr 33.53 csys = 112.53 CPU)
Result: FAIL

}}}

At this stage the test exited, so I ran the remaining tests manually.

The make testr failed:
{{{
Test Summary Report
-------------------
t/op/pushaction.t                    (Wstat: 256 Tests: 7 Failed: 1)
  Failed test:  6
  Non-zero exit status: 1
t/pmc/sub.t                          (Wstat: 256 Tests: 64 Failed: 1)
  Failed test:  63
  Non-zero exit status: 1
Files=252, Tests=8417, 333 wallclock secs ( 2.63 usr  0.68 sys + 105.04 cusr 53.34 csys = 161.69 CPU)
Result: FAIL

}}}

The make testS gave the same results as C

make src_tests and make perl_tests were successful.

make codetest gave the following:
{{{
Test Summary Report
-------------------
t/codingstd/c_cppcomments.t  (Wstat: 256 Tests: 1 Failed: 1)
  Failed test:  1                                           
  Non-zero exit status: 1                                   
t/codingstd/pod_syntax.t     (Wstat: 256 Tests: 2 Failed: 1)
  Failed test:  2                                           
  Non-zero exit status: 1                                   
t/codingstd/trailing_space.t (Wstat: 256 Tests: 1 Failed: 1)
  Failed test:  1                                           
  Non-zero exit status: 1                                   
Files=28, Tests=356, 215 wallclock secs ( 0.20 usr  0.08 sys + 202.78 cusr  3.27 csys = 206.33 CPU)
Result: FAIL                                                                                       

}}}

make benchmark_tests gave the following:
{{{
Test Summary Report
-------------------
t/benchmark/benchmarks.t (Wstat: 1024 Tests: 37 Failed: 4)
  Failed tests:  20-23                                    
  Non-zero exit status: 4                                 
Files=1, Tests=37, 683 wallclock secs ( 0.06 usr  0.01 sys + 669.67 cusr  7.89 csys = 677.63 CPU)
Result: FAIL                                                                                     

}}}

make doc_tests had NO TEST.

make manifest_tests was successful.

make examples_tests failed:
{{{
Test Summary Report
-------------------
t/examples/catchall.t (Wstat: 3328 Tests: 159 Failed: 13)
  Failed tests:  40-42, 44, 63, 65, 72-73, 102, 106, 109-110
                112                                         
  Non-zero exit status: 13                                  
t/examples/japh.t     (Wstat: 256 Tests: 5 Failed: 1)       
  Failed test:  2                                           
  Non-zero exit status: 1                                   
t/examples/shootout.t (Wstat: 256 Tests: 20 Failed: 1)      
  Failed test:  3                                           
  Non-zero exit status: 1                                   
Files=11, Tests=265, 268 wallclock secs ( 0.14 usr  0.03 sys + 16.18 cusr  4.37 csys = 20.72 CPU)
Result: FAIL                                                                                     

}}}

and finally make distro_tests failed:
{{{
Test Summary Report
-------------------
t/distro/test_file_coverage.t (Wstat: 256 Tests: 3 Failed: 1)
  Failed test:  1
  Non-zero exit status: 1
Files=4, Tests=13,  5 wallclock secs ( 0.04 usr  0.01 sys +  3.83 cusr  1.47 csys =  5.35 CPU)
Result: FAIL

}}}

"	bug	closed	normal	1.0	none		medium	fixed					
