id summary reporter owner description type status priority milestone component version severity resolution keywords cc lang patch platform 428 Test failures and TODO passes summary for Linux AMD64 (Kubuntu Intrepid) at r37267 mikehh "Following up on TT#420 for Linux i386 (Kubuntu Intrepid) I have included test failures and test summaries with TODO passes. The smolder report for the build is: http://smolder.plusthree.com/app/public_projects/report_details/18823 this included a TODO pass: {{{ All tests successful. Test Summary Report ------------------- t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 30 Files=396, Tests=11740, 366 wallclock secs ( 4.59 usr 1.57 sys + 125.47 cusr 55.31 csys = 186.94 CPU) Result: PASS }}} My build was as follows: {{{ mhk64@mhk64-desktop:~/parrot$ make realclean mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:17:04 GMT 2009 mhk64@mhk64-desktop:~/parrot$ svn up At revision 37267. mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:17:27 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl Configure.pl --optimize --test --configure_trace pre config tests: All tests successful. Files=124, Tests=2887, 31 wallclock secs ( 1.14 usr 0.38 sys + 21.00 cusr 5.79 csys = 28.31 CPU) Result: PASS post config tests: All tests successful. Files=38, Tests=1042, 35 wallclock secs ( 0.42 usr 0.18 sys + 29.55 cusr 1.90 csys = 32.05 CPU) Result: PASS mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:19:46 GMT 2009 mhk64@mhk64-desktop:~/parrot$ make world mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:25:06 GMT 2009 mhk64@mhk64-desktop:~/parrot$ make html make -C docs html make[1]: Entering directory `/home/mhk64/parrot/docs' /usr/bin/perl -I../lib ../tools/docs/write_docs.pl --silent --version=0.9.1-devel make[1]: Leaving directory `/home/mhk64/parrot/docs' mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:25:40 GMT 2009 mhk64@mhk64-desktop:~/parrot$ make smoke All tests successful. Test Summary Report ------------------- t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 30 Files=396, Tests=11740, 366 wallclock secs ( 4.59 usr 1.57 sys + 125.47 cusr 55.31 csys = 186.94 CPU) Result: PASS TAP Archive created at /home/mhk64/parrot/parrot_test_run.tar.gz Test report successfully sent to Smolder at http://smolder.plusthree.com/app/public_projects/report_details/18823 You can see other recent reports at http://smolder.plusthree.com/app/public_projects/smoke_reports/8 . }}} As make fulltest exits before completion I ran the tests manually. The -b, -C, -g, -f and -S give the same result as -b: {{{ mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:43:27 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test -b --runcore-tests All tests successful. Test Summary Report ------------------- t/compilers/imcc/syn/hll.t (Wstat: 0 Tests: 2 Failed: 0) TODO passed: 2 t/op/exceptions.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 23 t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 26, 30 Files=252, Tests=8393, 306 wallclock secs ( 3.68 usr 0.76 sys + 86.83 cusr 42.38 csys = 133.65 CPU) Result: PASS }}} There was a failure with -r: {{{ mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:11:45 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test -r --runcore-tests t/op/pushaction.t ...................... 4/7 # Failed test 'pushaction as closure' # at t/op/pushaction.t line 100. # Exited with error code: 1 # Received: # main # at popmark, flag = 0 # a = Null PMC in say # current instr.: 'exit_handler' pc 32 (/home/mhk64/parrot/t/op/pushaction_6.pir:22) # called from Sub 'main' pc 15 (/home/mhk64/parrot/t/op/pushaction_6.pir:11) # # Expected: # main # at popmark, flag = 0 # a = 42 # not ok 7 - pushaction: error while handling error # TODO runloop shenanigans # Looks like you failed 1 test of 7. t/op/pushaction.t ...................... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/7 subtests t/pmc/packfile.t ....................... 4/6 # Failed test 'set_integer_keyed_str' # at t/pmc/packfile.t line 142. # Exited with error code: 134 # Received: # Aborted # # Expected: # not equal # # Looks like you failed 1 test of 6. t/pmc/packfile.t ....................... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/6 subtests t/pmc/sub.t ............................ 60/64 # Failed test ':outer with identical sub names' # at t/pmc/sub.t line 1457. # Exited with error code: 1 # Received: # ABC::outer # ABC::inner # Null PMC in say # current instr.: 'parrot;ABC;inner' pc 47 (/home/mhk64/parrot/t/pmc/sub_63.pir:20) # called from Sub 'parrot;ABC;outer' pc 37 (/home/mhk64/parrot/t/pmc/sub_63.pir:14) # called from Sub 'main' pc 9 (/home/mhk64/parrot/t/pmc/sub_63.pir:3) # # Expected: # ABC::outer # ABC::inner # ABC lex # DEF::outer # DEF::inner # DEF lex # # Looks like you failed 1 test of 64. t/pmc/sub.t ............................ Dubious, test returned 1 (wstat 256, 0x100) Failed 1/64 subtests Test Summary Report ------------------- t/op/pushaction.t (Wstat: 256 Tests: 7 Failed: 1) Failed test: 6 Non-zero exit status: 1 t/pmc/packfile.t (Wstat: 256 Tests: 6 Failed: 1) Failed test: 6 Non-zero exit status: 1 t/pmc/sub.t (Wstat: 256 Tests: 64 Failed: 1) Failed test: 63 Non-zero exit status: 1 Files=252, Tests=8393, 358 wallclock secs ( 4.25 usr 0.85 sys + 115.25 cusr 68.72 csys = 189.07 CPU) Result: FAIL }}} I don't know if anyone else is getting the t/pmc/packfile.t failure. I have had problems with this before. see TT#412 make src_tests, make run_tests and make perl_tests were all successful. The code_tests failed with the following result: {{{ mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:28:23 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test --code-tests t/distro/file_metadata.t ....... # Collecting svn:mime-type attributes... t/distro/file_metadata.t ....... 1/5 # Collecting svn:keywords attributes... t/distro/file_metadata.t ....... 3/5 # Failed test 'svn:keywords' # at t/distro/file_metadata.t line 131. # got: 'Set svn:keywords with: # svn ps svn:keywords ""Author Date Id Revision"" examples/pir/befunge/Makefile # ' # expected: '' # Collecting svn:eol-style attributes... t/distro/file_metadata.t ....... 4/5 # Collecting svn:eol-style attributes... # Looks like you failed 1 test of 5. t/distro/file_metadata.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/5 subtests t/codingstd/perlcritic.t ....... 269/307 # Failed test 'Test::Perl::Critic for ""/home/mhk64/parrot/tools/dev/install_files.pl""' # at t/codingstd/perlcritic.t line 88. # # Perl::Critic found these violations in ""/home/mhk64/parrot/tools/dev/install_files.pl"": # Flag comment 'TODO' found at /home/mhk64/parrot/tools/dev/install_files.pl line 198 t/codingstd/perlcritic.t ....... 307/307 # Looks like you failed 1 test of 307. t/codingstd/perlcritic.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/307 subtests t/codingstd/pir_code_coda.t .... ok t/codingstd/pod_syntax.t ....... 1/2 Finding files with POD, this may take a minute. t/codingstd/pod_syntax.t ....... 2/2 # Failed test 'Pod syntax correct' # at t/codingstd/pod_syntax.t line 45. # got: 'xconf/samples/yourfoobar # t/configure/testlib/verbosefoobar # t/configure/testlib/ddefectivefoobar # t/configure/testlib/adefectivefoobar # t/configure/testlib/cdefectivefoobar # t/configure/testlib/bdefectivefoobar # xconf/samples/testfoobar' # expected: '' # You should use podchecker to check the failed files. # Looks like you failed 1 test of 2. t/codingstd/pod_syntax.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/2 subtests Test Summary Report ------------------- t/distro/file_metadata.t (Wstat: 256 Tests: 5 Failed: 1) Failed test: 3 Non-zero exit status: 1 t/codingstd/perlcritic.t (Wstat: 256 Tests: 307 Failed: 1) Failed test: 270 Non-zero exit status: 1 t/codingstd/pod_syntax.t (Wstat: 256 Tests: 2 Failed: 1) Failed test: 2 Non-zero exit status: 1 Files=28, Tests=354, 220 wallclock secs ( 0.31 usr 0.09 sys + 205.54 cusr 4.68 csys = 210.62 CPU) Result: FAIL }}} The benchmark_tests gave the following: {{{ mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:33:53 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/benchmark/*.t t/benchmark/benchmarks.t .. 19/37 # Failed test 'examples/benchmarks/oo1.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo2.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo3.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo4.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 500000 # t/benchmark/benchmarks.t .. 37/37 # Looks like you failed 4 tests of 37. t/benchmark/benchmarks.t .. Dubious, test returned 4 (wstat 1024, 0x400) Failed 4/37 subtests Test Summary Report ------------------- t/benchmark/benchmarks.t (Wstat: 1024 Tests: 37 Failed: 4) Failed tests: 20-23 Non-zero exit status: 4 Files=1, Tests=37, 513 wallclock secs ( 0.05 usr 0.00 sys + 482.09 cusr 27.20 csys = 509.34 CPU) Result: FAIL }}} The manifest_tests were successful. There were NO doc_tests: {{{ mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:45:21 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/doc/*.t Files=0, Tests=0, 0 wallclock secs ( 0.01 usr + 0.00 sys = 0.01 CPU) Result: NOTESTS }}} For the example_tests I have included the summary here - see the attached report for the test failures (but not all). {{{ mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:49:54 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/examples/*.t Test Summary Report ------------------- t/examples/catchall.t (Wstat: 3584 Tests: 166 Failed: 14) Failed tests: 40-42, 44, 63, 65, 72-73, 78, 109, 113 116-117, 119 Non-zero exit status: 14 t/examples/shootout.t (Wstat: 2816 Tests: 20 Failed: 11) Failed tests: 1, 3, 6-11, 17-19 Non-zero exit status: 11 t/examples/streams.t (Wstat: 512 Tests: 12 Failed: 2) Failed tests: 1-2 Non-zero exit status: 2 Files=11, Tests=272, 220 wallclock secs ( 0.22 usr 0.04 sys + 11.61 cusr 4.80 csys = 16.67 CPU) Result: FAIL }}} and finally the distro_tests: {{{ mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 12:08:28 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/distro/*.t t/distro/file_metadata.t ....... # Collecting svn:mime-type attributes... t/distro/file_metadata.t ....... 1/5 # Collecting svn:keywords attributes... t/distro/file_metadata.t ....... 3/5 # Failed test 'svn:keywords' # at t/distro/file_metadata.t line 131. # got: 'Set svn:keywords with: # svn ps svn:keywords ""Author Date Id Revision"" examples/pir/befunge/Makefile # ' # expected: '' # Collecting svn:eol-style attributes... t/distro/file_metadata.t ....... 4/5 # Collecting svn:eol-style attributes... # Looks like you failed 1 test of 5. t/distro/file_metadata.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/5 subtests t/distro/test_file_coverage.t .. 1/3 # Failed test 'there are PMC files for all test files in t/pmc' # at t/distro/test_file_coverage.t line 57. # files in src/pmc but not in test dir: # packfileannotation # packfileannotationkeys # packfileannotations # Looks like you failed 1 test of 3. t/distro/test_file_coverage.t .. Dubious, test returned 1 (wstat 256, 0x100) Failed 1/3 subtests Test Summary Report ------------------- t/distro/file_metadata.t (Wstat: 256 Tests: 5 Failed: 1) Failed test: 3 Non-zero exit status: 1 t/distro/test_file_coverage.t (Wstat: 256 Tests: 3 Failed: 1) Failed test: 1 Non-zero exit status: 1 Files=4, Tests=13, 5 wallclock secs ( 0.05 usr 0.02 sys + 3.49 cusr 1.59 csys = 5.15 CPU) Result: FAIL }}} After the tests I built rakudo using this build of parrot. make test passed and make spectest had some failures. They all passed on build r37250: {{{ mhk64@mhk64-desktop:~/rakudo$ date Tue Mar 10 12:11:40 GMT 2009 mhk64@mhk64-desktop:~/rakudo$ cat ../parrot/.parrot_current_rev 37267 mhk64@mhk64-desktop:~/rakudo$ git pull remote: Counting objects: 19, done. remote: Compressing objects: 100% (13/13), done. remote: Total 13 (delta 10), reused 0 (delta 0) Unpacking objects: 100% (13/13), done. From git://github.com/rakudo/rakudo d16d3c3..95ce390 master -> origin/master Updating d16d3c3..95ce390 Fast forward docs/guide_to_setting.pod | 30 +++++++++++++++++++++--------- src/setting/Any-list.pm | 6 +++--- 2 files changed, 24 insertions(+), 12 deletions(-) mhk64@mhk64-desktop:~/rakudo$ make realclean mhk64@mhk64-desktop:~/rakudo$ perl Configure.pl --parrot-config=../parrot/parrot_config mhk64@mhk64-desktop:~/rakudo$ make mhk64@mhk64-desktop:~/rakudo$ date Tue Mar 10 12:15:54 GMT 2009 mhk64@mhk64-desktop:~/rakudo$ make test All tests successful. Files=29, Tests=236, 56 wallclock secs ( 0.24 usr 0.08 sys + 45.68 cusr 9.20 csys = 55.20 CPU) Result: PASS mhk64@mhk64-desktop:~/rakudo$ make spectest t/spec/S04-statements/given.rakudo ............................. Failed 16/48 subtests (less 2 skipped subtests: 30 okay) t/spec/S32-num/complex.rakudo .................................. Method 're' not found for invocant of class 'Complex' current instr.: 'parrot;P6metaclass;dispatch' pc 320 (src/classes/ClassHOW.pir:161) called from Sub '_block21' pc 336 (EVAL_20:121) called from Sub '_block14' pc 101 (EVAL_20:53) called from Sub '!UNIT_START' pc 17435 (src/builtins/guts.pir:325) called from Sub 'parrot;PCT;HLLCompiler;eval' pc 950 (src/PCT/HLLCompiler.pir:527) called from Sub 'parrot;PCT;HLLCompiler;evalfiles' pc 1275 (src/PCT/HLLCompiler.pir:688) called from Sub 'parrot;PCT;HLLCompiler;command_line' pc 1456 (src/PCT/HLLCompiler.pir:778) called from Sub 'parrot;Perl6;Compiler;main' pc 21732 (perl6.pir:163) t/spec/S32-num/complex.rakudo .................................. Dubious, test returned 1 (wstat 256, 0x100) Failed 140/140 subtests Test Summary Report ------------------- t/spec/S04-statements/given.rakudo (Wstat: 11 Tests: 32 Failed: 0) Non-zero wait status: 11 Parse errors: Bad plan. You planned 48 tests but ran 32. t/spec/S32-list/reduce.rakudo (Wstat: 0 Tests: 14 Failed: 0) TODO passed: 14 t/spec/S32-num/complex.rakudo (Wstat: 256 Tests: 0 Failed: 0) Non-zero exit status: 1 Parse errors: Bad plan. You planned 140 tests but ran 0. Files=317, Tests=9242, 2410 wallclock secs ( 8.52 usr 3.33 sys + 2162.31 cusr 208.41 csys = 2382.57 CPU) Result: FAIL Failed 2/317 test programs. 0/9242 subtests failed. make: *** [spectest] Error 255 }}} " bug closed normal 1.0 none trunk medium fixed