Parrot r37351 Test failure and TODO passes Summary on Kubuntu Intrepid i386 Kubuntu and CPAN are up to date The addition of make fulltest_all has greatly eased the creation of this report - util++ ------------------------------------------------------------------------------- I built and tested parrot in the alternate directory parrot.t make realclean svn up mhk@mhk-desktop:~/parrot.t$ date Wed Mar 11 08:59:26 GMT 2009 mhk@mhk-desktop:~/parrot.t$ perl Configure.pl --optimize --test --configure_trace the pre-configure and post-configure tests all passed mhk@mhk-desktop:~/parrot.t$ date Thu Mar 12 09:11:38 GMT 2009 mhk@mhk-desktop:~/parrot.t$ make world 2>&1 | tee make_world.37351,log (I intend to do a report on compiler warnings etc) mhk@mhk-desktop:~/parrot.t$ date Thu Mar 12 09:20:44 GMT 2009 mhk@mhk-desktop:~/parrot.t$ make html mhk@mhk-desktop:~/parrot.t$ date Thu Mar 12 09:21:30 GMT 2009 mhk@mhk-desktop:~/parrot.t$ make smoke All tests successful. Files=396, Tests=11742, 347 wallclock secs ( 3.74 usr 1.15 sys + 115.06 cusr 43.26 csys = 163.21 CPU) Result: PASS TAP Archive created at /home/mhk/parrot.t/parrot_test_run.tar.gz Test report successfully sent to Smolder at http://smolder.plusthree.com/app/public_projects/report_details/18917 ------------------------------------------------------------------------------- I then built and tested rakudo mhk@mhk-desktop:~/rakudo.t$ date Wed Mar 11 09:36:56 GMT 2009 mhk@mhk-desktop:~/rakudo.t$ make realclean mhk@mhk-desktop:~/rakudo.t$ git pull Updating 8bbc31c..0c893bc mhk@mhk-desktop:~/rakudo.t$ date Wed Mar 11 09:37:38 GMT 2009 mhk@mhk-desktop:~/rakudo.t$ perl Configure.pl --parrot-config=../parrot.t/parrot_config mhk@mhk-desktop:~/rakudo.t$ date Wed Mar 11 09:38:47 GMT 2009 mhk@mhk-desktop:~/rakudo.t$ make mhk@mhk-desktop:~/rakudo.t$ date Wed Mar 11 09:40:13 GMT 2009 mhk@mhk-desktop:~/rakudo.t$ make test All tests successful. Files=29, Tests=236, 48 wallclock secs ( 0.19 usr 0.11 sys + 41.92 cusr 5.37 csys = 47.59 CPU) Result: PASS mhk@mhk-desktop:~/rakudo.t$ date Wed Mar 11 09:41:14 GMT 2009 mhk@mhk-desktop:~/rakudo.t$ make spectest All tests successful. Files=317, Tests=9398, 1829 wallclock secs ( 6.24 usr 2.28 sys + 1702.14 cusr 100.58 csys = 1811.24 CPU) Result: PASS mhk@mhk-desktop:~/rakudo.t$ date Thu Mar 12 10:21:34 GMT 2009 ------------------------------------------------------------------------------- I then ran make fulltest_all mhk@mhk-desktop:~/parrot.t$ date Thu Mar 12 10:22:05 GMT 2009 mhk@mhk-desktop:~/parrot.t$ make fulltest_all 2>&1 | tee fulltest_all.37351.log mhk@mhk-desktop:~/parrot.t$ date Thu Mar 12 11:18:10 GMT 2009 I have extracted the test summaries from fulltest_all.37351.log (size: 439118) I then give some information on the failures. ------------------------------------------------------------------------------- make testb All tests successful. Test Summary Report ------------------- t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 30 Files=252, Tests=8449, 293 wallclock secs ( 2.65 usr 0.71 sys + 77.03 cusr 34.82 csys = 115.21 CPU) Result: PASS ------------------------------------------------------------------------------- make testC All tests successful. Test Summary Report ------------------- t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 30 Files=252, Tests=8449, 293 wallclock secs ( 2.65 usr 0.71 sys + 77.03 cusr 34.82 csys = 115.21 CPU) Result: PASS ------------------------------------------------------------------------------- make testf All tests successful. Files=252, Tests=8449, 291 wallclock secs ( 2.41 usr 0.70 sys + 76.10 cusr 35.00 csys = 114.21 CPU) Result: PASS ------------------------------------------------------------------------------- make testg All tests successful. Files=252, Tests=8449, 287 wallclock secs ( 2.46 usr 0.64 sys + 76.78 cusr 34.85 csys = 114.73 CPU) Result: PASS ------------------------------------------------------------------------------- make testj Test Summary Report ------------------- t/pmc/fixedintegerarray.t (Wstat: 256 Tests: 11 Failed: 1) Failed test: 7 Non-zero exit status: 1 t/library/md5.t (Wstat: 1536 Tests: 6 Failed: 6) Failed tests: 1-6 Non-zero exit status: 6 t/library/mt19937ar.t (Wstat: 256 Tests: 10 Failed: 1) Failed test: 10 Non-zero exit status: 1 Files=252, Tests=8150, 287 wallclock secs ( 2.73 usr 0.58 sys + 76.50 cusr 34.44 csys = 114.25 CPU) Result: FAIL ------------------------------------------------------------------------------- make testr All tests successful. Files=252, Tests=8397, 351 wallclock secs ( 2.69 usr 0.60 sys + 107.37 cusr 57.03 csys = 167.69 CPU) Result: PASS ------------------------------------------------------------------------------- make testS All tests successful. Test Summary Report ------------------- t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 30 Files=252, Tests=8150, 294 wallclock secs ( 2.54 usr 0.69 sys + 75.66 cusr 32.90 csys = 111.79 CPU) Result: PASS ------------------------------------------------------------------------------- make src_tests All tests successful. Files=2, Tests=36, 1 wallclock secs ( 0.04 usr 0.00 sys + 0.52 cusr 0.32 csys = 0.88 CPU) Result: PASS ------------------------------------------------------------------------------- make perl_tests All tests successful. Files=4, Tests=229, 5 wallclock secs ( 0.09 usr 0.00 sys + 2.37 cusr 0.65 csys = 3.11 CPU) Result: PASS ------------------------------------------------------------------------------- make codetest All tests successful. Files=29, Tests=356, 225 wallclock secs ( 0.18 usr 0.09 sys + 200.25 cusr 3.30 csys = 203.82 CPU) Result: PASS ------------------------------------------------------------------------------- make doc_tests Result: NOTESTS ------------------------------------------------------------------------------- make manifest_tests Test Summary Report ------------------- t/examples/catchall.t (Wstat: 4096 Tests: 170 Failed: 16) Failed tests: 40-42, 44, 52, 54, 67, 69, 76-77, 82, 113 117, 120-121, 123 Non-zero exit status: 16 t/examples/japh.t (Wstat: 256 Tests: 5 Failed: 1) Failed test: 2 Non-zero exit status: 1 t/examples/shootout.t (Wstat: 256 Tests: 20 Failed: 1) Failed test: 3 Non-zero exit status: 1 Files=11, Tests=276, 269 wallclock secs ( 0.15 usr 0.04 sys + 15.94 cusr 4.10 csys = 20.23 CPU) Result: FAIL ------------------------------------------------------------------------------- make distro_tests Test Summary Report ------------------- t/distro/test_file_coverage.t (Wstat: 256 Tests: 3 Failed: 1) Failed test: 1 Non-zero exit status: 1 Files=4, Tests=13, 7 wallclock secs ( 0.05 usr 0.00 sys + 3.38 cusr 1.46 csys = 4.89 CPU) Result: FAIL ------------------------------------------------------------------------------- make benchmark_tests Test Summary Report ------------------- t/benchmark/benchmarks.t (Wstat: 1024 Tests: 37 Failed: 4) Failed tests: 20-23 Non-zero exit status: 4 Files=1, Tests=37, 661 wallclock secs ( 0.06 usr 0.01 sys + 647.57 cusr 7.24 csys = 654.88 CPU) Result: FAIL ------------------------------------------------------------------------------- ------------------------------------------------------------------------------- testj, manifest_tests, distro_tests and benchmark_tests failed. doc_tests had NO TESTS. The other tests were sucessful, however. testbm testC and testS, passed a TODO test, t/pmc/exception.t: TODO passed: 30. An extract of the test failures is given below: ------------------------------------------------------------------------------- make testj # Failed test 'Getting out-of-bounds elements, I' # at t/pmc/fixedintegerarray.t line 144. # Expected error but exited cleanly # Received: # # Expected: # /FixedIntegerArray: index out of bounds! # current instr\.:/ # # Looks like you failed 1 test of 11. t/pmc/fixedintegerarray.t .............. Dubious, test returned 1 (wstat 256, 0x100) Failed 1/11 subtests # Failed test 'Miscellaneous words' # at t/library/md5.t line 35. # Exited with error code: 139 # Received: # Segmentation fault # ... # Failed test 'Funny chars' # at t/library/md5.t line 63. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # b66434493525523b4393ce0d1f2425d7 # # Failed test 'String lengths' # at t/library/md5.t line 201. # Exited with error code: 139 # Received: # 23a1149ad9c50e9b9f35d31a1c6ac14f # Segmentation fault # # Expected: ... # Failed test 'REALLY long string' # at t/library/md5.t line 324. # Exited with error code: 139 # Received: # Segmentation fault ... # Failed test 'recursive md5sum (1)' # at t/library/md5.t line 352. # Exited with error code: 139 # Received: # Hello World! # Segmentation fault ... # Failed test 'recursive md5sum (2)' # at t/library/md5.t line 590. # Exited with error code: 139 # Received: # Hello World! # Segmentation fault ... # # Looks like you failed 6 tests of 6. t/library/md5.t ........................ Dubious, test returned 6 (wstat 1536, 0x600) Failed 6/6 subtests t/library/mime_base64.t ................ ok # Failed test 'mt19937ar output' # at t/library/mt19937ar.t line 148. # Exited with error code: 139 # Received: # Segmentation fault ... # # Looks like you failed 1 test of 10. t/library/mt19937ar.t .................. Dubious, test returned 1 (wstat 256, 0x100) Failed 1/10 subtests ------------------------------------------------------------------------------- make examples_tests error:imcc:syntax error, unexpected VAR, expecting '(' ('sock') in file 'examples/io/echo_client.pir' line 33 error:imcc:syntax error, unexpected VAR, expecting '(' ('address') in file 'examples/io/echo_client.pir' line 36 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/echo_client.pir' line 38 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/echo_client.pir' line 49 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/echo_client.pir' line 50 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/echo_client.pir' line 51 # Failed test 'examples/io/echo_client.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected VAR, expecting '(' ('sock') in file 'examples/io/http.pir' line 31 error:imcc:syntax error, unexpected VAR, expecting '(' ('address') in file 'examples/io/http.pir' line 35 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/http.pir' line 37 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/http.pir' line 42 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/http.pir' line 43 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/http.pir' line 45 # Failed test 'examples/io/http.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected VAR, expecting '(' ('sock') in file 'examples/io/httpd.pir' line 112 error:imcc:syntax error, unexpected VAR, expecting '(' ('port') in file 'examples/io/httpd.pir' line 116 error:imcc:syntax error, unexpected VAR, expecting '(' ('sock') in file 'examples/io/httpd.pir' line 117 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/httpd.pir' line 132 error:imcc:syntax error, unexpected VAR, expecting '(' ('work') in file 'examples/io/httpd.pir' line 134 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/httpd.pir' line 137 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/httpd.pir' line 228 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/httpd.pir' line 251 error:imcc:syntax error, unexpected VAR, expecting '(' ('ret') in file 'examples/io/httpd.pir' line 278 error:imcc:syntax error, unexpected VAR, expecting '(' ('hex') in file 'examples/io/httpd.pir' line 334 # Failed test 'examples/io/httpd.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected IDENTIFIER, expecting PARROT_OP ('socket') in file 'examples/io/net_smtp.pasm' line 25 # Failed test 'examples/io/net_smtp.pasm' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:No such file or directory in file 'examples/languages/abc/abc.pir' line 53 # Failed test 'examples/languages/abc/abc.pir' # at t/examples/catchall.t line 45. # got: '512' # expected: '0' error:imcc:No such file or directory in file 'examples/languages/squaak/squaak.pir' line 60 # Failed test 'examples/languages/squaak/squaak.pir' # at t/examples/catchall.t line 45. # got: '512' # expected: '0' error:imcc:No such file or directory in file 'examples/nci/sdl_blue_rectangle.pir' line 9 # Failed test 'examples/nci/sdl_blue_rectangle.pir' # at t/examples/catchall.t line 45. # got: '512' # expected: '0' error:imcc:No such file or directory in file 'examples/nci/xlibtest.pir' line 21 # Failed test 'examples/nci/xlibtest.pir' # at t/examples/catchall.t line 45. # got: '512' # expected: '0' error:imcc:syntax error, unexpected IDENTIFIER, expecting PARROT_OP ('compile') in file 'examples/pasm/nanoforth.pasm' line 90 # Failed test 'examples/pasm/nanoforth.pasm' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected IDENTIFIER, expecting PARROT_OP ('find_global') in file 'examples/pasm/nanoforth2.pasm' line 30 # Failed test 'examples/pasm/nanoforth2.pasm' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:No such file or directory in file 'examples/pir/befunge/befunge.pir' line 3 # Failed test 'examples/pir/befunge/befunge.pir' # at t/examples/catchall.t line 45. # got: '512' # expected: '0' error:imcc:syntax error, unexpected STRINGC, expecting '(' (''Mines::Field'') in file 'examples/sdl/minesweeper/field.pir' line 180 error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"') in file 'examples/sdl/minesweeper/field.pir' line 317 error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"') in file 'examples/sdl/minesweeper/field.pir' line 320 error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"') in file 'examples/sdl/minesweeper/field.pir' line 979 error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"') in file 'examples/sdl/minesweeper/field.pir' line 984 # Failed test 'examples/sdl/minesweeper/field.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::App"') in file 'examples/sdl/tetris/app.pir' line 80 error:imcc:syntax error, unexpected PREG, expecting '(' ('$P0') in file 'examples/sdl/tetris/app.pir' line 168 error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::App"') in file 'examples/sdl/tetris/app.pir' line 192 # Failed test 'examples/sdl/tetris/app.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::Block"') in file 'examples/sdl/tetris/blocks.pir' line 61 # Failed test 'examples/sdl/tetris/blocks.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::Block"') in file 'examples/sdl/tetris/board.pir' line 879 # Failed test 'examples/sdl/tetris/board.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"SDL::Event"') in file 'examples/sdl/tetris/eventhandler.pir' line 42 # Failed test 'examples/sdl/tetris/eventhandler.pir' # at t/examples/catchall.t line 45. # got: '256' # expected: '0' # Looks like you failed 16 tests of 170. t/examples/catchall.t ... Dubious, test returned 16 (wstat 4096, 0x1000) Failed 16/170 subtests # Failed test 'examples/japh/japh2.pasm' # at t/examples/japh.t line 54. # got: '畊瑳愠潮桴牥倠牡潲⁴慈正牥瀊 ' # expected: 'Just another Parrot Hacker # ' # Looks like you failed 1 test of 5. t/examples/japh.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/5 subtests # Failed test 'examples/shootout/fannkuch.pir' # at t/examples/shootout.t line 107. # Exited with error code: 139 # Received: # 1234567 # FixedIntegerArray: index out of bounds! # current instr.: 'fannkuch' pc 0 (/home/mhk/parrot.t/t/examples/shootout_3.pir:8) # called from Sub 'main' pc 244 (/home/mhk/parrot.t/t/examples/shootout_3.pir:108) # Segmentation fault ... # Looks like you failed 1 test of 20. t/examples/shootout.t ... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/20 subtests t/examples/streams.t .... ------------------------------------------------------------------------------- make distro_tests # Failed test 'there are PMC files for all test files in t/pmc' # at t/distro/test_file_coverage.t line 57. # files in src/pmc but not in test dir: # packfileannotation # packfileannotationkeys # packfileannotations # Looks like you failed 1 test of 3. t/distro/test_file_coverage.t .. Dubious, test returned 1 (wstat 256, 0x100) Failed 1/3 subtests ------------------------------------------------------------------------------- make benchmark_tests # Failed test 'examples/benchmarks/oo1.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo2.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo3.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo4.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 500000 # # Looks like you failed 4 tests of 37. t/benchmark/benchmarks.t .. Dubious, test returned 4 (wstat 1024, 0x400) Failed 4/37 subtests ------------------------------------------------------------------------------- -------------------------------------------------------------------------------