Ticket #428 (closed bug: fixed)
Test failures and TODO passes summary for Linux AMD64 (Kubuntu Intrepid) at r37267
| Reported by: | mikehh | Owned by: | |
|---|---|---|---|
| Priority: | normal | Milestone: | 1.0 |
| Component: | none | Version: | trunk |
| Severity: | medium | Keywords: | |
| Cc: | Language: | ||
| Patch status: | Platform: |
Description
Following up on TT#420 for Linux i386 (Kubuntu Intrepid)
I have included test failures and test summaries with TODO passes.
The smolder report for the build is:
http://smolder.plusthree.com/app/public_projects/report_details/18823
this included a TODO pass:
All tests successful. Test Summary Report ------------------- t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 30 Files=396, Tests=11740, 366 wallclock secs ( 4.59 usr 1.57 sys + 125.47 cusr 55.31 csys = 186.94 CPU) Result: PASS
My build was as follows:
mhk64@mhk64-desktop:~/parrot$ make realclean mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:17:04 GMT 2009 mhk64@mhk64-desktop:~/parrot$ svn up At revision 37267. mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:17:27 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl Configure.pl --optimize --test --configure_trace pre config tests: All tests successful. Files=124, Tests=2887, 31 wallclock secs ( 1.14 usr 0.38 sys + 21.00 cusr 5.79 csys = 28.31 CPU) Result: PASS post config tests: All tests successful. Files=38, Tests=1042, 35 wallclock secs ( 0.42 usr 0.18 sys + 29.55 cusr 1.90 csys = 32.05 CPU) Result: PASS mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:19:46 GMT 2009 mhk64@mhk64-desktop:~/parrot$ make world mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:25:06 GMT 2009 mhk64@mhk64-desktop:~/parrot$ make html make -C docs html make[1]: Entering directory `/home/mhk64/parrot/docs' /usr/bin/perl -I../lib ../tools/docs/write_docs.pl --silent --version=0.9.1-devel make[1]: Leaving directory `/home/mhk64/parrot/docs' mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:25:40 GMT 2009 mhk64@mhk64-desktop:~/parrot$ make smoke All tests successful. Test Summary Report ------------------- t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 30 Files=396, Tests=11740, 366 wallclock secs ( 4.59 usr 1.57 sys + 125.47 cusr 55.31 csys = 186.94 CPU) Result: PASS TAP Archive created at /home/mhk64/parrot/parrot_test_run.tar.gz Test report successfully sent to Smolder at http://smolder.plusthree.com/app/public_projects/report_details/18823 You can see other recent reports at http://smolder.plusthree.com/app/public_projects/smoke_reports/8 .
As make fulltest exits before completion I ran the tests manually.
The -b, -C, -g, -f and -S give the same result as -b:
mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 10:43:27 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test -b --runcore-tests All tests successful. Test Summary Report ------------------- t/compilers/imcc/syn/hll.t (Wstat: 0 Tests: 2 Failed: 0) TODO passed: 2 t/op/exceptions.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 23 t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0) TODO passed: 26, 30 Files=252, Tests=8393, 306 wallclock secs ( 3.68 usr 0.76 sys + 86.83 cusr 42.38 csys = 133.65 CPU) Result: PASS
There was a failure with -r:
mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:11:45 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test -r --runcore-tests t/op/pushaction.t ...................... 4/7 # Failed test 'pushaction as closure' # at t/op/pushaction.t line 100. # Exited with error code: 1 # Received: # main # at popmark, flag = 0 # a = Null PMC in say # current instr.: 'exit_handler' pc 32 (/home/mhk64/parrot/t/op/pushaction_6.pir:22) # called from Sub 'main' pc 15 (/home/mhk64/parrot/t/op/pushaction_6.pir:11) # # Expected: # main # at popmark, flag = 0 # a = 42 # not ok 7 - pushaction: error while handling error # TODO runloop shenanigans # Looks like you failed 1 test of 7. t/op/pushaction.t ...................... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/7 subtests t/pmc/packfile.t ....................... 4/6 # Failed test 'set_integer_keyed_str' # at t/pmc/packfile.t line 142. # Exited with error code: 134 # Received: # Aborted # # Expected: # not equal # # Looks like you failed 1 test of 6. t/pmc/packfile.t ....................... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/6 subtests t/pmc/sub.t ............................ 60/64 # Failed test ':outer with identical sub names' # at t/pmc/sub.t line 1457. # Exited with error code: 1 # Received: # ABC::outer # ABC::inner # Null PMC in say # current instr.: 'parrot;ABC;inner' pc 47 (/home/mhk64/parrot/t/pmc/sub_63.pir:20) # called from Sub 'parrot;ABC;outer' pc 37 (/home/mhk64/parrot/t/pmc/sub_63.pir:14) # called from Sub 'main' pc 9 (/home/mhk64/parrot/t/pmc/sub_63.pir:3) # # Expected: # ABC::outer # ABC::inner # ABC lex # DEF::outer # DEF::inner # DEF lex # # Looks like you failed 1 test of 64. t/pmc/sub.t ............................ Dubious, test returned 1 (wstat 256, 0x100) Failed 1/64 subtests Test Summary Report ------------------- t/op/pushaction.t (Wstat: 256 Tests: 7 Failed: 1) Failed test: 6 Non-zero exit status: 1 t/pmc/packfile.t (Wstat: 256 Tests: 6 Failed: 1) Failed test: 6 Non-zero exit status: 1 t/pmc/sub.t (Wstat: 256 Tests: 64 Failed: 1) Failed test: 63 Non-zero exit status: 1 Files=252, Tests=8393, 358 wallclock secs ( 4.25 usr 0.85 sys + 115.25 cusr 68.72 csys = 189.07 CPU) Result: FAIL
I don't know if anyone else is getting the t/pmc/packfile.t failure. I have had problems with this before. see TT#412
make src_tests, make run_tests and make perl_tests were all successful.
The code_tests failed with the following result:
mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:28:23 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test --code-tests t/distro/file_metadata.t ....... # Collecting svn:mime-type attributes... t/distro/file_metadata.t ....... 1/5 # Collecting svn:keywords attributes... t/distro/file_metadata.t ....... 3/5 # Failed test 'svn:keywords' # at t/distro/file_metadata.t line 131. # got: 'Set svn:keywords with: # svn ps svn:keywords "Author Date Id Revision" examples/pir/befunge/Makefile # ' # expected: '' # Collecting svn:eol-style attributes... t/distro/file_metadata.t ....... 4/5 # Collecting svn:eol-style attributes... # Looks like you failed 1 test of 5. t/distro/file_metadata.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/5 subtests t/codingstd/perlcritic.t ....... 269/307 # Failed test 'Test::Perl::Critic for "/home/mhk64/parrot/tools/dev/install_files.pl"' # at t/codingstd/perlcritic.t line 88. # # Perl::Critic found these violations in "/home/mhk64/parrot/tools/dev/install_files.pl": # Flag comment 'TODO' found at /home/mhk64/parrot/tools/dev/install_files.pl line 198 t/codingstd/perlcritic.t ....... 307/307 # Looks like you failed 1 test of 307. t/codingstd/perlcritic.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/307 subtests t/codingstd/pir_code_coda.t .... ok t/codingstd/pod_syntax.t ....... 1/2 Finding files with POD, this may take a minute. t/codingstd/pod_syntax.t ....... 2/2 # Failed test 'Pod syntax correct' # at t/codingstd/pod_syntax.t line 45. # got: 'xconf/samples/yourfoobar # t/configure/testlib/verbosefoobar # t/configure/testlib/ddefectivefoobar # t/configure/testlib/adefectivefoobar # t/configure/testlib/cdefectivefoobar # t/configure/testlib/bdefectivefoobar # xconf/samples/testfoobar' # expected: '' # You should use podchecker to check the failed files. # Looks like you failed 1 test of 2. t/codingstd/pod_syntax.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/2 subtests Test Summary Report ------------------- t/distro/file_metadata.t (Wstat: 256 Tests: 5 Failed: 1) Failed test: 3 Non-zero exit status: 1 t/codingstd/perlcritic.t (Wstat: 256 Tests: 307 Failed: 1) Failed test: 270 Non-zero exit status: 1 t/codingstd/pod_syntax.t (Wstat: 256 Tests: 2 Failed: 1) Failed test: 2 Non-zero exit status: 1 Files=28, Tests=354, 220 wallclock secs ( 0.31 usr 0.09 sys + 205.54 cusr 4.68 csys = 210.62 CPU) Result: FAIL
The benchmark_tests gave the following:
mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:33:53 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/benchmark/*.t t/benchmark/benchmarks.t .. 19/37 # Failed test 'examples/benchmarks/oo1.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo2.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo3.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 10 # # Failed test 'examples/benchmarks/oo4.pasm' # at t/benchmark/benchmarks.t line 218. # Exited with error code: 139 # Received: # Segmentation fault # # Expected: # 500000 # t/benchmark/benchmarks.t .. 37/37 # Looks like you failed 4 tests of 37. t/benchmark/benchmarks.t .. Dubious, test returned 4 (wstat 1024, 0x400) Failed 4/37 subtests Test Summary Report ------------------- t/benchmark/benchmarks.t (Wstat: 1024 Tests: 37 Failed: 4) Failed tests: 20-23 Non-zero exit status: 4 Files=1, Tests=37, 513 wallclock secs ( 0.05 usr 0.00 sys + 482.09 cusr 27.20 csys = 509.34 CPU) Result: FAIL
The manifest_tests were successful.
There were NO doc_tests:
mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 11:45:21 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/doc/*.t Files=0, Tests=0, 0 wallclock secs ( 0.01 usr + 0.00 sys = 0.01 CPU) Result: NOTESTS
For the example_tests I have included the summary here - see the attached report for the test failures (but not all).
mhk64@mhk64-desktop:~/parrot$ date
Tue Mar 10 11:49:54 GMT 2009
mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/examples/*.t
Test Summary Report
-------------------
t/examples/catchall.t (Wstat: 3584 Tests: 166 Failed: 14)
Failed tests: 40-42, 44, 63, 65, 72-73, 78, 109, 113
116-117, 119
Non-zero exit status: 14
t/examples/shootout.t (Wstat: 2816 Tests: 20 Failed: 11)
Failed tests: 1, 3, 6-11, 17-19
Non-zero exit status: 11
t/examples/streams.t (Wstat: 512 Tests: 12 Failed: 2)
Failed tests: 1-2
Non-zero exit status: 2
Files=11, Tests=272, 220 wallclock secs ( 0.22 usr 0.04 sys + 11.61 cusr 4.80 csys = 16.67 CPU)
Result: FAIL
and finally the distro_tests:
mhk64@mhk64-desktop:~/parrot$ date Tue Mar 10 12:08:28 GMT 2009 mhk64@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-test t/distro/*.t t/distro/file_metadata.t ....... # Collecting svn:mime-type attributes... t/distro/file_metadata.t ....... 1/5 # Collecting svn:keywords attributes... t/distro/file_metadata.t ....... 3/5 # Failed test 'svn:keywords' # at t/distro/file_metadata.t line 131. # got: 'Set svn:keywords with: # svn ps svn:keywords "Author Date Id Revision" examples/pir/befunge/Makefile # ' # expected: '' # Collecting svn:eol-style attributes... t/distro/file_metadata.t ....... 4/5 # Collecting svn:eol-style attributes... # Looks like you failed 1 test of 5. t/distro/file_metadata.t ....... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/5 subtests t/distro/test_file_coverage.t .. 1/3 # Failed test 'there are PMC files for all test files in t/pmc' # at t/distro/test_file_coverage.t line 57. # files in src/pmc but not in test dir: # packfileannotation # packfileannotationkeys # packfileannotations # Looks like you failed 1 test of 3. t/distro/test_file_coverage.t .. Dubious, test returned 1 (wstat 256, 0x100) Failed 1/3 subtests Test Summary Report ------------------- t/distro/file_metadata.t (Wstat: 256 Tests: 5 Failed: 1) Failed test: 3 Non-zero exit status: 1 t/distro/test_file_coverage.t (Wstat: 256 Tests: 3 Failed: 1) Failed test: 1 Non-zero exit status: 1 Files=4, Tests=13, 5 wallclock secs ( 0.05 usr 0.02 sys + 3.49 cusr 1.59 csys = 5.15 CPU) Result: FAIL
After the tests I built rakudo using this build of parrot.
make test passed and make spectest had some failures.
They all passed on build r37250:
mhk64@mhk64-desktop:~/rakudo$ date
Tue Mar 10 12:11:40 GMT 2009
mhk64@mhk64-desktop:~/rakudo$ cat ../parrot/.parrot_current_rev
37267
mhk64@mhk64-desktop:~/rakudo$ git pull
remote: Counting objects: 19, done.
remote: Compressing objects: 100% (13/13), done.
remote: Total 13 (delta 10), reused 0 (delta 0)
Unpacking objects: 100% (13/13), done.
From git://github.com/rakudo/rakudo
d16d3c3..95ce390 master -> origin/master
Updating d16d3c3..95ce390
Fast forward
docs/guide_to_setting.pod | 30 +++++++++++++++++++++---------
src/setting/Any-list.pm | 6 +++---
2 files changed, 24 insertions(+), 12 deletions(-)
mhk64@mhk64-desktop:~/rakudo$ make realclean
mhk64@mhk64-desktop:~/rakudo$ perl Configure.pl --parrot-config=../parrot/parrot_config
mhk64@mhk64-desktop:~/rakudo$ make
mhk64@mhk64-desktop:~/rakudo$ date
Tue Mar 10 12:15:54 GMT 2009
mhk64@mhk64-desktop:~/rakudo$ make test
All tests successful.
Files=29, Tests=236, 56 wallclock secs ( 0.24 usr 0.08 sys + 45.68 cusr 9.20 csys = 55.20 CPU)
Result: PASS
mhk64@mhk64-desktop:~/rakudo$ make spectest
t/spec/S04-statements/given.rakudo ............................. Failed 16/48 subtests
(less 2 skipped subtests: 30 okay)
t/spec/S32-num/complex.rakudo .................................. Method 're' not found for invocant of class 'Complex'
current instr.: 'parrot;P6metaclass;dispatch' pc 320 (src/classes/ClassHOW.pir:161)
called from Sub '_block21' pc 336 (EVAL_20:121)
called from Sub '_block14' pc 101 (EVAL_20:53)
called from Sub '!UNIT_START' pc 17435 (src/builtins/guts.pir:325)
called from Sub 'parrot;PCT;HLLCompiler;eval' pc 950 (src/PCT/HLLCompiler.pir:527)
called from Sub 'parrot;PCT;HLLCompiler;evalfiles' pc 1275 (src/PCT/HLLCompiler.pir:688)
called from Sub 'parrot;PCT;HLLCompiler;command_line' pc 1456 (src/PCT/HLLCompiler.pir:778)
called from Sub 'parrot;Perl6;Compiler;main' pc 21732 (perl6.pir:163)
t/spec/S32-num/complex.rakudo .................................. Dubious, test returned 1 (wstat 256, 0x100)
Failed 140/140 subtests
Test Summary Report
-------------------
t/spec/S04-statements/given.rakudo (Wstat: 11 Tests: 32 Failed: 0)
Non-zero wait status: 11
Parse errors: Bad plan. You planned 48 tests but ran 32.
t/spec/S32-list/reduce.rakudo (Wstat: 0 Tests: 14 Failed: 0)
TODO passed: 14
t/spec/S32-num/complex.rakudo (Wstat: 256 Tests: 0 Failed: 0)
Non-zero exit status: 1
Parse errors: Bad plan. You planned 140 tests but ran 0.
Files=317, Tests=9242, 2410 wallclock secs ( 8.52 usr 3.33 sys + 2162.31 cusr 208.41 csys = 2382.57 CPU)
Result: FAIL
Failed 2/317 test programs. 0/9242 subtests failed.
make: *** [spectest] Error 255
Attachments
-
fulltest.summaries.37267.log
(61.1 KB) - added by mikehh
13 years ago.
Change History
Note: See
TracTickets for help on using
tickets.
