Ticket #420: fulltest_all_summary.37351.log

File fulltest_all_summary.37351.log, 18.5 KB (added by mikehh, 4 years ago)

Latest Test failures and TODO pases summary r37351

Line 
1Parrot r37351 Test failure and TODO passes Summary on Kubuntu Intrepid i386
2
3Kubuntu and CPAN are up to date
4
5The addition of make fulltest_all has greatly eased the creation of this report - util++
6
7-------------------------------------------------------------------------------
8
9I built and tested parrot in the alternate directory parrot.t
10
11make realclean
12svn up
13
14mhk@mhk-desktop:~/parrot.t$ date
15Wed Mar 11 08:59:26 GMT 2009
16mhk@mhk-desktop:~/parrot.t$ perl Configure.pl --optimize --test --configure_trace
17
18the pre-configure and post-configure tests all passed
19
20mhk@mhk-desktop:~/parrot.t$ date
21Thu Mar 12 09:11:38 GMT 2009
22mhk@mhk-desktop:~/parrot.t$ make world 2>&1 | tee make_world.37351,log
23
24(I intend to do a report on compiler warnings etc)
25
26mhk@mhk-desktop:~/parrot.t$ date
27Thu Mar 12 09:20:44 GMT 2009
28mhk@mhk-desktop:~/parrot.t$ make html
29
30mhk@mhk-desktop:~/parrot.t$ date
31Thu Mar 12 09:21:30 GMT 2009
32mhk@mhk-desktop:~/parrot.t$ make smoke
33
34All tests successful.
35Files=396, Tests=11742, 347 wallclock secs ( 3.74 usr  1.15 sys + 115.06 cusr 43.26 csys = 163.21 CPU)
36Result: PASS
37
38TAP Archive created at /home/mhk/parrot.t/parrot_test_run.tar.gz
39Test report successfully sent to Smolder at
40http://smolder.plusthree.com/app/public_projects/report_details/18917
41
42-------------------------------------------------------------------------------
43
44I then built and tested rakudo
45
46mhk@mhk-desktop:~/rakudo.t$ date
47Wed Mar 11 09:36:56 GMT 2009
48mhk@mhk-desktop:~/rakudo.t$ make realclean
49
50mhk@mhk-desktop:~/rakudo.t$ git pull
51
52Updating 8bbc31c..0c893bc
53
54mhk@mhk-desktop:~/rakudo.t$ date
55Wed Mar 11 09:37:38 GMT 2009
56mhk@mhk-desktop:~/rakudo.t$ perl Configure.pl --parrot-config=../parrot.t/parrot_config
57
58mhk@mhk-desktop:~/rakudo.t$ date
59Wed Mar 11 09:38:47 GMT 2009
60mhk@mhk-desktop:~/rakudo.t$ make
61
62mhk@mhk-desktop:~/rakudo.t$ date
63Wed Mar 11 09:40:13 GMT 2009
64mhk@mhk-desktop:~/rakudo.t$ make test
65
66All tests successful.
67Files=29, Tests=236, 48 wallclock secs ( 0.19 usr  0.11 sys + 41.92 cusr  5.37 csys = 47.59 CPU)
68Result: PASS
69
70mhk@mhk-desktop:~/rakudo.t$ date
71Wed Mar 11 09:41:14 GMT 2009
72mhk@mhk-desktop:~/rakudo.t$ make spectest
73
74All tests successful.
75Files=317, Tests=9398, 1829 wallclock secs ( 6.24 usr  2.28 sys + 1702.14 cusr 100.58 csys = 1811.24 CPU)
76Result: PASS
77
78mhk@mhk-desktop:~/rakudo.t$ date
79Thu Mar 12 10:21:34 GMT 2009
80
81-------------------------------------------------------------------------------
82
83I then ran make fulltest_all
84
85mhk@mhk-desktop:~/parrot.t$ date
86Thu Mar 12 10:22:05 GMT 2009
87mhk@mhk-desktop:~/parrot.t$ make fulltest_all 2>&1 | tee fulltest_all.37351.log
88
89mhk@mhk-desktop:~/parrot.t$ date
90Thu Mar 12 11:18:10 GMT 2009
91
92I have extracted the test summaries from fulltest_all.37351.log (size: 439118)
93
94I then give some information on the failures.
95
96-------------------------------------------------------------------------------
97
98make testb
99
100All tests successful.
101
102Test Summary Report
103-------------------
104t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
105  TODO passed:   30
106Files=252, Tests=8449, 293 wallclock secs ( 2.65 usr  0.71 sys + 77.03 cusr 34.82 csys = 115.21 CPU)
107Result: PASS
108
109-------------------------------------------------------------------------------
110
111make testC
112
113All tests successful.
114
115Test Summary Report
116-------------------
117t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
118  TODO passed:   30
119Files=252, Tests=8449, 293 wallclock secs ( 2.65 usr  0.71 sys + 77.03 cusr 34.82 csys = 115.21 CPU)
120Result: PASS
121
122-------------------------------------------------------------------------------
123
124make testf
125
126All tests successful.
127Files=252, Tests=8449, 291 wallclock secs ( 2.41 usr  0.70 sys + 76.10 cusr 35.00 csys = 114.21 CPU)
128Result: PASS
129
130-------------------------------------------------------------------------------
131
132make testg
133
134All tests successful.
135Files=252, Tests=8449, 287 wallclock secs ( 2.46 usr  0.64 sys + 76.78 cusr 34.85 csys = 114.73 CPU)
136Result: PASS
137
138-------------------------------------------------------------------------------
139
140make testj
141
142Test Summary Report
143-------------------
144t/pmc/fixedintegerarray.t            (Wstat: 256 Tests: 11 Failed: 1)
145  Failed test:  7
146  Non-zero exit status: 1
147t/library/md5.t                      (Wstat: 1536 Tests: 6 Failed: 6)
148  Failed tests:  1-6
149  Non-zero exit status: 6
150t/library/mt19937ar.t                (Wstat: 256 Tests: 10 Failed: 1)
151  Failed test:  10
152  Non-zero exit status: 1
153Files=252, Tests=8150, 287 wallclock secs ( 2.73 usr  0.58 sys + 76.50 cusr 34.44 csys = 114.25 CPU)
154Result: FAIL
155
156-------------------------------------------------------------------------------
157
158make testr
159
160All tests successful.
161Files=252, Tests=8397, 351 wallclock secs ( 2.69 usr  0.60 sys + 107.37 cusr 57.03 csys = 167.69 CPU)
162Result: PASS
163
164-------------------------------------------------------------------------------
165
166make testS
167
168All tests successful.
169
170Test Summary Report
171-------------------
172t/pmc/exception.t                    (Wstat: 0 Tests: 31 Failed: 0)
173  TODO passed:   30
174Files=252, Tests=8150, 294 wallclock secs ( 2.54 usr  0.69 sys + 75.66 cusr 32.90 csys = 111.79 CPU)
175Result: PASS
176
177-------------------------------------------------------------------------------
178
179make src_tests
180
181All tests successful.
182Files=2, Tests=36,  1 wallclock secs ( 0.04 usr  0.00 sys +  0.52 cusr  0.32 csys =  0.88 CPU)
183Result: PASS
184
185-------------------------------------------------------------------------------
186
187make perl_tests
188
189All tests successful.
190Files=4, Tests=229,  5 wallclock secs ( 0.09 usr  0.00 sys +  2.37 cusr  0.65 csys =  3.11 CPU)
191Result: PASS
192
193-------------------------------------------------------------------------------
194
195make codetest
196
197All tests successful.
198Files=29, Tests=356, 225 wallclock secs ( 0.18 usr  0.09 sys + 200.25 cusr  3.30 csys = 203.82 CPU)
199Result: PASS
200
201-------------------------------------------------------------------------------
202
203make doc_tests
204
205Result: NOTESTS
206
207-------------------------------------------------------------------------------
208
209make manifest_tests
210
211Test Summary Report
212-------------------
213t/examples/catchall.t (Wstat: 4096 Tests: 170 Failed: 16)
214  Failed tests:  40-42, 44, 52, 54, 67, 69, 76-77, 82, 113
215                117, 120-121, 123
216  Non-zero exit status: 16
217t/examples/japh.t     (Wstat: 256 Tests: 5 Failed: 1)
218  Failed test:  2
219  Non-zero exit status: 1
220t/examples/shootout.t (Wstat: 256 Tests: 20 Failed: 1)
221  Failed test:  3
222  Non-zero exit status: 1
223Files=11, Tests=276, 269 wallclock secs ( 0.15 usr  0.04 sys + 15.94 cusr  4.10 csys = 20.23 CPU)
224Result: FAIL
225
226-------------------------------------------------------------------------------
227
228make distro_tests
229
230Test Summary Report
231-------------------
232t/distro/test_file_coverage.t (Wstat: 256 Tests: 3 Failed: 1)
233  Failed test:  1
234  Non-zero exit status: 1
235Files=4, Tests=13,  7 wallclock secs ( 0.05 usr  0.00 sys +  3.38 cusr  1.46 csys =  4.89 CPU)
236Result: FAIL
237
238-------------------------------------------------------------------------------
239
240make benchmark_tests
241
242Test Summary Report
243-------------------
244t/benchmark/benchmarks.t (Wstat: 1024 Tests: 37 Failed: 4)
245  Failed tests:  20-23
246  Non-zero exit status: 4
247Files=1, Tests=37, 661 wallclock secs ( 0.06 usr  0.01 sys + 647.57 cusr  7.24 csys = 654.88 CPU)
248Result: FAIL
249
250-------------------------------------------------------------------------------
251-------------------------------------------------------------------------------
252
253testj, manifest_tests, distro_tests and benchmark_tests failed.
254
255doc_tests had NO TESTS.
256
257The other tests were sucessful, however. testbm testC and testS, passed a TODO
258test, t/pmc/exception.t: TODO passed: 30.
259
260An extract of the test failures is given below:
261
262-------------------------------------------------------------------------------
263
264make testj
265
266#   Failed test 'Getting out-of-bounds elements, I'
267#   at t/pmc/fixedintegerarray.t line 144.
268# Expected error but exited cleanly
269# Received:
270#
271# Expected:
272# /FixedIntegerArray: index out of bounds!
273# current instr\.:/
274#
275# Looks like you failed 1 test of 11.
276t/pmc/fixedintegerarray.t ..............
277Dubious, test returned 1 (wstat 256, 0x100)
278Failed 1/11 subtests
279
280#   Failed test 'Miscellaneous words'
281#   at t/library/md5.t line 35.
282# Exited with error code: 139
283# Received:
284# Segmentation fault
285#
286...
287
288#   Failed test 'Funny chars'
289#   at t/library/md5.t line 63.
290# Exited with error code: 139
291# Received:
292# Segmentation fault
293#
294# Expected:
295# b66434493525523b4393ce0d1f2425d7
296#
297
298#   Failed test 'String lengths'
299#   at t/library/md5.t line 201.
300# Exited with error code: 139
301# Received:
302# 23a1149ad9c50e9b9f35d31a1c6ac14f
303# Segmentation fault
304#
305# Expected:
306...
307
308#   Failed test 'REALLY long string'
309#   at t/library/md5.t line 324.
310# Exited with error code: 139
311# Received:
312# Segmentation fault
313...
314
315#   Failed test 'recursive md5sum (1)'
316#   at t/library/md5.t line 352.
317# Exited with error code: 139
318# Received:
319# Hello World!
320# Segmentation fault
321...
322
323#   Failed test 'recursive md5sum (2)'
324#   at t/library/md5.t line 590.
325# Exited with error code: 139
326# Received:
327# Hello World!
328# Segmentation fault
329...
330#
331# Looks like you failed 6 tests of 6.
332t/library/md5.t ........................
333Dubious, test returned 6 (wstat 1536, 0x600)
334Failed 6/6 subtests
335t/library/mime_base64.t ................ ok
336
337
338#   Failed test 'mt19937ar output'
339#   at t/library/mt19937ar.t line 148.
340# Exited with error code: 139
341# Received:
342# Segmentation fault
343...
344#
345# Looks like you failed 1 test of 10.
346t/library/mt19937ar.t ..................
347Dubious, test returned 1 (wstat 256, 0x100)
348Failed 1/10 subtests
349
350-------------------------------------------------------------------------------
351
352make examples_tests
353
354error:imcc:syntax error, unexpected VAR, expecting '(' ('sock')
355        in file 'examples/io/echo_client.pir' line 33
356error:imcc:syntax error, unexpected VAR, expecting '(' ('address')
357        in file 'examples/io/echo_client.pir' line 36
358error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
359        in file 'examples/io/echo_client.pir' line 38
360error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
361        in file 'examples/io/echo_client.pir' line 49
362error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
363        in file 'examples/io/echo_client.pir' line 50
364error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
365        in file 'examples/io/echo_client.pir' line 51
366
367#   Failed test 'examples/io/echo_client.pir'
368#   at t/examples/catchall.t line 45.
369#          got: '256'
370#     expected: '0'
371error:imcc:syntax error, unexpected VAR, expecting '(' ('sock')
372        in file 'examples/io/http.pir' line 31
373error:imcc:syntax error, unexpected VAR, expecting '(' ('address')
374        in file 'examples/io/http.pir' line 35
375error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
376        in file 'examples/io/http.pir' line 37
377error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
378        in file 'examples/io/http.pir' line 42
379error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
380        in file 'examples/io/http.pir' line 43
381error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
382        in file 'examples/io/http.pir' line 45
383
384#   Failed test 'examples/io/http.pir'
385#   at t/examples/catchall.t line 45.
386#          got: '256'
387#     expected: '0'
388error:imcc:syntax error, unexpected VAR, expecting '(' ('sock')
389        in file 'examples/io/httpd.pir' line 112
390error:imcc:syntax error, unexpected VAR, expecting '(' ('port')
391        in file 'examples/io/httpd.pir' line 116
392error:imcc:syntax error, unexpected VAR, expecting '(' ('sock')
393        in file 'examples/io/httpd.pir' line 117
394error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
395        in file 'examples/io/httpd.pir' line 132
396error:imcc:syntax error, unexpected VAR, expecting '(' ('work')
397        in file 'examples/io/httpd.pir' line 134
398error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
399        in file 'examples/io/httpd.pir' line 137
400error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
401        in file 'examples/io/httpd.pir' line 228
402error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
403        in file 'examples/io/httpd.pir' line 251
404error:imcc:syntax error, unexpected VAR, expecting '(' ('ret')
405        in file 'examples/io/httpd.pir' line 278
406error:imcc:syntax error, unexpected VAR, expecting '(' ('hex')
407        in file 'examples/io/httpd.pir' line 334
408
409#   Failed test 'examples/io/httpd.pir'
410#   at t/examples/catchall.t line 45.
411#          got: '256'
412#     expected: '0'
413error:imcc:syntax error, unexpected IDENTIFIER, expecting PARROT_OP ('socket')
414        in file 'examples/io/net_smtp.pasm' line 25
415
416#   Failed test 'examples/io/net_smtp.pasm'
417#   at t/examples/catchall.t line 45.
418#          got: '256'
419#     expected: '0'
420error:imcc:No such file or directory
421        in file 'examples/languages/abc/abc.pir' line 53
422
423#   Failed test 'examples/languages/abc/abc.pir'
424#   at t/examples/catchall.t line 45.
425#          got: '512'
426#     expected: '0'
427error:imcc:No such file or directory
428        in file 'examples/languages/squaak/squaak.pir' line 60
429
430#   Failed test 'examples/languages/squaak/squaak.pir'
431#   at t/examples/catchall.t line 45.
432#          got: '512'
433#     expected: '0'
434error:imcc:No such file or directory
435        in file 'examples/nci/sdl_blue_rectangle.pir' line 9
436
437#   Failed test 'examples/nci/sdl_blue_rectangle.pir'
438#   at t/examples/catchall.t line 45.
439#          got: '512'
440#     expected: '0'
441error:imcc:No such file or directory
442        in file 'examples/nci/xlibtest.pir' line 21
443
444#   Failed test 'examples/nci/xlibtest.pir'
445#   at t/examples/catchall.t line 45.
446#          got: '512'
447#     expected: '0'
448error:imcc:syntax error, unexpected IDENTIFIER, expecting PARROT_OP ('compile')
449        in file 'examples/pasm/nanoforth.pasm' line 90
450
451#   Failed test 'examples/pasm/nanoforth.pasm'
452#   at t/examples/catchall.t line 45.
453#          got: '256'
454#     expected: '0'
455error:imcc:syntax error, unexpected IDENTIFIER, expecting PARROT_OP ('find_global')
456        in file 'examples/pasm/nanoforth2.pasm' line 30
457
458#   Failed test 'examples/pasm/nanoforth2.pasm'
459#   at t/examples/catchall.t line 45.
460#          got: '256'
461#     expected: '0'
462error:imcc:No such file or directory
463        in file 'examples/pir/befunge/befunge.pir' line 3
464
465#   Failed test 'examples/pir/befunge/befunge.pir'
466#   at t/examples/catchall.t line 45.
467#          got: '512'
468#     expected: '0'
469error:imcc:syntax error, unexpected STRINGC, expecting '(' (''Mines::Field'')
470        in file 'examples/sdl/minesweeper/field.pir' line 180
471error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"')
472        in file 'examples/sdl/minesweeper/field.pir' line 317
473error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"')
474        in file 'examples/sdl/minesweeper/field.pir' line 320
475error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"')
476        in file 'examples/sdl/minesweeper/field.pir' line 979
477error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Mines::Field"')
478        in file 'examples/sdl/minesweeper/field.pir' line 984
479
480#   Failed test 'examples/sdl/minesweeper/field.pir'
481#   at t/examples/catchall.t line 45.
482#          got: '256'
483#     expected: '0'
484error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::App"')
485        in file 'examples/sdl/tetris/app.pir' line 80
486error:imcc:syntax error, unexpected PREG, expecting '(' ('$P0')
487        in file 'examples/sdl/tetris/app.pir' line 168
488error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::App"')
489        in file 'examples/sdl/tetris/app.pir' line 192
490
491#   Failed test 'examples/sdl/tetris/app.pir'
492#   at t/examples/catchall.t line 45.
493#          got: '256'
494#     expected: '0'
495error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::Block"')
496        in file 'examples/sdl/tetris/blocks.pir' line 61
497
498#   Failed test 'examples/sdl/tetris/blocks.pir'
499#   at t/examples/catchall.t line 45.
500#          got: '256'
501#     expected: '0'
502error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"Tetris::Block"')
503        in file 'examples/sdl/tetris/board.pir' line 879
504
505#   Failed test 'examples/sdl/tetris/board.pir'
506#   at t/examples/catchall.t line 45.
507#          got: '256'
508#     expected: '0'
509error:imcc:syntax error, unexpected STRINGC, expecting '(' ('"SDL::Event"')
510        in file 'examples/sdl/tetris/eventhandler.pir' line 42
511
512#   Failed test 'examples/sdl/tetris/eventhandler.pir'
513#   at t/examples/catchall.t line 45.
514#          got: '256'
515#     expected: '0'
516# Looks like you failed 16 tests of 170.
517t/examples/catchall.t ...
518Dubious, test returned 16 (wstat 4096, 0x1000)
519Failed 16/170 subtests
520
521
522#   Failed test 'examples/japh/japh2.pasm'
523#   at t/examples/japh.t line 54.
524#          got: '畊瑳愠朮桎牥倠牡朲⁎慈正牥瀊             '
525#     expected: 'Just another Parrot Hacker
526# '
527# Looks like you failed 1 test of 5.
528t/examples/japh.t .......
529Dubious, test returned 1 (wstat 256, 0x100)
530Failed 1/5 subtests
531
532
533#   Failed test 'examples/shootout/fannkuch.pir'
534#   at t/examples/shootout.t line 107.
535# Exited with error code: 139
536# Received:
537# 1234567
538# FixedIntegerArray: index out of bounds!
539# current instr.: 'fannkuch' pc 0 (/home/mhk/parrot.t/t/examples/shootout_3.pir:8)
540# called from Sub 'main' pc 244 (/home/mhk/parrot.t/t/examples/shootout_3.pir:108)
541# Segmentation fault
542...
543# Looks like you failed 1 test of 20.
544t/examples/shootout.t ...
545Dubious, test returned 1 (wstat 256, 0x100)
546Failed 1/20 subtests
547t/examples/streams.t ....
548
549
550-------------------------------------------------------------------------------
551
552make distro_tests
553
554#   Failed test 'there are PMC files for all test files in t/pmc'
555#   at t/distro/test_file_coverage.t line 57.
556# files in src/pmc but not in test dir:
557#       packfileannotation
558#       packfileannotationkeys
559#       packfileannotations
560# Looks like you failed 1 test of 3.
561t/distro/test_file_coverage.t ..
562Dubious, test returned 1 (wstat 256, 0x100)
563Failed 1/3 subtests
564
565-------------------------------------------------------------------------------
566
567make benchmark_tests
568
569#   Failed test 'examples/benchmarks/oo1.pasm'
570#   at t/benchmark/benchmarks.t line 218.
571# Exited with error code: 139
572# Received:
573# Segmentation fault
574#
575# Expected:
576# 10
577#
578
579#   Failed test 'examples/benchmarks/oo2.pasm'
580#   at t/benchmark/benchmarks.t line 218.
581# Exited with error code: 139
582# Received:
583# Segmentation fault
584#
585# Expected:
586# 10
587#
588
589#   Failed test 'examples/benchmarks/oo3.pasm'
590#   at t/benchmark/benchmarks.t line 218.
591# Exited with error code: 139
592# Received:
593# Segmentation fault
594#
595# Expected:
596# 10
597#
598
599#   Failed test 'examples/benchmarks/oo4.pasm'
600#   at t/benchmark/benchmarks.t line 218.
601# Exited with error code: 139
602# Received:
603# Segmentation fault
604#
605# Expected:
606# 500000
607#
608# Looks like you failed 4 tests of 37.
609t/benchmark/benchmarks.t ..
610Dubious, test returned 4 (wstat 1024, 0x400)
611Failed 4/37 subtests
612
613-------------------------------------------------------------------------------
614-------------------------------------------------------------------------------