benchmark pasted by Kooda on Sat Apr 9 00:56:55 2016
kooda@crocmou:/tmp/chicken-benchmarks$ ./compare.scm 4.10.log 4.11.log +---[1]: (4.10.0) |-> installation-prefix: /usr/local |-> csc-options: |-> repetitions: 10 +---[2]: (4.11.0rc1) |-> installation-prefix: /usr/local |-> csc-options: |-> repetitions: 10 Displaying normalized results (larger numbers indicate better results) Programs [1] [2] ======================================== 0_________________________1.00______1.00 binarytrees_______________1.06______1.00 boyer_____________________1.19______1.00 browse____________________1.57______1.00 conform___________________1.26______1.00 cpstak____________________1.10______1.00 ctak______________________1.00______1.02 dderiv____________________1.06______1.00 deriv_____________________1.01______1.00 destructive_______________1.00______1.01 div-iter__________________1.19______1.00 div-rec___________________1.25______1.00 dynamic___________________1.14______1.00 earley____________________1.09______1.00 fft_______________________1.00______1.02 fib_______________________1.20______1.00 fibc______________________1.12______1.00 fibfp_____________________1.15______1.00 fprint____________________1.17______1.00 fread_____________________1.04______1.00 gcbench___________________1.03______1.00 graphs____________________1.19______1.00 hanoi_____________________1.15______1.00 kanren____________________1.12______1.00 kernwyk-ackermann_________1.12______1.00 kernwyk-array_____________1.01______1.00 kernwyk-cat_______________1.00______1.31 kernwyk-string____________1.00______1.01 kernwyk-sum_______________1.13______1.00 kernwyk-tail______________1.11______1.00 kernwyk-wc________________2.10______1.00 knucleotide_______________1.05______1.00 lattice___________________1.19______1.00 maze______________________1.21______1.00 mazefun___________________1.14______1.00 mbrot_____________________1.00______1.02 nbody_____________________1.08______1.00 nboyer____________________1.03______1.00 nestedloop________________1.06______1.00 nfa_______________________8.74______1.00 nqueens___________________1.11______1.00 ntakl_____________________1.17______1.00 nucleic2__________________1.04______1.00 paraffins_________________1.03______1.00 parsing___________________1.56______1.00 pnpoly____________________1.00______1.08 primes____________________1.19______1.00 psyntax___________________1.04______1.00 puzzle____________________1.24______1.00 ray_______________________1.18______1.00 ray2______________________1.00______1.04 sboyer____________________1.10______1.00 scheme____________________1.27______1.00 sieves-eratosthenes_______1.12______1.00 simplex___________________1.15______1.00 slatex____________________1.57______1.00 sort1_____________________1.01______1.00 tak_______________________1.38______1.00 takl______________________1.16______1.00 takr______________________1.48______1.00 traverse__________________1.25______1.00 travinit__________________1.08______1.00 triangl___________________1.43______1.00
with heavy optimizations pasted by Kooda on Sat Apr 9 01:23:09 2016
kooda@crocmou:/tmp/chicken-benchmarks$ ./compare.scm opti-4.10.log opti-4.11.log +---[1]: (4.10.0) |-> installation-prefix: /usr/local |-> csc-options: -O5 -d0 -C -O3 |-> repetitions: 10 +---[2]: (4.11.0rc1) |-> installation-prefix: /usr/local |-> csc-options: -O5 -d0 -C -O3 |-> repetitions: 10 Displaying normalized results (larger numbers indicate better results) Programs [1] [2] ======================================== 0_________________________1.00______1.00 binarytrees_______________1.00______1.12 boyer_____________________1.08______1.00 browse____________________1.41______1.00 conform___________________1.13______1.00 cpstak____________________1.40______1.00 ctak______________________1.13______1.00 dderiv____________________1.05______1.00 deriv_____________________1.08______1.00 destructive_______________1.02______1.00 div-iter__________________1.00______1.07 div-rec___________________1.00______1.21 dynamic___________________1.07______1.00 earley____________________1.06______1.00 fft_______________________1.01______1.00 fib_______________________1.10______1.00 fibc______________________1.00______1.00 fibfp_____________________1.08______1.00 fprint____________________1.14______1.00 fread_____________________1.01______1.00 gcbench___________________1.03______1.00 graphs____________________1.21______1.00 hanoi_____________________1.35______1.00 kanren____________________1.24______1.00 kernwyk-ackermann_________1.03______1.00 kernwyk-array_____________1.00______1.00 kernwyk-cat_______________1.00______1.50 kernwyk-string____________1.00______1.00 kernwyk-sum_______________1.15______1.00 kernwyk-tail______________1.14______1.00 kernwyk-wc________________1.00______1.28 knucleotide_______________1.06______1.00 lattice___________________1.17______1.00 maze______________________1.09______1.00 mazefun___________________1.08______1.00 mbrot_____________________1.00______1.02 nbody_____________________1.00______1.09 nboyer____________________1.00______1.00 nestedloop________________1.05______1.00 nfa_______________________1.09______1.00 nqueens___________________1.06______1.00 ntakl_____________________1.00______1.00 nucleic2__________________1.00______1.01 paraffins_________________1.00______1.10 parsing___________________1.19______1.00 pnpoly____________________1.00______1.02 primes____________________1.09______1.00 psyntax___________________1.01______1.00 puzzle____________________1.15______1.00 ray_______________________1.00______1.04 ray2______________________1.00______1.29 sboyer____________________1.20______1.00 scheme____________________1.30______1.00 sieves-eratosthenes_______1.09______1.00 simplex___________________1.00______1.09 slatex____________________1.00______1.15 sort1_____________________1.00______1.08 tak_______________________1.00______1.00 takl______________________1.00______1.00 takr______________________1.22______1.00 traverse__________________1.14______1.00 travinit__________________1.11______1.00 triangl___________________1.06______1.00
with usual optimizations pasted by Kooda on Sat Apr 9 12:18:49 2016
+---[1]: (4.10.0) |-> installation-prefix: /usr/local |-> csc-options: -O2 |-> repetitions: 10 +---[2]: (4.11.0rc1) |-> installation-prefix: /usr/local |-> csc-options: -O2 |-> repetitions: 10 Displaying normalized results (larger numbers indicate better results) Programs [1] [2] ======================================== 0_________________________1.00______1.00 binarytrees_______________1.03______1.00 boyer_____________________1.19______1.00 browse____________________1.57______1.00 conform___________________1.25______1.00 cpstak____________________1.08______1.00 ctak______________________1.00______1.04 dderiv____________________1.11______1.00 deriv_____________________1.18______1.00 destructive_______________1.12______1.00 div-iter__________________1.14______1.00 div-rec___________________1.20______1.00 dynamic___________________1.14______1.00 earley____________________1.06______1.00 fft_______________________1.00______1.00 fib_______________________1.19______1.00 fibc______________________1.04______1.00 fibfp_____________________1.11______1.00 fprint____________________1.14______1.00 fread_____________________1.03______1.00 gcbench___________________1.02______1.00 graphs____________________1.19______1.00 hanoi_____________________1.22______1.00 kanren____________________1.12______1.00 kernwyk-ackermann_________1.13______1.00 kernwyk-array_____________1.02______1.00 kernwyk-cat_______________1.00______1.29 kernwyk-string____________1.00______1.01 kernwyk-sum_______________1.12______1.00 kernwyk-tail______________1.01______1.00 kernwyk-wc________________2.23______1.00 knucleotide_______________1.06______1.00 lattice___________________1.25______1.00 maze______________________1.18______1.00 mazefun___________________1.11______1.00 mbrot_____________________1.00______1.00 nbody_____________________1.12______1.00 nboyer____________________1.02______1.00 nestedloop________________1.02______1.00 nfa_______________________8.51______1.00 nqueens___________________1.12______1.00 ntakl_____________________1.11______1.00 nucleic2__________________1.00______1.00 paraffins_________________1.02______1.00 parsing___________________1.59______1.00 pnpoly____________________1.00______1.08 primes____________________1.13______1.00 psyntax___________________1.03______1.00 puzzle____________________1.02______1.00 ray_______________________1.22______1.00 ray2______________________1.00______1.03 sboyer____________________1.14______1.00 scheme____________________1.25______1.00 sieves-eratosthenes_______1.11______1.00 simplex___________________1.15______1.00 slatex____________________1.52______1.00 sort1_____________________1.02______1.00 tak_______________________1.24______1.00 takl______________________1.13______1.00 takr______________________1.43______1.00 traverse__________________1.24______1.00 travinit__________________1.00______1.00 triangl___________________1.29______1.00
full time info 4.10.0 pasted by Kooda on Sat Apr 9 17:57:16 2016
Repeating each program 10 times Using /usr/local/bin/csc410 Total number of programs to benchmark: 63 The values displayed correspond to the arithmetic mean of all results (except build time). Columns legend: BT [1] => Build time (seconds) CT [2] => CPU time (seconds) MGT[3] => Major GCs time (seconds) Mut[4] => number of mutations MT [5] => number of tracked mutations MGC[6] => number of major GCs mGC[7] => number of minor GCs Programs BT [1] CT [2] MGT[3] Mut[4] MT [5] MGC[6] mGC[7] 1 0......................0.341 0 0 0 0 0 0 2 binarytrees............0.646 0.0636 0.0104 0 0 12 134 3 boyer..................0.805 0.0808 0.0324 48272 48236 11 132 4 browse.................0.914 0.0764 0.0036 62395 486 4 296 5 conform................3.083 0.0916 0.0036 68640 29556 4 322 6 cpstak.................0.417 0.3476 0.0024 0 0 4 1647 7 ctak...................0.47 0.1168 0.0012 0 0 2 624 8 dderiv.................0.695 0.0968 0.0004 120000 2246 2 444 9 deriv..................0.619 0.094 0.0016 120000 2399 2 427 10 destructive............0.585 0.0604 0 0 0 0 274 11 div-iter...............0.463 0.0176 0 0 0 0 59 12 div-rec................0.43 0.048 0.0012 0 0 1 203 13 dynamic................11.975 0.1128 0.0284 98730 10496 7 190 14 earley.................2.436 0.0756 0.0112 558 80 7 206 15 fft....................0.726 0.0288 0.0004 337760 314526 4 31 16 fib....................0.385 0.1344 0 0 0 0 616 17 fibc...................0.439 0.8648 0.008 0 0 12 4134 18 fibfp..................0.393 0.1476 0.0004 0 0 1 615 19 fprint.................0.48 0.104 0 3 0 0 369 20 fread..................0.378 0.708 0.1232 218474 41234 19 2608 21 gcbench................0.963 15.816 2.2868 349452 134128 25 46661 22 graphs.................1.25 0.7992 0.0332 246033 65844 12 2989 23 hanoi..................0.424 0.5584 0.0016 0 0 3 2558 24 kanren.................71.618 3.1448 0.7096 4601 49 198 4855 25 kernwyk-ackermann......0.374 4.6916 1.9976 0 0 2518 6012 26 kernwyk-array..........0.46 5.7148 0.6292 100 0 101 9099 27 kernwyk-cat............0.427 0.3692 0 6 0 0 1776 28 kernwyk-string.........0.463 0.7992 0.2692 770 270 49 131 29 kernwyk-sum............0.397 0.5796 0.0056 3 0 6 2388 30 kernwyk-tail...........0.464 0.1204 0.0172 7 0 4 284 31 kernwyk-wc.............0.415 0.2492 0 3 0 0 1304 32 knucleotide............0.805 3.9436 0.3688 828123 821983 19.9 4354.9 33 lattice................0.951 4.75 0.0628 176520 181182 110 19863 34 maze...................2.467 0.1372 0.0112 275600 80307 19 437 35 mazefun................1.144 1.6312 0.0564 252000 526 96 5920 36 mbrot..................0.511 0.0212 0 75 0 0 53 37 nbody..................1.26 2.2064 0.0128 750000 749522 27 9246 38 nboyer.................1.333 17.98 11.310 178921 178921 125 19075 39 nestedloop.............0.601 2.026 0.0056 0 0 6 6473 40 nfa....................0.486 1.3024 0.02 1 0 42 5277 41 nqueens................0.473 0.0408 0 0 0 0 149 42 ntakl..................0.463 0.13 0 0 0 0 471 43 nucleic2...............6.552 2.226 0.0948 756000 26273 81 6614 44 paraffins..............0.899 8.7016 4.67 11 0 16 956 45 parsing................3.516 0.9792 0.024 613850 193345 16 3857 46 pnpoly.................0.692 1.9828 0.0192 200000 0 25 8349 47 primes.................0.465 0.2652 0.01 0 0 20 977 48 psyntax................42.054 1.616 0.1836 349548 41554 21 3092 49 puzzle.................1.097 0.0448 0 0 0 0 176 50 ray....................1.4 0.5612 0.0036 36 33 4 2379 51 ray2...................1.524 7.3284 0.6632 100475 729023 43 24349 52 sboyer.................1.331 31.084 12.220 415870 415870 154 79322 53 scheme.................4.805 0.016 0 500 98 0 45 54 sieves-eratosthenes....0.424 6.21 2.8888 0 0 3269 3316 55 simplex................1.689 0.3656 0.0064 118000 83357 7 1402 56 slatex.................7.147 0.5196 0.0012 252836 4546 2 1468 57 sort1..................0.605 3.0668 1.096 197092 45 24 5490 58 tak....................0.394 0.3108 0.0028 0 0 2 1503 59 takl...................0.46 0.1316 0 0 0 0 471 60 takr...................3.733 0.3852 0.0008 0 0 2 1503 61 traverse...............1.082 0.42 0.0028 0 0 1 1221 62 travinit...............1.072 0.042 0.0044 73688 36310 2 89 63 triangl................0.477 0.6332 0.0172 775 775 18 2675 Total compile time: 3m15.847s Total run time (CPU time): 22m51.7119999999998s Total time spent in major GCs: 6m39.3600000000001s Total mutations: 1804128500 Total mutations tracked: 174992068 Total number of minor GCs 3119609 Total number of major GCs 71599 Total number failures 0
full time info 4.11.0 added by Kooda on Sat Apr 9 17:57:44 2016
Repeating each program 10 times Using /usr/local/bin/csc Total number of programs to benchmark: 63 The values displayed correspond to the arithmetic mean of all results (except build time). Columns legend: BT [1] => Build time (seconds) CT [2] => CPU time (seconds) MGT[3] => Major GCs time (seconds) Mut[4] => number of mutations MT [5] => number of tracked mutations MGC[6] => number of major GCs mGC[7] => number of minor GCs Programs BT [1] CT [2] MGT[3] Mut[4] MT [5] MGC[6] mGC[7] 1 0......................1.045 0 0 0 0 0 0 2 binarytrees............1.43 0.0668 0.004 0 0 5 180 3 boyer..................1.444 0.0936 0.0296 48272 48231 13 166 4 browse.................1.571 0.1208 0.0172 62395 548 20 335 5 conform................4.247 0.1152 0.0028 68640 29793 4 445 6 cpstak.................1.133 0.418 0.002 0 0 4 1865 7 ctak...................1.221 0.126 0 0 0 2 633 8 dderiv.................1.356 0.1096 0.0004 120000 2276 2 457 9 deriv..................1.182 0.1052 0 120000 2516 2 448 10 destructive............1.168 0.0648 0 0 0 0 284 11 div-iter...............1.186 0.0196 0 0 0 0 60 12 div-rec................1.097 0.0588 0.0024 0 0 2 257 13 dynamic................14.777 0.1328 0.0416 98730 10595 8 231 14 earley.................3.421 0.086 0.0164 558 100 9 234 15 fft....................1.344 0.0284 0.0028 337760 315270 4 34 16 fib....................1.144 0.1568 0.0004 0 0 1 780 17 fibc...................1.1 0.978 0.0084 0 0 12 4399 18 fibfp..................1.077 0.1628 0.0004 0 0 1 780 19 fprint.................1.192 0.1184 0 3 0 0 454 20 fread..................1.079 0.7412 0.0508 218474 41338 18 2996 21 gcbench................1.667 16.601 2.1788 349452 135819 29 50015 22 graphs.................2.084 0.966 0.0348 246033 64642 22 3752 23 hanoi..................1.005 0.6572 0.002 0 0 4 3117 24 kanren.................89.332 3.5608 0.5576 4601 48 226 6788 25 kernwyk-ackermann......1.062 5.4036 1.9316 0 0 2732 7505 26 kernwyk-array..........1.197 5.8596 0.614 100 0 101 9099 27 kernwyk-cat............1.168 0.2924 0 6 0 0 1349 28 kernwyk-string.........1.202 0.802 0.258 770 270 49 131 29 kernwyk-sum............1.094 0.632 0.006 3 0 8 2683 30 kernwyk-tail...........1.169 0.1296 0.0284 7 0 6 279 31 kernwyk-wc.............1.161 0.5396 0 3 0 0 1057 32 knucleotide............1.485 4.1696 0.3884 828120 822300 55.5 4949.8 33 lattice................1.662 6.0412 0.074 176520 224900 142 27044 34 maze...................3.571 0.17 0.0088 275600 84483 21 580 35 mazefun................1.868 1.8164 0.0648 252000 543 110 7139 36 mbrot..................1.213 0.0204 0 75 0 0 54 37 nbody..................2.028 2.4652 0.0176 750000 749648 31 10776 38 nboyer.................2.08 18.788 10.924 178921 178921 131 23767 39 nestedloop.............1.254 2.1464 0.002 0 0 6 6663 40 nfa....................1.256 11.579 0.0324 1 0 60 6223 41 nqueens................1.234 0.048 0 0 0 0 163 42 ntakl..................1.196 0.152 0 0 0 0 541 43 nucleic2...............7.976 2.2744 0.0844 756000 27840 81 7250 44 paraffins..............1.532 8.966 5.2976 11 0 17 1130 45 parsing................4.625 1.5756 0.0452 613850 193291 34 4580 46 pnpoly.................1.394 1.8748 0.0176 200000 0 17 9203 47 primes.................1.215 0.314 0.0188 0 0 25 1313 48 psyntax................46.781 1.6664 0.0864 349548 44789 8 3710 49 puzzle.................1.888 0.0524 0 0 0 0 219 50 ray....................2.291 0.6668 0.004 36 33 5 2994 51 ray2...................2.328 6.7736 0.6164 100475 719441 42 22997 52 sboyer.................2.124 35.078 12.838 415870 415870 177 95201 53 scheme.................6.57 0.0184 0 500 99 0 59 54 sieves-eratosthenes....1.109 6.9012 3.0516 0 0 3778 3950 55 simplex................2.59 0.4164 0.0068 118000 101255 7 1722 56 slatex.................9.016 0.7788 0.0056 255060 4881 5 1292 57 sort1..................1.303 3.1104 1.0032 197092 45 24 5607 58 tak....................1.18 0.446 0.0008 0 0 3 2133 59 takl...................1.271 0.1508 0 0 0 0 541 60 takr...................5.639 0.5744 0.0024 0 0 4 2132 61 traverse...............1.86 0.5328 0.0024 0 0 1 1568 62 travinit...............1.869 0.044 0.004 73688 36374 2 104 63 triangl................1.23 0.7888 0.0152 775 775 22 3486 Total compile time: 4m29.9930000000001s Total run time (CPU time): 26m35.4759999999994s Total time spent in major GCs: 6m44.0360000000001s Total mutations: 1804150719 Total mutations tracked: 175792755 Total number of minor GCs 3599038 Total number of major GCs 80925 Total number failures 0