tinycc benchmark results pasted by Kooda on Fri Feb 14 21:52:02 2020
[1] is GCC [2] is TCC +---[1]: |-> installation-prefix: /home/kooda/coop/bench |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[2]: |-> installation-prefix: /home/kooda/coop/tcc |-> csc-options: |-> runtime-options: |-> repetitions: 10 Displaying normalized results (larger numbers indicate better results) === === cpu-time === Programs [1] [2] ======================================== 0_________________________1.00______1.00 binarytrees_______________1.75______1.00 boyer_____________________1.57______1.00 browse____________________3.16______1.00 conform___________________2.21______1.00 cpstak____________________1.49______1.00 ctak______________________2.10______1.00 dderiv____________________2.50______1.00 deriv_____________________2.28______1.00 destructive_______________1.84______1.00 dfa_______________________2.09______1.00 div-iter__________________2.70______1.00 div-rec___________________2.08______1.00 dynamic___________________1.78______1.00 earley____________________1.58______1.00 fannkuch__________________1.97______1.00 fft_______________________1.56______1.00 fib_______________________1.64______1.00 fibc______________________1.97______1.00 fibfp_____________________2.03______1.00 fprint____________________2.63______1.00 fread_____________________2.38______1.00 gcbench___________________1.87______1.00 gold______________________1.82______1.00 gold2_____________________1.69______1.00 graphs____________________1.84______1.00 hanoi_____________________1.63______1.00 integ_____________________2.00______1.00 integ2____________________1.78______1.00 kanren____________________1.72______1.00 kernwyk-ackermann_________1.26______1.00 kernwyk-array_____________1.77______1.00 kernwyk-cat_______________2.48______1.00 kernwyk-string____________1.00______1.00 kernwyk-sum_______________2.23______1.00 kernwyk-tail______________1.72______1.00 kernwyk-wc________________2.38______1.00 knucleotide_______________1.86______1.00 lattice___________________1.96______1.00 matrix____________________2.17______1.00 maze______________________1.85______1.00 mazefun___________________1.79______1.00 mbrot_____________________1.99______1.00 nbody_____________________2.32______1.00 nboyer____________________1.36______1.00 nestedloop________________1.84______1.00 nfa_______________________2.09______1.00 nqueens___________________1.81______1.00 ntakl_____________________2.01______1.00 nucleic2__________________1.76______1.00 paraffins_________________1.32______1.00 parsing___________________1.95______1.00 pnpoly____________________2.08______1.00 primes____________________1.69______1.00 psyntax___________________1.55______1.00 puzzle____________________1.57______1.00 ray_______________________1.88______1.00 ray2______________________2.04______1.00 sboyer____________________1.51______1.00 scheme____________________2.25______1.00 sieves-eratosthenes_______2.21______1.00 simplex___________________1.96______1.00 slatex____________________2.07______1.00 sort1_____________________1.62______1.00 tak_______________________1.58______1.00 takl______________________2.05______1.00 takr______________________1.92______1.00 traverse__________________1.72______1.00 travinit__________________1.58______1.00 triangl___________________1.79______1.00
GCC run pasted by Kooda on Fri Feb 14 21:52:49 2020
Repeating each program 10 times Using /home/kooda/coop/bench/bin/csc Total number of programs to benchmark: 70 Maximum deviance: 5. Results whose deviance are greater than the maximum are annotated with a `*' in the summary below. The values displayed correspond to the arithmetic mean of all results (except build time). Columns legend: BT [1] => Build time (seconds) CT [2] => CPU time (seconds) MGT[3] => Major GCs time (seconds) Mut[4] => number of mutations MT [5] => number of tracked mutations MGC[6] => number of major GCs mGC[7] => number of minor GCs Programs BT [1] CT [2] MGT[3] Mut[4] MT [5] MGC[6] mGC[7] 1 0......................0.851 0 0 0 0 0 0 2 binarytrees............1.948 0.1653 0.0206 0 0 7 377 3 boyer..................2.254 0.1982 0.0761 48272 48246 12 144 4 browse.................2.457 0.1637 0.002 62395 417 1 270 5 conform................9.869 0.2636 *0.004 68640 29695 2 410 6 cpstak.................1.083 1.0122 *0.012 0 0 8 3609 7 ctak...................1.196 0.2581 *0.003 0 0 2 687 8 dderiv.................1.834 0.2034 *0.002 120000 2278 2 448 9 deriv..................1.616 0.1858 *0.002 120000 2413 2 444 10 destructive............1.381 0.2187 *0.003 0 0 2 842 11 dfa....................12.007 1.532 0.0557 986298 58522 18 2302 12 div-iter...............1.177 0.0366 0 0 0 0 42 13 div-rec................1.18 0.1263 *0.001 0 0 1 204 14 dynamic................36.733 0.2967 0.0773 98729 10371 7 219 15 earley.................6.854 0.1742 0.035 558 111 8 289 16 fannkuch...............1.745 7.4457 *0.033 0 0 22 25931 17 fft....................2.006 0.087 0.0218 337760 308510 13 180 18 fib....................0.933 0.4323 *0.002 0 0 2 1744 19 fibc...................1.149 2.1556 0.0302 0 0 20 9715 20 fibfp..................0.948 0.4709 *0.004 0 0 3 1743 21 fprint.................1.29 0.1932 0 3 0 0 294 22 fread..................0.9 1.778 0.3712 218474 41283 36 2753 23 gcbench................2.842 9.2493 1.0791 768766 348424 19 16519 24 gold...................2.717 10.104 0.0708 500500 250601 47 34717 25 gold2..................2.933 10.250 0.072 500500 251238 47 34712 26 graphs.................3.605 2.1034 0.1147 246033 62674 29 5030 27 hanoi..................1.004 1.39 *0.011 0 0 7 5835 28 integ..................1.812 9.4254 0.0921 0 0 63 34446 29 integ2.................10.939 11.916 0.2953 0 0 200 27080 30 kanren.................231.88 9.2249 1.8267 4601 50 290 5975 31 kernwyk-ackermann......0.924 14.908 6.3602 0 0 3393 24584 32 kernwyk-array..........1.195 8.1864 0.5847 100 0 103 22897 33 kernwyk-cat............1.097 0.5451 0 6 0 0 1169 34 kernwyk-string.........1.187 1.6783 0.6278 770 270 49 131 35 kernwyk-sum............0.968 2.6708 *0.011 100003 0 6 3690 36 kernwyk-tail...........1.255 0.2407 0.0443 7 0 4 245 37 kernwyk-wc.............1.017 1.02 0 3 0 0 1506 38 knucleotide............2.364 9.4088 0.6971 828120 822871 *22.1 9401.7 39 lattice................2.634 12.544 0.2089 176520 213620 137 25217 40 matrix.................6.61 6.7036 0.3731 282060 12632 111 12262 41 maze...................7.647 0.3704 *0.038 275600 87382 22 676 42 mazefun................3.328 5.3624 0.2541 252000 812 166 13559 43 mbrot..................1.3 0.0463 0 75 0 0 379 44 nbody..................4.054 9.6728 *0.093 750000 749548 62 20287 45 nboyer.................3.61 10.475 4.9929 888245 888245 88 8472 46 nestedloop.............1.566 6.5707 *0.035 0 0 25 34728 47 nfa....................1.379 2.3301 *0.010 1 0 7 927 48 nqueens................1.244 0.1157 *0.001 0 0 1 439 49 ntakl..................1.241 0.3456 0 0 0 0 527 50 nucleic2...............19.836 8.2193 0.5249 756000 64174 192 22398 51 paraffins..............2.487 5.211 2.5838 11 0 11 365 52 parsing................10.618 4.4241 0.0604 615178 194646 29 6610 53 pnpoly.................1.918 6.0066 0.0822 200000 0 26 23420 54 primes.................1.232 0.435 *0.015 0 0 10 415 55 psyntax................115.87 3.5573 0.1968 354449 49972 8 3886 56 puzzle.................3.151 0.1307 *0.001 0 0 1 509 57 ray....................4.79 2.0001 *0.021 36 33 12 5047 58 ray2...................4.708 15.015 1.6963 565191 453563 66 24464 59 sboyer.................3.726 6.8944 1.8537 888245 888245 86 9988 60 scheme.................15.636 0.04 0 500 99 0 61 61 sieves-eratosthenes....1.027 6.0503 3.4299 0 0 1611 1652 62 simplex................5.14 1.2374 0.0382 118000 188910 25 3135 63 slatex.................21.994 1.6336 *0.008 255044 4861.2 *3.8 1236.2 64 sort1..................1.564 6.5177 1.5744 197092 30 16 5795 65 tak....................1.036 0.944 *0.008 0 0 6 3756 66 takl...................1.251 0.3516 0 0 0 0 527 67 takr...................12.847 1.5194 *0.008 0 0 6 3756 68 traverse...............3.101 0.9307 *0.005 0 0 1 1422 69 travinit...............3.085 0.1189 *0.008 73688 36581 *2.1 283.9 70 triangl................1.354 1.8252 *0.094 775 775 *39.4 5534.6 WARNING: some numbers are not stable (deviance greater than 5): triangl major-gcs 5400/197 triangl major-gcs-time 28.2943552209439 travinit major-gcs 100/7 travinit major-gcs-time 26.7261241912424 traverse major-gcs-time 8.74817765279707 takr major-gcs-time 13.7152310289143 tak major-gcs-time 14.5845718855742 slatex major-gcs 48.237638894272 slatex major-gcs-time 46.1683795944412 ray major-gcs-time 7.47854684268223 puzzle major-gcs-time 33.3333333333333 primes major-gcs-time 7.69230769230769 nqueens major-gcs-time 26.9563276173873 nfa major-gcs-time 12.5734804178259 nestedloop major-gcs-time 8.30335506028196 nbody major-gcs-time 5.54571912181833 maze major-gcs-time 5.07610456273961 knucleotide major-gcs 6.22069098862784 kernwyk-sum major-gcs-time 10.5847423701668 hanoi major-gcs-time 11.4991914915214 fibfp major-gcs-time 20.2600582022392 fib major-gcs-time 24.1379310344828 fannkuch major-gcs-time 5.42077085454495 div-rec major-gcs-time 33.3333333333333 destructive major-gcs-time 21.0818510677892 deriv major-gcs-time 23.715274953455 dderiv major-gcs-time 28.6435305617865 ctak major-gcs-time 21.0818510677892 cpstak major-gcs-time 10.5409255338946 conform major-gcs-time 14.890986598681 Total compile time: 10m30.1419999999997s Total run time (CPU time): 41m13.2170000000006s Total time spent in major GCs: 5m8.67800000000005s Total mutations: 1099434683 Total mutations tracked: 128180415 Total number of minor GCs: 5223184 Total number of major GCs: 72174 Total number failures: 0
TCC run added by Kooda on Fri Feb 14 21:53:17 2020
Repeating each program 10 times Using /home/kooda/coop/tcc/bin/csc Total number of programs to benchmark: 70 Maximum deviance: 5. Results whose deviance are greater than the maximum are annotated with a `*' in the summary below. The values displayed correspond to the arithmetic mean of all results (except build time). Columns legend: BT [1] => Build time (seconds) CT [2] => CPU time (seconds) MGT[3] => Major GCs time (seconds) Mut[4] => number of mutations MT [5] => number of tracked mutations MGC[6] => number of major GCs mGC[7] => number of minor GCs Programs BT [1] CT [2] MGT[3] Mut[4] MT [5] MGC[6] mGC[7] 1 0......................0.793 *0.000 0 0 0 0 0 2 binarytrees............1.014 0.2894 *0.031 0 0 *9.6 443.4 3 boyer..................1.336 0.3119 0.0871 48272 48243 12 267 4 browse.................1.256 0.5175 0.0798 62395 927 18 569 5 conform................3.174 0.584 *0.011 68640 30092 *4.1 677.9 6 cpstak.................0.843 1.5113 *0.013 0 0 *7.8 4290.2 7 ctak...................0.853 0.5431 *0.003 0 0 *1.8 983.2 8 dderiv.................1.013 0.5092 *0.004 120000 3261 *2.4 663.6 9 deriv..................0.986 0.4252 *0.004 120000 3794 *2.6 689.4 10 destructive............0.965 0.4045 *0.003 0 0 2 875 11 dfa....................3.114 3.2115 0.0555 986298 74560 12.9 3486.1 12 div-iter...............0.861 0.0989 0 0 0 0 62 13 div-rec................0.866 0.2632 *0.003 0 0 2 369 14 dynamic................11.481 0.5282 0.1209 98729 11764 9.9 430.1 15 earley.................2.759 0.2769 *0.039 558 129 *7.9 386.1 16 fannkuch...............1.073 14.685 *0.037 0 0 *21.6 28361. 17 fft....................1.127 0.1361 *0.020 337760 308316 *10.2 190.8 18 fib....................0.815 0.711 *0.002 0 0 *1.6 2074.4 19 fibc...................0.849 4.2565 *0.027 0 0 *15.6 11501. 20 fibfp..................0.825 0.9585 *0.004 0 0 *2.7 2073.3 21 fprint.................0.872 0.5094 0 3 0 0 563 22 fread..................0.804 4.2489 0.5735 218474 42027 47 5423 23 gcbench................1.171 17.357 *1.850 768766 392778 *29.4 23935. 24 gold...................1.384 18.458 *0.089 500500 251541 *47.6 39777. 25 gold2..................1.437 17.344 *0.082 500500 250235 *44.6 39945. 26 graphs.................1.655 3.889 0.0742 246033 60038 *12 6849 27 hanoi..................0.837 2.2766 *0.013 0 0 *7.6 6636.4 28 integ..................0.976 18.900 *0.111 0 0 *63.9 40595. 29 integ2.................2.55 21.260 *0.392 0 0 *220.6 31796. 30 kanren.................69.336 15.927 1.8139 4601 52 248 10000 31 kernwyk-ackermann......0.818 *18.89 *5.932 0 0 *2661. 29073. 32 kernwyk-array..........0.869 14.539 0.7642 100 0 103 24497 33 kernwyk-cat............0.829 1.3569 0 6 0 0 2766 34 kernwyk-string.........0.866 1.6722 *0.581 770 270 48.7 131.3 35 kernwyk-sum............0.827 5.9773 0.0465 100003 0 12 6415 36 kernwyk-tail...........0.851 0.4158 *0.081 7 0 *7.2 478.8 37 kernwyk-wc.............0.851 2.4297 0 3 0 0 2361 38 knucleotide............1.157 17.560 *1.137 828120 824704 *80.5 12476. 39 lattice................1.211 24.711 *0.287 176520 301028 *157.5 42685. 40 matrix.................2.38 14.597 0.9957 282060 16878 236.6 17424. 41 maze...................2.252 0.6882 *0.037 275600 90963 *18.2 913.8 42 mazefun................1.447 9.6509 *0.246 252000 1131 *134.6 17564. 43 mbrot..................0.912 0.0922 0 75 0 0 383 44 nbody..................1.559 22.495 *0.133 750000 749076 *71.4 28981. 45 nboyer.................1.775 *14.27 *5.320 888245 888245 *75.4 12352. 46 nestedloop.............0.958 12.114 *0.033 0 0 *17.8 35270. 47 nfa....................0.935 4.8914 *0.027 1 0 *15.2 2062.8 48 nqueens................0.91 0.2099 *0.003 0 0 2 506 49 ntakl..................0.868 0.696 *0.000 0 0 *0.4 984.6 50 nucleic2...............10.263 14.490 *0.634 756000 72098 *195.6 24968. 51 paraffins..............1.249 6.882 *3.516 11 0 12 506 52 parsing................4.139 8.6422 0.1931 615801 195207 38 9576 53 pnpoly.................1.037 12.526 *0.108 200000 0 *59.9 28100. 54 primes.................0.895 0.738 *0.027 0 0 *14.2 638.8 55 psyntax................45.671 5.5306 0.2834 354449 62941 10 5373 56 puzzle.................1.45 0.206 *0.001 0 0 *0.7 596.3 57 ray....................1.509 3.7639 *0.030 36 33 *13.4 6325.6 58 ray2...................1.638 30.72 *2.303 565191 479475 *78 31574 59 sboyer.................1.775 *10.45 *2.229 888245 888245 *92.2 14798. 60 scheme.................3.623 0.09 *0.002 500 100 1 100 61 sieves-eratosthenes....0.87 13.430 *6.862 0 0 *2723. *3457. 62 simplex................1.99 2.4372 *0.053 118000 238148 *15.8 3957.2 63 slatex.................8.263 3.3974 *0.065 255044 5039.8 *12 2428 64 sort1..................1.03 10.615 2.6691 197092 45 24 9035 65 tak....................0.86 1.4929 *0.007 0 0 *4.6 4438.4 66 takl...................0.867 0.7229 *0.001 0 0 *0.7 1056.3 67 takr...................3.314 2.9264 *0.009 0 0 *5 4438 68 traverse...............1.311 1.6084 *0.006 0 0 1 2497 69 travinit...............1.305 0.1888 *0.010 73688 36596 *2.2 316.8 70 triangl................0.909 3.2709 *0.100 775 775 *36 7434 WARNING: some numbers are not stable (deviance greater than 5): triangl major-gcs 61.2372435695795 triangl major-gcs-time 61.9113286683432 travinit major-gcs 200/11 travinit major-gcs-time 40.6857321205597 traverse major-gcs-time 7.27392967453308 takr major-gcs 40 takr major-gcs-time 35.6548249279494 takl major-gcs 65.4653670707977 takl major-gcs-time 72.6483157256779 tak major-gcs 42.5998216136205 tak major-gcs-time 43.6479484799156 slatex major-gcs 50/3 slatex major-gcs-time 18.6478561096389 simplex major-gcs 9.30185978272093 simplex major-gcs-time 5.069146215574 sieves-eratosthenes minor-gcs 16050/2881 sieves-eratosthenes major-gcs 96300/13619 sieves-eratosthenes major-gcs-time 6.36961995690754 scheme major-gcs-time 14.2857142857143 sboyer major-gcs 24.9731058374858 sboyer major-gcs-time 30.5482906312495 sboyer cpu-time 6.57481900732059 ray2 major-gcs 5.87509704481518 ray2 major-gcs-time 11.4360631586948 ray major-gcs 1600/67 ray major-gcs-time 25.5237376910697 puzzle major-gcs 65.4653670707977 puzzle major-gcs-time 65.4653670707977 primes major-gcs 1200/71 primes major-gcs-time 17.9925300762831 pnpoly major-gcs 9300/599 pnpoly major-gcs-time 15.9025946719722 paraffins major-gcs-time 7.82433983058225 nucleic2 major-gcs 3100/163 nucleic2 major-gcs-time 19.2053809188934 ntakl major-gcs 122.474487139159 ntakl major-gcs-time 122.474487139159 nqueens major-gcs-time 7.69230769230769 nfa major-gcs 300/19 nfa major-gcs-time 15.985020158407 nestedloop major-gcs 33.0268279925822 nestedloop major-gcs-time 34.4442963354735 nboyer major-gcs 23.3903529814839 nboyer major-gcs-time 20.5813589277359 nboyer cpu-time 7.38582540992393 nbody major-gcs 30.1897895469075 nbody major-gcs-time 30.3737903534825 mazefun major-gcs 34.2127839259463 mazefun major-gcs-time 33.2879162851996 maze major-gcs 32.3009636410969 maze major-gcs-time 31.3378687694797 lattice major-gcs 2060/63 lattice major-gcs-time 33.0692548950422 knucleotide major-gcs 36.4982812229912 knucleotide major-gcs-time 13.7482839899335 kernwyk-tail major-gcs 13.6082763487954 kernwyk-tail major-gcs-time 25.7699855706563 kernwyk-string major-gcs-time 5.29077070708304 kernwyk-ackermann major-gcs 36.9567616162643 kernwyk-ackermann major-gcs-time 35.9943130013989 kernwyk-ackermann cpu-time 11.6444254973801 integ2 major-gcs 17100/1103 integ2 major-gcs-time 15.3800179103318 integ major-gcs 26.5344758549869 integ major-gcs-time 27.1243732097118 hanoi major-gcs 300/19 hanoi major-gcs-time 15.9088808543137 graphs major-gcs 25/3 gold2 major-gcs 3600/223 gold2 major-gcs-time 15.7690047563362 gold major-gcs 2700/119 gold major-gcs-time 22.7612637419065 gcbench major-gcs 34.9927106111883 gcbench major-gcs-time 33.1034146891604 fibfp major-gcs 16.9725025739105 fibfp major-gcs-time 10.9901322594582 fibc major-gcs 35.2505822688911 fibc major-gcs-time 36.2829354779848 fib major-gcs 30.6186217847897 fib major-gcs-time 28.6435305617865 fft major-gcs 33.6204474499652 fft major-gcs-time 34.1328074393145 fannkuch major-gcs 200/9 fannkuch major-gcs-time 23.3120672475371 earley major-gcs 17.4021861833766 earley major-gcs-time 13.4195255106934 div-rec major-gcs-time 10.5263157894737 destructive major-gcs-time 18.4256932797522 deriv major-gcs 400/13 deriv major-gcs-time 31.0496888197515 dderiv major-gcs 38.1881307912987 dderiv major-gcs-time 29.1051101701493 ctak major-gcs 54.4331053951817 ctak major-gcs-time 54.4331053951817 cpstak major-gcs 23.5003881792607 cpstak major-gcs-time 21.1685872120031 conform major-gcs 33.5310416704086 conform major-gcs-time 29.933764309667 binarytrees major-gcs 50 binarytrees major-gcs-time 49.5875315265017 0 cpu-time 300.0 Total compile time: 3m53.268s Total run time (CPU time): 1h15m17.9959999999983s Total time spent in major GCs: 6m43.006s Total mutations: 1099440919 Total mutations tracked: 130704454 Total number of minor GCs: 6628570 Total number of major GCs: 78478 Total number failures: 0