benchmarks: 5.2.0 vs. 5.2.0 + megane's patch pasted by mario-goulart on Sat Dec 12 11:47:10 2020
+---[1]: |-> installation-prefix: /home/mario/local/chicken-5.2.0 |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[2]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-megane |-> csc-options: |-> runtime-options: |-> repetitions: 10 Displaying normalized results (larger numbers indicate better results) === === cpu-time === Programs [1] [2] ======================================== awful_____________________1.00______1.03 base64____________________1.00______1.00 chicken-distfiles_________1.00______1.11 jsmin_____________________1.00______1.01 json______________________1.00______1.31 manual-labor______________1.00______1.03 salmonella-diff___________1.00______1.12 salmonella-html-repo______1.00______1.00 xml_______________________1.00______1.13 ;;; ;;; Stock 5.2.0 ;;; Repeating each program 10 times Using /home/mario/local/chicken-5.2.0/bin/csc Total number of programs to benchmark: 9 Maximum deviance: 5. Results whose deviance are greater than the maximum are annotated with a `*' in the summary below. The values displayed correspond to the arithmetic mean of all results (except build time). Columns legend: BT [1] => Build time (seconds) CT [2] => CPU time (seconds) MGT[3] => Major GCs time (seconds) Mut[4] => number of mutations MT [5] => number of tracked mutations MGC[6] => number of major GCs mGC[7] => number of minor GCs Programs BT [1] CT [2] MGT[3] Mut[4] MT [5] MGC[6] mGC[7] 1 awful..................0.375 5.5008 0 0 0 0 0 2 base64.................0.305 6.2707 *0.251 4607 474 *22.6 31999. 3 chicken-distfiles......0.243 36.535 0 0 0 0 0 4 jsmin..................0.199 0.5201 *0.011 30 15 29 4942 5 json...................0.191 6.4162 2.3808 489008 203214 39 31442 6 manual-labor...........0.242 0.9993 0 0 0 0 0 7 salmonella-diff........0.268 4.2633 0 0 0 0 0 8 salmonella-html-report.0.285 16.207 0 0 0 0 0 9 xml....................0.21 6.9192 *1.124 27825 122 *66 50149 WARNING: some numbers are not stable (deviance greater than 5): xml major-gcs 200/33 xml major-gcs-time 24.4357200754897 jsmin major-gcs-time 17.2487872372821 base64 major-gcs 600/113 base64 major-gcs-time 7.06652073556049 Total compile time: 2.318s Total run time (CPU time): 13m56.3180000000001s Total time spent in major GCs: 37.672s Total mutations: 49225470 Total mutations tracked: 2038250 Total number of minor GCs: 1185324 Total number of major GCs: 1566 Total number failures: 0 ;;; ;;; Stock 5.2.0 + megane's patch ;;; Repeating each program 10 times Using /home/mario/local/chicken-5.2.0-megane/bin/csc Total number of programs to benchmark: 9 Maximum deviance: 5. Results whose deviance are greater than the maximum are annotated with a `*' in the summary below. The values displayed correspond to the arithmetic mean of all results (except build time). Columns legend: BT [1] => Build time (seconds) CT [2] => CPU time (seconds) MGT[3] => Major GCs time (seconds) Mut[4] => number of mutations MT [5] => number of tracked mutations MGC[6] => number of major GCs mGC[7] => number of minor GCs Programs BT [1] CT [2] MGT[3] Mut[4] MT [5] MGC[6] mGC[7] 1 awful..................0.347 5.2907 0 0 0 0 0 2 base64.................0.299 6.2379 0.2434 4607 474 14.9 32008. 3 chicken-distfiles......0.242 32.655 0 0 0 0 0 4 jsmin..................0.193 0.5143 *0.002 30 15 2 4969 5 json...................0.206 4.8747 1.3137 489008 203803 10.7 31470. 6 manual-labor...........0.238 0.9652 0 0 0 0 0 7 salmonella-diff........0.267 3.7973 0 0 0 0 0 8 salmonella-html-report.0.274 16.082 0 0 0 0 0 9 xml....................0.212 6.0725 0.3585 27800. 95.7 10.7 50204. WARNING: some numbers are not stable (deviance greater than 5): jsmin major-gcs-time 24.1379310344828 Total compile time: 2.278s Total run time (CPU time): 12m44.904s Total time spent in major GCs: 19.185s Total mutations: 49225227 Total mutations tracked: 2043877 Total number of minor GCs: 1186517 Total number of major GCs: 383 Total number failures: 0
benchmarks: 5.2.0 vs. 5.2.0 + megane's + OPTIMIZE_FOR_SPEED pasted by mario-goulart on Sat Dec 12 13:44:46 2020
;;; [1] Stock 5.2.0 ;;; [2] 5.2.0 + megane's patch ;;; [3] Stock 5.2.0 built with OPTIMIZE_FOR_SPEED=1 ;;; [4] 5.2.0 + megane's patch built with OPTMIZE_FOR_SPEED=1 ;;; ;;; C compiler = GCC 6.3.0 +---[1]: |-> installation-prefix: /home/mario/local/chicken-5.2.0 |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[2]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-megane |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[3]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-speed |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[4]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-speed-megane |-> csc-options: |-> runtime-options: |-> repetitions: 10 Displaying normalized results (larger numbers indicate better results) === === cpu-time === Programs [1] [2] [3] [4] ============================================================ awful_____________________1.00______1.03______1.11______1.14 base64____________________1.00______1.00______1.04______1.07 chicken-distfiles_________1.00______1.11______1.14______1.25 jsmin_____________________1.00______1.01______1.41______1.46 json______________________1.00______1.31______1.26______1.74 manual-labor______________1.00______1.03______1.44______1.51 salmonella-diff___________1.00______1.12______1.27______1.39 salmonella-html-repo______1.00______1.00______1.08______1.08 xml_______________________1.00______1.13______1.39______1.55
Add results with -O3 for chicken added by mario-goulart on Sat Dec 12 17:04:07 2020
+---[1]: |-> installation-prefix: /home/mario/local/chicken-5.2.0 |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[2]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-megane |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[3]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-speed |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[4]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-speed-megane |-> csc-options: |-> runtime-options: |-> repetitions: 10 +---[5]: |-> installation-prefix: /home/mario/local/chicken-5.2.0-speed-megane |-> csc-options: -O3 |-> runtime-options: |-> repetitions: 10 Displaying normalized results (larger numbers indicate better results) === === cpu-time === Programs [1] [2] [3] [4] [5] ====================================================================== awful_____________________1.00______1.03______1.11______1.14______1.14 base64____________________1.00______1.00______1.04______1.07______1.07 chicken-distfiles_________1.00______1.11______1.14______1.25______1.25 jsmin_____________________1.00______1.01______1.41______1.46______1.46 json______________________1.00______1.31______1.26______1.74______1.72 manual-labor______________1.00______1.03______1.44______1.51______1.50 salmonella-diff___________1.00______1.12______1.27______1.39______1.39 salmonella-html-repo______1.00______1.00______1.08______1.08______1.09 xml_______________________1.00______1.13______1.39______1.55______1.55