benchmarks: 5.2.0 vs. 5.2.0 + megane's patch pasted by mario-goulart on Sat Dec 12 11:47:10 2020

+---[1]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[2]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-megane
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

Displaying normalized results (larger numbers indicate better results)

===
=== cpu-time
===

Programs                   [1]       [2]
========================================
awful_____________________1.00______1.03
base64____________________1.00______1.00
chicken-distfiles_________1.00______1.11
jsmin_____________________1.00______1.01
json______________________1.00______1.31
manual-labor______________1.00______1.03
salmonella-diff___________1.00______1.12
salmonella-html-repo______1.00______1.00
xml_______________________1.00______1.13


;;;
;;; Stock 5.2.0
;;;
Repeating each program 10 times
Using /home/mario/local/chicken-5.2.0/bin/csc 

Total number of programs to benchmark: 9

Maximum deviance: 5.  Results whose deviance are greater than
the maximum are annotated with a `*' in the summary below.

The values displayed correspond to the arithmetic mean of
all results (except build time).

Columns legend:

BT [1] => Build time (seconds)
CT [2] => CPU time (seconds)
MGT[3] => Major GCs time (seconds)
Mut[4] => number of mutations
MT [5] => number of tracked mutations
MGC[6] => number of major GCs
mGC[7] => number of minor GCs

   Programs               BT [1]  CT [2]  MGT[3]  Mut[4]  MT [5]  MGC[6]  mGC[7]  
1  awful..................0.375   5.5008  0       0       0       0       0       
2  base64.................0.305   6.2707  *0.251  4607    474     *22.6   31999.  
3  chicken-distfiles......0.243   36.535  0       0       0       0       0       
4  jsmin..................0.199   0.5201  *0.011  30      15      29      4942    
5  json...................0.191   6.4162  2.3808  489008  203214  39      31442   
6  manual-labor...........0.242   0.9993  0       0       0       0       0       
7  salmonella-diff........0.268   4.2633  0       0       0       0       0       
8  salmonella-html-report.0.285   16.207  0       0       0       0       0       
9  xml....................0.21    6.9192  *1.124  27825   122     *66     50149   

WARNING: some numbers are not stable (deviance greater than 5):
xml                 major-gcs           200/33              
xml                 major-gcs-time      24.4357200754897    
jsmin               major-gcs-time      17.2487872372821    
base64              major-gcs           600/113             
base64              major-gcs-time      7.06652073556049    

Total compile time:             2.318s
Total run time (CPU time):      13m56.3180000000001s
Total time spent in major GCs:  37.672s
Total mutations:                49225470
Total mutations tracked:        2038250
Total number of minor GCs:      1185324
Total number of major GCs:      1566
Total number failures:          0


;;;
;;; Stock 5.2.0 + megane's patch
;;;
Repeating each program 10 times
Using /home/mario/local/chicken-5.2.0-megane/bin/csc 

Total number of programs to benchmark: 9

Maximum deviance: 5.  Results whose deviance are greater than
the maximum are annotated with a `*' in the summary below.

The values displayed correspond to the arithmetic mean of
all results (except build time).

Columns legend:

BT [1] => Build time (seconds)
CT [2] => CPU time (seconds)
MGT[3] => Major GCs time (seconds)
Mut[4] => number of mutations
MT [5] => number of tracked mutations
MGC[6] => number of major GCs
mGC[7] => number of minor GCs

   Programs               BT [1]  CT [2]  MGT[3]  Mut[4]  MT [5]  MGC[6]  mGC[7]  
1  awful..................0.347   5.2907  0       0       0       0       0       
2  base64.................0.299   6.2379  0.2434  4607    474     14.9    32008.  
3  chicken-distfiles......0.242   32.655  0       0       0       0       0       
4  jsmin..................0.193   0.5143  *0.002  30      15      2       4969    
5  json...................0.206   4.8747  1.3137  489008  203803  10.7    31470.  
6  manual-labor...........0.238   0.9652  0       0       0       0       0       
7  salmonella-diff........0.267   3.7973  0       0       0       0       0       
8  salmonella-html-report.0.274   16.082  0       0       0       0       0       
9  xml....................0.212   6.0725  0.3585  27800.  95.7    10.7    50204.  

WARNING: some numbers are not stable (deviance greater than 5):
jsmin               major-gcs-time      24.1379310344828    

Total compile time:             2.278s
Total run time (CPU time):      12m44.904s
Total time spent in major GCs:  19.185s
Total mutations:                49225227
Total mutations tracked:        2043877
Total number of minor GCs:      1186517
Total number of major GCs:      383
Total number failures:          0

benchmarks: 5.2.0 vs. 5.2.0 + megane's + OPTIMIZE_FOR_SPEED pasted by mario-goulart on Sat Dec 12 13:44:46 2020

;;; [1] Stock 5.2.0
;;; [2] 5.2.0 + megane's patch
;;; [3] Stock 5.2.0 built with OPTIMIZE_FOR_SPEED=1
;;; [4] 5.2.0 + megane's patch built with OPTMIZE_FOR_SPEED=1
;;;
;;; C compiler = GCC 6.3.0


+---[1]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[2]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-megane
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[3]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-speed
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[4]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-speed-megane
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

Displaying normalized results (larger numbers indicate better results)

===
=== cpu-time
===

Programs                   [1]       [2]       [3]       [4]
============================================================
awful_____________________1.00______1.03______1.11______1.14
base64____________________1.00______1.00______1.04______1.07
chicken-distfiles_________1.00______1.11______1.14______1.25
jsmin_____________________1.00______1.01______1.41______1.46
json______________________1.00______1.31______1.26______1.74
manual-labor______________1.00______1.03______1.44______1.51
salmonella-diff___________1.00______1.12______1.27______1.39
salmonella-html-repo______1.00______1.00______1.08______1.08
xml_______________________1.00______1.13______1.39______1.55

Add results with -O3 for chicken added by mario-goulart on Sat Dec 12 17:04:07 2020

+---[1]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[2]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-megane
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[3]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-speed
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[4]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-speed-megane
|-> csc-options: 
|-> runtime-options: 
|-> repetitions: 10

+---[5]:
|-> installation-prefix: /home/mario/local/chicken-5.2.0-speed-megane
|-> csc-options: -O3
|-> runtime-options: 
|-> repetitions: 10

Displaying normalized results (larger numbers indicate better results)

===
=== cpu-time
===

Programs                   [1]       [2]       [3]       [4]       [5]
======================================================================
awful_____________________1.00______1.03______1.11______1.14______1.14
base64____________________1.00______1.00______1.04______1.07______1.07
chicken-distfiles_________1.00______1.11______1.14______1.25______1.25
jsmin_____________________1.00______1.01______1.41______1.46______1.46
json______________________1.00______1.31______1.26______1.74______1.72
manual-labor______________1.00______1.03______1.44______1.51______1.50
salmonella-diff___________1.00______1.12______1.27______1.39______1.39
salmonella-html-repo______1.00______1.00______1.08______1.08______1.09
xml_______________________1.00______1.13______1.39______1.55______1.55