Wed Aug 28 04:39:35 UTC 2024
dataset: mnist
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0239 (1.0)      1.0239 (1.0)      1.0239 (1.0)      0.0000 (1.0)      1.0239 (1.0)      0.0000 (1.0)           0;0  0.9766 (1.0)           1           1
test_exp_show-exp[3.10.0]     6.9246 (6.76)     6.9246 (6.76)     6.9246 (6.76)     0.0000 (1.0)      6.9246 (6.76)     0.0000 (1.0)           0;0  0.1444 (0.15)          1           1
test_exp_show-exp[3.53.2]     4.4570 (4.35)     4.4570 (4.35)     4.4570 (4.35)     0.0000 (1.0)      4.4570 (4.35)     0.0000 (1.0)           0;0  0.2244 (0.23)          1           1
test_exp_show-exp[main]       5.8249 (5.69)     5.8249 (5.69)     5.8249 (5.69)     0.0000 (1.0)      5.8249 (5.69)     0.0000 (1.0)           0;0  0.1717 (0.18)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     114.5868 (1.01)     130.1942 (1.0)      120.4128 (1.01)     2.5802 (1.0)      120.8870 (1.01)     3.7293 (1.16)         22;1  8.3048 (0.99)        100           1
test_help---help[3.10.0]     113.0782 (1.0)      133.9958 (1.03)     119.3216 (1.0)      2.5991 (1.01)     120.0724 (1.0)      3.2934 (1.03)         16;1  8.3807 (1.0)         100           1
test_help---help[3.53.2]     115.3835 (1.02)     139.3562 (1.07)     120.4459 (1.01)     3.2139 (1.25)     120.3946 (1.00)     3.7018 (1.16)         19;3  8.3025 (0.99)        100           1
test_help---help[main]       115.4549 (1.02)     143.2070 (1.10)     120.7828 (1.01)     3.5330 (1.37)     120.7102 (1.01)     3.2031 (1.0)          13;2  8.2793 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     406.2541 (1.0)      478.4095 (1.0)      426.0266 (1.0)      10.5873 (1.21)     424.3303 (1.0)      12.5834 (1.33)         26;1  2.3473 (1.0)         100           1
test_init-init[3.10.0]     424.7663 (1.05)     480.2374 (1.00)     443.2782 (1.04)      8.7443 (1.0)      442.5672 (1.04)      9.4566 (1.0)          22;4  2.2559 (0.96)        100           1
test_init-init[3.53.2]     414.5374 (1.02)     479.1368 (1.00)     432.4697 (1.02)     10.1695 (1.16)     430.9422 (1.02)     11.6544 (1.23)         26;2  2.3123 (0.99)        100           1
test_init-init[main]       414.1062 (1.02)     550.2718 (1.15)     435.6127 (1.02)     18.4266 (2.11)     431.9748 (1.02)     11.8704 (1.26)          9;8  2.2956 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     456.9840 (1.0)      465.1262 (1.0)      460.8824 (1.0)      2.8894 (1.0)      460.7857 (1.0)       2.4428 (1.0)           2;0  2.1698 (1.0)           5           3
test_plots-plots-diff[3.10.0]     820.8953 (1.80)     845.7857 (1.82)     828.8997 (1.80)     9.8747 (3.42)     825.5826 (1.79)     10.2395 (4.19)          1;0  1.2064 (0.56)          5           3
test_plots-plots-diff[3.53.2]     775.4892 (1.70)     788.6960 (1.70)     783.1200 (1.70)     6.2660 (2.17)     786.2135 (1.71)     11.3531 (4.65)          1;0  1.2769 (0.59)          5           3
test_plots-plots-diff[main]       777.0926 (1.70)     802.2303 (1.72)     786.3039 (1.71)     9.8172 (3.40)     781.9782 (1.70)     11.6350 (4.76)          1;0  1.2718 (0.59)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       469.6708 (1.0)        476.7012 (1.0)        472.9624 (1.0)       3.1853 (1.0)        473.1952 (1.0)       5.9315 (1.00)          2;0  2.1143 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,042.3406 (2.22)     1,064.3546 (2.23)     1,052.5284 (2.23)      8.4473 (2.65)     1,051.9905 (2.22)     12.2851 (2.07)          2;0  0.9501 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       850.8847 (1.81)       880.8293 (1.85)       859.6226 (1.82)     12.2293 (3.84)       855.3505 (1.81)     12.2654 (2.07)          1;0  1.1633 (0.55)          5           3
test_plots-plots-diff-json[main]         853.3393 (1.82)       871.7750 (1.83)       857.7802 (1.81)      7.8690 (2.47)       854.2783 (1.81)      5.9224 (1.0)           1;1  1.1658 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     418.7785 (1.0)      426.6150 (1.0)      422.6771 (1.0)       2.8287 (1.88)     422.3716 (1.0)       3.1065 (1.59)          2;0  2.3659 (1.0)           5           3
test_plots-plots-show[3.10.0]     672.2805 (1.61)     697.2262 (1.63)     684.8717 (1.62)     10.1550 (6.74)     682.3984 (1.62)     16.3843 (8.38)          2;0  1.4601 (0.62)          5           3
test_plots-plots-show[3.53.2]     647.0606 (1.55)     651.0136 (1.53)     649.3918 (1.54)      1.5056 (1.0)      649.6718 (1.54)      1.9555 (1.0)           2;0  1.5399 (0.65)          5           3
test_plots-plots-show[main]       659.9738 (1.58)     678.4616 (1.59)     666.3010 (1.58)      7.7950 (5.18)     662.7925 (1.57)     11.3404 (5.80)          1;0  1.5008 (0.63)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     441.1230 (1.0)      452.0076 (1.0)      446.5075 (1.0)      5.0102 (1.38)     446.7455 (1.0)      9.5164 (2.30)          2;0  2.2396 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     807.1781 (1.83)     816.7623 (1.81)     811.4964 (1.82)     3.6430 (1.0)      811.1757 (1.82)     5.0812 (1.23)          2;0  1.2323 (0.55)          5           3
test_plots-plots-show-json[3.53.2]     696.4067 (1.58)     715.0185 (1.58)     702.2499 (1.57)     7.6099 (2.09)     700.0469 (1.57)     9.2099 (2.23)          1;0  1.4240 (0.64)          5           3
test_plots-plots-show-json[main]       694.3680 (1.57)     707.1935 (1.56)     697.9216 (1.56)     5.2505 (1.44)     696.0496 (1.56)     4.1379 (1.0)           1;1  1.4328 (0.64)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean