Fri Mar 27 01:42:58 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.6743 (3.74)     85.6743 (3.74)     85.6743 (3.74)     0.0000 (1.0)      85.6743 (3.74)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_add_copy-add[3.10.0]     87.8112 (3.83)     87.8112 (3.83)     87.8112 (3.83)     0.0000 (1.0)      87.8112 (3.83)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_add_copy-add[3.53.2]     76.6238 (3.34)     76.6238 (3.34)     76.6238 (3.34)     0.0000 (1.0)      76.6238 (3.34)     0.0000 (1.0)           0;0  0.0131 (0.30)          1           1
test_add_copy-add[3.60.1]     22.9077 (1.0)      22.9077 (1.0)      22.9077 (1.0)      0.0000 (1.0)      22.9077 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
test_add_copy-add[main]       24.0294 (1.05)     24.0294 (1.05)     24.0294 (1.05)     0.0000 (1.0)      24.0294 (1.05)     0.0000 (1.0)           0;0  0.0416 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.9790 (6.79)     27.9790 (6.79)     27.9790 (6.79)     0.0000 (1.0)      27.9790 (6.79)     0.0000 (1.0)           0;0  0.0357 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.6061 (6.94)     28.6061 (6.94)     28.6061 (6.94)     0.0000 (1.0)      28.6061 (6.94)     0.0000 (1.0)           0;0  0.0350 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     27.3219 (6.63)     27.3219 (6.63)     27.3219 (6.63)     0.0000 (1.0)      27.3219 (6.63)     0.0000 (1.0)           0;0  0.0366 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.1216 (1.0)       4.1216 (1.0)       4.1216 (1.0)      0.0000 (1.0)       4.1216 (1.0)      0.0000 (1.0)           0;0  0.2426 (1.0)           1           1
test_add_copy-add-noop[main]        4.3265 (1.05)      4.3265 (1.05)      4.3265 (1.05)     0.0000 (1.0)       4.3265 (1.05)     0.0000 (1.0)           0;0  0.2311 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.7801 (4.16)     66.7801 (4.16)     66.7801 (4.16)     0.0000 (1.0)      66.7801 (4.16)     0.0000 (1.0)           0;0  0.0150 (0.24)          1           1
test_add_hardlink-add[3.10.0]     67.6508 (4.21)     67.6508 (4.21)     67.6508 (4.21)     0.0000 (1.0)      67.6508 (4.21)     0.0000 (1.0)           0;0  0.0148 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.0677 (3.86)     62.0677 (3.86)     62.0677 (3.86)     0.0000 (1.0)      62.0677 (3.86)     0.0000 (1.0)           0;0  0.0161 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.0696 (1.0)      16.0696 (1.0)      16.0696 (1.0)      0.0000 (1.0)      16.0696 (1.0)      0.0000 (1.0)           0;0  0.0622 (1.0)           1           1
test_add_hardlink-add[main]       17.1670 (1.07)     17.1670 (1.07)     17.1670 (1.07)     0.0000 (1.0)      17.1670 (1.07)     0.0000 (1.0)           0;0  0.0583 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.6947 (8.20)     33.6947 (8.20)     33.6947 (8.20)     0.0000 (1.0)      33.6947 (8.20)     0.0000 (1.0)           0;0  0.0297 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     34.0215 (8.28)     34.0215 (8.28)     34.0215 (8.28)     0.0000 (1.0)      34.0215 (8.28)     0.0000 (1.0)           0;0  0.0294 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     31.8079 (7.74)     31.8079 (7.74)     31.8079 (7.74)     0.0000 (1.0)      31.8079 (7.74)     0.0000 (1.0)           0;0  0.0314 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.1106 (1.0)       4.1106 (1.0)       4.1106 (1.0)      0.0000 (1.0)       4.1106 (1.0)      0.0000 (1.0)           0;0  0.2433 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4555 (1.08)      4.4555 (1.08)      4.4555 (1.08)     0.0000 (1.0)       4.4555 (1.08)     0.0000 (1.0)           0;0  0.2244 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.5879 (1.95)     71.5879 (1.95)     71.5879 (1.95)     0.0000 (1.0)      71.5879 (1.95)     0.0000 (1.0)           0;0  0.0140 (0.51)          1           1
test_add_symlink-add[3.10.0]     72.0000 (1.96)     72.0000 (1.96)     72.0000 (1.96)     0.0000 (1.0)      72.0000 (1.96)     0.0000 (1.0)           0;0  0.0139 (0.51)          1           1
test_add_symlink-add[3.53.2]     67.2258 (1.83)     67.2258 (1.83)     67.2258 (1.83)     0.0000 (1.0)      67.2258 (1.83)     0.0000 (1.0)           0;0  0.0149 (0.55)          1           1
test_add_symlink-add[3.60.1]     36.6756 (1.0)      36.6756 (1.0)      36.6756 (1.0)      0.0000 (1.0)      36.6756 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
test_add_symlink-add[main]       38.4105 (1.05)     38.4105 (1.05)     38.4105 (1.05)     0.0000 (1.0)      38.4105 (1.05)     0.0000 (1.0)           0;0  0.0260 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.1824 (8.51)     45.1824 (8.51)     45.1824 (8.51)     0.0000 (1.0)      45.1824 (8.51)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.4062 (8.55)     45.4062 (8.55)     45.4062 (8.55)     0.0000 (1.0)      45.4062 (8.55)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.5363 (8.38)     44.5363 (8.38)     44.5363 (8.38)     0.0000 (1.0)      44.5363 (8.38)     0.0000 (1.0)           0;0  0.0225 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.3940 (1.02)      5.3940 (1.02)      5.3940 (1.02)     0.0000 (1.0)       5.3940 (1.02)     0.0000 (1.0)           0;0  0.1854 (0.98)          1           1
test_add_symlink-add-noop[main]        5.3119 (1.0)       5.3119 (1.0)       5.3119 (1.0)      0.0000 (1.0)       5.3119 (1.0)      0.0000 (1.0)           0;0  0.1883 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      41.4876 (1.94)      41.4876 (1.94)      41.4876 (1.94)     0.0000 (1.0)       41.4876 (1.94)     0.0000 (1.0)           0;0  0.0241 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     105.5607 (4.94)     105.5607 (4.94)     105.5607 (4.94)     0.0000 (1.0)      105.5607 (4.94)     0.0000 (1.0)           0;0  0.0095 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      29.0536 (1.36)      29.0536 (1.36)      29.0536 (1.36)     0.0000 (1.0)       29.0536 (1.36)     0.0000 (1.0)           0;0  0.0344 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]      21.3778 (1.0)       21.3778 (1.0)       21.3778 (1.0)      0.0000 (1.0)       21.3778 (1.0)      0.0000 (1.0)           0;0  0.0468 (1.0)           1           1
test_checkout_copy-checkout[main]        22.4387 (1.05)      22.4387 (1.05)      22.4387 (1.05)     0.0000 (1.0)       22.4387 (1.05)     0.0000 (1.0)           0;0  0.0446 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5996 (1.73)     5.5996 (1.73)     5.5996 (1.73)     0.0000 (1.0)      5.5996 (1.73)     0.0000 (1.0)           0;0  0.1786 (0.58)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8676 (1.81)     5.8676 (1.81)     5.8676 (1.81)     0.0000 (1.0)      5.8676 (1.81)     0.0000 (1.0)           0;0  0.1704 (0.55)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6073 (1.73)     5.6073 (1.73)     5.6073 (1.73)     0.0000 (1.0)      5.6073 (1.73)     0.0000 (1.0)           0;0  0.1783 (0.58)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2431 (1.0)      3.2431 (1.0)      3.2431 (1.0)      0.0000 (1.0)      3.2431 (1.0)      0.0000 (1.0)           0;0  0.3083 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4160 (1.05)     3.4160 (1.05)     3.4160 (1.05)     0.0000 (1.0)      3.4160 (1.05)     0.0000 (1.0)           0;0  0.2927 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.7006 (1.89)     7.7006 (1.89)     7.7006 (1.89)     0.0000 (1.0)      7.7006 (1.89)     0.0000 (1.0)           0;0  0.1299 (0.53)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4848 (1.59)     6.4848 (1.59)     6.4848 (1.59)     0.0000 (1.0)      6.4848 (1.59)     0.0000 (1.0)           0;0  0.1542 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4345 (1.58)     6.4345 (1.58)     6.4345 (1.58)     0.0000 (1.0)      6.4345 (1.58)     0.0000 (1.0)           0;0  0.1554 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0793 (1.0)      4.0793 (1.0)      4.0793 (1.0)      0.0000 (1.0)      4.0793 (1.0)      0.0000 (1.0)           0;0  0.2451 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.2440 (1.04)     4.2440 (1.04)     4.2440 (1.04)     0.0000 (1.0)      4.2440 (1.04)     0.0000 (1.0)           0;0  0.2356 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.6724 (2.96)     22.6724 (2.96)     22.6724 (2.96)     0.0000 (1.0)      22.6724 (2.96)     0.0000 (1.0)           0;0  0.0441 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.6485 (2.17)     16.6485 (2.17)     16.6485 (2.17)     0.0000 (1.0)      16.6485 (2.17)     0.0000 (1.0)           0;0  0.0601 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.9759 (1.95)     14.9759 (1.95)     14.9759 (1.95)     0.0000 (1.0)      14.9759 (1.95)     0.0000 (1.0)           0;0  0.0668 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6651 (1.0)       7.6651 (1.0)       7.6651 (1.0)      0.0000 (1.0)       7.6651 (1.0)      0.0000 (1.0)           0;0  0.1305 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.6901 (1.13)      8.6901 (1.13)      8.6901 (1.13)     0.0000 (1.0)       8.6901 (1.13)     0.0000 (1.0)           0;0  0.1151 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.7448 (1.71)     5.7448 (1.71)     5.7448 (1.71)     0.0000 (1.0)      5.7448 (1.71)     0.0000 (1.0)           0;0  0.1741 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8808 (1.75)     5.8808 (1.75)     5.8808 (1.75)     0.0000 (1.0)      5.8808 (1.75)     0.0000 (1.0)           0;0  0.1700 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5978 (1.66)     5.5978 (1.66)     5.5978 (1.66)     0.0000 (1.0)      5.5978 (1.66)     0.0000 (1.0)           0;0  0.1786 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3646 (1.0)      3.3646 (1.0)      3.3646 (1.0)      0.0000 (1.0)      3.3646 (1.0)      0.0000 (1.0)           0;0  0.2972 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5969 (1.07)     3.5969 (1.07)     3.5969 (1.07)     0.0000 (1.0)      3.5969 (1.07)     0.0000 (1.0)           0;0  0.2780 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.0616 (2.02)     8.0616 (2.02)     8.0616 (2.02)     0.0000 (1.0)      8.0616 (2.02)     0.0000 (1.0)           0;0  0.1240 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7721 (1.70)     6.7721 (1.70)     6.7721 (1.70)     0.0000 (1.0)      6.7721 (1.70)     0.0000 (1.0)           0;0  0.1477 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4575 (1.62)     6.4575 (1.62)     6.4575 (1.62)     0.0000 (1.0)      6.4575 (1.62)     0.0000 (1.0)           0;0  0.1549 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9880 (1.0)      3.9880 (1.0)      3.9880 (1.0)      0.0000 (1.0)      3.9880 (1.0)      0.0000 (1.0)           0;0  0.2507 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4650 (1.12)     4.4650 (1.12)     4.4650 (1.12)     0.0000 (1.0)      4.4650 (1.12)     0.0000 (1.0)           0;0  0.2240 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     17.9789 (2.13)     17.9789 (2.13)     17.9789 (2.13)     0.0000 (1.0)      17.9789 (2.13)     0.0000 (1.0)           0;0  0.0556 (0.47)          1           1
test_checkout_symlink-checkout[3.10.0]     13.8011 (1.63)     13.8011 (1.63)     13.8011 (1.63)     0.0000 (1.0)      13.8011 (1.63)     0.0000 (1.0)           0;0  0.0725 (0.61)          1           1
test_checkout_symlink-checkout[3.53.2]     13.2300 (1.56)     13.2300 (1.56)     13.2300 (1.56)     0.0000 (1.0)      13.2300 (1.56)     0.0000 (1.0)           0;0  0.0756 (0.64)          1           1
test_checkout_symlink-checkout[3.60.1]      8.4635 (1.00)      8.4635 (1.00)      8.4635 (1.00)     0.0000 (1.0)       8.4635 (1.00)     0.0000 (1.0)           0;0  0.1182 (1.00)          1           1
test_checkout_symlink-checkout[main]        8.4544 (1.0)       8.4544 (1.0)       8.4544 (1.0)      0.0000 (1.0)       8.4544 (1.0)      0.0000 (1.0)           0;0  0.1183 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     4.9274 (1.30)     4.9274 (1.30)     4.9274 (1.30)     0.0000 (1.0)      4.9274 (1.30)     0.0000 (1.0)           0;0  0.2029 (0.77)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.2940 (1.40)     5.2940 (1.40)     5.2940 (1.40)     0.0000 (1.0)      5.2940 (1.40)     0.0000 (1.0)           0;0  0.1889 (0.71)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     5.1600 (1.37)     5.1600 (1.37)     5.1600 (1.37)     0.0000 (1.0)      5.1600 (1.37)     0.0000 (1.0)           0;0  0.1938 (0.73)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     3.7762 (1.0)      3.7762 (1.0)      3.7762 (1.0)      0.0000 (1.0)      3.7762 (1.0)      0.0000 (1.0)           0;0  0.2648 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       3.9506 (1.05)     3.9506 (1.05)     3.9506 (1.05)     0.0000 (1.0)      3.9506 (1.05)     0.0000 (1.0)           0;0  0.2531 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     7.5363 (1.54)     7.5363 (1.54)     7.5363 (1.54)     0.0000 (1.0)      7.5363 (1.54)     0.0000 (1.0)           0;0  0.1327 (0.65)          1           1
test_checkout_symlink-checkout-update[3.10.0]     6.5232 (1.33)     6.5232 (1.33)     6.5232 (1.33)     0.0000 (1.0)      6.5232 (1.33)     0.0000 (1.0)           0;0  0.1533 (0.75)          1           1
test_checkout_symlink-checkout-update[3.53.2]     6.4691 (1.32)     6.4691 (1.32)     6.4691 (1.32)     0.0000 (1.0)      6.4691 (1.32)     0.0000 (1.0)           0;0  0.1546 (0.76)          1           1
test_checkout_symlink-checkout-update[3.60.1]     4.8867 (1.0)      4.8867 (1.0)      4.8867 (1.0)      0.0000 (1.0)      4.8867 (1.0)      0.0000 (1.0)           0;0  0.2046 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       5.3454 (1.09)     5.3454 (1.09)     5.3454 (1.09)     0.0000 (1.0)      5.3454 (1.09)     0.0000 (1.0)           0;0  0.1871 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0132 (1.73)     4.0132 (1.73)     4.0132 (1.73)     0.0000 (1.0)      4.0132 (1.73)     0.0000 (1.0)           0;0  0.2492 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.9830 (2.15)     4.9830 (2.15)     4.9830 (2.15)     0.0000 (1.0)      4.9830 (2.15)     0.0000 (1.0)           0;0  0.2007 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.6884 (2.02)     4.6884 (2.02)     4.6884 (2.02)     0.0000 (1.0)      4.6884 (2.02)     0.0000 (1.0)           0;0  0.2133 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3212 (1.0)      2.3212 (1.0)      2.3212 (1.0)      0.0000 (1.0)      2.3212 (1.0)      0.0000 (1.0)           0;0  0.4308 (1.0)           1           1
test_data_status-data-changed[main]       2.5585 (1.10)     2.5585 (1.10)     2.5585 (1.10)     0.0000 (1.0)      2.5585 (1.10)     0.0000 (1.0)           0;0  0.3909 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1104 (1.75)     4.1104 (1.75)     4.1104 (1.75)     0.0000 (1.0)      4.1104 (1.75)     0.0000 (1.0)           0;0  0.2433 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9452 (2.11)     4.9452 (2.11)     4.9452 (2.11)     0.0000 (1.0)      4.9452 (2.11)     0.0000 (1.0)           0;0  0.2022 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7407 (2.02)     4.7407 (2.02)     4.7407 (2.02)     0.0000 (1.0)      4.7407 (2.02)     0.0000 (1.0)           0;0  0.2109 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3437 (1.0)      2.3437 (1.0)      2.3437 (1.0)      0.0000 (1.0)      2.3437 (1.0)      0.0000 (1.0)           0;0  0.4267 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6420 (1.13)     2.6420 (1.13)     2.6420 (1.13)     0.0000 (1.0)      2.6420 (1.13)     0.0000 (1.0)           0;0  0.3785 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.3604 (3.71)     18.3604 (3.71)     18.3604 (3.71)     0.0000 (1.0)      18.3604 (3.71)     0.0000 (1.0)           0;0  0.0545 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.6613 (3.97)     19.6613 (3.97)     19.6613 (3.97)     0.0000 (1.0)      19.6613 (3.97)     0.0000 (1.0)           0;0  0.0509 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.8410 (3.81)     18.8410 (3.81)     18.8410 (3.81)     0.0000 (1.0)      18.8410 (3.81)     0.0000 (1.0)           0;0  0.0531 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9504 (1.0)       4.9504 (1.0)       4.9504 (1.0)      0.0000 (1.0)       4.9504 (1.0)      0.0000 (1.0)           0;0  0.2020 (1.0)           1           1
test_data_status-data-new[main]        5.5153 (1.11)      5.5153 (1.11)      5.5153 (1.11)     0.0000 (1.0)       5.5153 (1.11)     0.0000 (1.0)           0;0  0.1813 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9637 (1.71)     3.9637 (1.71)     3.9637 (1.71)     0.0000 (1.0)      3.9637 (1.71)     0.0000 (1.0)           0;0  0.2523 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.8782 (2.11)     4.8782 (2.11)     4.8782 (2.11)     0.0000 (1.0)      4.8782 (2.11)     0.0000 (1.0)           0;0  0.2050 (0.47)          1           1
test_data_status-data-noop[3.53.2]     4.7374 (2.04)     4.7374 (2.04)     4.7374 (2.04)     0.0000 (1.0)      4.7374 (2.04)     0.0000 (1.0)           0;0  0.2111 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.3171 (1.0)      2.3171 (1.0)      2.3171 (1.0)      0.0000 (1.0)      2.3171 (1.0)      0.0000 (1.0)           0;0  0.4316 (1.0)           1           1
test_data_status-data-noop[main]       2.6804 (1.16)     2.6804 (1.16)     2.6804 (1.16)     0.0000 (1.0)      2.6804 (1.16)     0.0000 (1.0)           0;0  0.3731 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.6871 (1.28)     6.6871 (1.28)     6.6871 (1.28)     0.0000 (1.0)      6.6871 (1.28)     0.0000 (1.0)           0;0  0.1495 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7139 (1.48)     7.7139 (1.48)     7.7139 (1.48)     0.0000 (1.0)      7.7139 (1.48)     0.0000 (1.0)           0;0  0.1296 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5604 (1.45)     7.5604 (1.45)     7.5604 (1.45)     0.0000 (1.0)      7.5604 (1.45)     0.0000 (1.0)           0;0  0.1323 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.2222 (1.0)      5.2222 (1.0)      5.2222 (1.0)      0.0000 (1.0)      5.2222 (1.0)      0.0000 (1.0)           0;0  0.1915 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5594 (1.06)     5.5594 (1.06)     5.5594 (1.06)     0.0000 (1.0)      5.5594 (1.06)     0.0000 (1.0)           0;0  0.1799 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.9789 (1.33)     6.9789 (1.33)     6.9789 (1.33)     0.0000 (1.0)      6.9789 (1.33)     0.0000 (1.0)           0;0  0.1433 (0.75)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7773 (1.48)     7.7773 (1.48)     7.7773 (1.48)     0.0000 (1.0)      7.7773 (1.48)     0.0000 (1.0)           0;0  0.1286 (0.67)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.5438 (1.44)     7.5438 (1.44)     7.5438 (1.44)     0.0000 (1.0)      7.5438 (1.44)     0.0000 (1.0)           0;0  0.1326 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.2481 (1.0)      5.2481 (1.0)      5.2481 (1.0)      0.0000 (1.0)      5.2481 (1.0)      0.0000 (1.0)           0;0  0.1905 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8062 (1.11)     5.8062 (1.11)     5.8062 (1.11)     0.0000 (1.0)      5.8062 (1.11)     0.0000 (1.0)           0;0  0.1722 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.8369 (2.62)     20.8369 (2.62)     20.8369 (2.62)     0.0000 (1.0)      20.8369 (2.62)     0.0000 (1.0)           0;0  0.0480 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.2852 (2.80)     22.2852 (2.80)     22.2852 (2.80)     0.0000 (1.0)      22.2852 (2.80)     0.0000 (1.0)           0;0  0.0449 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.9380 (2.76)     21.9380 (2.76)     21.9380 (2.76)     0.0000 (1.0)      21.9380 (2.76)     0.0000 (1.0)           0;0  0.0456 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9576 (1.0)       7.9576 (1.0)       7.9576 (1.0)      0.0000 (1.0)       7.9576 (1.0)      0.0000 (1.0)           0;0  0.1257 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.0593 (1.01)      8.0593 (1.01)      8.0593 (1.01)     0.0000 (1.0)       8.0593 (1.01)     0.0000 (1.0)           0;0  0.1241 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4202 (1.40)     6.4202 (1.40)     6.4202 (1.40)     0.0000 (1.0)      6.4202 (1.40)     0.0000 (1.0)           0;0  0.1558 (0.71)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1590 (1.56)     7.1590 (1.56)     7.1590 (1.56)     0.0000 (1.0)      7.1590 (1.56)     0.0000 (1.0)           0;0  0.1397 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0867 (1.54)     7.0867 (1.54)     7.0867 (1.54)     0.0000 (1.0)      7.0867 (1.54)     0.0000 (1.0)           0;0  0.1411 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5869 (1.0)      4.5869 (1.0)      4.5869 (1.0)      0.0000 (1.0)      4.5869 (1.0)      0.0000 (1.0)           0;0  0.2180 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0305 (1.10)     5.0305 (1.10)     5.0305 (1.10)     0.0000 (1.0)      5.0305 (1.10)     0.0000 (1.0)           0;0  0.1988 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.3910 (2.69)     18.3910 (2.69)     18.3910 (2.69)     0.0000 (1.0)      18.3910 (2.69)     0.0000 (1.0)           0;0  0.0544 (0.37)          1           1
test_diff-diff[3.10.0]     19.6121 (2.87)     19.6121 (2.87)     19.6121 (2.87)     0.0000 (1.0)      19.6121 (2.87)     0.0000 (1.0)           0;0  0.0510 (0.35)          1           1
test_diff-diff[3.53.2]     19.5337 (2.85)     19.5337 (2.85)     19.5337 (2.85)     0.0000 (1.0)      19.5337 (2.85)     0.0000 (1.0)           0;0  0.0512 (0.35)          1           1
test_diff-diff[3.60.1]      6.8423 (1.0)       6.8423 (1.0)       6.8423 (1.0)      0.0000 (1.0)       6.8423 (1.0)      0.0000 (1.0)           0;0  0.1461 (1.0)           1           1
test_diff-diff[main]        7.8114 (1.14)      7.8114 (1.14)      7.8114 (1.14)     0.0000 (1.0)       7.8114 (1.14)     0.0000 (1.0)           0;0  0.1280 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0701 (1.80)     6.0701 (1.80)     6.0701 (1.80)     0.0000 (1.0)      6.0701 (1.80)     0.0000 (1.0)           0;0  0.1647 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.9258 (2.05)     6.9258 (2.05)     6.9258 (2.05)     0.0000 (1.0)      6.9258 (2.05)     0.0000 (1.0)           0;0  0.1444 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.7811 (1.72)     5.7811 (1.72)     5.7811 (1.72)     0.0000 (1.0)      5.7811 (1.72)     0.0000 (1.0)           0;0  0.1730 (0.58)          1           1
test_diff-diff-changed[3.60.1]     3.3708 (1.0)      3.3708 (1.0)      3.3708 (1.0)      0.0000 (1.0)      3.3708 (1.0)      0.0000 (1.0)           0;0  0.2967 (1.0)           1           1
test_diff-diff-changed[main]       4.1230 (1.22)     4.1230 (1.22)     4.1230 (1.22)     0.0000 (1.0)      4.1230 (1.22)     0.0000 (1.0)           0;0  0.2425 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2131 (1.52)     5.2131 (1.52)     5.2131 (1.52)     0.0000 (1.0)      5.2131 (1.52)     0.0000 (1.0)           0;0  0.1918 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8263 (1.70)     5.8263 (1.70)     5.8263 (1.70)     0.0000 (1.0)      5.8263 (1.70)     0.0000 (1.0)           0;0  0.1716 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5858 (1.63)     5.5858 (1.63)     5.5858 (1.63)     0.0000 (1.0)      5.5858 (1.63)     0.0000 (1.0)           0;0  0.1790 (0.62)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4363 (1.0)      3.4363 (1.0)      3.4363 (1.0)      0.0000 (1.0)      3.4363 (1.0)      0.0000 (1.0)           0;0  0.2910 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1690 (1.21)     4.1690 (1.21)     4.1690 (1.21)     0.0000 (1.0)      4.1690 (1.21)     0.0000 (1.0)           0;0  0.2399 (0.82)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1447 (1.23)     4.1447 (1.23)     4.1447 (1.23)     0.0000 (1.0)      4.1447 (1.23)     0.0000 (1.0)           0;0  0.2413 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.9525 (1.46)     4.9525 (1.46)     4.9525 (1.46)     0.0000 (1.0)      4.9525 (1.46)     0.0000 (1.0)           0;0  0.2019 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.6114 (1.66)     5.6114 (1.66)     5.6114 (1.66)     0.0000 (1.0)      5.6114 (1.66)     0.0000 (1.0)           0;0  0.1782 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3827 (1.0)      3.3827 (1.0)      3.3827 (1.0)      0.0000 (1.0)      3.3827 (1.0)      0.0000 (1.0)           0;0  0.2956 (1.0)           1           1
test_diff-diff-noop[main]       4.1573 (1.23)     4.1573 (1.23)     4.1573 (1.23)     0.0000 (1.0)      4.1573 (1.23)     0.0000 (1.0)           0;0  0.2405 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.2253 (1.0)      1.2253 (1.0)      1.2253 (1.0)      0.0000 (1.0)      1.2253 (1.0)      0.0000 (1.0)           0;0  0.8161 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.5294 (3.70)     4.5294 (3.70)     4.5294 (3.70)     0.0000 (1.0)      4.5294 (3.70)     0.0000 (1.0)           0;0  0.2208 (0.27)          1           1
test_exp_show-exp[3.53.2]     2.9059 (2.37)     2.9059 (2.37)     2.9059 (2.37)     0.0000 (1.0)      2.9059 (2.37)     0.0000 (1.0)           0;0  0.3441 (0.42)          1           1
test_exp_show-exp[3.60.1]     3.2741 (2.67)     3.2741 (2.67)     3.2741 (2.67)     0.0000 (1.0)      3.2741 (2.67)     0.0000 (1.0)           0;0  0.3054 (0.37)          1           1
test_exp_show-exp[main]       6.0092 (4.90)     6.0092 (4.90)     6.0092 (4.90)     0.0000 (1.0)      6.0092 (4.90)     0.0000 (1.0)           0;0  0.1664 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     110.8018 (4.66)     110.8018 (4.66)     110.8018 (4.66)     0.0000 (1.0)      110.8018 (4.66)     0.0000 (1.0)           0;0  0.0090 (0.21)          1           1
test_fetch-fetch[3.10.0]     116.1653 (4.88)     116.1653 (4.88)     116.1653 (4.88)     0.0000 (1.0)      116.1653 (4.88)     0.0000 (1.0)           0;0  0.0086 (0.20)          1           1
test_fetch-fetch[3.53.2]      34.8693 (1.47)      34.8693 (1.47)      34.8693 (1.47)     0.0000 (1.0)       34.8693 (1.47)     0.0000 (1.0)           0;0  0.0287 (0.68)          1           1
test_fetch-fetch[3.60.1]      23.8511 (1.00)      23.8511 (1.00)      23.8511 (1.00)     0.0000 (1.0)       23.8511 (1.00)     0.0000 (1.0)           0;0  0.0419 (1.00)          1           1
test_fetch-fetch[main]        23.7854 (1.0)       23.7854 (1.0)       23.7854 (1.0)      0.0000 (1.0)       23.7854 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8951 (1.0)      2.8951 (1.0)      2.8951 (1.0)      0.0000 (1.0)      2.8951 (1.0)      0.0000 (1.0)           0;0  0.3454 (1.0)           1           1
test_gc-gc[3.10.0]     3.2480 (1.12)     3.2480 (1.12)     3.2480 (1.12)     0.0000 (1.0)      3.2480 (1.12)     0.0000 (1.0)           0;0  0.3079 (0.89)          1           1
test_gc-gc[3.53.2]     2.9589 (1.02)     2.9589 (1.02)     2.9589 (1.02)     0.0000 (1.0)      2.9589 (1.02)     0.0000 (1.0)           0;0  0.3380 (0.98)          1           1
test_gc-gc[3.60.1]     2.9695 (1.03)     2.9695 (1.03)     2.9695 (1.03)     0.0000 (1.0)      2.9695 (1.03)     0.0000 (1.0)           0;0  0.3368 (0.97)          1           1
test_gc-gc[main]       3.0026 (1.04)     3.0026 (1.04)     3.0026 (1.04)     0.0000 (1.0)      3.0026 (1.04)     0.0000 (1.0)           0;0  0.3330 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     200.6056 (3.82)     200.6056 (3.82)     200.6056 (3.82)     0.0000 (1.0)      200.6056 (3.82)     0.0000 (1.0)           0;0  0.0050 (0.26)          1           1
test_get-get[3.10.0]     268.2258 (5.11)     268.2258 (5.11)     268.2258 (5.11)     0.0000 (1.0)      268.2258 (5.11)     0.0000 (1.0)           0;0  0.0037 (0.20)          1           1
test_get-get[3.53.2]     216.7606 (4.13)     216.7606 (4.13)     216.7606 (4.13)     0.0000 (1.0)      216.7606 (4.13)     0.0000 (1.0)           0;0  0.0046 (0.24)          1           1
test_get-get[3.60.1]      52.4465 (1.0)       52.4465 (1.0)       52.4465 (1.0)      0.0000 (1.0)       52.4465 (1.0)      0.0000 (1.0)           0;0  0.0191 (1.0)           1           1
test_get-get[main]        57.1362 (1.09)      57.1362 (1.09)      57.1362 (1.09)     0.0000 (1.0)       57.1362 (1.09)     0.0000 (1.0)           0;0  0.0175 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     91.0096 (5.44)     91.0096 (5.44)     91.0096 (5.44)     0.0000 (1.0)      91.0096 (5.44)     0.0000 (1.0)           0;0  0.0110 (0.18)          1           1
test_get_url-get-url[3.10.0]     93.3511 (5.58)     93.3511 (5.58)     93.3511 (5.58)     0.0000 (1.0)      93.3511 (5.58)     0.0000 (1.0)           0;0  0.0107 (0.18)          1           1
test_get_url-get-url[3.53.2]     16.7442 (1.0)      16.7442 (1.0)      16.7442 (1.0)      0.0000 (1.0)      16.7442 (1.0)      0.0000 (1.0)           0;0  0.0597 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.8396 (1.01)     16.8396 (1.01)     16.8396 (1.01)     0.0000 (1.0)      16.8396 (1.01)     0.0000 (1.0)           0;0  0.0594 (0.99)          1           1
test_get_url-get-url[main]       16.8207 (1.00)     16.8207 (1.00)     16.8207 (1.00)     0.0000 (1.0)      16.8207 (1.00)     0.0000 (1.0)           0;0  0.0595 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     150.7430 (1.04)     163.5836 (1.03)     157.3448 (1.05)     2.8547 (1.38)     157.2898 (1.06)     4.2846 (1.62)         36;0  6.3555 (0.95)        100           1
test_help---help[3.10.0]     149.9061 (1.04)     159.2896 (1.0)      153.8142 (1.03)     2.0749 (1.0)      153.2781 (1.03)     2.6526 (1.0)          28;2  6.5013 (0.97)        100           1
test_help---help[3.53.2]     152.4942 (1.05)     162.5409 (1.02)     156.2736 (1.05)     2.1761 (1.05)     155.9002 (1.05)     2.8016 (1.06)         29;2  6.3990 (0.96)        100           1
test_help---help[3.60.1]     152.9530 (1.06)     163.4158 (1.03)     156.3629 (1.05)     2.3248 (1.12)     155.8377 (1.05)     3.5400 (1.33)         32;1  6.3954 (0.95)        100           1
test_help---help[main]       144.6122 (1.0)      186.1559 (1.17)     149.2996 (1.0)      5.1318 (2.47)     148.4553 (1.0)      3.5061 (1.32)          7;3  6.6979 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     270.1831 (3.43)     270.1831 (3.43)     270.1831 (3.43)     0.0000 (1.0)      270.1831 (3.43)     0.0000 (1.0)           0;0  0.0037 (0.29)          1           1
test_import-import[3.10.0]     305.5892 (3.88)     305.5892 (3.88)     305.5892 (3.88)     0.0000 (1.0)      305.5892 (3.88)     0.0000 (1.0)           0;0  0.0033 (0.26)          1           1
test_import-import[3.60.1]      78.8595 (1.0)       78.8595 (1.0)       78.8595 (1.0)      0.0000 (1.0)       78.8595 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
test_import-import[main]        79.7638 (1.01)      79.7638 (1.01)      79.7638 (1.01)     0.0000 (1.0)       79.7638 (1.01)     0.0000 (1.0)           0;0  0.0125 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     203.8511 (4.30)     203.8511 (4.30)     203.8511 (4.30)     0.0000 (1.0)      203.8511 (4.30)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.10.0]     206.1780 (4.35)     206.1780 (4.35)     206.1780 (4.35)     0.0000 (1.0)      206.1780 (4.35)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.53.2]     119.5380 (2.52)     119.5380 (2.52)     119.5380 (2.52)     0.0000 (1.0)      119.5380 (2.52)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_import_url-import-url[3.60.1]      47.4484 (1.0)       47.4484 (1.0)       47.4484 (1.0)      0.0000 (1.0)       47.4484 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
test_import_url-import-url[main]        48.8141 (1.03)      48.8141 (1.03)      48.8141 (1.03)     0.0000 (1.0)       48.8141 (1.03)     0.0000 (1.0)           0;0  0.0205 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     395.3025 (1.02)     416.3345 (1.02)     402.6093 (1.02)     3.4237 (1.22)     402.1953 (1.02)     4.3789 (1.53)         27;2  2.4838 (0.98)        100           1
test_init-init[3.10.0]     404.5488 (1.04)     422.5419 (1.04)     410.5188 (1.04)     3.3283 (1.19)     409.9625 (1.04)     3.6118 (1.26)         31;3  2.4359 (0.96)        100           1
test_init-init[3.53.2]     388.1652 (1.0)      407.6295 (1.0)      393.2102 (1.0)      2.8014 (1.0)      392.8266 (1.0)      2.8590 (1.0)          24;4  2.5432 (1.0)         100           1
test_init-init[3.60.1]     390.2425 (1.01)     410.9756 (1.01)     395.6892 (1.01)     3.0046 (1.07)     395.4584 (1.01)     3.4742 (1.22)         26;1  2.5272 (0.99)        100           1
test_init-init[main]       430.2678 (1.11)     488.3976 (1.20)     437.4324 (1.11)     7.6152 (2.72)     436.0640 (1.11)     4.3474 (1.52)          6;6  2.2861 (0.90)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     622.5529 (1.05)     622.5529 (1.05)     622.5529 (1.05)     0.0000 (1.0)      622.5529 (1.05)     0.0000 (1.0)           0;0  1.6063 (0.95)          1           1
test_list-list[3.10.0]     917.6954 (1.55)     917.6954 (1.55)     917.6954 (1.55)     0.0000 (1.0)      917.6954 (1.55)     0.0000 (1.0)           0;0  1.0897 (0.65)          1           1
test_list-list[3.53.2]     616.8366 (1.04)     616.8366 (1.04)     616.8366 (1.04)     0.0000 (1.0)      616.8366 (1.04)     0.0000 (1.0)           0;0  1.6212 (0.96)          1           1
test_list-list[3.60.1]     642.0961 (1.08)     642.0961 (1.08)     642.0961 (1.08)     0.0000 (1.0)      642.0961 (1.08)     0.0000 (1.0)           0;0  1.5574 (0.92)          1           1
test_list-list[main]       592.2282 (1.0)      592.2282 (1.0)      592.2282 (1.0)      0.0000 (1.0)      592.2282 (1.0)      0.0000 (1.0)           0;0  1.6885 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     424.0915 (1.04)     424.0915 (1.04)     424.0915 (1.04)     0.0000 (1.0)      424.0915 (1.04)     0.0000 (1.0)           0;0  2.3580 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     438.5197 (1.07)     438.5197 (1.07)     438.5197 (1.07)     0.0000 (1.0)      438.5197 (1.07)     0.0000 (1.0)           0;0  2.2804 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     408.7022 (1.0)      408.7022 (1.0)      408.7022 (1.0)      0.0000 (1.0)      408.7022 (1.0)      0.0000 (1.0)           0;0  2.4468 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     409.4085 (1.00)     409.4085 (1.00)     409.4085 (1.00)     0.0000 (1.0)      409.4085 (1.00)     0.0000 (1.0)           0;0  2.4425 (1.00)          1           1
test_list-list-dvc-only[main]       412.3509 (1.01)     412.3509 (1.01)     412.3509 (1.01)     0.0000 (1.0)      412.3509 (1.01)     0.0000 (1.0)           0;0  2.4251 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4387 (1.01)     2.4387 (1.01)     2.4387 (1.01)     0.0000 (1.0)      2.4387 (1.01)     0.0000 (1.0)           0;0  0.4101 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.4044 (1.0)      2.4044 (1.0)      2.4044 (1.0)      0.0000 (1.0)      2.4044 (1.0)      0.0000 (1.0)           0;0  0.4159 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.4620 (1.02)     2.4620 (1.02)     2.4620 (1.02)     0.0000 (1.0)      2.4620 (1.02)     0.0000 (1.0)           0;0  0.4062 (0.98)          1           1
test_list-list-recursive[3.60.1]     2.5606 (1.06)     2.5606 (1.06)     2.5606 (1.06)     0.0000 (1.0)      2.5606 (1.06)     0.0000 (1.0)           0;0  0.3905 (0.94)          1           1
test_list-list-recursive[main]       2.6331 (1.10)     2.6331 (1.10)     2.6331 (1.10)     0.0000 (1.0)      2.6331 (1.10)     0.0000 (1.0)           0;0  0.3798 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     428.1253 (1.06)     428.1253 (1.06)     428.1253 (1.06)     0.0000 (1.0)      428.1253 (1.06)     0.0000 (1.0)           0;0  2.3358 (0.94)          1           1
test_list-list-shallow[3.10.0]     418.8359 (1.04)     418.8359 (1.04)     418.8359 (1.04)     0.0000 (1.0)      418.8359 (1.04)     0.0000 (1.0)           0;0  2.3876 (0.96)          1           1
test_list-list-shallow[3.53.2]     403.7466 (1.0)      403.7466 (1.0)      403.7466 (1.0)      0.0000 (1.0)      403.7466 (1.0)      0.0000 (1.0)           0;0  2.4768 (1.0)           1           1
test_list-list-shallow[3.60.1]     408.4703 (1.01)     408.4703 (1.01)     408.4703 (1.01)     0.0000 (1.0)      408.4703 (1.01)     0.0000 (1.0)           0;0  2.4482 (0.99)          1           1
test_list-list-shallow[main]       411.1889 (1.02)     411.1889 (1.02)     411.1889 (1.02)     0.0000 (1.0)      411.1889 (1.02)     0.0000 (1.0)           0;0  2.4320 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     11.7173 (3.03)     11.7173 (3.03)     11.7173 (3.03)     0.0000 (1.0)      11.7173 (3.03)     0.0000 (1.0)           0;0  0.0853 (0.33)          1           1
test_partial_add-add[3.10.0]     12.1010 (3.13)     12.1010 (3.13)     12.1010 (3.13)     0.0000 (1.0)      12.1010 (3.13)     0.0000 (1.0)           0;0  0.0826 (0.32)          1           1
test_partial_add-add[3.53.2]     10.6052 (2.74)     10.6052 (2.74)     10.6052 (2.74)     0.0000 (1.0)      10.6052 (2.74)     0.0000 (1.0)           0;0  0.0943 (0.36)          1           1
test_partial_add-add[3.60.1]      3.8697 (1.0)       3.8697 (1.0)       3.8697 (1.0)      0.0000 (1.0)       3.8697 (1.0)      0.0000 (1.0)           0;0  0.2584 (1.0)           1           1
test_partial_add-add[main]        4.6687 (1.21)      4.6687 (1.21)      4.6687 (1.21)     0.0000 (1.0)       4.6687 (1.21)     0.0000 (1.0)           0;0  0.2142 (0.83)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     78.1092 (3.96)     78.1092 (3.96)     78.1092 (3.96)     0.0000 (1.0)      78.1092 (3.96)     0.0000 (1.0)           0;0  0.0128 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     79.3357 (4.02)     79.3357 (4.02)     79.3357 (4.02)     0.0000 (1.0)      79.3357 (4.02)     0.0000 (1.0)           0;0  0.0126 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     70.8938 (3.59)     70.8938 (3.59)     70.8938 (3.59)     0.0000 (1.0)      70.8938 (3.59)     0.0000 (1.0)           0;0  0.0141 (0.28)          1           1
test_partial_add-add-partial[3.60.1]     19.7483 (1.0)      19.7483 (1.0)      19.7483 (1.0)      0.0000 (1.0)      19.7483 (1.0)      0.0000 (1.0)           0;0  0.0506 (1.0)           1           1
test_partial_add-add-partial[main]       20.5230 (1.04)     20.5230 (1.04)     20.5230 (1.04)     0.0000 (1.0)      20.5230 (1.04)     0.0000 (1.0)           0;0  0.0487 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6292 (1.0)      4.6292 (1.0)      4.6292 (1.0)      0.0000 (1.0)      4.6292 (1.0)      0.0000 (1.0)           0;0  0.2160 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.2678 (1.35)     6.2678 (1.35)     6.2678 (1.35)     0.0000 (1.0)      6.2678 (1.35)     0.0000 (1.0)           0;0  0.1595 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1130 (1.54)     7.1130 (1.54)     7.1130 (1.54)     0.0000 (1.0)      7.1130 (1.54)     0.0000 (1.0)           0;0  0.1406 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.0324 (1.52)     7.0324 (1.52)     7.0324 (1.52)     0.0000 (1.0)      7.0324 (1.52)     0.0000 (1.0)           0;0  0.1422 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.1967 (1.34)     6.1967 (1.34)     6.1967 (1.34)     0.0000 (1.0)      6.1967 (1.34)     0.0000 (1.0)           0;0  0.1614 (0.75)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6151 (1.0)      2.6151 (1.0)      2.6151 (1.0)      0.0000 (1.0)      2.6151 (1.0)      0.0000 (1.0)           0;0  0.3824 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8753 (1.48)     3.8753 (1.48)     3.8753 (1.48)     0.0000 (1.0)      3.8753 (1.48)     0.0000 (1.0)           0;0  0.2580 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.9008 (1.49)     3.9008 (1.49)     3.9008 (1.49)     0.0000 (1.0)      3.9008 (1.49)     0.0000 (1.0)           0;0  0.2564 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.9701 (1.52)     3.9701 (1.52)     3.9701 (1.52)     0.0000 (1.0)      3.9701 (1.52)     0.0000 (1.0)           0;0  0.2519 (0.66)          1           1
test_partial_add-gc-noop[main]       3.0140 (1.15)     3.0140 (1.15)     3.0140 (1.15)     0.0000 (1.0)      3.0140 (1.15)     0.0000 (1.0)           0;0  0.3318 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     13.7596 (3.85)     13.7596 (3.85)     13.7596 (3.85)     0.0000 (1.0)      13.7596 (3.85)     0.0000 (1.0)           0;0  0.0727 (0.26)          1           1
test_partial_add-push[3.10.0]      6.5470 (1.83)      6.5470 (1.83)      6.5470 (1.83)     0.0000 (1.0)       6.5470 (1.83)     0.0000 (1.0)           0;0  0.1527 (0.55)          1           1
test_partial_add-push[3.53.2]      3.6926 (1.03)      3.6926 (1.03)      3.6926 (1.03)     0.0000 (1.0)       3.6926 (1.03)     0.0000 (1.0)           0;0  0.2708 (0.97)          1           1
test_partial_add-push[3.60.1]      3.5695 (1.0)       3.5695 (1.0)       3.5695 (1.0)      0.0000 (1.0)       3.5695 (1.0)      0.0000 (1.0)           0;0  0.2802 (1.0)           1           1
test_partial_add-push[main]        3.7142 (1.04)      3.7142 (1.04)      3.7142 (1.04)     0.0000 (1.0)       3.7142 (1.04)     0.0000 (1.0)           0;0  0.2692 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     80.7454 (4.00)     80.7454 (4.00)     80.7454 (4.00)     0.0000 (1.0)      80.7454 (4.00)     0.0000 (1.0)           0;0  0.0124 (0.25)          1           1
test_partial_add-push-partial[3.10.0]     37.7503 (1.87)     37.7503 (1.87)     37.7503 (1.87)     0.0000 (1.0)      37.7503 (1.87)     0.0000 (1.0)           0;0  0.0265 (0.53)          1           1
test_partial_add-push-partial[3.53.2]     20.9954 (1.04)     20.9954 (1.04)     20.9954 (1.04)     0.0000 (1.0)      20.9954 (1.04)     0.0000 (1.0)           0;0  0.0476 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     20.2312 (1.00)     20.2312 (1.00)     20.2312 (1.00)     0.0000 (1.0)      20.2312 (1.00)     0.0000 (1.0)           0;0  0.0494 (1.00)          1           1
test_partial_add-push-partial[main]       20.1941 (1.0)      20.1941 (1.0)      20.1941 (1.0)      0.0000 (1.0)      20.1941 (1.0)      0.0000 (1.0)           0;0  0.0495 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     68.1862 (4.56)     68.1862 (4.56)     68.1862 (4.56)     0.0000 (1.0)      68.1862 (4.56)     0.0000 (1.0)           0;0  0.0147 (0.22)          1           1
test_partial_remove-add[3.10.0]     66.3695 (4.44)     66.3695 (4.44)     66.3695 (4.44)     0.0000 (1.0)      66.3695 (4.44)     0.0000 (1.0)           0;0  0.0151 (0.23)          1           1
test_partial_remove-add[3.53.2]     58.5895 (3.92)     58.5895 (3.92)     58.5895 (3.92)     0.0000 (1.0)      58.5895 (3.92)     0.0000 (1.0)           0;0  0.0171 (0.26)          1           1
test_partial_remove-add[3.60.1]     14.9548 (1.0)      14.9548 (1.0)      14.9548 (1.0)      0.0000 (1.0)      14.9548 (1.0)      0.0000 (1.0)           0;0  0.0669 (1.0)           1           1
test_partial_remove-add[main]       15.7683 (1.05)     15.7683 (1.05)     15.7683 (1.05)     0.0000 (1.0)      15.7683 (1.05)     0.0000 (1.0)           0;0  0.0634 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     35.9966 (9.85)     35.9966 (9.85)     35.9966 (9.85)     0.0000 (1.0)      35.9966 (9.85)     0.0000 (1.0)           0;0  0.0278 (0.10)          1           1
test_partial_remove-add-update[3.10.0]     37.3228 (10.21)    37.3228 (10.21)    37.3228 (10.21)    0.0000 (1.0)      37.3228 (10.21)    0.0000 (1.0)           0;0  0.0268 (0.10)          1           1
test_partial_remove-add-update[3.53.2]     33.1807 (9.08)     33.1807 (9.08)     33.1807 (9.08)     0.0000 (1.0)      33.1807 (9.08)     0.0000 (1.0)           0;0  0.0301 (0.11)          1           1
test_partial_remove-add-update[3.60.1]      3.6777 (1.01)      3.6777 (1.01)      3.6777 (1.01)     0.0000 (1.0)       3.6777 (1.01)     0.0000 (1.0)           0;0  0.2719 (0.99)          1           1
test_partial_remove-add-update[main]        3.6544 (1.0)       3.6544 (1.0)       3.6544 (1.0)      0.0000 (1.0)       3.6544 (1.0)      0.0000 (1.0)           0;0  0.2736 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6001 (1.0)      2.6001 (1.0)      2.6001 (1.0)      0.0000 (1.0)      2.6001 (1.0)      0.0000 (1.0)           0;0  0.3846 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5843 (1.38)     3.5843 (1.38)     3.5843 (1.38)     0.0000 (1.0)      3.5843 (1.38)     0.0000 (1.0)           0;0  0.2790 (0.73)          1           1
test_partial_remove-gc[3.53.2]     3.6234 (1.39)     3.6234 (1.39)     3.6234 (1.39)     0.0000 (1.0)      3.6234 (1.39)     0.0000 (1.0)           0;0  0.2760 (0.72)          1           1
test_partial_remove-gc[3.60.1]     3.3792 (1.30)     3.3792 (1.30)     3.3792 (1.30)     0.0000 (1.0)      3.3792 (1.30)     0.0000 (1.0)           0;0  0.2959 (0.77)          1           1
test_partial_remove-gc[main]       2.8964 (1.11)     2.8964 (1.11)     2.8964 (1.11)     0.0000 (1.0)      2.8964 (1.11)     0.0000 (1.0)           0;0  0.3453 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.5408 (1.0)      4.5408 (1.0)      4.5408 (1.0)      0.0000 (1.0)      4.5408 (1.0)      0.0000 (1.0)           0;0  0.2202 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.6416 (1.24)     5.6416 (1.24)     5.6416 (1.24)     0.0000 (1.0)      5.6416 (1.24)     0.0000 (1.0)           0;0  0.1773 (0.80)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.9245 (1.52)     6.9245 (1.52)     6.9245 (1.52)     0.0000 (1.0)      6.9245 (1.52)     0.0000 (1.0)           0;0  0.1444 (0.66)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.4914 (1.43)     6.4914 (1.43)     6.4914 (1.43)     0.0000 (1.0)      6.4914 (1.43)     0.0000 (1.0)           0;0  0.1541 (0.70)          1           1
test_partial_remove-gc-cloud[main]       5.5577 (1.22)     5.5577 (1.22)     5.5577 (1.22)     0.0000 (1.0)      5.5577 (1.22)     0.0000 (1.0)           0;0  0.1799 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     87.2924 (5.90)     87.2924 (5.90)     87.2924 (5.90)     0.0000 (1.0)      87.2924 (5.90)     0.0000 (1.0)           0;0  0.0115 (0.17)          1           1
test_partial_remove-push[3.10.0]     40.1885 (2.72)     40.1885 (2.72)     40.1885 (2.72)     0.0000 (1.0)      40.1885 (2.72)     0.0000 (1.0)           0;0  0.0249 (0.37)          1           1
test_partial_remove-push[3.53.2]     15.8922 (1.07)     15.8922 (1.07)     15.8922 (1.07)     0.0000 (1.0)      15.8922 (1.07)     0.0000 (1.0)           0;0  0.0629 (0.93)          1           1
test_partial_remove-push[3.60.1]     14.7934 (1.0)      14.7934 (1.0)      14.7934 (1.0)      0.0000 (1.0)      14.7934 (1.0)      0.0000 (1.0)           0;0  0.0676 (1.0)           1           1
test_partial_remove-push[main]       15.5458 (1.05)     15.5458 (1.05)     15.5458 (1.05)     0.0000 (1.0)      15.5458 (1.05)     0.0000 (1.0)           0;0  0.0643 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8252 (1.0)      3.8252 (1.0)      3.8252 (1.0)      0.0000 (1.0)      3.8252 (1.0)      0.0000 (1.0)           0;0  0.2614 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.9331 (1.03)     3.9331 (1.03)     3.9331 (1.03)     0.0000 (1.0)      3.9331 (1.03)     0.0000 (1.0)           0;0  0.2542 (0.97)          1           1
test_partial_remove-push-update[3.53.2]     7.1349 (1.87)     7.1349 (1.87)     7.1349 (1.87)     0.0000 (1.0)      7.1349 (1.87)     0.0000 (1.0)           0;0  0.1402 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     6.3815 (1.67)     6.3815 (1.67)     6.3815 (1.67)     0.0000 (1.0)      6.3815 (1.67)     0.0000 (1.0)           0;0  0.1567 (0.60)          1           1
test_partial_remove-push-update[main]       6.7571 (1.77)     6.7571 (1.77)     6.7571 (1.77)     0.0000 (1.0)      6.7571 (1.77)     0.0000 (1.0)           0;0  0.1480 (0.57)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     529.1665 (1.0)      541.2584 (1.0)      536.2748 (1.0)      4.5168 (1.87)     536.9135 (1.0)      5.3295 (2.70)          2;0  1.8647 (1.0)           5           3
test_plots-plots-diff[3.10.0]     973.7452 (1.84)     980.1546 (1.81)     976.0738 (1.82)     2.4095 (1.0)      975.4484 (1.82)     1.9726 (1.0)           1;1  1.0245 (0.55)          5           3
test_plots-plots-diff[3.53.2]     935.2630 (1.77)     944.0026 (1.74)     939.6227 (1.75)     3.2410 (1.35)     938.9875 (1.75)     4.0918 (2.07)          2;0  1.0643 (0.57)          5           3
test_plots-plots-diff[3.60.1]     933.6029 (1.76)     943.5698 (1.74)     940.7073 (1.75)     4.0869 (1.70)     941.5584 (1.75)     3.8632 (1.96)          1;1  1.0630 (0.57)          5           3
test_plots-plots-diff[main]       946.5950 (1.79)     954.6141 (1.76)     950.6159 (1.77)     3.2348 (1.34)     950.3127 (1.77)     5.2840 (2.68)          2;0  1.0519 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       544.6126 (1.0)        546.6320 (1.0)        545.1370 (1.0)      0.8675 (1.0)        544.6552 (1.0)      0.9139 (1.0)           1;0  1.8344 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,196.9886 (2.20)     1,209.3666 (2.21)     1,202.1899 (2.21)     5.0140 (5.78)     1,201.5619 (2.21)     7.9201 (8.67)          2;0  0.8318 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]     1,004.3201 (1.84)     1,011.5877 (1.85)     1,009.0519 (1.85)     2.8007 (3.23)     1,009.7434 (1.85)     2.8486 (3.12)          1;0  0.9910 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]     1,010.4313 (1.86)     1,016.7107 (1.86)     1,013.8116 (1.86)     2.7951 (3.22)     1,014.0882 (1.86)     5.1386 (5.62)          2;0  0.9864 (0.54)          5           3
test_plots-plots-diff-json[main]       1,021.4873 (1.88)     1,031.8812 (1.89)     1,025.9238 (1.88)     4.8065 (5.54)     1,023.9975 (1.88)     8.7324 (9.55)          1;0  0.9747 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     425.2747 (1.0)      427.9116 (1.0)      426.9240 (1.0)       1.0156 (1.0)      427.2134 (1.0)       1.2176 (1.0)           1;0  2.3423 (1.0)           5           3
test_plots-plots-show[3.10.0]     786.5910 (1.85)     802.6092 (1.88)     791.9049 (1.85)      6.7935 (6.69)     788.4984 (1.85)      9.6383 (7.92)          1;0  1.2628 (0.54)          5           3
test_plots-plots-show[3.53.2]     772.2674 (1.82)     775.0038 (1.81)     773.9051 (1.81)      1.1058 (1.09)     774.2028 (1.81)      1.6818 (1.38)          1;0  1.2921 (0.55)          5           3
test_plots-plots-show[3.60.1]     775.1015 (1.82)     778.9743 (1.82)     777.8923 (1.82)      1.6461 (1.62)     778.8297 (1.82)      1.8576 (1.53)          1;0  1.2855 (0.55)          5           3
test_plots-plots-show[main]       787.6729 (1.85)     823.6359 (1.92)     805.9198 (1.89)     16.6303 (16.37)    808.0850 (1.89)     31.5763 (25.93)         2;0  1.2408 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     441.2131 (1.0)      444.3474 (1.0)      442.9167 (1.0)      1.2674 (1.06)     443.4006 (1.0)      1.9549 (1.22)          2;0  2.2578 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     914.3434 (2.07)     918.6548 (2.07)     916.5616 (2.07)     1.8192 (1.51)     916.8381 (2.07)     3.1585 (1.97)          2;0  1.0910 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     815.8189 (1.85)     835.7307 (1.88)     822.9058 (1.86)     7.6245 (6.35)     819.9546 (1.85)     7.4055 (4.63)          1;0  1.2152 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     821.8002 (1.86)     824.9518 (1.86)     823.1725 (1.86)     1.2012 (1.0)      822.8029 (1.86)     1.5994 (1.0)           2;0  1.2148 (0.54)          5           3
test_plots-plots-show-json[main]       833.8072 (1.89)     841.9959 (1.89)     837.1788 (1.89)     3.2409 (2.70)     835.9579 (1.89)     4.6294 (2.89)          2;0  1.1945 (0.53)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     80.3599 (5.58)     80.3599 (5.58)     80.3599 (5.58)     0.0000 (1.0)      80.3599 (5.58)     0.0000 (1.0)           0;0  0.0124 (0.18)          1           1
test_push-push[3.10.0]     34.2593 (2.38)     34.2593 (2.38)     34.2593 (2.38)     0.0000 (1.0)      34.2593 (2.38)     0.0000 (1.0)           0;0  0.0292 (0.42)          1           1
test_push-push[3.53.2]     15.0043 (1.04)     15.0043 (1.04)     15.0043 (1.04)     0.0000 (1.0)      15.0043 (1.04)     0.0000 (1.0)           0;0  0.0666 (0.96)          1           1
test_push-push[3.60.1]     14.6102 (1.01)     14.6102 (1.01)     14.6102 (1.01)     0.0000 (1.0)      14.6102 (1.01)     0.0000 (1.0)           0;0  0.0684 (0.99)          1           1
test_push-push[main]       14.4088 (1.0)      14.4088 (1.0)      14.4088 (1.0)      0.0000 (1.0)      14.4088 (1.0)      0.0000 (1.0)           0;0  0.0694 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     106.1429 (4.73)     106.1429 (4.73)     106.1429 (4.73)     0.0000 (1.0)      106.1429 (4.73)     0.0000 (1.0)           0;0  0.0094 (0.21)          1           1
test_sharing-fetch[3.10.0]     110.2987 (4.92)     110.2987 (4.92)     110.2987 (4.92)     0.0000 (1.0)      110.2987 (4.92)     0.0000 (1.0)           0;0  0.0091 (0.20)          1           1
test_sharing-fetch[3.53.2]      33.2223 (1.48)      33.2223 (1.48)      33.2223 (1.48)     0.0000 (1.0)       33.2223 (1.48)     0.0000 (1.0)           0;0  0.0301 (0.68)          1           1
test_sharing-fetch[3.60.1]      22.4383 (1.0)       22.4383 (1.0)       22.4383 (1.0)      0.0000 (1.0)       22.4383 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_sharing-fetch[main]        22.4385 (1.00)      22.4385 (1.00)      22.4385 (1.00)     0.0000 (1.0)       22.4385 (1.00)     0.0000 (1.0)           0;0  0.0446 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2128 (1.0)      1.2128 (1.0)      1.2128 (1.0)      0.0000 (1.0)      1.2128 (1.0)      0.0000 (1.0)           0;0  0.8246 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5741 (2.95)     3.5741 (2.95)     3.5741 (2.95)     0.0000 (1.0)      3.5741 (2.95)     0.0000 (1.0)           0;0  0.2798 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.7411 (4.73)     5.7411 (4.73)     5.7411 (4.73)     0.0000 (1.0)      5.7411 (4.73)     0.0000 (1.0)           0;0  0.1742 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.7782 (4.76)     5.7782 (4.76)     5.7782 (4.76)     0.0000 (1.0)      5.7782 (4.76)     0.0000 (1.0)           0;0  0.1731 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8667 (4.84)     5.8667 (4.84)     5.8667 (4.84)     0.0000 (1.0)      5.8667 (4.84)     0.0000 (1.0)           0;0  0.1705 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     93.8527 (4.33)     93.8527 (4.33)     93.8527 (4.33)     0.0000 (1.0)      93.8527 (4.33)     0.0000 (1.0)           0;0  0.0107 (0.23)          1           1
test_sharing-push[3.10.0]     43.5542 (2.01)     43.5542 (2.01)     43.5542 (2.01)     0.0000 (1.0)      43.5542 (2.01)     0.0000 (1.0)           0;0  0.0230 (0.50)          1           1
test_sharing-push[3.53.2]     22.6265 (1.04)     22.6265 (1.04)     22.6265 (1.04)     0.0000 (1.0)      22.6265 (1.04)     0.0000 (1.0)           0;0  0.0442 (0.96)          1           1
test_sharing-push[3.60.1]     21.6776 (1.0)      21.6776 (1.0)      21.6776 (1.0)      0.0000 (1.0)      21.6776 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
test_sharing-push[main]       22.1319 (1.02)     22.1319 (1.02)     22.1319 (1.02)     0.0000 (1.0)      22.1319 (1.02)     0.0000 (1.0)           0;0  0.0452 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     1.9775 (1.0)      1.9775 (1.0)      1.9775 (1.0)      0.0000 (1.0)      1.9775 (1.0)      0.0000 (1.0)           0;0  0.5057 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1486 (1.09)     2.1486 (1.09)     2.1486 (1.09)     0.0000 (1.0)      2.1486 (1.09)     0.0000 (1.0)           0;0  0.4654 (0.92)          1           1
test_sharing-push-noop[3.53.2]     6.0147 (3.04)     6.0147 (3.04)     6.0147 (3.04)     0.0000 (1.0)      6.0147 (3.04)     0.0000 (1.0)           0;0  0.1663 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.1147 (3.09)     6.1147 (3.09)     6.1147 (3.09)     0.0000 (1.0)      6.1147 (3.09)     0.0000 (1.0)           0;0  0.1635 (0.32)          1           1
test_sharing-push-noop[main]       6.2217 (3.15)     6.2217 (3.15)     6.2217 (3.15)     0.0000 (1.0)      6.2217 (3.15)     0.0000 (1.0)           0;0  0.1607 (0.32)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     270.8331 (1.03)     270.8331 (1.03)     270.8331 (1.03)     0.0000 (1.0)      270.8331 (1.03)     0.0000 (1.0)           0;0  0.0037 (0.97)          1           1
test_sharing_azure-fetch[main]       263.3359 (1.0)      263.3359 (1.0)      263.3359 (1.0)      0.0000 (1.0)      263.3359 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.6354 (1.0)      6.6354 (1.0)      6.6354 (1.0)      0.0000 (1.0)      6.6354 (1.0)      0.0000 (1.0)           0;0  0.1507 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.8248 (1.03)     6.8248 (1.03)     6.8248 (1.03)     0.0000 (1.0)      6.8248 (1.03)     0.0000 (1.0)           0;0  0.1465 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     267.8673 (1.0)      267.8673 (1.0)      267.8673 (1.0)      0.0000 (1.0)      267.8673 (1.0)      0.0000 (1.0)           0;0  0.0037 (1.0)           1           1
test_sharing_azure-push[main]       274.4443 (1.02)     274.4443 (1.02)     274.4443 (1.02)     0.0000 (1.0)      274.4443 (1.02)     0.0000 (1.0)           0;0  0.0036 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.2015 (1.00)     7.2015 (1.00)     7.2015 (1.00)     0.0000 (1.0)      7.2015 (1.00)     0.0000 (1.0)           0;0  0.1389 (1.00)          1           1
test_sharing_azure-push-noop[main]       7.1807 (1.0)      7.1807 (1.0)      7.1807 (1.0)      0.0000 (1.0)      7.1807 (1.0)      0.0000 (1.0)           0;0  0.1393 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.8503 (3.61)     20.8503 (3.61)     20.8503 (3.61)     0.0000 (1.0)      20.8503 (3.61)     0.0000 (1.0)           0;0  0.0480 (0.28)          1           1
test_status-status[3.10.0]     21.9791 (3.81)     21.9791 (3.81)     21.9791 (3.81)     0.0000 (1.0)      21.9791 (3.81)     0.0000 (1.0)           0;0  0.0455 (0.26)          1           1
test_status-status[3.53.2]     19.5232 (3.38)     19.5232 (3.38)     19.5232 (3.38)     0.0000 (1.0)      19.5232 (3.38)     0.0000 (1.0)           0;0  0.0512 (0.30)          1           1
test_status-status[3.60.1]      5.7697 (1.0)       5.7697 (1.0)       5.7697 (1.0)      0.0000 (1.0)       5.7697 (1.0)      0.0000 (1.0)           0;0  0.1733 (1.0)           1           1
test_status-status[main]        5.8661 (1.02)      5.8661 (1.02)      5.8661 (1.02)     0.0000 (1.0)       5.8661 (1.02)     0.0000 (1.0)           0;0  0.1705 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.2097 (1.72)     5.2097 (1.72)     5.2097 (1.72)     0.0000 (1.0)      5.2097 (1.72)     0.0000 (1.0)           0;0  0.1919 (0.58)          1           1
test_status-status-changed[3.10.0]     5.4879 (1.81)     5.4879 (1.81)     5.4879 (1.81)     0.0000 (1.0)      5.4879 (1.81)     0.0000 (1.0)           0;0  0.1822 (0.55)          1           1
test_status-status-changed[3.53.2]     5.4274 (1.79)     5.4274 (1.79)     5.4274 (1.79)     0.0000 (1.0)      5.4274 (1.79)     0.0000 (1.0)           0;0  0.1843 (0.56)          1           1
test_status-status-changed[3.60.1]     3.0378 (1.00)     3.0378 (1.00)     3.0378 (1.00)     0.0000 (1.0)      3.0378 (1.00)     0.0000 (1.0)           0;0  0.3292 (1.00)          1           1
test_status-status-changed[main]       3.0291 (1.0)      3.0291 (1.0)      3.0291 (1.0)      0.0000 (1.0)      3.0291 (1.0)      0.0000 (1.0)           0;0  0.3301 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.2203 (1.79)     5.2203 (1.79)     5.2203 (1.79)     0.0000 (1.0)      5.2203 (1.79)     0.0000 (1.0)           0;0  0.1916 (0.56)          1           1
test_status-status-changed-noop[3.10.0]     5.4369 (1.87)     5.4369 (1.87)     5.4369 (1.87)     0.0000 (1.0)      5.4369 (1.87)     0.0000 (1.0)           0;0  0.1839 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     5.2443 (1.80)     5.2443 (1.80)     5.2443 (1.80)     0.0000 (1.0)      5.2443 (1.80)     0.0000 (1.0)           0;0  0.1907 (0.56)          1           1
test_status-status-changed-noop[3.60.1]     2.9144 (1.0)      2.9144 (1.0)      2.9144 (1.0)      0.0000 (1.0)      2.9144 (1.0)      0.0000 (1.0)           0;0  0.3431 (1.0)           1           1
test_status-status-changed-noop[main]       2.9295 (1.01)     2.9295 (1.01)     2.9295 (1.01)     0.0000 (1.0)      2.9295 (1.01)     0.0000 (1.0)           0;0  0.3414 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1634 (1.87)     5.1634 (1.87)     5.1634 (1.87)     0.0000 (1.0)      5.1634 (1.87)     0.0000 (1.0)           0;0  0.1937 (0.53)          1           1
test_status-status-noop[3.10.0]     5.5553 (2.02)     5.5553 (2.02)     5.5553 (2.02)     0.0000 (1.0)      5.5553 (2.02)     0.0000 (1.0)           0;0  0.1800 (0.50)          1           1
test_status-status-noop[3.53.2]     5.2850 (1.92)     5.2850 (1.92)     5.2850 (1.92)     0.0000 (1.0)      5.2850 (1.92)     0.0000 (1.0)           0;0  0.1892 (0.52)          1           1
test_status-status-noop[3.60.1]     2.7547 (1.0)      2.7547 (1.0)      2.7547 (1.0)      0.0000 (1.0)      2.7547 (1.0)      0.0000 (1.0)           0;0  0.3630 (1.0)           1           1
test_status-status-noop[main]       2.9047 (1.05)     2.9047 (1.05)     2.9047 (1.05)     0.0000 (1.0)      2.9047 (1.05)     0.0000 (1.0)           0;0  0.3443 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     198.2563 (4.28)     198.2563 (4.28)     198.2563 (4.28)     0.0000 (1.0)      198.2563 (4.28)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.10.0]     201.9062 (4.36)     201.9062 (4.36)     201.9062 (4.36)     0.0000 (1.0)      201.9062 (4.36)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.53.2]     116.7048 (2.52)     116.7048 (2.52)     116.7048 (2.52)     0.0000 (1.0)      116.7048 (2.52)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.2856 (1.0)       46.2856 (1.0)       46.2856 (1.0)      0.0000 (1.0)       46.2856 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        47.1159 (1.02)      47.1159 (1.02)      47.1159 (1.02)     0.0000 (1.0)       47.1159 (1.02)     0.0000 (1.0)           0;0  0.0212 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     183.3568 (5.22)     183.3568 (5.22)     183.3568 (5.22)     0.0000 (1.0)      183.3568 (5.22)     0.0000 (1.0)           0;0  0.0055 (0.19)          1           1
test_update-update[3.10.0]     187.5268 (5.34)     187.5268 (5.34)     187.5268 (5.34)     0.0000 (1.0)      187.5268 (5.34)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.53.2]     108.6550 (3.09)     108.6550 (3.09)     108.6550 (3.09)     0.0000 (1.0)      108.6550 (3.09)     0.0000 (1.0)           0;0  0.0092 (0.32)          1           1
test_update-update[3.60.1]      35.1188 (1.0)       35.1188 (1.0)       35.1188 (1.0)      0.0000 (1.0)       35.1188 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
test_update-update[main]        35.7911 (1.02)      35.7911 (1.02)      35.7911 (1.02)     0.0000 (1.0)       35.7911 (1.02)     0.0000 (1.0)           0;0  0.0279 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.0043 (2.22)     17.0043 (2.22)     17.0043 (2.22)     0.0000 (1.0)      17.0043 (2.22)     0.0000 (1.0)           0;0  0.0588 (0.45)          1           1
test_update-update-noop[3.10.0]     18.1852 (2.38)     18.1852 (2.38)     18.1852 (2.38)     0.0000 (1.0)      18.1852 (2.38)     0.0000 (1.0)           0;0  0.0550 (0.42)          1           1
test_update-update-noop[3.53.2]     17.0476 (2.23)     17.0476 (2.23)     17.0476 (2.23)     0.0000 (1.0)      17.0476 (2.23)     0.0000 (1.0)           0;0  0.0587 (0.45)          1           1
test_update-update-noop[3.60.1]      7.6433 (1.0)       7.6433 (1.0)       7.6433 (1.0)      0.0000 (1.0)       7.6433 (1.0)      0.0000 (1.0)           0;0  0.1308 (1.0)           1           1
test_update-update-noop[main]        8.1741 (1.07)      8.1741 (1.07)      8.1741 (1.07)     0.0000 (1.0)       8.1741 (1.07)     0.0000 (1.0)           0;0  0.1223 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean