Thu Feb 12 00:57:15 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.3640 (3.76)     84.3640 (3.76)     84.3640 (3.76)     0.0000 (1.0)      84.3640 (3.76)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_add_copy-add[3.10.0]     83.7460 (3.74)     83.7460 (3.74)     83.7460 (3.74)     0.0000 (1.0)      83.7460 (3.74)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_add_copy-add[3.53.2]     75.6074 (3.37)     75.6074 (3.37)     75.6074 (3.37)     0.0000 (1.0)      75.6074 (3.37)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_add_copy-add[3.60.1]     22.4179 (1.0)      22.4179 (1.0)      22.4179 (1.0)      0.0000 (1.0)      22.4179 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_add_copy-add[main]       23.5220 (1.05)     23.5220 (1.05)     23.5220 (1.05)     0.0000 (1.0)      23.5220 (1.05)     0.0000 (1.0)           0;0  0.0425 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.4747 (6.58)     27.4747 (6.58)     27.4747 (6.58)     0.0000 (1.0)      27.4747 (6.58)     0.0000 (1.0)           0;0  0.0364 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.1340 (6.74)     28.1340 (6.74)     28.1340 (6.74)     0.0000 (1.0)      28.1340 (6.74)     0.0000 (1.0)           0;0  0.0355 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.7231 (6.40)     26.7231 (6.40)     26.7231 (6.40)     0.0000 (1.0)      26.7231 (6.40)     0.0000 (1.0)           0;0  0.0374 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.1733 (1.0)       4.1733 (1.0)       4.1733 (1.0)      0.0000 (1.0)       4.1733 (1.0)      0.0000 (1.0)           0;0  0.2396 (1.0)           1           1
test_add_copy-add-noop[main]        4.4746 (1.07)      4.4746 (1.07)      4.4746 (1.07)     0.0000 (1.0)       4.4746 (1.07)     0.0000 (1.0)           0;0  0.2235 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     62.9719 (3.87)     62.9719 (3.87)     62.9719 (3.87)     0.0000 (1.0)      62.9719 (3.87)     0.0000 (1.0)           0;0  0.0159 (0.26)          1           1
test_add_hardlink-add[3.10.0]     64.3203 (3.95)     64.3203 (3.95)     64.3203 (3.95)     0.0000 (1.0)      64.3203 (3.95)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.53.2]     57.7988 (3.55)     57.7988 (3.55)     57.7988 (3.55)     0.0000 (1.0)      57.7988 (3.55)     0.0000 (1.0)           0;0  0.0173 (0.28)          1           1
test_add_hardlink-add[3.60.1]     16.2753 (1.0)      16.2753 (1.0)      16.2753 (1.0)      0.0000 (1.0)      16.2753 (1.0)      0.0000 (1.0)           0;0  0.0614 (1.0)           1           1
test_add_hardlink-add[main]       17.1568 (1.05)     17.1568 (1.05)     17.1568 (1.05)     0.0000 (1.0)      17.1568 (1.05)     0.0000 (1.0)           0;0  0.0583 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     31.7040 (7.44)     31.7040 (7.44)     31.7040 (7.44)     0.0000 (1.0)      31.7040 (7.44)     0.0000 (1.0)           0;0  0.0315 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     32.1266 (7.54)     32.1266 (7.54)     32.1266 (7.54)     0.0000 (1.0)      32.1266 (7.54)     0.0000 (1.0)           0;0  0.0311 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     30.1371 (7.07)     30.1371 (7.07)     30.1371 (7.07)     0.0000 (1.0)      30.1371 (7.07)     0.0000 (1.0)           0;0  0.0332 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2633 (1.0)       4.2633 (1.0)       4.2633 (1.0)      0.0000 (1.0)       4.2633 (1.0)      0.0000 (1.0)           0;0  0.2346 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.5105 (1.06)      4.5105 (1.06)      4.5105 (1.06)     0.0000 (1.0)       4.5105 (1.06)     0.0000 (1.0)           0;0  0.2217 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     65.1982 (1.81)     65.1982 (1.81)     65.1982 (1.81)     0.0000 (1.0)      65.1982 (1.81)     0.0000 (1.0)           0;0  0.0153 (0.55)          1           1
test_add_symlink-add[3.10.0]     66.7946 (1.85)     66.7946 (1.85)     66.7946 (1.85)     0.0000 (1.0)      66.7946 (1.85)     0.0000 (1.0)           0;0  0.0150 (0.54)          1           1
test_add_symlink-add[3.53.2]     60.8733 (1.69)     60.8733 (1.69)     60.8733 (1.69)     0.0000 (1.0)      60.8733 (1.69)     0.0000 (1.0)           0;0  0.0164 (0.59)          1           1
test_add_symlink-add[3.60.1]     36.0683 (1.0)      36.0683 (1.0)      36.0683 (1.0)      0.0000 (1.0)      36.0683 (1.0)      0.0000 (1.0)           0;0  0.0277 (1.0)           1           1
test_add_symlink-add[main]       37.7813 (1.05)     37.7813 (1.05)     37.7813 (1.05)     0.0000 (1.0)      37.7813 (1.05)     0.0000 (1.0)           0;0  0.0265 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     44.3017 (8.03)     44.3017 (8.03)     44.3017 (8.03)     0.0000 (1.0)      44.3017 (8.03)     0.0000 (1.0)           0;0  0.0226 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.4025 (8.23)     45.4025 (8.23)     45.4025 (8.23)     0.0000 (1.0)      45.4025 (8.23)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     43.1882 (7.83)     43.1882 (7.83)     43.1882 (7.83)     0.0000 (1.0)      43.1882 (7.83)     0.0000 (1.0)           0;0  0.0232 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.5139 (1.0)       5.5139 (1.0)       5.5139 (1.0)      0.0000 (1.0)       5.5139 (1.0)      0.0000 (1.0)           0;0  0.1814 (1.0)           1           1
test_add_symlink-add-noop[main]        5.8770 (1.07)      5.8770 (1.07)      5.8770 (1.07)     0.0000 (1.0)       5.8770 (1.07)     0.0000 (1.0)           0;0  0.1702 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.0812 (1.87)     39.0812 (1.87)     39.0812 (1.87)     0.0000 (1.0)      39.0812 (1.87)     0.0000 (1.0)           0;0  0.0256 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     99.2249 (4.75)     99.2249 (4.75)     99.2249 (4.75)     0.0000 (1.0)      99.2249 (4.75)     0.0000 (1.0)           0;0  0.0101 (0.21)          1           1
test_checkout_copy-checkout[3.53.2]     27.8255 (1.33)     27.8255 (1.33)     27.8255 (1.33)     0.0000 (1.0)      27.8255 (1.33)     0.0000 (1.0)           0;0  0.0359 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.8920 (1.0)      20.8920 (1.0)      20.8920 (1.0)      0.0000 (1.0)      20.8920 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]       21.7120 (1.04)     21.7120 (1.04)     21.7120 (1.04)     0.0000 (1.0)      21.7120 (1.04)     0.0000 (1.0)           0;0  0.0461 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3914 (1.69)     5.3914 (1.69)     5.3914 (1.69)     0.0000 (1.0)      5.3914 (1.69)     0.0000 (1.0)           0;0  0.1855 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.5976 (1.76)     5.5976 (1.76)     5.5976 (1.76)     0.0000 (1.0)      5.5976 (1.76)     0.0000 (1.0)           0;0  0.1786 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5666 (1.75)     5.5666 (1.75)     5.5666 (1.75)     0.0000 (1.0)      5.5666 (1.75)     0.0000 (1.0)           0;0  0.1796 (0.57)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.1881 (1.0)      3.1881 (1.0)      3.1881 (1.0)      0.0000 (1.0)      3.1881 (1.0)      0.0000 (1.0)           0;0  0.3137 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3709 (1.06)     3.3709 (1.06)     3.3709 (1.06)     0.0000 (1.0)      3.3709 (1.06)     0.0000 (1.0)           0;0  0.2967 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.3899 (1.92)     7.3899 (1.92)     7.3899 (1.92)     0.0000 (1.0)      7.3899 (1.92)     0.0000 (1.0)           0;0  0.1353 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.2802 (1.63)     6.2802 (1.63)     6.2802 (1.63)     0.0000 (1.0)      6.2802 (1.63)     0.0000 (1.0)           0;0  0.1592 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2881 (1.64)     6.2881 (1.64)     6.2881 (1.64)     0.0000 (1.0)      6.2881 (1.64)     0.0000 (1.0)           0;0  0.1590 (0.61)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8455 (1.0)      3.8455 (1.0)      3.8455 (1.0)      0.0000 (1.0)      3.8455 (1.0)      0.0000 (1.0)           0;0  0.2600 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.2508 (1.11)     4.2508 (1.11)     4.2508 (1.11)     0.0000 (1.0)      4.2508 (1.11)     0.0000 (1.0)           0;0  0.2353 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.5411 (2.90)     21.5411 (2.90)     21.5411 (2.90)     0.0000 (1.0)      21.5411 (2.90)     0.0000 (1.0)           0;0  0.0464 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.2861 (2.19)     16.2861 (2.19)     16.2861 (2.19)     0.0000 (1.0)      16.2861 (2.19)     0.0000 (1.0)           0;0  0.0614 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.5006 (1.95)     14.5006 (1.95)     14.5006 (1.95)     0.0000 (1.0)      14.5006 (1.95)     0.0000 (1.0)           0;0  0.0690 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4316 (1.0)       7.4316 (1.0)       7.4316 (1.0)      0.0000 (1.0)       7.4316 (1.0)      0.0000 (1.0)           0;0  0.1346 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1288 (1.09)      8.1288 (1.09)      8.1288 (1.09)     0.0000 (1.0)       8.1288 (1.09)     0.0000 (1.0)           0;0  0.1230 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4468 (1.69)     5.4468 (1.69)     5.4468 (1.69)     0.0000 (1.0)      5.4468 (1.69)     0.0000 (1.0)           0;0  0.1836 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7649 (1.79)     5.7649 (1.79)     5.7649 (1.79)     0.0000 (1.0)      5.7649 (1.79)     0.0000 (1.0)           0;0  0.1735 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4932 (1.70)     5.4932 (1.70)     5.4932 (1.70)     0.0000 (1.0)      5.4932 (1.70)     0.0000 (1.0)           0;0  0.1820 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2265 (1.0)      3.2265 (1.0)      3.2265 (1.0)      0.0000 (1.0)      3.2265 (1.0)      0.0000 (1.0)           0;0  0.3099 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4791 (1.08)     3.4791 (1.08)     3.4791 (1.08)     0.0000 (1.0)      3.4791 (1.08)     0.0000 (1.0)           0;0  0.2874 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6332 (1.98)     7.6332 (1.98)     7.6332 (1.98)     0.0000 (1.0)      7.6332 (1.98)     0.0000 (1.0)           0;0  0.1310 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5755 (1.71)     6.5755 (1.71)     6.5755 (1.71)     0.0000 (1.0)      6.5755 (1.71)     0.0000 (1.0)           0;0  0.1521 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2713 (1.63)     6.2713 (1.63)     6.2713 (1.63)     0.0000 (1.0)      6.2713 (1.63)     0.0000 (1.0)           0;0  0.1595 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8470 (1.0)      3.8470 (1.0)      3.8470 (1.0)      0.0000 (1.0)      3.8470 (1.0)      0.0000 (1.0)           0;0  0.2599 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3160 (1.12)     4.3160 (1.12)     4.3160 (1.12)     0.0000 (1.0)      4.3160 (1.12)     0.0000 (1.0)           0;0  0.2317 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.7090 (2.30)     24.7090 (2.30)     24.7090 (2.30)     0.0000 (1.0)      24.7090 (2.30)     0.0000 (1.0)           0;0  0.0405 (0.43)          1           1
test_checkout_symlink-checkout[3.10.0]     19.5269 (1.82)     19.5269 (1.82)     19.5269 (1.82)     0.0000 (1.0)      19.5269 (1.82)     0.0000 (1.0)           0;0  0.0512 (0.55)          1           1
test_checkout_symlink-checkout[3.53.2]     17.6415 (1.65)     17.6415 (1.65)     17.6415 (1.65)     0.0000 (1.0)      17.6415 (1.65)     0.0000 (1.0)           0;0  0.0567 (0.61)          1           1
test_checkout_symlink-checkout[3.60.1]     10.7231 (1.0)      10.7231 (1.0)      10.7231 (1.0)      0.0000 (1.0)      10.7231 (1.0)      0.0000 (1.0)           0;0  0.0933 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.6995 (1.09)     11.6995 (1.09)     11.6995 (1.09)     0.0000 (1.0)      11.6995 (1.09)     0.0000 (1.0)           0;0  0.0855 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6657 (1.61)     6.6657 (1.61)     6.6657 (1.61)     0.0000 (1.0)      6.6657 (1.61)     0.0000 (1.0)           0;0  0.1500 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8853 (1.66)     6.8853 (1.66)     6.8853 (1.66)     0.0000 (1.0)      6.8853 (1.66)     0.0000 (1.0)           0;0  0.1452 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.5782 (1.59)     6.5782 (1.59)     6.5782 (1.59)     0.0000 (1.0)      6.5782 (1.59)     0.0000 (1.0)           0;0  0.1520 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1499 (1.0)      4.1499 (1.0)      4.1499 (1.0)      0.0000 (1.0)      4.1499 (1.0)      0.0000 (1.0)           0;0  0.2410 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4355 (1.07)     4.4355 (1.07)     4.4355 (1.07)     0.0000 (1.0)      4.4355 (1.07)     0.0000 (1.0)           0;0  0.2255 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.6782 (1.69)     9.6782 (1.69)     9.6782 (1.69)     0.0000 (1.0)      9.6782 (1.69)     0.0000 (1.0)           0;0  0.1033 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.6577 (1.51)     8.6577 (1.51)     8.6577 (1.51)     0.0000 (1.0)      8.6577 (1.51)     0.0000 (1.0)           0;0  0.1155 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.4655 (1.48)     8.4655 (1.48)     8.4655 (1.48)     0.0000 (1.0)      8.4655 (1.48)     0.0000 (1.0)           0;0  0.1181 (0.68)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.7298 (1.0)      5.7298 (1.0)      5.7298 (1.0)      0.0000 (1.0)      5.7298 (1.0)      0.0000 (1.0)           0;0  0.1745 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.3622 (1.11)     6.3622 (1.11)     6.3622 (1.11)     0.0000 (1.0)      6.3622 (1.11)     0.0000 (1.0)           0;0  0.1572 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9528 (1.73)     3.9528 (1.73)     3.9528 (1.73)     0.0000 (1.0)      3.9528 (1.73)     0.0000 (1.0)           0;0  0.2530 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.8742 (2.13)     4.8742 (2.13)     4.8742 (2.13)     0.0000 (1.0)      4.8742 (2.13)     0.0000 (1.0)           0;0  0.2052 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.7765 (2.09)     4.7765 (2.09)     4.7765 (2.09)     0.0000 (1.0)      4.7765 (2.09)     0.0000 (1.0)           0;0  0.2094 (0.48)          1           1
test_data_status-data-changed[3.60.1]     2.2901 (1.0)      2.2901 (1.0)      2.2901 (1.0)      0.0000 (1.0)      2.2901 (1.0)      0.0000 (1.0)           0;0  0.4367 (1.0)           1           1
test_data_status-data-changed[main]       2.5078 (1.10)     2.5078 (1.10)     2.5078 (1.10)     0.0000 (1.0)      2.5078 (1.10)     0.0000 (1.0)           0;0  0.3988 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9657 (1.73)     3.9657 (1.73)     3.9657 (1.73)     0.0000 (1.0)      3.9657 (1.73)     0.0000 (1.0)           0;0  0.2522 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9015 (2.13)     4.9015 (2.13)     4.9015 (2.13)     0.0000 (1.0)      4.9015 (2.13)     0.0000 (1.0)           0;0  0.2040 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7921 (2.08)     4.7921 (2.08)     4.7921 (2.08)     0.0000 (1.0)      4.7921 (2.08)     0.0000 (1.0)           0;0  0.2087 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2985 (1.0)      2.2985 (1.0)      2.2985 (1.0)      0.0000 (1.0)      2.2985 (1.0)      0.0000 (1.0)           0;0  0.4351 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5621 (1.11)     2.5621 (1.11)     2.5621 (1.11)     0.0000 (1.0)      2.5621 (1.11)     0.0000 (1.0)           0;0  0.3903 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.6498 (3.94)     18.6498 (3.94)     18.6498 (3.94)     0.0000 (1.0)      18.6498 (3.94)     0.0000 (1.0)           0;0  0.0536 (0.25)          1           1
test_data_status-data-new[3.10.0]     19.5509 (4.13)     19.5509 (4.13)     19.5509 (4.13)     0.0000 (1.0)      19.5509 (4.13)     0.0000 (1.0)           0;0  0.0511 (0.24)          1           1
test_data_status-data-new[3.53.2]     18.7991 (3.97)     18.7991 (3.97)     18.7991 (3.97)     0.0000 (1.0)      18.7991 (3.97)     0.0000 (1.0)           0;0  0.0532 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.7336 (1.0)       4.7336 (1.0)       4.7336 (1.0)      0.0000 (1.0)       4.7336 (1.0)      0.0000 (1.0)           0;0  0.2113 (1.0)           1           1
test_data_status-data-new[main]        5.0056 (1.06)      5.0056 (1.06)      5.0056 (1.06)     0.0000 (1.0)       5.0056 (1.06)     0.0000 (1.0)           0;0  0.1998 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1220 (1.79)     4.1220 (1.79)     4.1220 (1.79)     0.0000 (1.0)      4.1220 (1.79)     0.0000 (1.0)           0;0  0.2426 (0.56)          1           1
test_data_status-data-noop[3.10.0]     5.0203 (2.18)     5.0203 (2.18)     5.0203 (2.18)     0.0000 (1.0)      5.0203 (2.18)     0.0000 (1.0)           0;0  0.1992 (0.46)          1           1
test_data_status-data-noop[3.53.2]     4.9305 (2.14)     4.9305 (2.14)     4.9305 (2.14)     0.0000 (1.0)      4.9305 (2.14)     0.0000 (1.0)           0;0  0.2028 (0.47)          1           1
test_data_status-data-noop[3.60.1]     2.3078 (1.0)      2.3078 (1.0)      2.3078 (1.0)      0.0000 (1.0)      2.3078 (1.0)      0.0000 (1.0)           0;0  0.4333 (1.0)           1           1
test_data_status-data-noop[main]       2.5374 (1.10)     2.5374 (1.10)     2.5374 (1.10)     0.0000 (1.0)      2.5374 (1.10)     0.0000 (1.0)           0;0  0.3941 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.5202 (1.27)     6.5202 (1.27)     6.5202 (1.27)     0.0000 (1.0)      6.5202 (1.27)     0.0000 (1.0)           0;0  0.1534 (0.79)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.4214 (1.44)     7.4214 (1.44)     7.4214 (1.44)     0.0000 (1.0)      7.4214 (1.44)     0.0000 (1.0)           0;0  0.1347 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5437 (1.47)     7.5437 (1.47)     7.5437 (1.47)     0.0000 (1.0)      7.5437 (1.47)     0.0000 (1.0)           0;0  0.1326 (0.68)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.1436 (1.0)      5.1436 (1.0)      5.1436 (1.0)      0.0000 (1.0)      5.1436 (1.0)      0.0000 (1.0)           0;0  0.1944 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.4293 (1.06)     5.4293 (1.06)     5.4293 (1.06)     0.0000 (1.0)      5.4293 (1.06)     0.0000 (1.0)           0;0  0.1842 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.5579 (1.24)     6.5579 (1.24)     6.5579 (1.24)     0.0000 (1.0)      6.5579 (1.24)     0.0000 (1.0)           0;0  0.1525 (0.81)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.5274 (1.42)     7.5274 (1.42)     7.5274 (1.42)     0.0000 (1.0)      7.5274 (1.42)     0.0000 (1.0)           0;0  0.1328 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.4705 (1.41)     7.4705 (1.41)     7.4705 (1.41)     0.0000 (1.0)      7.4705 (1.41)     0.0000 (1.0)           0;0  0.1339 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.2894 (1.0)      5.2894 (1.0)      5.2894 (1.0)      0.0000 (1.0)      5.2894 (1.0)      0.0000 (1.0)           0;0  0.1891 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.4360 (1.03)     5.4360 (1.03)     5.4360 (1.03)     0.0000 (1.0)      5.4360 (1.03)     0.0000 (1.0)           0;0  0.1840 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.6980 (2.72)     20.6980 (2.72)     20.6980 (2.72)     0.0000 (1.0)      20.6980 (2.72)     0.0000 (1.0)           0;0  0.0483 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0252 (2.89)     22.0252 (2.89)     22.0252 (2.89)     0.0000 (1.0)      22.0252 (2.89)     0.0000 (1.0)           0;0  0.0454 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.4390 (2.82)     21.4390 (2.82)     21.4390 (2.82)     0.0000 (1.0)      21.4390 (2.82)     0.0000 (1.0)           0;0  0.0466 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.6114 (1.0)       7.6114 (1.0)       7.6114 (1.0)      0.0000 (1.0)       7.6114 (1.0)      0.0000 (1.0)           0;0  0.1314 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2088 (1.08)      8.2088 (1.08)      8.2088 (1.08)     0.0000 (1.0)       8.2088 (1.08)     0.0000 (1.0)           0;0  0.1218 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.1275 (1.36)     6.1275 (1.36)     6.1275 (1.36)     0.0000 (1.0)      6.1275 (1.36)     0.0000 (1.0)           0;0  0.1632 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0393 (1.56)     7.0393 (1.56)     7.0393 (1.56)     0.0000 (1.0)      7.0393 (1.56)     0.0000 (1.0)           0;0  0.1421 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0093 (1.56)     7.0093 (1.56)     7.0093 (1.56)     0.0000 (1.0)      7.0093 (1.56)     0.0000 (1.0)           0;0  0.1427 (0.64)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5026 (1.0)      4.5026 (1.0)      4.5026 (1.0)      0.0000 (1.0)      4.5026 (1.0)      0.0000 (1.0)           0;0  0.2221 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.8893 (1.09)     4.8893 (1.09)     4.8893 (1.09)     0.0000 (1.0)      4.8893 (1.09)     0.0000 (1.0)           0;0  0.2045 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0767 (2.71)     18.0767 (2.71)     18.0767 (2.71)     0.0000 (1.0)      18.0767 (2.71)     0.0000 (1.0)           0;0  0.0553 (0.37)          1           1
test_diff-diff[3.10.0]     20.0902 (3.01)     20.0902 (3.01)     20.0902 (3.01)     0.0000 (1.0)      20.0902 (3.01)     0.0000 (1.0)           0;0  0.0498 (0.33)          1           1
test_diff-diff[3.53.2]     19.2189 (2.88)     19.2189 (2.88)     19.2189 (2.88)     0.0000 (1.0)      19.2189 (2.88)     0.0000 (1.0)           0;0  0.0520 (0.35)          1           1
test_diff-diff[3.60.1]      6.6690 (1.0)       6.6690 (1.0)       6.6690 (1.0)      0.0000 (1.0)       6.6690 (1.0)      0.0000 (1.0)           0;0  0.1499 (1.0)           1           1
test_diff-diff[main]        7.5911 (1.14)      7.5911 (1.14)      7.5911 (1.14)     0.0000 (1.0)       7.5911 (1.14)     0.0000 (1.0)           0;0  0.1317 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.8910 (1.78)     5.8910 (1.78)     5.8910 (1.78)     0.0000 (1.0)      5.8910 (1.78)     0.0000 (1.0)           0;0  0.1698 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.9003 (2.09)     6.9003 (2.09)     6.9003 (2.09)     0.0000 (1.0)      6.9003 (2.09)     0.0000 (1.0)           0;0  0.1449 (0.48)          1           1
test_diff-diff-changed[3.53.2]     5.8117 (1.76)     5.8117 (1.76)     5.8117 (1.76)     0.0000 (1.0)      5.8117 (1.76)     0.0000 (1.0)           0;0  0.1721 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.3009 (1.0)      3.3009 (1.0)      3.3009 (1.0)      0.0000 (1.0)      3.3009 (1.0)      0.0000 (1.0)           0;0  0.3029 (1.0)           1           1
test_diff-diff-changed[main]       4.0740 (1.23)     4.0740 (1.23)     4.0740 (1.23)     0.0000 (1.0)      4.0740 (1.23)     0.0000 (1.0)           0;0  0.2455 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0725 (1.48)     5.0725 (1.48)     5.0725 (1.48)     0.0000 (1.0)      5.0725 (1.48)     0.0000 (1.0)           0;0  0.1971 (0.68)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8753 (1.71)     5.8753 (1.71)     5.8753 (1.71)     0.0000 (1.0)      5.8753 (1.71)     0.0000 (1.0)           0;0  0.1702 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6395 (1.64)     5.6395 (1.64)     5.6395 (1.64)     0.0000 (1.0)      5.6395 (1.64)     0.0000 (1.0)           0;0  0.1773 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4285 (1.0)      3.4285 (1.0)      3.4285 (1.0)      0.0000 (1.0)      3.4285 (1.0)      0.0000 (1.0)           0;0  0.2917 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0855 (1.19)     4.0855 (1.19)     4.0855 (1.19)     0.0000 (1.0)      4.0855 (1.19)     0.0000 (1.0)           0;0  0.2448 (0.84)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2096 (1.27)     4.2096 (1.27)     4.2096 (1.27)     0.0000 (1.0)      4.2096 (1.27)     0.0000 (1.0)           0;0  0.2376 (0.79)          1           1
test_diff-diff-noop[3.10.0]     5.0346 (1.52)     5.0346 (1.52)     5.0346 (1.52)     0.0000 (1.0)      5.0346 (1.52)     0.0000 (1.0)           0;0  0.1986 (0.66)          1           1
test_diff-diff-noop[3.53.2]     5.6938 (1.72)     5.6938 (1.72)     5.6938 (1.72)     0.0000 (1.0)      5.6938 (1.72)     0.0000 (1.0)           0;0  0.1756 (0.58)          1           1
test_diff-diff-noop[3.60.1]     3.3078 (1.0)      3.3078 (1.0)      3.3078 (1.0)      0.0000 (1.0)      3.3078 (1.0)      0.0000 (1.0)           0;0  0.3023 (1.0)           1           1
test_diff-diff-noop[main]       4.0636 (1.23)     4.0636 (1.23)     4.0636 (1.23)     0.0000 (1.0)      4.0636 (1.23)     0.0000 (1.0)           0;0  0.2461 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.1847 (1.0)       1.1847 (1.0)       1.1847 (1.0)      0.0000 (1.0)       1.1847 (1.0)      0.0000 (1.0)           0;0  0.8441 (1.0)           1           1
test_exp_show-exp[3.10.0]     15.9271 (13.44)    15.9271 (13.44)    15.9271 (13.44)    0.0000 (1.0)      15.9271 (13.44)    0.0000 (1.0)           0;0  0.0628 (0.07)          1           1
test_exp_show-exp[3.53.2]      9.4591 (7.98)      9.4591 (7.98)      9.4591 (7.98)     0.0000 (1.0)       9.4591 (7.98)     0.0000 (1.0)           0;0  0.1057 (0.13)          1           1
test_exp_show-exp[3.60.1]      9.1996 (7.77)      9.1996 (7.77)      9.1996 (7.77)     0.0000 (1.0)       9.1996 (7.77)     0.0000 (1.0)           0;0  0.1087 (0.13)          1           1
test_exp_show-exp[main]       12.4132 (10.48)    12.4132 (10.48)    12.4132 (10.48)    0.0000 (1.0)      12.4132 (10.48)    0.0000 (1.0)           0;0  0.0806 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     107.7776 (4.55)     107.7776 (4.55)     107.7776 (4.55)     0.0000 (1.0)      107.7776 (4.55)     0.0000 (1.0)           0;0  0.0093 (0.22)          1           1
test_fetch-fetch[3.10.0]     112.8711 (4.77)     112.8711 (4.77)     112.8711 (4.77)     0.0000 (1.0)      112.8711 (4.77)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_fetch-fetch[3.53.2]      35.7324 (1.51)      35.7324 (1.51)      35.7324 (1.51)     0.0000 (1.0)       35.7324 (1.51)     0.0000 (1.0)           0;0  0.0280 (0.66)          1           1
test_fetch-fetch[3.60.1]      24.1663 (1.02)      24.1663 (1.02)      24.1663 (1.02)     0.0000 (1.0)       24.1663 (1.02)     0.0000 (1.0)           0;0  0.0414 (0.98)          1           1
test_fetch-fetch[main]        23.6807 (1.0)       23.6807 (1.0)       23.6807 (1.0)      0.0000 (1.0)       23.6807 (1.0)      0.0000 (1.0)           0;0  0.0422 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.0215 (1.0)      2.0215 (1.0)      2.0215 (1.0)      0.0000 (1.0)      2.0215 (1.0)      0.0000 (1.0)           0;0  0.4947 (1.0)           1           1
test_gc-gc[3.10.0]     2.3564 (1.17)     2.3564 (1.17)     2.3564 (1.17)     0.0000 (1.0)      2.3564 (1.17)     0.0000 (1.0)           0;0  0.4244 (0.86)          1           1
test_gc-gc[3.53.2]     2.0933 (1.04)     2.0933 (1.04)     2.0933 (1.04)     0.0000 (1.0)      2.0933 (1.04)     0.0000 (1.0)           0;0  0.4777 (0.97)          1           1
test_gc-gc[3.60.1]     2.1069 (1.04)     2.1069 (1.04)     2.1069 (1.04)     0.0000 (1.0)      2.1069 (1.04)     0.0000 (1.0)           0;0  0.4746 (0.96)          1           1
test_gc-gc[main]       2.2706 (1.12)     2.2706 (1.12)     2.2706 (1.12)     0.0000 (1.0)      2.2706 (1.12)     0.0000 (1.0)           0;0  0.4404 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     173.9967 (3.52)     173.9967 (3.52)     173.9967 (3.52)     0.0000 (1.0)      173.9967 (3.52)     0.0000 (1.0)           0;0  0.0057 (0.28)          1           1
test_get-get[3.10.0]     202.9632 (4.10)     202.9632 (4.10)     202.9632 (4.10)     0.0000 (1.0)      202.9632 (4.10)     0.0000 (1.0)           0;0  0.0049 (0.24)          1           1
test_get-get[3.53.2]     150.4958 (3.04)     150.4958 (3.04)     150.4958 (3.04)     0.0000 (1.0)      150.4958 (3.04)     0.0000 (1.0)           0;0  0.0066 (0.33)          1           1
test_get-get[3.60.1]      49.4723 (1.00)      49.4723 (1.00)      49.4723 (1.00)     0.0000 (1.0)       49.4723 (1.00)     0.0000 (1.0)           0;0  0.0202 (1.00)          1           1
test_get-get[main]        49.4683 (1.0)       49.4683 (1.0)       49.4683 (1.0)      0.0000 (1.0)       49.4683 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     85.1937 (5.05)     85.1937 (5.05)     85.1937 (5.05)     0.0000 (1.0)      85.1937 (5.05)     0.0000 (1.0)           0;0  0.0117 (0.20)          1           1
test_get_url-get-url[3.10.0]     88.6179 (5.25)     88.6179 (5.25)     88.6179 (5.25)     0.0000 (1.0)      88.6179 (5.25)     0.0000 (1.0)           0;0  0.0113 (0.19)          1           1
test_get_url-get-url[3.53.2]     17.1191 (1.01)     17.1191 (1.01)     17.1191 (1.01)     0.0000 (1.0)      17.1191 (1.01)     0.0000 (1.0)           0;0  0.0584 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.8842 (1.00)     16.8842 (1.00)     16.8842 (1.00)     0.0000 (1.0)      16.8842 (1.00)     0.0000 (1.0)           0;0  0.0592 (1.00)          1           1
test_get_url-get-url[main]       16.8796 (1.0)      16.8796 (1.0)      16.8796 (1.0)      0.0000 (1.0)      16.8796 (1.0)      0.0000 (1.0)           0;0  0.0592 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     171.2926 (1.06)     184.1804 (1.02)     175.3011 (1.05)     2.3573 (1.0)      175.0583 (1.06)     2.9829 (1.14)         29;2  5.7045 (0.96)        100           1
test_help---help[3.10.0]     165.9938 (1.03)     179.8398 (1.0)      171.3803 (1.02)     2.4007 (1.02)     171.0938 (1.03)     2.6098 (1.0)          30;3  5.8350 (0.98)        100           1
test_help---help[3.53.2]     169.8706 (1.05)     182.8568 (1.02)     174.3093 (1.04)     2.4620 (1.04)     173.9904 (1.05)     3.3220 (1.27)         31;2  5.7369 (0.96)        100           1
test_help---help[3.60.1]     170.0007 (1.05)     192.4679 (1.07)     175.2271 (1.05)     3.6813 (1.56)     174.2883 (1.05)     3.8692 (1.48)         22;5  5.7069 (0.96)        100           1
test_help---help[main]       161.6615 (1.0)      207.6469 (1.15)     167.4855 (1.0)      6.9784 (2.96)     165.8481 (1.0)      3.1736 (1.22)          6;6  5.9707 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     214.5493 (3.71)     214.5493 (3.71)     214.5493 (3.71)     0.0000 (1.0)      214.5493 (3.71)     0.0000 (1.0)           0;0  0.0047 (0.27)          1           1
test_import-import[3.10.0]     246.3597 (4.26)     246.3597 (4.26)     246.3597 (4.26)     0.0000 (1.0)      246.3597 (4.26)     0.0000 (1.0)           0;0  0.0041 (0.23)          1           1
test_import-import[3.60.1]      57.8063 (1.0)       57.8063 (1.0)       57.8063 (1.0)      0.0000 (1.0)       57.8063 (1.0)      0.0000 (1.0)           0;0  0.0173 (1.0)           1           1
test_import-import[main]        58.1232 (1.01)      58.1232 (1.01)      58.1232 (1.01)     0.0000 (1.0)       58.1232 (1.01)     0.0000 (1.0)           0;0  0.0172 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     152.0315 (5.35)     152.0315 (5.35)     152.0315 (5.35)     0.0000 (1.0)      152.0315 (5.35)     0.0000 (1.0)           0;0  0.0066 (0.19)          1           1
test_import_url-import-url[3.10.0]     158.7152 (5.58)     158.7152 (5.58)     158.7152 (5.58)     0.0000 (1.0)      158.7152 (5.58)     0.0000 (1.0)           0;0  0.0063 (0.18)          1           1
test_import_url-import-url[3.53.2]      80.9629 (2.85)      80.9629 (2.85)      80.9629 (2.85)     0.0000 (1.0)       80.9629 (2.85)     0.0000 (1.0)           0;0  0.0124 (0.35)          1           1
test_import_url-import-url[3.60.1]      28.4235 (1.0)       28.4235 (1.0)       28.4235 (1.0)      0.0000 (1.0)       28.4235 (1.0)      0.0000 (1.0)           0;0  0.0352 (1.0)           1           1
test_import_url-import-url[main]        29.8917 (1.05)      29.8917 (1.05)      29.8917 (1.05)     0.0000 (1.0)       29.8917 (1.05)     0.0000 (1.0)           0;0  0.0335 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     416.7941 (1.03)     446.0934 (1.03)     426.0519 (1.04)      6.2523 (1.40)     424.2668 (1.04)     5.9683 (1.51)        23;10  2.3471 (0.96)        100           1
test_init-init[3.10.0]     423.3242 (1.05)     526.0687 (1.22)     432.0033 (1.05)     11.0110 (2.47)     429.5033 (1.05)     5.9925 (1.52)          7;8  2.3148 (0.95)        100           1
test_init-init[3.53.2]     402.8474 (1.0)      431.6380 (1.0)      410.4384 (1.0)       4.6695 (1.05)     409.0797 (1.0)      5.3705 (1.36)         27;2  2.4364 (1.0)         100           1
test_init-init[3.60.1]     404.9152 (1.01)     434.4368 (1.01)     411.3916 (1.00)      4.4579 (1.0)      410.3536 (1.00)     3.9529 (1.0)          22;6  2.4308 (1.00)        100           1
test_init-init[main]       443.2415 (1.10)     580.8459 (1.35)     453.9522 (1.11)     18.9435 (4.25)     450.0157 (1.10)     4.8994 (1.24)          3;8  2.2029 (0.90)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     648.7995 (1.07)     648.7995 (1.07)     648.7995 (1.07)     0.0000 (1.0)      648.7995 (1.07)     0.0000 (1.0)           0;0  1.5413 (0.94)          1           1
test_list-list[3.10.0]     939.6992 (1.54)     939.6992 (1.54)     939.6992 (1.54)     0.0000 (1.0)      939.6992 (1.54)     0.0000 (1.0)           0;0  1.0642 (0.65)          1           1
test_list-list[3.53.2]     635.3379 (1.04)     635.3379 (1.04)     635.3379 (1.04)     0.0000 (1.0)      635.3379 (1.04)     0.0000 (1.0)           0;0  1.5740 (0.96)          1           1
test_list-list[3.60.1]     649.9307 (1.07)     649.9307 (1.07)     649.9307 (1.07)     0.0000 (1.0)      649.9307 (1.07)     0.0000 (1.0)           0;0  1.5386 (0.94)          1           1
test_list-list[main]       608.3224 (1.0)      608.3224 (1.0)      608.3224 (1.0)      0.0000 (1.0)      608.3224 (1.0)      0.0000 (1.0)           0;0  1.6439 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     445.8233 (1.05)     445.8233 (1.05)     445.8233 (1.05)     0.0000 (1.0)      445.8233 (1.05)     0.0000 (1.0)           0;0  2.2430 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     444.9504 (1.05)     444.9504 (1.05)     444.9504 (1.05)     0.0000 (1.0)      444.9504 (1.05)     0.0000 (1.0)           0;0  2.2474 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     423.6323 (1.0)      423.6323 (1.0)      423.6323 (1.0)      0.0000 (1.0)      423.6323 (1.0)      0.0000 (1.0)           0;0  2.3605 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     423.6809 (1.00)     423.6809 (1.00)     423.6809 (1.00)     0.0000 (1.0)      423.6809 (1.00)     0.0000 (1.0)           0;0  2.3603 (1.00)          1           1
test_list-list-dvc-only[main]       426.8045 (1.01)     426.8045 (1.01)     426.8045 (1.01)     0.0000 (1.0)      426.8045 (1.01)     0.0000 (1.0)           0;0  2.3430 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4799 (1.02)     2.4799 (1.02)     2.4799 (1.02)     0.0000 (1.0)      2.4799 (1.02)     0.0000 (1.0)           0;0  0.4032 (0.98)          1           1
test_list-list-recursive[3.10.0]     2.4390 (1.0)      2.4390 (1.0)      2.4390 (1.0)      0.0000 (1.0)      2.4390 (1.0)      0.0000 (1.0)           0;0  0.4100 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.6707 (1.10)     2.6707 (1.10)     2.6707 (1.10)     0.0000 (1.0)      2.6707 (1.10)     0.0000 (1.0)           0;0  0.3744 (0.91)          1           1
test_list-list-recursive[3.60.1]     2.7833 (1.14)     2.7833 (1.14)     2.7833 (1.14)     0.0000 (1.0)      2.7833 (1.14)     0.0000 (1.0)           0;0  0.3593 (0.88)          1           1
test_list-list-recursive[main]       2.8687 (1.18)     2.8687 (1.18)     2.8687 (1.18)     0.0000 (1.0)      2.8687 (1.18)     0.0000 (1.0)           0;0  0.3486 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     462.3230 (1.12)     462.3230 (1.12)     462.3230 (1.12)     0.0000 (1.0)      462.3230 (1.12)     0.0000 (1.0)           0;0  2.1630 (0.89)          1           1
test_list-list-shallow[3.10.0]     441.1335 (1.07)     441.1335 (1.07)     441.1335 (1.07)     0.0000 (1.0)      441.1335 (1.07)     0.0000 (1.0)           0;0  2.2669 (0.93)          1           1
test_list-list-shallow[3.53.2]     412.1102 (1.0)      412.1102 (1.0)      412.1102 (1.0)      0.0000 (1.0)      412.1102 (1.0)      0.0000 (1.0)           0;0  2.4265 (1.0)           1           1
test_list-list-shallow[3.60.1]     421.5284 (1.02)     421.5284 (1.02)     421.5284 (1.02)     0.0000 (1.0)      421.5284 (1.02)     0.0000 (1.0)           0;0  2.3723 (0.98)          1           1
test_list-list-shallow[main]       426.7681 (1.04)     426.7681 (1.04)     426.7681 (1.04)     0.0000 (1.0)      426.7681 (1.04)     0.0000 (1.0)           0;0  2.3432 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     68.7772 (3.56)     68.7772 (3.56)     68.7772 (3.56)     0.0000 (1.0)      68.7772 (3.56)     0.0000 (1.0)           0;0  0.0145 (0.28)          1           1
test_partial_add-add[3.10.0]     69.0986 (3.58)     69.0986 (3.58)     69.0986 (3.58)     0.0000 (1.0)      69.0986 (3.58)     0.0000 (1.0)           0;0  0.0145 (0.28)          1           1
test_partial_add-add[3.53.2]     61.6146 (3.19)     61.6146 (3.19)     61.6146 (3.19)     0.0000 (1.0)      61.6146 (3.19)     0.0000 (1.0)           0;0  0.0162 (0.31)          1           1
test_partial_add-add[3.60.1]     19.3083 (1.0)      19.3083 (1.0)      19.3083 (1.0)      0.0000 (1.0)      19.3083 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
test_partial_add-add[main]       20.4343 (1.06)     20.4343 (1.06)     20.4343 (1.06)     0.0000 (1.0)      20.4343 (1.06)     0.0000 (1.0)           0;0  0.0489 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     57.3173 (7.78)     57.3173 (7.78)     57.3173 (7.78)     0.0000 (1.0)      57.3173 (7.78)     0.0000 (1.0)           0;0  0.0174 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     57.5191 (7.81)     57.5191 (7.81)     57.5191 (7.81)     0.0000 (1.0)      57.5191 (7.81)     0.0000 (1.0)           0;0  0.0174 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     52.3554 (7.11)     52.3554 (7.11)     52.3554 (7.11)     0.0000 (1.0)      52.3554 (7.11)     0.0000 (1.0)           0;0  0.0191 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.3671 (1.0)       7.3671 (1.0)       7.3671 (1.0)      0.0000 (1.0)       7.3671 (1.0)      0.0000 (1.0)           0;0  0.1357 (1.0)           1           1
test_partial_add-add-partial[main]        7.5648 (1.03)      7.5648 (1.03)      7.5648 (1.03)     0.0000 (1.0)       7.5648 (1.03)     0.0000 (1.0)           0;0  0.1322 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4355 (1.0)      4.4355 (1.0)      4.4355 (1.0)      0.0000 (1.0)      4.4355 (1.0)      0.0000 (1.0)           0;0  0.2255 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8585 (1.32)     5.8585 (1.32)     5.8585 (1.32)     0.0000 (1.0)      5.8585 (1.32)     0.0000 (1.0)           0;0  0.1707 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7298 (1.52)     6.7298 (1.52)     6.7298 (1.52)     0.0000 (1.0)      6.7298 (1.52)     0.0000 (1.0)           0;0  0.1486 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7704 (1.53)     6.7704 (1.53)     6.7704 (1.53)     0.0000 (1.0)      6.7704 (1.53)     0.0000 (1.0)           0;0  0.1477 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       5.7429 (1.29)     5.7429 (1.29)     5.7429 (1.29)     0.0000 (1.0)      5.7429 (1.29)     0.0000 (1.0)           0;0  0.1741 (0.77)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4491 (1.0)      2.4491 (1.0)      2.4491 (1.0)      0.0000 (1.0)      2.4491 (1.0)      0.0000 (1.0)           0;0  0.4083 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7397 (1.53)     3.7397 (1.53)     3.7397 (1.53)     0.0000 (1.0)      3.7397 (1.53)     0.0000 (1.0)           0;0  0.2674 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.7699 (1.54)     3.7699 (1.54)     3.7699 (1.54)     0.0000 (1.0)      3.7699 (1.54)     0.0000 (1.0)           0;0  0.2653 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.7799 (1.54)     3.7799 (1.54)     3.7799 (1.54)     0.0000 (1.0)      3.7799 (1.54)     0.0000 (1.0)           0;0  0.2646 (0.65)          1           1
test_partial_add-gc-noop[main]       2.7756 (1.13)     2.7756 (1.13)     2.7756 (1.13)     0.0000 (1.0)      2.7756 (1.13)     0.0000 (1.0)           0;0  0.3603 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     82.7638 (4.37)     82.7638 (4.37)     82.7638 (4.37)     0.0000 (1.0)      82.7638 (4.37)     0.0000 (1.0)           0;0  0.0121 (0.23)          1           1
test_partial_add-push[3.10.0]     37.2536 (1.97)     37.2536 (1.97)     37.2536 (1.97)     0.0000 (1.0)      37.2536 (1.97)     0.0000 (1.0)           0;0  0.0268 (0.51)          1           1
test_partial_add-push[3.53.2]     19.3603 (1.02)     19.3603 (1.02)     19.3603 (1.02)     0.0000 (1.0)      19.3603 (1.02)     0.0000 (1.0)           0;0  0.0517 (0.98)          1           1
test_partial_add-push[3.60.1]     18.9276 (1.0)      18.9276 (1.0)      18.9276 (1.0)      0.0000 (1.0)      18.9276 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
test_partial_add-push[main]       19.0037 (1.00)     19.0037 (1.00)     19.0037 (1.00)     0.0000 (1.0)      19.0037 (1.00)     0.0000 (1.0)           0;0  0.0526 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.4563 (1.74)     17.4563 (1.74)     17.4563 (1.74)     0.0000 (1.0)      17.4563 (1.74)     0.0000 (1.0)           0;0  0.0573 (0.58)          1           1
test_partial_add-push-partial[3.10.0]     10.1384 (1.01)     10.1384 (1.01)     10.1384 (1.01)     0.0000 (1.0)      10.1384 (1.01)     0.0000 (1.0)           0;0  0.0986 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.3319 (1.03)     10.3319 (1.03)     10.3319 (1.03)     0.0000 (1.0)      10.3319 (1.03)     0.0000 (1.0)           0;0  0.0968 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.1900 (1.01)     10.1900 (1.01)     10.1900 (1.01)     0.0000 (1.0)      10.1900 (1.01)     0.0000 (1.0)           0;0  0.0981 (0.99)          1           1
test_partial_add-push-partial[main]       10.0456 (1.0)      10.0456 (1.0)      10.0456 (1.0)      0.0000 (1.0)      10.0456 (1.0)      0.0000 (1.0)           0;0  0.0995 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.1941 (3.70)     83.1941 (3.70)     83.1941 (3.70)     0.0000 (1.0)      83.1941 (3.70)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_partial_remove-add[3.10.0]     83.7174 (3.73)     83.7174 (3.73)     83.7174 (3.73)     0.0000 (1.0)      83.7174 (3.73)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.2974 (3.35)     75.2974 (3.35)     75.2974 (3.35)     0.0000 (1.0)      75.2974 (3.35)     0.0000 (1.0)           0;0  0.0133 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.4628 (1.0)      22.4628 (1.0)      22.4628 (1.0)      0.0000 (1.0)      22.4628 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_partial_remove-add[main]       23.4849 (1.05)     23.4849 (1.05)     23.4849 (1.05)     0.0000 (1.0)      23.4849 (1.05)     0.0000 (1.0)           0;0  0.0426 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.2237 (7.58)     8.2237 (7.58)     8.2237 (7.58)     0.0000 (1.0)      8.2237 (7.58)     0.0000 (1.0)           0;0  0.1216 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.3568 (7.71)     8.3568 (7.71)     8.3568 (7.71)     0.0000 (1.0)      8.3568 (7.71)     0.0000 (1.0)           0;0  0.1197 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.3916 (6.82)     7.3916 (6.82)     7.3916 (6.82)     0.0000 (1.0)      7.3916 (6.82)     0.0000 (1.0)           0;0  0.1353 (0.15)          1           1
test_partial_remove-add-update[3.60.1]     1.0844 (1.0)      1.0844 (1.0)      1.0844 (1.0)      0.0000 (1.0)      1.0844 (1.0)      0.0000 (1.0)           0;0  0.9221 (1.0)           1           1
test_partial_remove-add-update[main]       1.2306 (1.13)     1.2306 (1.13)     1.2306 (1.13)     0.0000 (1.0)      1.2306 (1.13)     0.0000 (1.0)           0;0  0.8126 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3609 (1.0)      3.3609 (1.0)      3.3609 (1.0)      0.0000 (1.0)      3.3609 (1.0)      0.0000 (1.0)           0;0  0.2975 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6504 (1.09)     3.6504 (1.09)     3.6504 (1.09)     0.0000 (1.0)      3.6504 (1.09)     0.0000 (1.0)           0;0  0.2739 (0.92)          1           1
test_partial_remove-gc[3.53.2]     3.5712 (1.06)     3.5712 (1.06)     3.5712 (1.06)     0.0000 (1.0)      3.5712 (1.06)     0.0000 (1.0)           0;0  0.2800 (0.94)          1           1
test_partial_remove-gc[3.60.1]     3.6442 (1.08)     3.6442 (1.08)     3.6442 (1.08)     0.0000 (1.0)      3.6442 (1.08)     0.0000 (1.0)           0;0  0.2744 (0.92)          1           1
test_partial_remove-gc[main]       3.5638 (1.06)     3.5638 (1.06)     3.5638 (1.06)     0.0000 (1.0)      3.5638 (1.06)     0.0000 (1.0)           0;0  0.2806 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.0476 (1.06)     5.0476 (1.06)     5.0476 (1.06)     0.0000 (1.0)      5.0476 (1.06)     0.0000 (1.0)           0;0  0.1981 (0.95)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1701 (1.08)     5.1701 (1.08)     5.1701 (1.08)     0.0000 (1.0)      5.1701 (1.08)     0.0000 (1.0)           0;0  0.1934 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0298 (1.05)     5.0298 (1.05)     5.0298 (1.05)     0.0000 (1.0)      5.0298 (1.05)     0.0000 (1.0)           0;0  0.1988 (0.95)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.7796 (1.0)      4.7796 (1.0)      4.7796 (1.0)      0.0000 (1.0)      4.7796 (1.0)      0.0000 (1.0)           0;0  0.2092 (1.0)           1           1
test_partial_remove-gc-cloud[main]       4.8084 (1.01)     4.8084 (1.01)     4.8084 (1.01)     0.0000 (1.0)      4.8084 (1.01)     0.0000 (1.0)           0;0  0.2080 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     91.4559 (4.13)     91.4559 (4.13)     91.4559 (4.13)     0.0000 (1.0)      91.4559 (4.13)     0.0000 (1.0)           0;0  0.0109 (0.24)          1           1
test_partial_remove-push[3.10.0]     42.2471 (1.91)     42.2471 (1.91)     42.2471 (1.91)     0.0000 (1.0)      42.2471 (1.91)     0.0000 (1.0)           0;0  0.0237 (0.52)          1           1
test_partial_remove-push[3.53.2]     23.1352 (1.05)     23.1352 (1.05)     23.1352 (1.05)     0.0000 (1.0)      23.1352 (1.05)     0.0000 (1.0)           0;0  0.0432 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.1254 (1.0)      22.1254 (1.0)      22.1254 (1.0)      0.0000 (1.0)      22.1254 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_partial_remove-push[main]       22.3143 (1.01)     22.3143 (1.01)     22.3143 (1.01)     0.0000 (1.0)      22.3143 (1.01)     0.0000 (1.0)           0;0  0.0448 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8097 (1.01)     1.8097 (1.01)     1.8097 (1.01)     0.0000 (1.0)      1.8097 (1.01)     0.0000 (1.0)           0;0  0.5526 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     1.7942 (1.0)      1.7942 (1.0)      1.7942 (1.0)      0.0000 (1.0)      1.7942 (1.0)      0.0000 (1.0)           0;0  0.5574 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5081 (1.40)     2.5081 (1.40)     2.5081 (1.40)     0.0000 (1.0)      2.5081 (1.40)     0.0000 (1.0)           0;0  0.3987 (0.72)          1           1
test_partial_remove-push-update[3.60.1]     2.5541 (1.42)     2.5541 (1.42)     2.5541 (1.42)     0.0000 (1.0)      2.5541 (1.42)     0.0000 (1.0)           0;0  0.3915 (0.70)          1           1
test_partial_remove-push-update[main]       2.5782 (1.44)     2.5782 (1.44)     2.5782 (1.44)     0.0000 (1.0)      2.5782 (1.44)     0.0000 (1.0)           0;0  0.3879 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     555.6002 (1.0)        624.6265 (1.0)        584.0436 (1.0)      25.3713 (1.0)        579.3878 (1.0)      26.0752 (1.04)          2;0  1.7122 (1.0)           5           3
test_plots-plots-diff[3.10.0]     969.3814 (1.74)     1,043.0139 (1.67)     1,006.2615 (1.72)     28.7782 (1.13)     1,013.7683 (1.75)     42.5549 (1.70)          2;0  0.9938 (0.58)          5           3
test_plots-plots-diff[3.53.2]     890.4850 (1.60)       975.5843 (1.56)       918.3961 (1.57)     32.9840 (1.30)       910.2311 (1.57)     25.0594 (1.0)           1;1  1.0889 (0.64)          5           3
test_plots-plots-diff[3.60.1]     890.6818 (1.60)       959.3546 (1.54)       915.8990 (1.57)     26.5970 (1.05)       904.7029 (1.56)     30.3799 (1.21)          1;0  1.0918 (0.64)          5           3
test_plots-plots-diff[main]       888.8624 (1.60)       962.0000 (1.54)       916.1956 (1.57)     30.6090 (1.21)       900.9281 (1.55)     45.6211 (1.82)          1;0  1.0915 (0.64)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       579.8694 (1.0)        591.1024 (1.0)        588.1986 (1.0)       4.7275 (1.0)        590.3015 (1.0)       4.1700 (1.0)           1;1  1.7001 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,238.2986 (2.14)     1,292.4793 (2.19)     1,255.2836 (2.13)     22.0584 (4.67)     1,247.6646 (2.11)     25.9580 (6.22)          1;0  0.7966 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]       977.6868 (1.69)     1,030.1498 (1.74)     1,010.5120 (1.72)     22.0218 (4.66)     1,014.6332 (1.72)     34.8169 (8.35)          1;0  0.9896 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]       974.3069 (1.68)     1,002.8890 (1.70)       986.8659 (1.68)     10.7471 (2.27)       984.3294 (1.67)     13.9096 (3.34)          2;0  1.0133 (0.60)          5           3
test_plots-plots-diff-json[main]         951.6804 (1.64)     1,027.1156 (1.74)     1,002.1476 (1.70)     30.8831 (6.53)     1,014.8425 (1.72)     40.1146 (9.62)          1;0  0.9979 (0.59)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     462.8262 (1.0)      481.7562 (1.0)      467.7016 (1.0)       7.9597 (1.0)      464.3397 (1.0)       6.8283 (1.0)           1;1  2.1381 (1.0)           5           3
test_plots-plots-show[3.10.0]     784.1512 (1.69)     807.8721 (1.68)     796.9094 (1.70)     11.8249 (1.49)     801.8991 (1.73)     22.5781 (3.31)          2;0  1.2548 (0.59)          5           3
test_plots-plots-show[3.53.2]     770.0184 (1.66)     801.4073 (1.66)     779.3927 (1.67)     12.7983 (1.61)     776.3777 (1.67)     13.3844 (1.96)          1;0  1.2831 (0.60)          5           3
test_plots-plots-show[3.60.1]     740.1320 (1.60)     789.6635 (1.64)     764.6744 (1.63)     19.3247 (2.43)     759.5393 (1.64)     28.4555 (4.17)          2;0  1.3077 (0.61)          5           3
test_plots-plots-show[main]       769.5300 (1.66)     807.1668 (1.68)     782.0693 (1.67)     14.9054 (1.87)     779.9181 (1.68)     16.3468 (2.39)          1;0  1.2787 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     500.0779 (1.0)      519.1843 (1.0)      507.2084 (1.0)       8.2980 (1.0)      504.3111 (1.0)      13.7057 (1.15)          1;0  1.9716 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     914.2986 (1.83)     965.3227 (1.86)     949.9149 (1.87)     20.3522 (2.45)     957.7941 (1.90)     16.5579 (1.39)          1;1  1.0527 (0.53)          5           3
test_plots-plots-show-json[3.53.2]     801.9559 (1.60)     859.8165 (1.66)     830.2437 (1.64)     21.8374 (2.63)     827.6372 (1.64)     30.3774 (2.55)          2;0  1.2045 (0.61)          5           3
test_plots-plots-show-json[3.60.1]     781.6086 (1.56)     815.7284 (1.57)     803.6315 (1.58)     12.9956 (1.57)     807.8222 (1.60)     11.9158 (1.0)           1;0  1.2444 (0.63)          5           3
test_plots-plots-show-json[main]       822.7825 (1.65)     891.3350 (1.72)     847.4465 (1.67)     25.8824 (3.12)     839.5557 (1.66)     21.7114 (1.82)          1;1  1.1800 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     92.3343 (4.18)     92.3343 (4.18)     92.3343 (4.18)     0.0000 (1.0)      92.3343 (4.18)     0.0000 (1.0)           0;0  0.0108 (0.24)          1           1
test_push-push[3.10.0]     42.7525 (1.93)     42.7525 (1.93)     42.7525 (1.93)     0.0000 (1.0)      42.7525 (1.93)     0.0000 (1.0)           0;0  0.0234 (0.52)          1           1
test_push-push[3.53.2]     23.1849 (1.05)     23.1849 (1.05)     23.1849 (1.05)     0.0000 (1.0)      23.1849 (1.05)     0.0000 (1.0)           0;0  0.0431 (0.95)          1           1
test_push-push[3.60.1]     22.3510 (1.01)     22.3510 (1.01)     22.3510 (1.01)     0.0000 (1.0)      22.3510 (1.01)     0.0000 (1.0)           0;0  0.0447 (0.99)          1           1
test_push-push[main]       22.0950 (1.0)      22.0950 (1.0)      22.0950 (1.0)      0.0000 (1.0)      22.0950 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     108.4933 (4.86)     108.4933 (4.86)     108.4933 (4.86)     0.0000 (1.0)      108.4933 (4.86)     0.0000 (1.0)           0;0  0.0092 (0.21)          1           1
test_sharing-fetch[3.10.0]     112.1129 (5.02)     112.1129 (5.02)     112.1129 (5.02)     0.0000 (1.0)      112.1129 (5.02)     0.0000 (1.0)           0;0  0.0089 (0.20)          1           1
test_sharing-fetch[3.53.2]      32.4075 (1.45)      32.4075 (1.45)      32.4075 (1.45)     0.0000 (1.0)       32.4075 (1.45)     0.0000 (1.0)           0;0  0.0309 (0.69)          1           1
test_sharing-fetch[3.60.1]      22.4675 (1.01)      22.4675 (1.01)      22.4675 (1.01)     0.0000 (1.0)       22.4675 (1.01)     0.0000 (1.0)           0;0  0.0445 (0.99)          1           1
test_sharing-fetch[main]        22.3313 (1.0)       22.3313 (1.0)       22.3313 (1.0)      0.0000 (1.0)       22.3313 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3882 (1.0)      1.3882 (1.0)      1.3882 (1.0)      0.0000 (1.0)      1.3882 (1.0)      0.0000 (1.0)           0;0  0.7204 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6949 (2.66)     3.6949 (2.66)     3.6949 (2.66)     0.0000 (1.0)      3.6949 (2.66)     0.0000 (1.0)           0;0  0.2706 (0.38)          1           1
test_sharing-fetch-noop[3.53.2]     5.7898 (4.17)     5.7898 (4.17)     5.7898 (4.17)     0.0000 (1.0)      5.7898 (4.17)     0.0000 (1.0)           0;0  0.1727 (0.24)          1           1
test_sharing-fetch-noop[3.60.1]     5.9500 (4.29)     5.9500 (4.29)     5.9500 (4.29)     0.0000 (1.0)      5.9500 (4.29)     0.0000 (1.0)           0;0  0.1681 (0.23)          1           1
test_sharing-fetch-noop[main]       5.8507 (4.21)     5.8507 (4.21)     5.8507 (4.21)     0.0000 (1.0)      5.8507 (4.21)     0.0000 (1.0)           0;0  0.1709 (0.24)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     95.6771 (4.34)     95.6771 (4.34)     95.6771 (4.34)     0.0000 (1.0)      95.6771 (4.34)     0.0000 (1.0)           0;0  0.0105 (0.23)          1           1
test_sharing-push[3.10.0]     44.8911 (2.04)     44.8911 (2.04)     44.8911 (2.04)     0.0000 (1.0)      44.8911 (2.04)     0.0000 (1.0)           0;0  0.0223 (0.49)          1           1
test_sharing-push[3.53.2]     22.8280 (1.04)     22.8280 (1.04)     22.8280 (1.04)     0.0000 (1.0)      22.8280 (1.04)     0.0000 (1.0)           0;0  0.0438 (0.97)          1           1
test_sharing-push[3.60.1]     22.0321 (1.0)      22.0321 (1.0)      22.0321 (1.0)      0.0000 (1.0)      22.0321 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
test_sharing-push[main]       22.3143 (1.01)     22.3143 (1.01)     22.3143 (1.01)     0.0000 (1.0)      22.3143 (1.01)     0.0000 (1.0)           0;0  0.0448 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     1.9899 (1.0)      1.9899 (1.0)      1.9899 (1.0)      0.0000 (1.0)      1.9899 (1.0)      0.0000 (1.0)           0;0  0.5025 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0078 (1.01)     2.0078 (1.01)     2.0078 (1.01)     0.0000 (1.0)      2.0078 (1.01)     0.0000 (1.0)           0;0  0.4981 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.0695 (3.05)     6.0695 (3.05)     6.0695 (3.05)     0.0000 (1.0)      6.0695 (3.05)     0.0000 (1.0)           0;0  0.1648 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.0280 (3.03)     6.0280 (3.03)     6.0280 (3.03)     0.0000 (1.0)      6.0280 (3.03)     0.0000 (1.0)           0;0  0.1659 (0.33)          1           1
test_sharing-push-noop[main]       5.8253 (2.93)     5.8253 (2.93)     5.8253 (2.93)     0.0000 (1.0)      5.8253 (2.93)     0.0000 (1.0)           0;0  0.1717 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     149.0785 (1.08)     149.0785 (1.08)     149.0785 (1.08)     0.0000 (1.0)      149.0785 (1.08)     0.0000 (1.0)           0;0  0.0067 (0.93)          1           1
test_sharing_azure-fetch[main]       138.3610 (1.0)      138.3610 (1.0)      138.3610 (1.0)      0.0000 (1.0)      138.3610 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.0854 (1.0)      6.0854 (1.0)      6.0854 (1.0)      0.0000 (1.0)      6.0854 (1.0)      0.0000 (1.0)           0;0  0.1643 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.2215 (1.02)     6.2215 (1.02)     6.2215 (1.02)     0.0000 (1.0)      6.2215 (1.02)     0.0000 (1.0)           0;0  0.1607 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     124.8267 (1.0)      124.8267 (1.0)      124.8267 (1.0)      0.0000 (1.0)      124.8267 (1.0)      0.0000 (1.0)           0;0  0.0080 (1.0)           1           1
test_sharing_azure-push[main]       128.5296 (1.03)     128.5296 (1.03)     128.5296 (1.03)     0.0000 (1.0)      128.5296 (1.03)     0.0000 (1.0)           0;0  0.0078 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.1185 (1.0)      6.1185 (1.0)      6.1185 (1.0)      0.0000 (1.0)      6.1185 (1.0)      0.0000 (1.0)           0;0  0.1634 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.2633 (1.02)     6.2633 (1.02)     6.2633 (1.02)     0.0000 (1.0)      6.2633 (1.02)     0.0000 (1.0)           0;0  0.1597 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     425.2660 (1.02)     425.2660 (1.02)     425.2660 (1.02)     0.0000 (1.0)      425.2660 (1.02)     0.0000 (1.0)           0;0  0.0024 (0.98)          1           1
test_sharing_s3-fetch[main]       416.7062 (1.0)      416.7062 (1.0)      416.7062 (1.0)      0.0000 (1.0)      416.7062 (1.0)      0.0000 (1.0)           0;0  0.0024 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2671 (1.0)      6.2671 (1.0)      6.2671 (1.0)      0.0000 (1.0)      6.2671 (1.0)      0.0000 (1.0)           0;0  0.1596 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.4250 (1.03)     6.4250 (1.03)     6.4250 (1.03)     0.0000 (1.0)      6.4250 (1.03)     0.0000 (1.0)           0;0  0.1556 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     412.4790 (1.0)      412.4790 (1.0)      412.4790 (1.0)      0.0000 (1.0)      412.4790 (1.0)      0.0000 (1.0)           0;0  0.0024 (1.0)           1           1
test_sharing_s3-push[main]       417.6956 (1.01)     417.6956 (1.01)     417.6956 (1.01)     0.0000 (1.0)      417.6956 (1.01)     0.0000 (1.0)           0;0  0.0024 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5274 (1.0)      6.5274 (1.0)      6.5274 (1.0)      0.0000 (1.0)      6.5274 (1.0)      0.0000 (1.0)           0;0  0.1532 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.6627 (1.02)     6.6627 (1.02)     6.6627 (1.02)     0.0000 (1.0)      6.6627 (1.02)     0.0000 (1.0)           0;0  0.1501 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     18.8215 (3.60)     18.8215 (3.60)     18.8215 (3.60)     0.0000 (1.0)      18.8215 (3.60)     0.0000 (1.0)           0;0  0.0531 (0.28)          1           1
test_status-status[3.10.0]     19.4837 (3.73)     19.4837 (3.73)     19.4837 (3.73)     0.0000 (1.0)      19.4837 (3.73)     0.0000 (1.0)           0;0  0.0513 (0.27)          1           1
test_status-status[3.53.2]     17.8073 (3.41)     17.8073 (3.41)     17.8073 (3.41)     0.0000 (1.0)      17.8073 (3.41)     0.0000 (1.0)           0;0  0.0562 (0.29)          1           1
test_status-status[3.60.1]      5.2250 (1.0)       5.2250 (1.0)       5.2250 (1.0)      0.0000 (1.0)       5.2250 (1.0)      0.0000 (1.0)           0;0  0.1914 (1.0)           1           1
test_status-status[main]        5.4707 (1.05)      5.4707 (1.05)      5.4707 (1.05)     0.0000 (1.0)       5.4707 (1.05)     0.0000 (1.0)           0;0  0.1828 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7731 (1.83)     4.7731 (1.83)     4.7731 (1.83)     0.0000 (1.0)      4.7731 (1.83)     0.0000 (1.0)           0;0  0.2095 (0.55)          1           1
test_status-status-changed[3.10.0]     5.1496 (1.97)     5.1496 (1.97)     5.1496 (1.97)     0.0000 (1.0)      5.1496 (1.97)     0.0000 (1.0)           0;0  0.1942 (0.51)          1           1
test_status-status-changed[3.53.2]     4.9691 (1.90)     4.9691 (1.90)     4.9691 (1.90)     0.0000 (1.0)      4.9691 (1.90)     0.0000 (1.0)           0;0  0.2012 (0.53)          1           1
test_status-status-changed[3.60.1]     2.6095 (1.0)      2.6095 (1.0)      2.6095 (1.0)      0.0000 (1.0)      2.6095 (1.0)      0.0000 (1.0)           0;0  0.3832 (1.0)           1           1
test_status-status-changed[main]       2.8665 (1.10)     2.8665 (1.10)     2.8665 (1.10)     0.0000 (1.0)      2.8665 (1.10)     0.0000 (1.0)           0;0  0.3489 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0110 (1.96)     5.0110 (1.96)     5.0110 (1.96)     0.0000 (1.0)      5.0110 (1.96)     0.0000 (1.0)           0;0  0.1996 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.0377 (1.97)     5.0377 (1.97)     5.0377 (1.97)     0.0000 (1.0)      5.0377 (1.97)     0.0000 (1.0)           0;0  0.1985 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     4.9331 (1.93)     4.9331 (1.93)     4.9331 (1.93)     0.0000 (1.0)      4.9331 (1.93)     0.0000 (1.0)           0;0  0.2027 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.5611 (1.0)      2.5611 (1.0)      2.5611 (1.0)      0.0000 (1.0)      2.5611 (1.0)      0.0000 (1.0)           0;0  0.3905 (1.0)           1           1
test_status-status-changed-noop[main]       2.6510 (1.04)     2.6510 (1.04)     2.6510 (1.04)     0.0000 (1.0)      2.6510 (1.04)     0.0000 (1.0)           0;0  0.3772 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9789 (1.96)     4.9789 (1.96)     4.9789 (1.96)     0.0000 (1.0)      4.9789 (1.96)     0.0000 (1.0)           0;0  0.2008 (0.51)          1           1
test_status-status-noop[3.10.0]     5.0855 (2.01)     5.0855 (2.01)     5.0855 (2.01)     0.0000 (1.0)      5.0855 (2.01)     0.0000 (1.0)           0;0  0.1966 (0.50)          1           1
test_status-status-noop[3.53.2]     4.9490 (1.95)     4.9490 (1.95)     4.9490 (1.95)     0.0000 (1.0)      4.9490 (1.95)     0.0000 (1.0)           0;0  0.2021 (0.51)          1           1
test_status-status-noop[3.60.1]     2.5348 (1.0)      2.5348 (1.0)      2.5348 (1.0)      0.0000 (1.0)      2.5348 (1.0)      0.0000 (1.0)           0;0  0.3945 (1.0)           1           1
test_status-status-noop[main]       2.6506 (1.05)     2.6506 (1.05)     2.6506 (1.05)     0.0000 (1.0)      2.6506 (1.05)     0.0000 (1.0)           0;0  0.3773 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     191.4907 (4.24)     191.4907 (4.24)     191.4907 (4.24)     0.0000 (1.0)      191.4907 (4.24)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_update-import-url[3.10.0]     194.5561 (4.31)     194.5561 (4.31)     194.5561 (4.31)     0.0000 (1.0)      194.5561 (4.31)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_update-import-url[3.53.2]     115.5450 (2.56)     115.5450 (2.56)     115.5450 (2.56)     0.0000 (1.0)      115.5450 (2.56)     0.0000 (1.0)           0;0  0.0087 (0.39)          1           1
test_update-import-url[3.60.1]      45.1644 (1.0)       45.1644 (1.0)       45.1644 (1.0)      0.0000 (1.0)       45.1644 (1.0)      0.0000 (1.0)           0;0  0.0221 (1.0)           1           1
test_update-import-url[main]        46.9120 (1.04)      46.9120 (1.04)      46.9120 (1.04)     0.0000 (1.0)       46.9120 (1.04)     0.0000 (1.0)           0;0  0.0213 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     177.5318 (5.15)     177.5318 (5.15)     177.5318 (5.15)     0.0000 (1.0)      177.5318 (5.15)     0.0000 (1.0)           0;0  0.0056 (0.19)          1           1
test_update-update[3.10.0]     181.5181 (5.26)     181.5181 (5.26)     181.5181 (5.26)     0.0000 (1.0)      181.5181 (5.26)     0.0000 (1.0)           0;0  0.0055 (0.19)          1           1
test_update-update[3.53.2]     108.8270 (3.15)     108.8270 (3.15)     108.8270 (3.15)     0.0000 (1.0)      108.8270 (3.15)     0.0000 (1.0)           0;0  0.0092 (0.32)          1           1
test_update-update[3.60.1]      34.5014 (1.0)       34.5014 (1.0)       34.5014 (1.0)      0.0000 (1.0)       34.5014 (1.0)      0.0000 (1.0)           0;0  0.0290 (1.0)           1           1
test_update-update[main]        35.1645 (1.02)      35.1645 (1.02)      35.1645 (1.02)     0.0000 (1.0)       35.1645 (1.02)     0.0000 (1.0)           0;0  0.0284 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.9641 (2.33)     16.9641 (2.33)     16.9641 (2.33)     0.0000 (1.0)      16.9641 (2.33)     0.0000 (1.0)           0;0  0.0589 (0.43)          1           1
test_update-update-noop[3.10.0]     18.0626 (2.48)     18.0626 (2.48)     18.0626 (2.48)     0.0000 (1.0)      18.0626 (2.48)     0.0000 (1.0)           0;0  0.0554 (0.40)          1           1
test_update-update-noop[3.53.2]     17.0359 (2.34)     17.0359 (2.34)     17.0359 (2.34)     0.0000 (1.0)      17.0359 (2.34)     0.0000 (1.0)           0;0  0.0587 (0.43)          1           1
test_update-update-noop[3.60.1]      7.2832 (1.0)       7.2832 (1.0)       7.2832 (1.0)      0.0000 (1.0)       7.2832 (1.0)      0.0000 (1.0)           0;0  0.1373 (1.0)           1           1
test_update-update-noop[main]        7.9287 (1.09)      7.9287 (1.09)      7.9287 (1.09)     0.0000 (1.0)       7.9287 (1.09)     0.0000 (1.0)           0;0  0.1261 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean