Fri Feb 20 00:52:14 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     81.3529 (3.56)     81.3529 (3.56)     81.3529 (3.56)     0.0000 (1.0)      81.3529 (3.56)     0.0000 (1.0)           0;0  0.0123 (0.28)          1           1
test_add_copy-add[3.10.0]     82.7150 (3.62)     82.7150 (3.62)     82.7150 (3.62)     0.0000 (1.0)      82.7150 (3.62)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_add_copy-add[3.53.2]     73.9614 (3.24)     73.9614 (3.24)     73.9614 (3.24)     0.0000 (1.0)      73.9614 (3.24)     0.0000 (1.0)           0;0  0.0135 (0.31)          1           1
test_add_copy-add[3.60.1]     22.8540 (1.0)      22.8540 (1.0)      22.8540 (1.0)      0.0000 (1.0)      22.8540 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
test_add_copy-add[main]       23.6483 (1.03)     23.6483 (1.03)     23.6483 (1.03)     0.0000 (1.0)      23.6483 (1.03)     0.0000 (1.0)           0;0  0.0423 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     26.6037 (6.16)     26.6037 (6.16)     26.6037 (6.16)     0.0000 (1.0)      26.6037 (6.16)     0.0000 (1.0)           0;0  0.0376 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     26.9047 (6.23)     26.9047 (6.23)     26.9047 (6.23)     0.0000 (1.0)      26.9047 (6.23)     0.0000 (1.0)           0;0  0.0372 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     25.5115 (5.91)     25.5115 (5.91)     25.5115 (5.91)     0.0000 (1.0)      25.5115 (5.91)     0.0000 (1.0)           0;0  0.0392 (0.17)          1           1
test_add_copy-add-noop[3.60.1]      4.3172 (1.0)       4.3172 (1.0)       4.3172 (1.0)      0.0000 (1.0)       4.3172 (1.0)      0.0000 (1.0)           0;0  0.2316 (1.0)           1           1
test_add_copy-add-noop[main]        4.4854 (1.04)      4.4854 (1.04)      4.4854 (1.04)     0.0000 (1.0)       4.4854 (1.04)     0.0000 (1.0)           0;0  0.2229 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.4250 (4.11)     67.4250 (4.11)     67.4250 (4.11)     0.0000 (1.0)      67.4250 (4.11)     0.0000 (1.0)           0;0  0.0148 (0.24)          1           1
test_add_hardlink-add[3.10.0]     67.2286 (4.10)     67.2286 (4.10)     67.2286 (4.10)     0.0000 (1.0)      67.2286 (4.10)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.53.2]     66.5556 (4.06)     66.5556 (4.06)     66.5556 (4.06)     0.0000 (1.0)      66.5556 (4.06)     0.0000 (1.0)           0;0  0.0150 (0.25)          1           1
test_add_hardlink-add[3.60.1]     16.4070 (1.0)      16.4070 (1.0)      16.4070 (1.0)      0.0000 (1.0)      16.4070 (1.0)      0.0000 (1.0)           0;0  0.0609 (1.0)           1           1
test_add_hardlink-add[main]       17.3873 (1.06)     17.3873 (1.06)     17.3873 (1.06)     0.0000 (1.0)      17.3873 (1.06)     0.0000 (1.0)           0;0  0.0575 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.7055 (7.86)     33.7055 (7.86)     33.7055 (7.86)     0.0000 (1.0)      33.7055 (7.86)     0.0000 (1.0)           0;0  0.0297 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.7047 (7.86)     33.7047 (7.86)     33.7047 (7.86)     0.0000 (1.0)      33.7047 (7.86)     0.0000 (1.0)           0;0  0.0297 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.9060 (7.44)     31.9060 (7.44)     31.9060 (7.44)     0.0000 (1.0)      31.9060 (7.44)     0.0000 (1.0)           0;0  0.0313 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2887 (1.0)       4.2887 (1.0)       4.2887 (1.0)      0.0000 (1.0)       4.2887 (1.0)      0.0000 (1.0)           0;0  0.2332 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.5734 (1.07)      4.5734 (1.07)      4.5734 (1.07)     0.0000 (1.0)       4.5734 (1.07)     0.0000 (1.0)           0;0  0.2187 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     66.9811 (1.82)     66.9811 (1.82)     66.9811 (1.82)     0.0000 (1.0)      66.9811 (1.82)     0.0000 (1.0)           0;0  0.0149 (0.55)          1           1
test_add_symlink-add[3.10.0]     68.6117 (1.87)     68.6117 (1.87)     68.6117 (1.87)     0.0000 (1.0)      68.6117 (1.87)     0.0000 (1.0)           0;0  0.0146 (0.54)          1           1
test_add_symlink-add[3.53.2]     63.3785 (1.72)     63.3785 (1.72)     63.3785 (1.72)     0.0000 (1.0)      63.3785 (1.72)     0.0000 (1.0)           0;0  0.0158 (0.58)          1           1
test_add_symlink-add[3.60.1]     36.7678 (1.0)      36.7678 (1.0)      36.7678 (1.0)      0.0000 (1.0)      36.7678 (1.0)      0.0000 (1.0)           0;0  0.0272 (1.0)           1           1
test_add_symlink-add[main]       37.3313 (1.02)     37.3313 (1.02)     37.3313 (1.02)     0.0000 (1.0)      37.3313 (1.02)     0.0000 (1.0)           0;0  0.0268 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.8326 (7.86)     45.8326 (7.86)     45.8326 (7.86)     0.0000 (1.0)      45.8326 (7.86)     0.0000 (1.0)           0;0  0.0218 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     45.6632 (7.83)     45.6632 (7.83)     45.6632 (7.83)     0.0000 (1.0)      45.6632 (7.83)     0.0000 (1.0)           0;0  0.0219 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     45.7125 (7.84)     45.7125 (7.84)     45.7125 (7.84)     0.0000 (1.0)      45.7125 (7.84)     0.0000 (1.0)           0;0  0.0219 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.8291 (1.0)       5.8291 (1.0)       5.8291 (1.0)      0.0000 (1.0)       5.8291 (1.0)      0.0000 (1.0)           0;0  0.1716 (1.0)           1           1
test_add_symlink-add-noop[main]        5.8352 (1.00)      5.8352 (1.00)      5.8352 (1.00)     0.0000 (1.0)       5.8352 (1.00)     0.0000 (1.0)           0;0  0.1714 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     27.4610 (2.09)     27.4610 (2.09)     27.4610 (2.09)     0.0000 (1.0)      27.4610 (2.09)     0.0000 (1.0)           0;0  0.0364 (0.48)          1           1
test_checkout_copy-checkout[3.10.0]     90.8852 (6.93)     90.8852 (6.93)     90.8852 (6.93)     0.0000 (1.0)      90.8852 (6.93)     0.0000 (1.0)           0;0  0.0110 (0.14)          1           1
test_checkout_copy-checkout[3.53.2]     17.4922 (1.33)     17.4922 (1.33)     17.4922 (1.33)     0.0000 (1.0)      17.4922 (1.33)     0.0000 (1.0)           0;0  0.0572 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     13.1154 (1.0)      13.1154 (1.0)      13.1154 (1.0)      0.0000 (1.0)      13.1154 (1.0)      0.0000 (1.0)           0;0  0.0762 (1.0)           1           1
test_checkout_copy-checkout[main]       13.7000 (1.04)     13.7000 (1.04)     13.7000 (1.04)     0.0000 (1.0)      13.7000 (1.04)     0.0000 (1.0)           0;0  0.0730 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     4.1245 (1.33)     4.1245 (1.33)     4.1245 (1.33)     0.0000 (1.0)      4.1245 (1.33)     0.0000 (1.0)           0;0  0.2425 (0.75)          1           1
test_checkout_copy-checkout-noop[3.10.0]     4.4886 (1.45)     4.4886 (1.45)     4.4886 (1.45)     0.0000 (1.0)      4.4886 (1.45)     0.0000 (1.0)           0;0  0.2228 (0.69)          1           1
test_checkout_copy-checkout-noop[3.53.2]     4.3427 (1.40)     4.3427 (1.40)     4.3427 (1.40)     0.0000 (1.0)      4.3427 (1.40)     0.0000 (1.0)           0;0  0.2303 (0.71)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.1039 (1.0)      3.1039 (1.0)      3.1039 (1.0)      0.0000 (1.0)      3.1039 (1.0)      0.0000 (1.0)           0;0  0.3222 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3063 (1.07)     3.3063 (1.07)     3.3063 (1.07)     0.0000 (1.0)      3.3063 (1.07)     0.0000 (1.0)           0;0  0.3025 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     6.0418 (1.68)     6.0418 (1.68)     6.0418 (1.68)     0.0000 (1.0)      6.0418 (1.68)     0.0000 (1.0)           0;0  0.1655 (0.60)          1           1
test_checkout_copy-checkout-update[3.10.0]     5.1376 (1.43)     5.1376 (1.43)     5.1376 (1.43)     0.0000 (1.0)      5.1376 (1.43)     0.0000 (1.0)           0;0  0.1946 (0.70)          1           1
test_checkout_copy-checkout-update[3.53.2]     5.0042 (1.39)     5.0042 (1.39)     5.0042 (1.39)     0.0000 (1.0)      5.0042 (1.39)     0.0000 (1.0)           0;0  0.1998 (0.72)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.6052 (1.0)      3.6052 (1.0)      3.6052 (1.0)      0.0000 (1.0)      3.6052 (1.0)      0.0000 (1.0)           0;0  0.2774 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.0506 (1.12)     4.0506 (1.12)     4.0506 (1.12)     0.0000 (1.0)      4.0506 (1.12)     0.0000 (1.0)           0;0  0.2469 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     16.2395 (2.78)     16.2395 (2.78)     16.2395 (2.78)     0.0000 (1.0)      16.2395 (2.78)     0.0000 (1.0)           0;0  0.0616 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     11.9783 (2.05)     11.9783 (2.05)     11.9783 (2.05)     0.0000 (1.0)      11.9783 (2.05)     0.0000 (1.0)           0;0  0.0835 (0.49)          1           1
test_checkout_hardlink-checkout[3.53.2]     11.1054 (1.90)     11.1054 (1.90)     11.1054 (1.90)     0.0000 (1.0)      11.1054 (1.90)     0.0000 (1.0)           0;0  0.0900 (0.53)          1           1
test_checkout_hardlink-checkout[3.60.1]      5.8412 (1.0)       5.8412 (1.0)       5.8412 (1.0)      0.0000 (1.0)       5.8412 (1.0)      0.0000 (1.0)           0;0  0.1712 (1.0)           1           1
test_checkout_hardlink-checkout[main]        6.9484 (1.19)      6.9484 (1.19)      6.9484 (1.19)     0.0000 (1.0)       6.9484 (1.19)     0.0000 (1.0)           0;0  0.1439 (0.84)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     4.0240 (1.28)     4.0240 (1.28)     4.0240 (1.28)     0.0000 (1.0)      4.0240 (1.28)     0.0000 (1.0)           0;0  0.2485 (0.78)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     4.4192 (1.41)     4.4192 (1.41)     4.4192 (1.41)     0.0000 (1.0)      4.4192 (1.41)     0.0000 (1.0)           0;0  0.2263 (0.71)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     4.3181 (1.37)     4.3181 (1.37)     4.3181 (1.37)     0.0000 (1.0)      4.3181 (1.37)     0.0000 (1.0)           0;0  0.2316 (0.73)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.1432 (1.0)      3.1432 (1.0)      3.1432 (1.0)      0.0000 (1.0)      3.1432 (1.0)      0.0000 (1.0)           0;0  0.3181 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.1980 (1.02)     3.1980 (1.02)     3.1980 (1.02)     0.0000 (1.0)      3.1980 (1.02)     0.0000 (1.0)           0;0  0.3127 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     5.8718 (1.65)     5.8718 (1.65)     5.8718 (1.65)     0.0000 (1.0)      5.8718 (1.65)     0.0000 (1.0)           0;0  0.1703 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     5.0810 (1.42)     5.0810 (1.42)     5.0810 (1.42)     0.0000 (1.0)      5.0810 (1.42)     0.0000 (1.0)           0;0  0.1968 (0.70)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     4.9676 (1.39)     4.9676 (1.39)     4.9676 (1.39)     0.0000 (1.0)      4.9676 (1.39)     0.0000 (1.0)           0;0  0.2013 (0.72)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.5685 (1.0)      3.5685 (1.0)      3.5685 (1.0)      0.0000 (1.0)      3.5685 (1.0)      0.0000 (1.0)           0;0  0.2802 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.9194 (1.10)     3.9194 (1.10)     3.9194 (1.10)     0.0000 (1.0)      3.9194 (1.10)     0.0000 (1.0)           0;0  0.2551 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     23.7040 (2.33)     23.7040 (2.33)     23.7040 (2.33)     0.0000 (1.0)      23.7040 (2.33)     0.0000 (1.0)           0;0  0.0422 (0.43)          1           1
test_checkout_symlink-checkout[3.10.0]     19.2531 (1.90)     19.2531 (1.90)     19.2531 (1.90)     0.0000 (1.0)      19.2531 (1.90)     0.0000 (1.0)           0;0  0.0519 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.1911 (1.69)     17.1911 (1.69)     17.1911 (1.69)     0.0000 (1.0)      17.1911 (1.69)     0.0000 (1.0)           0;0  0.0582 (0.59)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1566 (1.0)      10.1566 (1.0)      10.1566 (1.0)      0.0000 (1.0)      10.1566 (1.0)      0.0000 (1.0)           0;0  0.0985 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.8016 (1.06)     10.8016 (1.06)     10.8016 (1.06)     0.0000 (1.0)      10.8016 (1.06)     0.0000 (1.0)           0;0  0.0926 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8566 (1.60)     6.8566 (1.60)     6.8566 (1.60)     0.0000 (1.0)      6.8566 (1.60)     0.0000 (1.0)           0;0  0.1458 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8810 (1.61)     6.8810 (1.61)     6.8810 (1.61)     0.0000 (1.0)      6.8810 (1.61)     0.0000 (1.0)           0;0  0.1453 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9583 (1.62)     6.9583 (1.62)     6.9583 (1.62)     0.0000 (1.0)      6.9583 (1.62)     0.0000 (1.0)           0;0  0.1437 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2823 (1.0)      4.2823 (1.0)      4.2823 (1.0)      0.0000 (1.0)      4.2823 (1.0)      0.0000 (1.0)           0;0  0.2335 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3671 (1.02)     4.3671 (1.02)     4.3671 (1.02)     0.0000 (1.0)      4.3671 (1.02)     0.0000 (1.0)           0;0  0.2290 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.9257 (1.72)     9.9257 (1.72)     9.9257 (1.72)     0.0000 (1.0)      9.9257 (1.72)     0.0000 (1.0)           0;0  0.1007 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.8566 (1.53)     8.8566 (1.53)     8.8566 (1.53)     0.0000 (1.0)      8.8566 (1.53)     0.0000 (1.0)           0;0  0.1129 (0.65)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.6419 (1.50)     8.6419 (1.50)     8.6419 (1.50)     0.0000 (1.0)      8.6419 (1.50)     0.0000 (1.0)           0;0  0.1157 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.7736 (1.0)      5.7736 (1.0)      5.7736 (1.0)      0.0000 (1.0)      5.7736 (1.0)      0.0000 (1.0)           0;0  0.1732 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.1961 (1.07)     6.1961 (1.07)     6.1961 (1.07)     0.0000 (1.0)      6.1961 (1.07)     0.0000 (1.0)           0;0  0.1614 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1247 (1.68)     4.1247 (1.68)     4.1247 (1.68)     0.0000 (1.0)      4.1247 (1.68)     0.0000 (1.0)           0;0  0.2424 (0.60)          1           1
test_data_status-data-changed[3.10.0]     4.9800 (2.03)     4.9800 (2.03)     4.9800 (2.03)     0.0000 (1.0)      4.9800 (2.03)     0.0000 (1.0)           0;0  0.2008 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.9050 (2.00)     4.9050 (2.00)     4.9050 (2.00)     0.0000 (1.0)      4.9050 (2.00)     0.0000 (1.0)           0;0  0.2039 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.4543 (1.0)      2.4543 (1.0)      2.4543 (1.0)      0.0000 (1.0)      2.4543 (1.0)      0.0000 (1.0)           0;0  0.4075 (1.0)           1           1
test_data_status-data-changed[main]       2.6622 (1.08)     2.6622 (1.08)     2.6622 (1.08)     0.0000 (1.0)      2.6622 (1.08)     0.0000 (1.0)           0;0  0.3756 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1992 (1.72)     4.1992 (1.72)     4.1992 (1.72)     0.0000 (1.0)      4.1992 (1.72)     0.0000 (1.0)           0;0  0.2381 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9979 (2.05)     4.9979 (2.05)     4.9979 (2.05)     0.0000 (1.0)      4.9979 (2.05)     0.0000 (1.0)           0;0  0.2001 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.9852 (2.05)     4.9852 (2.05)     4.9852 (2.05)     0.0000 (1.0)      4.9852 (2.05)     0.0000 (1.0)           0;0  0.2006 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4362 (1.0)      2.4362 (1.0)      2.4362 (1.0)      0.0000 (1.0)      2.4362 (1.0)      0.0000 (1.0)           0;0  0.4105 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6404 (1.08)     2.6404 (1.08)     2.6404 (1.08)     0.0000 (1.0)      2.6404 (1.08)     0.0000 (1.0)           0;0  0.3787 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.8186 (3.75)     18.8186 (3.75)     18.8186 (3.75)     0.0000 (1.0)      18.8186 (3.75)     0.0000 (1.0)           0;0  0.0531 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.6783 (3.92)     19.6783 (3.92)     19.6783 (3.92)     0.0000 (1.0)      19.6783 (3.92)     0.0000 (1.0)           0;0  0.0508 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.0911 (3.81)     19.0911 (3.81)     19.0911 (3.81)     0.0000 (1.0)      19.0911 (3.81)     0.0000 (1.0)           0;0  0.0524 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.0166 (1.0)       5.0166 (1.0)       5.0166 (1.0)      0.0000 (1.0)       5.0166 (1.0)      0.0000 (1.0)           0;0  0.1993 (1.0)           1           1
test_data_status-data-new[main]        5.4678 (1.09)      5.4678 (1.09)      5.4678 (1.09)     0.0000 (1.0)       5.4678 (1.09)     0.0000 (1.0)           0;0  0.1829 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0932 (1.67)     4.0932 (1.67)     4.0932 (1.67)     0.0000 (1.0)      4.0932 (1.67)     0.0000 (1.0)           0;0  0.2443 (0.60)          1           1
test_data_status-data-noop[3.10.0]     4.9271 (2.01)     4.9271 (2.01)     4.9271 (2.01)     0.0000 (1.0)      4.9271 (2.01)     0.0000 (1.0)           0;0  0.2030 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.9901 (2.04)     4.9901 (2.04)     4.9901 (2.04)     0.0000 (1.0)      4.9901 (2.04)     0.0000 (1.0)           0;0  0.2004 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.4471 (1.0)      2.4471 (1.0)      2.4471 (1.0)      0.0000 (1.0)      2.4471 (1.0)      0.0000 (1.0)           0;0  0.4086 (1.0)           1           1
test_data_status-data-noop[main]       2.6941 (1.10)     2.6941 (1.10)     2.6941 (1.10)     0.0000 (1.0)      2.6941 (1.10)     0.0000 (1.0)           0;0  0.3712 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.7305 (1.24)     6.7305 (1.24)     6.7305 (1.24)     0.0000 (1.0)      6.7305 (1.24)     0.0000 (1.0)           0;0  0.1486 (0.81)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.5947 (1.40)     7.5947 (1.40)     7.5947 (1.40)     0.0000 (1.0)      7.5947 (1.40)     0.0000 (1.0)           0;0  0.1317 (0.72)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5719 (1.39)     7.5719 (1.39)     7.5719 (1.39)     0.0000 (1.0)      7.5719 (1.39)     0.0000 (1.0)           0;0  0.1321 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4350 (1.0)      5.4350 (1.0)      5.4350 (1.0)      0.0000 (1.0)      5.4350 (1.0)      0.0000 (1.0)           0;0  0.1840 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.8259 (1.07)     5.8259 (1.07)     5.8259 (1.07)     0.0000 (1.0)      5.8259 (1.07)     0.0000 (1.0)           0;0  0.1716 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.6846 (1.21)     6.6846 (1.21)     6.6846 (1.21)     0.0000 (1.0)      6.6846 (1.21)     0.0000 (1.0)           0;0  0.1496 (0.83)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6096 (1.38)     7.6096 (1.38)     7.6096 (1.38)     0.0000 (1.0)      7.6096 (1.38)     0.0000 (1.0)           0;0  0.1314 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.5900 (1.37)     7.5900 (1.37)     7.5900 (1.37)     0.0000 (1.0)      7.5900 (1.37)     0.0000 (1.0)           0;0  0.1318 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5201 (1.0)      5.5201 (1.0)      5.5201 (1.0)      0.0000 (1.0)      5.5201 (1.0)      0.0000 (1.0)           0;0  0.1812 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8516 (1.06)     5.8516 (1.06)     5.8516 (1.06)     0.0000 (1.0)      5.8516 (1.06)     0.0000 (1.0)           0;0  0.1709 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.5619 (2.59)     20.5619 (2.59)     20.5619 (2.59)     0.0000 (1.0)      20.5619 (2.59)     0.0000 (1.0)           0;0  0.0486 (0.39)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.1941 (2.80)     22.1941 (2.80)     22.1941 (2.80)     0.0000 (1.0)      22.1941 (2.80)     0.0000 (1.0)           0;0  0.0451 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.5872 (2.72)     21.5872 (2.72)     21.5872 (2.72)     0.0000 (1.0)      21.5872 (2.72)     0.0000 (1.0)           0;0  0.0463 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9253 (1.0)       7.9253 (1.0)       7.9253 (1.0)      0.0000 (1.0)       7.9253 (1.0)      0.0000 (1.0)           0;0  0.1262 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4846 (1.07)      8.4846 (1.07)      8.4846 (1.07)     0.0000 (1.0)       8.4846 (1.07)     0.0000 (1.0)           0;0  0.1179 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.1387 (1.34)     6.1387 (1.34)     6.1387 (1.34)     0.0000 (1.0)      6.1387 (1.34)     0.0000 (1.0)           0;0  0.1629 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2843 (1.59)     7.2843 (1.59)     7.2843 (1.59)     0.0000 (1.0)      7.2843 (1.59)     0.0000 (1.0)           0;0  0.1373 (0.63)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1071 (1.55)     7.1071 (1.55)     7.1071 (1.55)     0.0000 (1.0)      7.1071 (1.55)     0.0000 (1.0)           0;0  0.1407 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5903 (1.0)      4.5903 (1.0)      4.5903 (1.0)      0.0000 (1.0)      4.5903 (1.0)      0.0000 (1.0)           0;0  0.2179 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.1788 (1.13)     5.1788 (1.13)     5.1788 (1.13)     0.0000 (1.0)      5.1788 (1.13)     0.0000 (1.0)           0;0  0.1931 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.5155 (2.67)     17.5155 (2.67)     17.5155 (2.67)     0.0000 (1.0)      17.5155 (2.67)     0.0000 (1.0)           0;0  0.0571 (0.37)          1           1
test_diff-diff[3.10.0]     19.1276 (2.92)     19.1276 (2.92)     19.1276 (2.92)     0.0000 (1.0)      19.1276 (2.92)     0.0000 (1.0)           0;0  0.0523 (0.34)          1           1
test_diff-diff[3.53.2]     18.4374 (2.81)     18.4374 (2.81)     18.4374 (2.81)     0.0000 (1.0)      18.4374 (2.81)     0.0000 (1.0)           0;0  0.0542 (0.36)          1           1
test_diff-diff[3.60.1]      6.5522 (1.0)       6.5522 (1.0)       6.5522 (1.0)      0.0000 (1.0)       6.5522 (1.0)      0.0000 (1.0)           0;0  0.1526 (1.0)           1           1
test_diff-diff[main]        7.6854 (1.17)      7.6854 (1.17)      7.6854 (1.17)     0.0000 (1.0)       7.6854 (1.17)     0.0000 (1.0)           0;0  0.1301 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.8429 (1.74)     5.8429 (1.74)     5.8429 (1.74)     0.0000 (1.0)      5.8429 (1.74)     0.0000 (1.0)           0;0  0.1711 (0.58)          1           1
test_diff-diff-changed[3.10.0]     6.5218 (1.94)     6.5218 (1.94)     6.5218 (1.94)     0.0000 (1.0)      6.5218 (1.94)     0.0000 (1.0)           0;0  0.1533 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.5236 (1.64)     5.5236 (1.64)     5.5236 (1.64)     0.0000 (1.0)      5.5236 (1.64)     0.0000 (1.0)           0;0  0.1810 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.3652 (1.0)      3.3652 (1.0)      3.3652 (1.0)      0.0000 (1.0)      3.3652 (1.0)      0.0000 (1.0)           0;0  0.2972 (1.0)           1           1
test_diff-diff-changed[main]       4.1984 (1.25)     4.1984 (1.25)     4.1984 (1.25)     0.0000 (1.0)      4.1984 (1.25)     0.0000 (1.0)           0;0  0.2382 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.9417 (1.52)     4.9417 (1.52)     4.9417 (1.52)     0.0000 (1.0)      4.9417 (1.52)     0.0000 (1.0)           0;0  0.2024 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6588 (1.74)     5.6588 (1.74)     5.6588 (1.74)     0.0000 (1.0)      5.6588 (1.74)     0.0000 (1.0)           0;0  0.1767 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5152 (1.69)     5.5152 (1.69)     5.5152 (1.69)     0.0000 (1.0)      5.5152 (1.69)     0.0000 (1.0)           0;0  0.1813 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2588 (1.0)      3.2588 (1.0)      3.2588 (1.0)      0.0000 (1.0)      3.2588 (1.0)      0.0000 (1.0)           0;0  0.3069 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0931 (1.26)     4.0931 (1.26)     4.0931 (1.26)     0.0000 (1.0)      4.0931 (1.26)     0.0000 (1.0)           0;0  0.2443 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2239 (1.30)     4.2239 (1.30)     4.2239 (1.30)     0.0000 (1.0)      4.2239 (1.30)     0.0000 (1.0)           0;0  0.2367 (0.77)          1           1
test_diff-diff-noop[3.10.0]     4.8549 (1.50)     4.8549 (1.50)     4.8549 (1.50)     0.0000 (1.0)      4.8549 (1.50)     0.0000 (1.0)           0;0  0.2060 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.4038 (1.67)     5.4038 (1.67)     5.4038 (1.67)     0.0000 (1.0)      5.4038 (1.67)     0.0000 (1.0)           0;0  0.1851 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.2379 (1.0)      3.2379 (1.0)      3.2379 (1.0)      0.0000 (1.0)      3.2379 (1.0)      0.0000 (1.0)           0;0  0.3088 (1.0)           1           1
test_diff-diff-noop[main]       4.0723 (1.26)     4.0723 (1.26)     4.0723 (1.26)     0.0000 (1.0)      4.0723 (1.26)     0.0000 (1.0)           0;0  0.2456 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.1743 (1.0)      1.1743 (1.0)      1.1743 (1.0)      0.0000 (1.0)      1.1743 (1.0)      0.0000 (1.0)           0;0  0.8516 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.6077 (4.78)     5.6077 (4.78)     5.6077 (4.78)     0.0000 (1.0)      5.6077 (4.78)     0.0000 (1.0)           0;0  0.1783 (0.21)          1           1
test_exp_show-exp[3.53.2]     3.3203 (2.83)     3.3203 (2.83)     3.3203 (2.83)     0.0000 (1.0)      3.3203 (2.83)     0.0000 (1.0)           0;0  0.3012 (0.35)          1           1
test_exp_show-exp[3.60.1]     3.5946 (3.06)     3.5946 (3.06)     3.5946 (3.06)     0.0000 (1.0)      3.5946 (3.06)     0.0000 (1.0)           0;0  0.2782 (0.33)          1           1
test_exp_show-exp[main]       6.2785 (5.35)     6.2785 (5.35)     6.2785 (5.35)     0.0000 (1.0)      6.2785 (5.35)     0.0000 (1.0)           0;0  0.1593 (0.19)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     106.5484 (4.65)     106.5484 (4.65)     106.5484 (4.65)     0.0000 (1.0)      106.5484 (4.65)     0.0000 (1.0)           0;0  0.0094 (0.22)          1           1
test_fetch-fetch[3.10.0]     112.1146 (4.89)     112.1146 (4.89)     112.1146 (4.89)     0.0000 (1.0)      112.1146 (4.89)     0.0000 (1.0)           0;0  0.0089 (0.20)          1           1
test_fetch-fetch[3.53.2]      32.8029 (1.43)      32.8029 (1.43)      32.8029 (1.43)     0.0000 (1.0)       32.8029 (1.43)     0.0000 (1.0)           0;0  0.0305 (0.70)          1           1
test_fetch-fetch[3.60.1]      23.2185 (1.01)      23.2185 (1.01)      23.2185 (1.01)     0.0000 (1.0)       23.2185 (1.01)     0.0000 (1.0)           0;0  0.0431 (0.99)          1           1
test_fetch-fetch[main]        22.9355 (1.0)       22.9355 (1.0)       22.9355 (1.0)      0.0000 (1.0)       22.9355 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9300 (1.0)      2.9300 (1.0)      2.9300 (1.0)      0.0000 (1.0)      2.9300 (1.0)      0.0000 (1.0)           0;0  0.3413 (1.0)           1           1
test_gc-gc[3.10.0]     3.2185 (1.10)     3.2185 (1.10)     3.2185 (1.10)     0.0000 (1.0)      3.2185 (1.10)     0.0000 (1.0)           0;0  0.3107 (0.91)          1           1
test_gc-gc[3.53.2]     3.0142 (1.03)     3.0142 (1.03)     3.0142 (1.03)     0.0000 (1.0)      3.0142 (1.03)     0.0000 (1.0)           0;0  0.3318 (0.97)          1           1
test_gc-gc[3.60.1]     3.0476 (1.04)     3.0476 (1.04)     3.0476 (1.04)     0.0000 (1.0)      3.0476 (1.04)     0.0000 (1.0)           0;0  0.3281 (0.96)          1           1
test_gc-gc[main]       3.1918 (1.09)     3.1918 (1.09)     3.1918 (1.09)     0.0000 (1.0)      3.1918 (1.09)     0.0000 (1.0)           0;0  0.3133 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     179.0540 (3.42)     179.0540 (3.42)     179.0540 (3.42)     0.0000 (1.0)      179.0540 (3.42)     0.0000 (1.0)           0;0  0.0056 (0.29)          1           1
test_get-get[3.10.0]     213.8727 (4.09)     213.8727 (4.09)     213.8727 (4.09)     0.0000 (1.0)      213.8727 (4.09)     0.0000 (1.0)           0;0  0.0047 (0.24)          1           1
test_get-get[3.53.2]     160.9295 (3.08)     160.9295 (3.08)     160.9295 (3.08)     0.0000 (1.0)      160.9295 (3.08)     0.0000 (1.0)           0;0  0.0062 (0.33)          1           1
test_get-get[3.60.1]      52.3036 (1.0)       52.3036 (1.0)       52.3036 (1.0)      0.0000 (1.0)       52.3036 (1.0)      0.0000 (1.0)           0;0  0.0191 (1.0)           1           1
test_get-get[main]        52.6559 (1.01)      52.6559 (1.01)      52.6559 (1.01)     0.0000 (1.0)       52.6559 (1.01)     0.0000 (1.0)           0;0  0.0190 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     87.9705 (5.26)     87.9705 (5.26)     87.9705 (5.26)     0.0000 (1.0)      87.9705 (5.26)     0.0000 (1.0)           0;0  0.0114 (0.19)          1           1
test_get_url-get-url[3.10.0]     89.5398 (5.36)     89.5398 (5.36)     89.5398 (5.36)     0.0000 (1.0)      89.5398 (5.36)     0.0000 (1.0)           0;0  0.0112 (0.19)          1           1
test_get_url-get-url[3.53.2]     16.7095 (1.0)      16.7095 (1.0)      16.7095 (1.0)      0.0000 (1.0)      16.7095 (1.0)      0.0000 (1.0)           0;0  0.0598 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.8523 (1.01)     16.8523 (1.01)     16.8523 (1.01)     0.0000 (1.0)      16.8523 (1.01)     0.0000 (1.0)           0;0  0.0593 (0.99)          1           1
test_get_url-get-url[main]       17.3265 (1.04)     17.3265 (1.04)     17.3265 (1.04)     0.0000 (1.0)      17.3265 (1.04)     0.0000 (1.0)           0;0  0.0577 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     171.4301 (1.03)     197.9760 (1.08)     178.4323 (1.03)     3.8371 (1.45)     178.5175 (1.03)     3.6618 (1.21)         27;4  5.6044 (0.97)        100           1
test_help---help[3.10.0]     166.2553 (1.00)     183.1314 (1.0)      173.0680 (1.0)      3.3002 (1.25)     172.6450 (1.0)      4.4655 (1.48)         30;3  5.7781 (1.0)         100           1
test_help---help[3.53.2]     173.3940 (1.04)     190.0428 (1.04)     179.5302 (1.04)     2.6444 (1.0)      179.4917 (1.04)     3.0181 (1.0)          26;4  5.5701 (0.96)        100           1
test_help---help[3.60.1]     173.2364 (1.04)     198.5846 (1.08)     179.9372 (1.04)     3.7667 (1.42)     179.5484 (1.04)     3.8828 (1.29)         26;3  5.5575 (0.96)        100           1
test_help---help[main]       166.0094 (1.0)      220.2074 (1.20)     174.8452 (1.01)     8.0143 (3.03)     172.9710 (1.00)     5.0190 (1.66)          8;7  5.7193 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     262.1440 (3.36)     262.1440 (3.36)     262.1440 (3.36)     0.0000 (1.0)      262.1440 (3.36)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[3.10.0]     298.9192 (3.83)     298.9192 (3.83)     298.9192 (3.83)     0.0000 (1.0)      298.9192 (3.83)     0.0000 (1.0)           0;0  0.0033 (0.26)          1           1
test_import-import[3.60.1]      78.0008 (1.00)      78.0008 (1.00)      78.0008 (1.00)     0.0000 (1.0)       78.0008 (1.00)     0.0000 (1.0)           0;0  0.0128 (1.00)          1           1
test_import-import[main]        77.9647 (1.0)       77.9647 (1.0)       77.9647 (1.0)      0.0000 (1.0)       77.9647 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     194.9755 (4.22)     194.9755 (4.22)     194.9755 (4.22)     0.0000 (1.0)      194.9755 (4.22)     0.0000 (1.0)           0;0  0.0051 (0.24)          1           1
test_import_url-import-url[3.10.0]     198.2836 (4.29)     198.2836 (4.29)     198.2836 (4.29)     0.0000 (1.0)      198.2836 (4.29)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_import_url-import-url[3.53.2]     116.7514 (2.53)     116.7514 (2.53)     116.7514 (2.53)     0.0000 (1.0)      116.7514 (2.53)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.1705 (1.0)       46.1705 (1.0)       46.1705 (1.0)      0.0000 (1.0)       46.1705 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_import_url-import-url[main]        47.3807 (1.03)      47.3807 (1.03)      47.3807 (1.03)     0.0000 (1.0)       47.3807 (1.03)     0.0000 (1.0)           0;0  0.0211 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     421.4314 (1.02)     470.8035 (1.03)     432.9999 (1.02)      6.7548 (1.0)      431.5766 (1.02)      5.3606 (1.0)          15;4  2.3095 (0.98)        100           1
test_init-init[3.10.0]     428.8856 (1.04)     486.5273 (1.06)     439.1100 (1.03)      8.6752 (1.28)     436.8047 (1.03)      7.1467 (1.33)         14;6  2.2773 (0.97)        100           1
test_init-init[3.53.2]     411.4250 (1.0)      533.1364 (1.16)     425.1708 (1.0)      13.1496 (1.95)     422.3925 (1.0)       7.0673 (1.32)          6;5  2.3520 (1.0)         100           1
test_init-init[3.60.1]     414.6575 (1.01)     458.7855 (1.0)      426.7311 (1.00)      7.7781 (1.15)     425.0125 (1.01)     10.7961 (2.01)         28;1  2.3434 (1.00)        100           1
test_init-init[main]       452.1745 (1.10)     572.6560 (1.25)     470.7195 (1.11)     14.2298 (2.11)     466.5163 (1.10)     12.4531 (2.32)         12;5  2.1244 (0.90)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     667.1461 (1.05)     667.1461 (1.05)     667.1461 (1.05)     0.0000 (1.0)      667.1461 (1.05)     0.0000 (1.0)           0;0  1.4989 (0.96)          1           1
test_list-list[3.10.0]     971.3186 (1.52)     971.3186 (1.52)     971.3186 (1.52)     0.0000 (1.0)      971.3186 (1.52)     0.0000 (1.0)           0;0  1.0295 (0.66)          1           1
test_list-list[3.53.2]     658.3458 (1.03)     658.3458 (1.03)     658.3458 (1.03)     0.0000 (1.0)      658.3458 (1.03)     0.0000 (1.0)           0;0  1.5190 (0.97)          1           1
test_list-list[3.60.1]     703.8236 (1.10)     703.8236 (1.10)     703.8236 (1.10)     0.0000 (1.0)      703.8236 (1.10)     0.0000 (1.0)           0;0  1.4208 (0.91)          1           1
test_list-list[main]       637.6309 (1.0)      637.6309 (1.0)      637.6309 (1.0)      0.0000 (1.0)      637.6309 (1.0)      0.0000 (1.0)           0;0  1.5683 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     471.6618 (1.08)     471.6618 (1.08)     471.6618 (1.08)     0.0000 (1.0)      471.6618 (1.08)     0.0000 (1.0)           0;0  2.1202 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     471.9527 (1.08)     471.9527 (1.08)     471.9527 (1.08)     0.0000 (1.0)      471.9527 (1.08)     0.0000 (1.0)           0;0  2.1189 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     435.3868 (1.0)      435.3868 (1.0)      435.3868 (1.0)      0.0000 (1.0)      435.3868 (1.0)      0.0000 (1.0)           0;0  2.2968 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     444.1619 (1.02)     444.1619 (1.02)     444.1619 (1.02)     0.0000 (1.0)      444.1619 (1.02)     0.0000 (1.0)           0;0  2.2514 (0.98)          1           1
test_list-list-dvc-only[main]       472.6071 (1.09)     472.6071 (1.09)     472.6071 (1.09)     0.0000 (1.0)      472.6071 (1.09)     0.0000 (1.0)           0;0  2.1159 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5487 (1.0)      2.5487 (1.0)      2.5487 (1.0)      0.0000 (1.0)      2.5487 (1.0)      0.0000 (1.0)           0;0  0.3924 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6001 (1.02)     2.6001 (1.02)     2.6001 (1.02)     0.0000 (1.0)      2.6001 (1.02)     0.0000 (1.0)           0;0  0.3846 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.7454 (1.08)     2.7454 (1.08)     2.7454 (1.08)     0.0000 (1.0)      2.7454 (1.08)     0.0000 (1.0)           0;0  0.3642 (0.93)          1           1
test_list-list-recursive[3.60.1]     2.7998 (1.10)     2.7998 (1.10)     2.7998 (1.10)     0.0000 (1.0)      2.7998 (1.10)     0.0000 (1.0)           0;0  0.3572 (0.91)          1           1
test_list-list-recursive[main]       2.9244 (1.15)     2.9244 (1.15)     2.9244 (1.15)     0.0000 (1.0)      2.9244 (1.15)     0.0000 (1.0)           0;0  0.3419 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     465.8749 (1.07)     465.8749 (1.07)     465.8749 (1.07)     0.0000 (1.0)      465.8749 (1.07)     0.0000 (1.0)           0;0  2.1465 (0.93)          1           1
test_list-list-shallow[3.10.0]     452.2167 (1.04)     452.2167 (1.04)     452.2167 (1.04)     0.0000 (1.0)      452.2167 (1.04)     0.0000 (1.0)           0;0  2.2113 (0.96)          1           1
test_list-list-shallow[3.53.2]     435.0761 (1.0)      435.0761 (1.0)      435.0761 (1.0)      0.0000 (1.0)      435.0761 (1.0)      0.0000 (1.0)           0;0  2.2984 (1.0)           1           1
test_list-list-shallow[3.60.1]     444.3495 (1.02)     444.3495 (1.02)     444.3495 (1.02)     0.0000 (1.0)      444.3495 (1.02)     0.0000 (1.0)           0;0  2.2505 (0.98)          1           1
test_list-list-shallow[main]       452.7999 (1.04)     452.7999 (1.04)     452.7999 (1.04)     0.0000 (1.0)      452.7999 (1.04)     0.0000 (1.0)           0;0  2.2085 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     67.5062 (3.52)     67.5062 (3.52)     67.5062 (3.52)     0.0000 (1.0)      67.5062 (3.52)     0.0000 (1.0)           0;0  0.0148 (0.28)          1           1
test_partial_add-add[3.10.0]     67.7825 (3.53)     67.7825 (3.53)     67.7825 (3.53)     0.0000 (1.0)      67.7825 (3.53)     0.0000 (1.0)           0;0  0.0148 (0.28)          1           1
test_partial_add-add[3.53.2]     60.8464 (3.17)     60.8464 (3.17)     60.8464 (3.17)     0.0000 (1.0)      60.8464 (3.17)     0.0000 (1.0)           0;0  0.0164 (0.32)          1           1
test_partial_add-add[3.60.1]     19.1872 (1.0)      19.1872 (1.0)      19.1872 (1.0)      0.0000 (1.0)      19.1872 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
test_partial_add-add[main]       20.2759 (1.06)     20.2759 (1.06)     20.2759 (1.06)     0.0000 (1.0)      20.2759 (1.06)     0.0000 (1.0)           0;0  0.0493 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     56.9262 (7.82)     56.9262 (7.82)     56.9262 (7.82)     0.0000 (1.0)      56.9262 (7.82)     0.0000 (1.0)           0;0  0.0176 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     57.7351 (7.93)     57.7351 (7.93)     57.7351 (7.93)     0.0000 (1.0)      57.7351 (7.93)     0.0000 (1.0)           0;0  0.0173 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     52.0542 (7.15)     52.0542 (7.15)     52.0542 (7.15)     0.0000 (1.0)      52.0542 (7.15)     0.0000 (1.0)           0;0  0.0192 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.2833 (1.0)       7.2833 (1.0)       7.2833 (1.0)      0.0000 (1.0)       7.2833 (1.0)      0.0000 (1.0)           0;0  0.1373 (1.0)           1           1
test_partial_add-add-partial[main]        7.4947 (1.03)      7.4947 (1.03)      7.4947 (1.03)     0.0000 (1.0)       7.4947 (1.03)     0.0000 (1.0)           0;0  0.1334 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5264 (1.0)      4.5264 (1.0)      4.5264 (1.0)      0.0000 (1.0)      4.5264 (1.0)      0.0000 (1.0)           0;0  0.2209 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8324 (1.29)     5.8324 (1.29)     5.8324 (1.29)     0.0000 (1.0)      5.8324 (1.29)     0.0000 (1.0)           0;0  0.1715 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6704 (1.47)     6.6704 (1.47)     6.6704 (1.47)     0.0000 (1.0)      6.6704 (1.47)     0.0000 (1.0)           0;0  0.1499 (0.68)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7490 (1.49)     6.7490 (1.49)     6.7490 (1.49)     0.0000 (1.0)      6.7490 (1.49)     0.0000 (1.0)           0;0  0.1482 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       5.7570 (1.27)     5.7570 (1.27)     5.7570 (1.27)     0.0000 (1.0)      5.7570 (1.27)     0.0000 (1.0)           0;0  0.1737 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4282 (1.0)      2.4282 (1.0)      2.4282 (1.0)      0.0000 (1.0)      2.4282 (1.0)      0.0000 (1.0)           0;0  0.4118 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6842 (1.52)     3.6842 (1.52)     3.6842 (1.52)     0.0000 (1.0)      3.6842 (1.52)     0.0000 (1.0)           0;0  0.2714 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.7504 (1.54)     3.7504 (1.54)     3.7504 (1.54)     0.0000 (1.0)      3.7504 (1.54)     0.0000 (1.0)           0;0  0.2666 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.7915 (1.56)     3.7915 (1.56)     3.7915 (1.56)     0.0000 (1.0)      3.7915 (1.56)     0.0000 (1.0)           0;0  0.2637 (0.64)          1           1
test_partial_add-gc-noop[main]       2.7964 (1.15)     2.7964 (1.15)     2.7964 (1.15)     0.0000 (1.0)      2.7964 (1.15)     0.0000 (1.0)           0;0  0.3576 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     80.3924 (4.25)     80.3924 (4.25)     80.3924 (4.25)     0.0000 (1.0)      80.3924 (4.25)     0.0000 (1.0)           0;0  0.0124 (0.24)          1           1
test_partial_add-push[3.10.0]     37.1845 (1.97)     37.1845 (1.97)     37.1845 (1.97)     0.0000 (1.0)      37.1845 (1.97)     0.0000 (1.0)           0;0  0.0269 (0.51)          1           1
test_partial_add-push[3.53.2]     19.0237 (1.01)     19.0237 (1.01)     19.0237 (1.01)     0.0000 (1.0)      19.0237 (1.01)     0.0000 (1.0)           0;0  0.0526 (0.99)          1           1
test_partial_add-push[3.60.1]     18.9041 (1.0)      18.9041 (1.0)      18.9041 (1.0)      0.0000 (1.0)      18.9041 (1.0)      0.0000 (1.0)           0;0  0.0529 (1.0)           1           1
test_partial_add-push[main]       19.0318 (1.01)     19.0318 (1.01)     19.0318 (1.01)     0.0000 (1.0)      19.0318 (1.01)     0.0000 (1.0)           0;0  0.0525 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.3375 (1.74)     17.3375 (1.74)     17.3375 (1.74)     0.0000 (1.0)      17.3375 (1.74)     0.0000 (1.0)           0;0  0.0577 (0.57)          1           1
test_partial_add-push-partial[3.10.0]     10.0594 (1.01)     10.0594 (1.01)     10.0594 (1.01)     0.0000 (1.0)      10.0594 (1.01)     0.0000 (1.0)           0;0  0.0994 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.2750 (1.03)     10.2750 (1.03)     10.2750 (1.03)     0.0000 (1.0)      10.2750 (1.03)     0.0000 (1.0)           0;0  0.0973 (0.97)          1           1
test_partial_add-push-partial[3.60.1]      9.9544 (1.0)       9.9544 (1.0)       9.9544 (1.0)      0.0000 (1.0)       9.9544 (1.0)      0.0000 (1.0)           0;0  0.1005 (1.0)           1           1
test_partial_add-push-partial[main]       10.1205 (1.02)     10.1205 (1.02)     10.1205 (1.02)     0.0000 (1.0)      10.1205 (1.02)     0.0000 (1.0)           0;0  0.0988 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.1179 (3.81)     85.1179 (3.81)     85.1179 (3.81)     0.0000 (1.0)      85.1179 (3.81)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_partial_remove-add[3.10.0]     84.7979 (3.80)     84.7979 (3.80)     84.7979 (3.80)     0.0000 (1.0)      84.7979 (3.80)     0.0000 (1.0)           0;0  0.0118 (0.26)          1           1
test_partial_remove-add[3.53.2]     76.3695 (3.42)     76.3695 (3.42)     76.3695 (3.42)     0.0000 (1.0)      76.3695 (3.42)     0.0000 (1.0)           0;0  0.0131 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.3178 (1.0)      22.3178 (1.0)      22.3178 (1.0)      0.0000 (1.0)      22.3178 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
test_partial_remove-add[main]       24.0145 (1.08)     24.0145 (1.08)     24.0145 (1.08)     0.0000 (1.0)      24.0145 (1.08)     0.0000 (1.0)           0;0  0.0416 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.6012 (7.89)     8.6012 (7.89)     8.6012 (7.89)     0.0000 (1.0)      8.6012 (7.89)     0.0000 (1.0)           0;0  0.1163 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.7480 (8.03)     8.7480 (8.03)     8.7480 (8.03)     0.0000 (1.0)      8.7480 (8.03)     0.0000 (1.0)           0;0  0.1143 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.4737 (6.86)     7.4737 (6.86)     7.4737 (6.86)     0.0000 (1.0)      7.4737 (6.86)     0.0000 (1.0)           0;0  0.1338 (0.15)          1           1
test_partial_remove-add-update[3.60.1]     1.0897 (1.0)      1.0897 (1.0)      1.0897 (1.0)      0.0000 (1.0)      1.0897 (1.0)      0.0000 (1.0)           0;0  0.9177 (1.0)           1           1
test_partial_remove-add-update[main]       1.2489 (1.15)     1.2489 (1.15)     1.2489 (1.15)     0.0000 (1.0)      1.2489 (1.15)     0.0000 (1.0)           0;0  0.8007 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3736 (1.0)      3.3736 (1.0)      3.3736 (1.0)      0.0000 (1.0)      3.3736 (1.0)      0.0000 (1.0)           0;0  0.2964 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6125 (1.07)     3.6125 (1.07)     3.6125 (1.07)     0.0000 (1.0)      3.6125 (1.07)     0.0000 (1.0)           0;0  0.2768 (0.93)          1           1
test_partial_remove-gc[3.53.2]     3.6222 (1.07)     3.6222 (1.07)     3.6222 (1.07)     0.0000 (1.0)      3.6222 (1.07)     0.0000 (1.0)           0;0  0.2761 (0.93)          1           1
test_partial_remove-gc[3.60.1]     3.8085 (1.13)     3.8085 (1.13)     3.8085 (1.13)     0.0000 (1.0)      3.8085 (1.13)     0.0000 (1.0)           0;0  0.2626 (0.89)          1           1
test_partial_remove-gc[main]       3.7070 (1.10)     3.7070 (1.10)     3.7070 (1.10)     0.0000 (1.0)      3.7070 (1.10)     0.0000 (1.0)           0;0  0.2698 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8561 (1.0)      4.8561 (1.0)      4.8561 (1.0)      0.0000 (1.0)      4.8561 (1.0)      0.0000 (1.0)           0;0  0.2059 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.3236 (1.10)     5.3236 (1.10)     5.3236 (1.10)     0.0000 (1.0)      5.3236 (1.10)     0.0000 (1.0)           0;0  0.1878 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.2607 (1.08)     5.2607 (1.08)     5.2607 (1.08)     0.0000 (1.0)      5.2607 (1.08)     0.0000 (1.0)           0;0  0.1901 (0.92)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8760 (1.00)     4.8760 (1.00)     4.8760 (1.00)     0.0000 (1.0)      4.8760 (1.00)     0.0000 (1.0)           0;0  0.2051 (1.00)          1           1
test_partial_remove-gc-cloud[main]       4.9428 (1.02)     4.9428 (1.02)     4.9428 (1.02)     0.0000 (1.0)      4.9428 (1.02)     0.0000 (1.0)           0;0  0.2023 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     91.1122 (4.05)     91.1122 (4.05)     91.1122 (4.05)     0.0000 (1.0)      91.1122 (4.05)     0.0000 (1.0)           0;0  0.0110 (0.25)          1           1
test_partial_remove-push[3.10.0]     41.7773 (1.86)     41.7773 (1.86)     41.7773 (1.86)     0.0000 (1.0)      41.7773 (1.86)     0.0000 (1.0)           0;0  0.0239 (0.54)          1           1
test_partial_remove-push[3.53.2]     23.0091 (1.02)     23.0091 (1.02)     23.0091 (1.02)     0.0000 (1.0)      23.0091 (1.02)     0.0000 (1.0)           0;0  0.0435 (0.98)          1           1
test_partial_remove-push[3.60.1]     22.6269 (1.01)     22.6269 (1.01)     22.6269 (1.01)     0.0000 (1.0)      22.6269 (1.01)     0.0000 (1.0)           0;0  0.0442 (0.99)          1           1
test_partial_remove-push[main]       22.4701 (1.0)      22.4701 (1.0)      22.4701 (1.0)      0.0000 (1.0)      22.4701 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.9334 (1.02)     1.9334 (1.02)     1.9334 (1.02)     0.0000 (1.0)      1.9334 (1.02)     0.0000 (1.0)           0;0  0.5172 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     1.8957 (1.0)      1.8957 (1.0)      1.8957 (1.0)      0.0000 (1.0)      1.8957 (1.0)      0.0000 (1.0)           0;0  0.5275 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5752 (1.36)     2.5752 (1.36)     2.5752 (1.36)     0.0000 (1.0)      2.5752 (1.36)     0.0000 (1.0)           0;0  0.3883 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.5709 (1.36)     2.5709 (1.36)     2.5709 (1.36)     0.0000 (1.0)      2.5709 (1.36)     0.0000 (1.0)           0;0  0.3890 (0.74)          1           1
test_partial_remove-push-update[main]       2.5647 (1.35)     2.5647 (1.35)     2.5647 (1.35)     0.0000 (1.0)      2.5647 (1.35)     0.0000 (1.0)           0;0  0.3899 (0.74)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     559.3691 (1.0)      567.0646 (1.0)      563.0732 (1.0)      3.1333 (1.36)     563.9115 (1.0)      4.9766 (1.69)          2;0  1.7760 (1.0)           5           3
test_plots-plots-diff[3.10.0]     948.7561 (1.70)     955.1336 (1.68)     952.2463 (1.69)     2.7546 (1.20)     951.5136 (1.69)     4.6691 (1.59)          2;0  1.0501 (0.59)          5           3
test_plots-plots-diff[3.53.2]     894.3001 (1.60)     900.3868 (1.59)     896.8168 (1.59)     2.3047 (1.0)      896.5613 (1.59)     2.9381 (1.0)           2;0  1.1151 (0.63)          5           3
test_plots-plots-diff[3.60.1]     896.0599 (1.60)     913.0572 (1.61)     904.3332 (1.61)     6.4969 (2.82)     902.8394 (1.60)     9.1684 (3.12)          2;0  1.1058 (0.62)          5           3
test_plots-plots-diff[main]       913.1680 (1.63)     922.6105 (1.63)     917.5761 (1.63)     3.5135 (1.52)     917.4578 (1.63)     4.6003 (1.57)          2;0  1.0898 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       569.0327 (1.0)        584.0081 (1.0)        574.1437 (1.0)       5.7516 (2.24)       572.5756 (1.0)       4.9822 (1.29)          1;1  1.7417 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,178.6641 (2.07)     1,186.4847 (2.03)     1,182.3711 (2.06)      3.2566 (1.27)     1,183.3098 (2.07)      5.3046 (1.38)          2;0  0.8458 (0.49)          5           3
test_plots-plots-diff-json[3.53.2]       967.0317 (1.70)       973.3152 (1.67)       970.1083 (1.69)      2.5717 (1.0)        969.6159 (1.69)      4.2534 (1.10)          2;0  1.0308 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       978.4142 (1.72)       988.2362 (1.69)       983.8516 (1.71)      3.5717 (1.39)       983.9088 (1.72)      3.8548 (1.0)           2;0  1.0164 (0.58)          5           3
test_plots-plots-diff-json[main]         977.7188 (1.72)     1,003.1031 (1.72)       992.1643 (1.73)     11.3518 (4.41)       998.7586 (1.74)     18.8455 (4.89)          1;0  1.0079 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     453.0836 (1.0)      457.7733 (1.0)      455.9384 (1.0)      1.9008 (1.0)      456.9133 (1.0)      2.6665 (1.0)           1;0  2.1933 (1.0)           5           3
test_plots-plots-show[3.10.0]     766.8891 (1.69)     783.0727 (1.71)     773.4448 (1.70)     6.6689 (3.51)     774.8791 (1.70)     9.8567 (3.70)          1;0  1.2929 (0.59)          5           3
test_plots-plots-show[3.53.2]     749.5180 (1.65)     761.5440 (1.66)     753.5286 (1.65)     4.6794 (2.46)     752.6941 (1.65)     4.3206 (1.62)          1;1  1.3271 (0.61)          5           3
test_plots-plots-show[3.60.1]     761.6540 (1.68)     768.9445 (1.68)     764.0772 (1.68)     2.9733 (1.56)     763.6941 (1.67)     3.8146 (1.43)          1;0  1.3088 (0.60)          5           3
test_plots-plots-show[main]       764.7413 (1.69)     773.1212 (1.69)     767.7449 (1.68)     3.1901 (1.68)     766.9744 (1.68)     3.1033 (1.16)          1;0  1.3025 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     470.5138 (1.0)      474.5468 (1.0)      472.2497 (1.0)      1.7566 (1.0)      472.3996 (1.0)      3.0696 (1.06)          1;0  2.1175 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     895.1460 (1.90)     900.7005 (1.90)     898.4016 (1.90)     2.3297 (1.33)     899.0114 (1.90)     3.8522 (1.33)          1;0  1.1131 (0.53)          5           3
test_plots-plots-show-json[3.53.2]     797.0289 (1.69)     804.1303 (1.69)     800.5876 (1.70)     2.6194 (1.49)     799.9839 (1.69)     3.1476 (1.09)          2;0  1.2491 (0.59)          5           3
test_plots-plots-show-json[3.60.1]     808.1571 (1.72)     815.6169 (1.72)     811.0126 (1.72)     3.0265 (1.72)     809.4437 (1.71)     4.1907 (1.45)          1;0  1.2330 (0.58)          5           3
test_plots-plots-show-json[main]       810.2327 (1.72)     821.4599 (1.73)     814.8047 (1.73)     4.0819 (2.32)     814.0993 (1.72)     2.8880 (1.0)           2;1  1.2273 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     91.0638 (4.17)     91.0638 (4.17)     91.0638 (4.17)     0.0000 (1.0)      91.0638 (4.17)     0.0000 (1.0)           0;0  0.0110 (0.24)          1           1
test_push-push[3.10.0]     42.4808 (1.95)     42.4808 (1.95)     42.4808 (1.95)     0.0000 (1.0)      42.4808 (1.95)     0.0000 (1.0)           0;0  0.0235 (0.51)          1           1
test_push-push[3.53.2]     23.3123 (1.07)     23.3123 (1.07)     23.3123 (1.07)     0.0000 (1.0)      23.3123 (1.07)     0.0000 (1.0)           0;0  0.0429 (0.94)          1           1
test_push-push[3.60.1]     21.8239 (1.0)      21.8239 (1.0)      21.8239 (1.0)      0.0000 (1.0)      21.8239 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
test_push-push[main]       22.0903 (1.01)     22.0903 (1.01)     22.0903 (1.01)     0.0000 (1.0)      22.0903 (1.01)     0.0000 (1.0)           0;0  0.0453 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     106.4626 (4.72)     106.4626 (4.72)     106.4626 (4.72)     0.0000 (1.0)      106.4626 (4.72)     0.0000 (1.0)           0;0  0.0094 (0.21)          1           1
test_sharing-fetch[3.10.0]     110.8750 (4.91)     110.8750 (4.91)     110.8750 (4.91)     0.0000 (1.0)      110.8750 (4.91)     0.0000 (1.0)           0;0  0.0090 (0.20)          1           1
test_sharing-fetch[3.53.2]      32.4852 (1.44)      32.4852 (1.44)      32.4852 (1.44)     0.0000 (1.0)       32.4852 (1.44)     0.0000 (1.0)           0;0  0.0308 (0.70)          1           1
test_sharing-fetch[3.60.1]      22.6511 (1.00)      22.6511 (1.00)      22.6511 (1.00)     0.0000 (1.0)       22.6511 (1.00)     0.0000 (1.0)           0;0  0.0441 (1.00)          1           1
test_sharing-fetch[main]        22.5784 (1.0)       22.5784 (1.0)       22.5784 (1.0)      0.0000 (1.0)       22.5784 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2900 (1.0)      1.2900 (1.0)      1.2900 (1.0)      0.0000 (1.0)      1.2900 (1.0)      0.0000 (1.0)           0;0  0.7752 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6052 (2.79)     3.6052 (2.79)     3.6052 (2.79)     0.0000 (1.0)      3.6052 (2.79)     0.0000 (1.0)           0;0  0.2774 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     5.8762 (4.56)     5.8762 (4.56)     5.8762 (4.56)     0.0000 (1.0)      5.8762 (4.56)     0.0000 (1.0)           0;0  0.1702 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     6.0067 (4.66)     6.0067 (4.66)     6.0067 (4.66)     0.0000 (1.0)      6.0067 (4.66)     0.0000 (1.0)           0;0  0.1665 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9705 (4.63)     5.9705 (4.63)     5.9705 (4.63)     0.0000 (1.0)      5.9705 (4.63)     0.0000 (1.0)           0;0  0.1675 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     95.0787 (4.30)     95.0787 (4.30)     95.0787 (4.30)     0.0000 (1.0)      95.0787 (4.30)     0.0000 (1.0)           0;0  0.0105 (0.23)          1           1
test_sharing-push[3.10.0]     44.7470 (2.02)     44.7470 (2.02)     44.7470 (2.02)     0.0000 (1.0)      44.7470 (2.02)     0.0000 (1.0)           0;0  0.0223 (0.49)          1           1
test_sharing-push[3.53.2]     22.7964 (1.03)     22.7964 (1.03)     22.7964 (1.03)     0.0000 (1.0)      22.7964 (1.03)     0.0000 (1.0)           0;0  0.0439 (0.97)          1           1
test_sharing-push[3.60.1]     22.1352 (1.0)      22.1352 (1.0)      22.1352 (1.0)      0.0000 (1.0)      22.1352 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_sharing-push[main]       22.8662 (1.03)     22.8662 (1.03)     22.8662 (1.03)     0.0000 (1.0)      22.8662 (1.03)     0.0000 (1.0)           0;0  0.0437 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1054 (1.02)     2.1054 (1.02)     2.1054 (1.02)     0.0000 (1.0)      2.1054 (1.02)     0.0000 (1.0)           0;0  0.4750 (0.98)          1           1
test_sharing-push-noop[3.10.0]     2.0698 (1.0)      2.0698 (1.0)      2.0698 (1.0)      0.0000 (1.0)      2.0698 (1.0)      0.0000 (1.0)           0;0  0.4831 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0595 (2.93)     6.0595 (2.93)     6.0595 (2.93)     0.0000 (1.0)      6.0595 (2.93)     0.0000 (1.0)           0;0  0.1650 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.1923 (2.99)     6.1923 (2.99)     6.1923 (2.99)     0.0000 (1.0)      6.1923 (2.99)     0.0000 (1.0)           0;0  0.1615 (0.33)          1           1
test_sharing-push-noop[main]       6.2581 (3.02)     6.2581 (3.02)     6.2581 (3.02)     0.0000 (1.0)      6.2581 (3.02)     0.0000 (1.0)           0;0  0.1598 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     363.8802 (1.03)     363.8802 (1.03)     363.8802 (1.03)     0.0000 (1.0)      363.8802 (1.03)     0.0000 (1.0)           0;0  0.0027 (0.97)          1           1
test_sharing_azure-fetch[main]       352.9655 (1.0)      352.9655 (1.0)      352.9655 (1.0)      0.0000 (1.0)      352.9655 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4483 (1.0)      6.4483 (1.0)      6.4483 (1.0)      0.0000 (1.0)      6.4483 (1.0)      0.0000 (1.0)           0;0  0.1551 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7205 (1.04)     6.7205 (1.04)     6.7205 (1.04)     0.0000 (1.0)      6.7205 (1.04)     0.0000 (1.0)           0;0  0.1488 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     361.9308 (1.01)     361.9308 (1.01)     361.9308 (1.01)     0.0000 (1.0)      361.9308 (1.01)     0.0000 (1.0)           0;0  0.0028 (0.99)          1           1
test_sharing_azure-push[main]       358.0937 (1.0)      358.0937 (1.0)      358.0937 (1.0)      0.0000 (1.0)      358.0937 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.5775 (1.0)      7.5775 (1.0)      7.5775 (1.0)      0.0000 (1.0)      7.5775 (1.0)      0.0000 (1.0)           0;0  0.1320 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.8042 (1.03)     7.8042 (1.03)     7.8042 (1.03)     0.0000 (1.0)      7.8042 (1.03)     0.0000 (1.0)           0;0  0.1281 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     395.9968 (1.01)     395.9968 (1.01)     395.9968 (1.01)     0.0000 (1.0)      395.9968 (1.01)     0.0000 (1.0)           0;0  0.0025 (0.99)          1           1
test_sharing_s3-fetch[main]       392.3307 (1.0)      392.3307 (1.0)      392.3307 (1.0)      0.0000 (1.0)      392.3307 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.1911 (1.0)      6.1911 (1.0)      6.1911 (1.0)      0.0000 (1.0)      6.1911 (1.0)      0.0000 (1.0)           0;0  0.1615 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3296 (1.02)     6.3296 (1.02)     6.3296 (1.02)     0.0000 (1.0)      6.3296 (1.02)     0.0000 (1.0)           0;0  0.1580 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     335.1521 (1.01)     335.1521 (1.01)     335.1521 (1.01)     0.0000 (1.0)      335.1521 (1.01)     0.0000 (1.0)           0;0  0.0030 (0.99)          1           1
test_sharing_s3-push[main]       333.0587 (1.0)      333.0587 (1.0)      333.0587 (1.0)      0.0000 (1.0)      333.0587 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.3843 (1.00)     6.3843 (1.00)     6.3843 (1.00)     0.0000 (1.0)      6.3843 (1.00)     0.0000 (1.0)           0;0  0.1566 (1.00)          1           1
test_sharing_s3-push-noop[main]       6.3782 (1.0)      6.3782 (1.0)      6.3782 (1.0)      0.0000 (1.0)      6.3782 (1.0)      0.0000 (1.0)           0;0  0.1568 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.4713 (3.65)     19.4713 (3.65)     19.4713 (3.65)     0.0000 (1.0)      19.4713 (3.65)     0.0000 (1.0)           0;0  0.0514 (0.27)          1           1
test_status-status[3.10.0]     19.7437 (3.70)     19.7437 (3.70)     19.7437 (3.70)     0.0000 (1.0)      19.7437 (3.70)     0.0000 (1.0)           0;0  0.0506 (0.27)          1           1
test_status-status[3.53.2]     17.9869 (3.37)     17.9869 (3.37)     17.9869 (3.37)     0.0000 (1.0)      17.9869 (3.37)     0.0000 (1.0)           0;0  0.0556 (0.30)          1           1
test_status-status[3.60.1]      5.3366 (1.0)       5.3366 (1.0)       5.3366 (1.0)      0.0000 (1.0)       5.3366 (1.0)      0.0000 (1.0)           0;0  0.1874 (1.0)           1           1
test_status-status[main]        5.6721 (1.06)      5.6721 (1.06)      5.6721 (1.06)     0.0000 (1.0)       5.6721 (1.06)     0.0000 (1.0)           0;0  0.1763 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9436 (1.84)     4.9436 (1.84)     4.9436 (1.84)     0.0000 (1.0)      4.9436 (1.84)     0.0000 (1.0)           0;0  0.2023 (0.54)          1           1
test_status-status-changed[3.10.0]     5.1311 (1.91)     5.1311 (1.91)     5.1311 (1.91)     0.0000 (1.0)      5.1311 (1.91)     0.0000 (1.0)           0;0  0.1949 (0.52)          1           1
test_status-status-changed[3.53.2]     5.1178 (1.90)     5.1178 (1.90)     5.1178 (1.90)     0.0000 (1.0)      5.1178 (1.90)     0.0000 (1.0)           0;0  0.1954 (0.53)          1           1
test_status-status-changed[3.60.1]     2.6903 (1.0)      2.6903 (1.0)      2.6903 (1.0)      0.0000 (1.0)      2.6903 (1.0)      0.0000 (1.0)           0;0  0.3717 (1.0)           1           1
test_status-status-changed[main]       2.8727 (1.07)     2.8727 (1.07)     2.8727 (1.07)     0.0000 (1.0)      2.8727 (1.07)     0.0000 (1.0)           0;0  0.3481 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9847 (1.98)     4.9847 (1.98)     4.9847 (1.98)     0.0000 (1.0)      4.9847 (1.98)     0.0000 (1.0)           0;0  0.2006 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.1964 (2.06)     5.1964 (2.06)     5.1964 (2.06)     0.0000 (1.0)      5.1964 (2.06)     0.0000 (1.0)           0;0  0.1924 (0.49)          1           1
test_status-status-changed-noop[3.53.2]     5.0756 (2.01)     5.0756 (2.01)     5.0756 (2.01)     0.0000 (1.0)      5.0756 (2.01)     0.0000 (1.0)           0;0  0.1970 (0.50)          1           1
test_status-status-changed-noop[3.60.1]     2.5227 (1.0)      2.5227 (1.0)      2.5227 (1.0)      0.0000 (1.0)      2.5227 (1.0)      0.0000 (1.0)           0;0  0.3964 (1.0)           1           1
test_status-status-changed-noop[main]       2.8047 (1.11)     2.8047 (1.11)     2.8047 (1.11)     0.0000 (1.0)      2.8047 (1.11)     0.0000 (1.0)           0;0  0.3565 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9759 (1.95)     4.9759 (1.95)     4.9759 (1.95)     0.0000 (1.0)      4.9759 (1.95)     0.0000 (1.0)           0;0  0.2010 (0.51)          1           1
test_status-status-noop[3.10.0]     5.1391 (2.01)     5.1391 (2.01)     5.1391 (2.01)     0.0000 (1.0)      5.1391 (2.01)     0.0000 (1.0)           0;0  0.1946 (0.50)          1           1
test_status-status-noop[3.53.2]     5.0469 (1.97)     5.0469 (1.97)     5.0469 (1.97)     0.0000 (1.0)      5.0469 (1.97)     0.0000 (1.0)           0;0  0.1981 (0.51)          1           1
test_status-status-noop[3.60.1]     2.5582 (1.0)      2.5582 (1.0)      2.5582 (1.0)      0.0000 (1.0)      2.5582 (1.0)      0.0000 (1.0)           0;0  0.3909 (1.0)           1           1
test_status-status-noop[main]       2.7823 (1.09)     2.7823 (1.09)     2.7823 (1.09)     0.0000 (1.0)      2.7823 (1.09)     0.0000 (1.0)           0;0  0.3594 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     196.2794 (4.24)     196.2794 (4.24)     196.2794 (4.24)     0.0000 (1.0)      196.2794 (4.24)     0.0000 (1.0)           0;0  0.0051 (0.24)          1           1
test_update-import-url[3.10.0]     200.7118 (4.34)     200.7118 (4.34)     200.7118 (4.34)     0.0000 (1.0)      200.7118 (4.34)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.53.2]     118.2279 (2.56)     118.2279 (2.56)     118.2279 (2.56)     0.0000 (1.0)      118.2279 (2.56)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_update-import-url[3.60.1]      46.2398 (1.0)       46.2398 (1.0)       46.2398 (1.0)      0.0000 (1.0)       46.2398 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        47.7229 (1.03)      47.7229 (1.03)      47.7229 (1.03)     0.0000 (1.0)       47.7229 (1.03)     0.0000 (1.0)           0;0  0.0210 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     183.5288 (5.17)     183.5288 (5.17)     183.5288 (5.17)     0.0000 (1.0)      183.5288 (5.17)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.10.0]     185.5454 (5.23)     185.5454 (5.23)     185.5454 (5.23)     0.0000 (1.0)      185.5454 (5.23)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.53.2]     111.8435 (3.15)     111.8435 (3.15)     111.8435 (3.15)     0.0000 (1.0)      111.8435 (3.15)     0.0000 (1.0)           0;0  0.0089 (0.32)          1           1
test_update-update[3.60.1]      35.4973 (1.0)       35.4973 (1.0)       35.4973 (1.0)      0.0000 (1.0)       35.4973 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.4223 (1.03)      36.4223 (1.03)      36.4223 (1.03)     0.0000 (1.0)       36.4223 (1.03)     0.0000 (1.0)           0;0  0.0275 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.2859 (2.18)     17.2859 (2.18)     17.2859 (2.18)     0.0000 (1.0)      17.2859 (2.18)     0.0000 (1.0)           0;0  0.0579 (0.46)          1           1
test_update-update-noop[3.10.0]     17.9279 (2.26)     17.9279 (2.26)     17.9279 (2.26)     0.0000 (1.0)      17.9279 (2.26)     0.0000 (1.0)           0;0  0.0558 (0.44)          1           1
test_update-update-noop[3.53.2]     17.5878 (2.22)     17.5878 (2.22)     17.5878 (2.22)     0.0000 (1.0)      17.5878 (2.22)     0.0000 (1.0)           0;0  0.0569 (0.45)          1           1
test_update-update-noop[3.60.1]      7.9215 (1.0)       7.9215 (1.0)       7.9215 (1.0)      0.0000 (1.0)       7.9215 (1.0)      0.0000 (1.0)           0;0  0.1262 (1.0)           1           1
test_update-update-noop[main]        8.4132 (1.06)      8.4132 (1.06)      8.4132 (1.06)     0.0000 (1.0)       8.4132 (1.06)     0.0000 (1.0)           0;0  0.1189 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean