Mon Mar 30 01:09:38 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     81.3911 (3.66)     81.3911 (3.66)     81.3911 (3.66)     0.0000 (1.0)      81.3911 (3.66)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_add_copy-add[3.10.0]     81.8255 (3.68)     81.8255 (3.68)     81.8255 (3.68)     0.0000 (1.0)      81.8255 (3.68)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_add_copy-add[3.53.2]     73.1848 (3.29)     73.1848 (3.29)     73.1848 (3.29)     0.0000 (1.0)      73.1848 (3.29)     0.0000 (1.0)           0;0  0.0137 (0.30)          1           1
test_add_copy-add[3.60.1]     22.2602 (1.0)      22.2602 (1.0)      22.2602 (1.0)      0.0000 (1.0)      22.2602 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
test_add_copy-add[main]       23.5259 (1.06)     23.5259 (1.06)     23.5259 (1.06)     0.0000 (1.0)      23.5259 (1.06)     0.0000 (1.0)           0;0  0.0425 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     26.5419 (6.44)     26.5419 (6.44)     26.5419 (6.44)     0.0000 (1.0)      26.5419 (6.44)     0.0000 (1.0)           0;0  0.0377 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     26.9300 (6.53)     26.9300 (6.53)     26.9300 (6.53)     0.0000 (1.0)      26.9300 (6.53)     0.0000 (1.0)           0;0  0.0371 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     25.3608 (6.15)     25.3608 (6.15)     25.3608 (6.15)     0.0000 (1.0)      25.3608 (6.15)     0.0000 (1.0)           0;0  0.0394 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.1220 (1.0)       4.1220 (1.0)       4.1220 (1.0)      0.0000 (1.0)       4.1220 (1.0)      0.0000 (1.0)           0;0  0.2426 (1.0)           1           1
test_add_copy-add-noop[main]        4.4747 (1.09)      4.4747 (1.09)      4.4747 (1.09)     0.0000 (1.0)       4.4747 (1.09)     0.0000 (1.0)           0;0  0.2235 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     65.5185 (3.90)     65.5185 (3.90)     65.5185 (3.90)     0.0000 (1.0)      65.5185 (3.90)     0.0000 (1.0)           0;0  0.0153 (0.26)          1           1
test_add_hardlink-add[3.10.0]     66.6798 (3.97)     66.6798 (3.97)     66.6798 (3.97)     0.0000 (1.0)      66.6798 (3.97)     0.0000 (1.0)           0;0  0.0150 (0.25)          1           1
test_add_hardlink-add[3.53.2]     60.9251 (3.63)     60.9251 (3.63)     60.9251 (3.63)     0.0000 (1.0)      60.9251 (3.63)     0.0000 (1.0)           0;0  0.0164 (0.28)          1           1
test_add_hardlink-add[3.60.1]     16.8009 (1.0)      16.8009 (1.0)      16.8009 (1.0)      0.0000 (1.0)      16.8009 (1.0)      0.0000 (1.0)           0;0  0.0595 (1.0)           1           1
test_add_hardlink-add[main]       17.8127 (1.06)     17.8127 (1.06)     17.8127 (1.06)     0.0000 (1.0)      17.8127 (1.06)     0.0000 (1.0)           0;0  0.0561 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.0022 (7.55)     33.0022 (7.55)     33.0022 (7.55)     0.0000 (1.0)      33.0022 (7.55)     0.0000 (1.0)           0;0  0.0303 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.2960 (7.62)     33.2960 (7.62)     33.2960 (7.62)     0.0000 (1.0)      33.2960 (7.62)     0.0000 (1.0)           0;0  0.0300 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.2865 (7.16)     31.2865 (7.16)     31.2865 (7.16)     0.0000 (1.0)      31.2865 (7.16)     0.0000 (1.0)           0;0  0.0320 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3685 (1.0)       4.3685 (1.0)       4.3685 (1.0)      0.0000 (1.0)       4.3685 (1.0)      0.0000 (1.0)           0;0  0.2289 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.6383 (1.06)      4.6383 (1.06)      4.6383 (1.06)     0.0000 (1.0)       4.6383 (1.06)     0.0000 (1.0)           0;0  0.2156 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.5237 (1.90)     69.5237 (1.90)     69.5237 (1.90)     0.0000 (1.0)      69.5237 (1.90)     0.0000 (1.0)           0;0  0.0144 (0.53)          1           1
test_add_symlink-add[3.10.0]     70.9702 (1.94)     70.9702 (1.94)     70.9702 (1.94)     0.0000 (1.0)      70.9702 (1.94)     0.0000 (1.0)           0;0  0.0141 (0.52)          1           1
test_add_symlink-add[3.53.2]     66.2231 (1.81)     66.2231 (1.81)     66.2231 (1.81)     0.0000 (1.0)      66.2231 (1.81)     0.0000 (1.0)           0;0  0.0151 (0.55)          1           1
test_add_symlink-add[3.60.1]     36.5626 (1.0)      36.5626 (1.0)      36.5626 (1.0)      0.0000 (1.0)      36.5626 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
test_add_symlink-add[main]       38.5175 (1.05)     38.5175 (1.05)     38.5175 (1.05)     0.0000 (1.0)      38.5175 (1.05)     0.0000 (1.0)           0;0  0.0260 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.4386 (8.18)     45.4386 (8.18)     45.4386 (8.18)     0.0000 (1.0)      45.4386 (8.18)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.1357 (8.12)     45.1357 (8.12)     45.1357 (8.12)     0.0000 (1.0)      45.1357 (8.12)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.9587 (8.09)     44.9587 (8.09)     44.9587 (8.09)     0.0000 (1.0)      44.9587 (8.09)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5571 (1.0)       5.5571 (1.0)       5.5571 (1.0)      0.0000 (1.0)       5.5571 (1.0)      0.0000 (1.0)           0;0  0.1800 (1.0)           1           1
test_add_symlink-add-noop[main]        5.7979 (1.04)      5.7979 (1.04)      5.7979 (1.04)     0.0000 (1.0)       5.7979 (1.04)     0.0000 (1.0)           0;0  0.1725 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      39.7767 (1.90)      39.7767 (1.90)      39.7767 (1.90)     0.0000 (1.0)       39.7767 (1.90)     0.0000 (1.0)           0;0  0.0251 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     100.9520 (4.82)     100.9520 (4.82)     100.9520 (4.82)     0.0000 (1.0)      100.9520 (4.82)     0.0000 (1.0)           0;0  0.0099 (0.21)          1           1
test_checkout_copy-checkout[3.53.2]      28.0154 (1.34)      28.0154 (1.34)      28.0154 (1.34)     0.0000 (1.0)       28.0154 (1.34)     0.0000 (1.0)           0;0  0.0357 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]      20.9364 (1.0)       20.9364 (1.0)       20.9364 (1.0)      0.0000 (1.0)       20.9364 (1.0)      0.0000 (1.0)           0;0  0.0478 (1.0)           1           1
test_checkout_copy-checkout[main]        21.8431 (1.04)      21.8431 (1.04)      21.8431 (1.04)     0.0000 (1.0)       21.8431 (1.04)     0.0000 (1.0)           0;0  0.0458 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5247 (1.69)     5.5247 (1.69)     5.5247 (1.69)     0.0000 (1.0)      5.5247 (1.69)     0.0000 (1.0)           0;0  0.1810 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6605 (1.73)     5.6605 (1.73)     5.6605 (1.73)     0.0000 (1.0)      5.6605 (1.73)     0.0000 (1.0)           0;0  0.1767 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7434 (1.76)     5.7434 (1.76)     5.7434 (1.76)     0.0000 (1.0)      5.7434 (1.76)     0.0000 (1.0)           0;0  0.1741 (0.57)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2672 (1.0)      3.2672 (1.0)      3.2672 (1.0)      0.0000 (1.0)      3.2672 (1.0)      0.0000 (1.0)           0;0  0.3061 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4073 (1.04)     3.4073 (1.04)     3.4073 (1.04)     0.0000 (1.0)      3.4073 (1.04)     0.0000 (1.0)           0;0  0.2935 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.6035 (1.95)     7.6035 (1.95)     7.6035 (1.95)     0.0000 (1.0)      7.6035 (1.95)     0.0000 (1.0)           0;0  0.1315 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4276 (1.65)     6.4276 (1.65)     6.4276 (1.65)     0.0000 (1.0)      6.4276 (1.65)     0.0000 (1.0)           0;0  0.1556 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3126 (1.62)     6.3126 (1.62)     6.3126 (1.62)     0.0000 (1.0)      6.3126 (1.62)     0.0000 (1.0)           0;0  0.1584 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9006 (1.0)      3.9006 (1.0)      3.9006 (1.0)      0.0000 (1.0)      3.9006 (1.0)      0.0000 (1.0)           0;0  0.2564 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3048 (1.10)     4.3048 (1.10)     4.3048 (1.10)     0.0000 (1.0)      4.3048 (1.10)     0.0000 (1.0)           0;0  0.2323 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.3894 (2.82)     21.3894 (2.82)     21.3894 (2.82)     0.0000 (1.0)      21.3894 (2.82)     0.0000 (1.0)           0;0  0.0468 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.2134 (2.14)     16.2134 (2.14)     16.2134 (2.14)     0.0000 (1.0)      16.2134 (2.14)     0.0000 (1.0)           0;0  0.0617 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.4192 (1.90)     14.4192 (1.90)     14.4192 (1.90)     0.0000 (1.0)      14.4192 (1.90)     0.0000 (1.0)           0;0  0.0694 (0.53)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5801 (1.0)       7.5801 (1.0)       7.5801 (1.0)      0.0000 (1.0)       7.5801 (1.0)      0.0000 (1.0)           0;0  0.1319 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1890 (1.08)      8.1890 (1.08)      8.1890 (1.08)     0.0000 (1.0)       8.1890 (1.08)     0.0000 (1.0)           0;0  0.1221 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6603 (1.71)     5.6603 (1.71)     5.6603 (1.71)     0.0000 (1.0)      5.6603 (1.71)     0.0000 (1.0)           0;0  0.1767 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7057 (1.72)     5.7057 (1.72)     5.7057 (1.72)     0.0000 (1.0)      5.7057 (1.72)     0.0000 (1.0)           0;0  0.1753 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6442 (1.70)     5.6442 (1.70)     5.6442 (1.70)     0.0000 (1.0)      5.6442 (1.70)     0.0000 (1.0)           0;0  0.1772 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3164 (1.0)      3.3164 (1.0)      3.3164 (1.0)      0.0000 (1.0)      3.3164 (1.0)      0.0000 (1.0)           0;0  0.3015 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4488 (1.04)     3.4488 (1.04)     3.4488 (1.04)     0.0000 (1.0)      3.4488 (1.04)     0.0000 (1.0)           0;0  0.2900 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.9033 (2.02)     7.9033 (2.02)     7.9033 (2.02)     0.0000 (1.0)      7.9033 (2.02)     0.0000 (1.0)           0;0  0.1265 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7288 (1.72)     6.7288 (1.72)     6.7288 (1.72)     0.0000 (1.0)      6.7288 (1.72)     0.0000 (1.0)           0;0  0.1486 (0.58)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4979 (1.66)     6.4979 (1.66)     6.4979 (1.66)     0.0000 (1.0)      6.4979 (1.66)     0.0000 (1.0)           0;0  0.1539 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9179 (1.0)      3.9179 (1.0)      3.9179 (1.0)      0.0000 (1.0)      3.9179 (1.0)      0.0000 (1.0)           0;0  0.2552 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3886 (1.12)     4.3886 (1.12)     4.3886 (1.12)     0.0000 (1.0)      4.3886 (1.12)     0.0000 (1.0)           0;0  0.2279 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.2515 (2.35)     24.2515 (2.35)     24.2515 (2.35)     0.0000 (1.0)      24.2515 (2.35)     0.0000 (1.0)           0;0  0.0412 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     19.4468 (1.89)     19.4468 (1.89)     19.4468 (1.89)     0.0000 (1.0)      19.4468 (1.89)     0.0000 (1.0)           0;0  0.0514 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.8681 (1.73)     17.8681 (1.73)     17.8681 (1.73)     0.0000 (1.0)      17.8681 (1.73)     0.0000 (1.0)           0;0  0.0560 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.3065 (1.0)      10.3065 (1.0)      10.3065 (1.0)      0.0000 (1.0)      10.3065 (1.0)      0.0000 (1.0)           0;0  0.0970 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.9198 (1.06)     10.9198 (1.06)     10.9198 (1.06)     0.0000 (1.0)      10.9198 (1.06)     0.0000 (1.0)           0;0  0.0916 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7545 (1.65)     6.7545 (1.65)     6.7545 (1.65)     0.0000 (1.0)      6.7545 (1.65)     0.0000 (1.0)           0;0  0.1480 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7745 (1.66)     6.7745 (1.66)     6.7745 (1.66)     0.0000 (1.0)      6.7745 (1.66)     0.0000 (1.0)           0;0  0.1476 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9658 (1.70)     6.9658 (1.70)     6.9658 (1.70)     0.0000 (1.0)      6.9658 (1.70)     0.0000 (1.0)           0;0  0.1436 (0.59)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.0893 (1.0)      4.0893 (1.0)      4.0893 (1.0)      0.0000 (1.0)      4.0893 (1.0)      0.0000 (1.0)           0;0  0.2445 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3095 (1.05)     4.3095 (1.05)     4.3095 (1.05)     0.0000 (1.0)      4.3095 (1.05)     0.0000 (1.0)           0;0  0.2320 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.7066 (1.74)     9.7066 (1.74)     9.7066 (1.74)     0.0000 (1.0)      9.7066 (1.74)     0.0000 (1.0)           0;0  0.1030 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.5501 (1.53)     8.5501 (1.53)     8.5501 (1.53)     0.0000 (1.0)      8.5501 (1.53)     0.0000 (1.0)           0;0  0.1170 (0.65)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.4724 (1.52)     8.4724 (1.52)     8.4724 (1.52)     0.0000 (1.0)      8.4724 (1.52)     0.0000 (1.0)           0;0  0.1180 (0.66)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.5901 (1.0)      5.5901 (1.0)      5.5901 (1.0)      0.0000 (1.0)      5.5901 (1.0)      0.0000 (1.0)           0;0  0.1789 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.1734 (1.10)     6.1734 (1.10)     6.1734 (1.10)     0.0000 (1.0)      6.1734 (1.10)     0.0000 (1.0)           0;0  0.1620 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0910 (1.72)     4.0910 (1.72)     4.0910 (1.72)     0.0000 (1.0)      4.0910 (1.72)     0.0000 (1.0)           0;0  0.2444 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.8542 (2.04)     4.8542 (2.04)     4.8542 (2.04)     0.0000 (1.0)      4.8542 (2.04)     0.0000 (1.0)           0;0  0.2060 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.7692 (2.00)     4.7692 (2.00)     4.7692 (2.00)     0.0000 (1.0)      4.7692 (2.00)     0.0000 (1.0)           0;0  0.2097 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3835 (1.0)      2.3835 (1.0)      2.3835 (1.0)      0.0000 (1.0)      2.3835 (1.0)      0.0000 (1.0)           0;0  0.4195 (1.0)           1           1
test_data_status-data-changed[main]       2.6972 (1.13)     2.6972 (1.13)     2.6972 (1.13)     0.0000 (1.0)      2.6972 (1.13)     0.0000 (1.0)           0;0  0.3708 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2103 (1.78)     4.2103 (1.78)     4.2103 (1.78)     0.0000 (1.0)      4.2103 (1.78)     0.0000 (1.0)           0;0  0.2375 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     5.1306 (2.17)     5.1306 (2.17)     5.1306 (2.17)     0.0000 (1.0)      5.1306 (2.17)     0.0000 (1.0)           0;0  0.1949 (0.46)          1           1
test_data_status-data-changed-noop[3.53.2]     4.9106 (2.08)     4.9106 (2.08)     4.9106 (2.08)     0.0000 (1.0)      4.9106 (2.08)     0.0000 (1.0)           0;0  0.2036 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3626 (1.0)      2.3626 (1.0)      2.3626 (1.0)      0.0000 (1.0)      2.3626 (1.0)      0.0000 (1.0)           0;0  0.4233 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5896 (1.10)     2.5896 (1.10)     2.5896 (1.10)     0.0000 (1.0)      2.5896 (1.10)     0.0000 (1.0)           0;0  0.3862 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5985 (3.78)     18.5985 (3.78)     18.5985 (3.78)     0.0000 (1.0)      18.5985 (3.78)     0.0000 (1.0)           0;0  0.0538 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.0126 (4.07)     20.0126 (4.07)     20.0126 (4.07)     0.0000 (1.0)      20.0126 (4.07)     0.0000 (1.0)           0;0  0.0500 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.5844 (3.98)     19.5844 (3.98)     19.5844 (3.98)     0.0000 (1.0)      19.5844 (3.98)     0.0000 (1.0)           0;0  0.0511 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.9176 (1.0)       4.9176 (1.0)       4.9176 (1.0)      0.0000 (1.0)       4.9176 (1.0)      0.0000 (1.0)           0;0  0.2034 (1.0)           1           1
test_data_status-data-new[main]        5.4437 (1.11)      5.4437 (1.11)      5.4437 (1.11)     0.0000 (1.0)       5.4437 (1.11)     0.0000 (1.0)           0;0  0.1837 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0274 (1.70)     4.0274 (1.70)     4.0274 (1.70)     0.0000 (1.0)      4.0274 (1.70)     0.0000 (1.0)           0;0  0.2483 (0.59)          1           1
test_data_status-data-noop[3.10.0]     4.8412 (2.05)     4.8412 (2.05)     4.8412 (2.05)     0.0000 (1.0)      4.8412 (2.05)     0.0000 (1.0)           0;0  0.2066 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.9100 (2.08)     4.9100 (2.08)     4.9100 (2.08)     0.0000 (1.0)      4.9100 (2.08)     0.0000 (1.0)           0;0  0.2037 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3635 (1.0)      2.3635 (1.0)      2.3635 (1.0)      0.0000 (1.0)      2.3635 (1.0)      0.0000 (1.0)           0;0  0.4231 (1.0)           1           1
test_data_status-data-noop[main]       2.5696 (1.09)     2.5696 (1.09)     2.5696 (1.09)     0.0000 (1.0)      2.5696 (1.09)     0.0000 (1.0)           0;0  0.3892 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1082 (1.25)     7.1082 (1.25)     7.1082 (1.25)     0.0000 (1.0)      7.1082 (1.25)     0.0000 (1.0)           0;0  0.1407 (0.80)          1           1
test_data_status_all_flags-data-changed[3.10.0]     8.0357 (1.42)     8.0357 (1.42)     8.0357 (1.42)     0.0000 (1.0)      8.0357 (1.42)     0.0000 (1.0)           0;0  0.1244 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8934 (1.39)     7.8934 (1.39)     7.8934 (1.39)     0.0000 (1.0)      7.8934 (1.39)     0.0000 (1.0)           0;0  0.1267 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6745 (1.0)      5.6745 (1.0)      5.6745 (1.0)      0.0000 (1.0)      5.6745 (1.0)      0.0000 (1.0)           0;0  0.1762 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.2039 (1.09)     6.2039 (1.09)     6.2039 (1.09)     0.0000 (1.0)      6.2039 (1.09)     0.0000 (1.0)           0;0  0.1612 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.0970 (1.27)     7.0970 (1.27)     7.0970 (1.27)     0.0000 (1.0)      7.0970 (1.27)     0.0000 (1.0)           0;0  0.1409 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     8.0062 (1.43)     8.0062 (1.43)     8.0062 (1.43)     0.0000 (1.0)      8.0062 (1.43)     0.0000 (1.0)           0;0  0.1249 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     8.0044 (1.43)     8.0044 (1.43)     8.0044 (1.43)     0.0000 (1.0)      8.0044 (1.43)     0.0000 (1.0)           0;0  0.1249 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5917 (1.0)      5.5917 (1.0)      5.5917 (1.0)      0.0000 (1.0)      5.5917 (1.0)      0.0000 (1.0)           0;0  0.1788 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.0324 (1.08)     6.0324 (1.08)     6.0324 (1.08)     0.0000 (1.0)      6.0324 (1.08)     0.0000 (1.0)           0;0  0.1658 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.4622 (2.61)     21.4622 (2.61)     21.4622 (2.61)     0.0000 (1.0)      21.4622 (2.61)     0.0000 (1.0)           0;0  0.0466 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.2109 (2.82)     23.2109 (2.82)     23.2109 (2.82)     0.0000 (1.0)      23.2109 (2.82)     0.0000 (1.0)           0;0  0.0431 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.7260 (2.76)     22.7260 (2.76)     22.7260 (2.76)     0.0000 (1.0)      22.7260 (2.76)     0.0000 (1.0)           0;0  0.0440 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.2238 (1.0)       8.2238 (1.0)       8.2238 (1.0)      0.0000 (1.0)       8.2238 (1.0)      0.0000 (1.0)           0;0  0.1216 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.8129 (1.07)      8.8129 (1.07)      8.8129 (1.07)     0.0000 (1.0)       8.8129 (1.07)     0.0000 (1.0)           0;0  0.1135 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4434 (1.30)     6.4434 (1.30)     6.4434 (1.30)     0.0000 (1.0)      6.4434 (1.30)     0.0000 (1.0)           0;0  0.1552 (0.77)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.5362 (1.51)     7.5362 (1.51)     7.5362 (1.51)     0.0000 (1.0)      7.5362 (1.51)     0.0000 (1.0)           0;0  0.1327 (0.66)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.3771 (1.48)     7.3771 (1.48)     7.3771 (1.48)     0.0000 (1.0)      7.3771 (1.48)     0.0000 (1.0)           0;0  0.1356 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.9755 (1.0)      4.9755 (1.0)      4.9755 (1.0)      0.0000 (1.0)      4.9755 (1.0)      0.0000 (1.0)           0;0  0.2010 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2595 (1.06)     5.2595 (1.06)     5.2595 (1.06)     0.0000 (1.0)      5.2595 (1.06)     0.0000 (1.0)           0;0  0.1901 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.1290 (2.71)     18.1290 (2.71)     18.1290 (2.71)     0.0000 (1.0)      18.1290 (2.71)     0.0000 (1.0)           0;0  0.0552 (0.37)          1           1
test_diff-diff[3.10.0]     19.5437 (2.93)     19.5437 (2.93)     19.5437 (2.93)     0.0000 (1.0)      19.5437 (2.93)     0.0000 (1.0)           0;0  0.0512 (0.34)          1           1
test_diff-diff[3.53.2]     19.2517 (2.88)     19.2517 (2.88)     19.2517 (2.88)     0.0000 (1.0)      19.2517 (2.88)     0.0000 (1.0)           0;0  0.0519 (0.35)          1           1
test_diff-diff[3.60.1]      6.6809 (1.0)       6.6809 (1.0)       6.6809 (1.0)      0.0000 (1.0)       6.6809 (1.0)      0.0000 (1.0)           0;0  0.1497 (1.0)           1           1
test_diff-diff[main]        7.5844 (1.14)      7.5844 (1.14)      7.5844 (1.14)     0.0000 (1.0)       7.5844 (1.14)     0.0000 (1.0)           0;0  0.1318 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0161 (1.87)     6.0161 (1.87)     6.0161 (1.87)     0.0000 (1.0)      6.0161 (1.87)     0.0000 (1.0)           0;0  0.1662 (0.54)          1           1
test_diff-diff-changed[3.10.0]     6.5607 (2.04)     6.5607 (2.04)     6.5607 (2.04)     0.0000 (1.0)      6.5607 (2.04)     0.0000 (1.0)           0;0  0.1524 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.4568 (1.69)     5.4568 (1.69)     5.4568 (1.69)     0.0000 (1.0)      5.4568 (1.69)     0.0000 (1.0)           0;0  0.1833 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.2212 (1.0)      3.2212 (1.0)      3.2212 (1.0)      0.0000 (1.0)      3.2212 (1.0)      0.0000 (1.0)           0;0  0.3104 (1.0)           1           1
test_diff-diff-changed[main]       3.9998 (1.24)     3.9998 (1.24)     3.9998 (1.24)     0.0000 (1.0)      3.9998 (1.24)     0.0000 (1.0)           0;0  0.2500 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1112 (1.56)     5.1112 (1.56)     5.1112 (1.56)     0.0000 (1.0)      5.1112 (1.56)     0.0000 (1.0)           0;0  0.1956 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7267 (1.75)     5.7267 (1.75)     5.7267 (1.75)     0.0000 (1.0)      5.7267 (1.75)     0.0000 (1.0)           0;0  0.1746 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.3550 (1.63)     5.3550 (1.63)     5.3550 (1.63)     0.0000 (1.0)      5.3550 (1.63)     0.0000 (1.0)           0;0  0.1867 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2805 (1.0)      3.2805 (1.0)      3.2805 (1.0)      0.0000 (1.0)      3.2805 (1.0)      0.0000 (1.0)           0;0  0.3048 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.9714 (1.21)     3.9714 (1.21)     3.9714 (1.21)     0.0000 (1.0)      3.9714 (1.21)     0.0000 (1.0)           0;0  0.2518 (0.83)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2020 (1.30)     4.2020 (1.30)     4.2020 (1.30)     0.0000 (1.0)      4.2020 (1.30)     0.0000 (1.0)           0;0  0.2380 (0.77)          1           1
test_diff-diff-noop[3.10.0]     4.8324 (1.50)     4.8324 (1.50)     4.8324 (1.50)     0.0000 (1.0)      4.8324 (1.50)     0.0000 (1.0)           0;0  0.2069 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.4703 (1.69)     5.4703 (1.69)     5.4703 (1.69)     0.0000 (1.0)      5.4703 (1.69)     0.0000 (1.0)           0;0  0.1828 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.2295 (1.0)      3.2295 (1.0)      3.2295 (1.0)      0.0000 (1.0)      3.2295 (1.0)      0.0000 (1.0)           0;0  0.3096 (1.0)           1           1
test_diff-diff-noop[main]       4.0578 (1.26)     4.0578 (1.26)     4.0578 (1.26)     0.0000 (1.0)      4.0578 (1.26)     0.0000 (1.0)           0;0  0.2464 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2146 (1.0)       1.2146 (1.0)       1.2146 (1.0)      0.0000 (1.0)       1.2146 (1.0)      0.0000 (1.0)           0;0  0.8233 (1.0)           1           1
test_exp_show-exp[3.10.0]      9.4222 (7.76)      9.4222 (7.76)      9.4222 (7.76)     0.0000 (1.0)       9.4222 (7.76)     0.0000 (1.0)           0;0  0.1061 (0.13)          1           1
test_exp_show-exp[3.53.2]      5.3622 (4.41)      5.3622 (4.41)      5.3622 (4.41)     0.0000 (1.0)       5.3622 (4.41)     0.0000 (1.0)           0;0  0.1865 (0.23)          1           1
test_exp_show-exp[3.60.1]      5.7588 (4.74)      5.7588 (4.74)      5.7588 (4.74)     0.0000 (1.0)       5.7588 (4.74)     0.0000 (1.0)           0;0  0.1736 (0.21)          1           1
test_exp_show-exp[main]       11.8487 (9.75)     11.8487 (9.75)     11.8487 (9.75)     0.0000 (1.0)      11.8487 (9.75)     0.0000 (1.0)           0;0  0.0844 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     113.0388 (4.79)     113.0388 (4.79)     113.0388 (4.79)     0.0000 (1.0)      113.0388 (4.79)     0.0000 (1.0)           0;0  0.0088 (0.21)          1           1
test_fetch-fetch[3.10.0]     118.8001 (5.04)     118.8001 (5.04)     118.8001 (5.04)     0.0000 (1.0)      118.8001 (5.04)     0.0000 (1.0)           0;0  0.0084 (0.20)          1           1
test_fetch-fetch[3.53.2]      33.3618 (1.42)      33.3618 (1.42)      33.3618 (1.42)     0.0000 (1.0)       33.3618 (1.42)     0.0000 (1.0)           0;0  0.0300 (0.71)          1           1
test_fetch-fetch[3.60.1]      23.5763 (1.0)       23.5763 (1.0)       23.5763 (1.0)      0.0000 (1.0)       23.5763 (1.0)      0.0000 (1.0)           0;0  0.0424 (1.0)           1           1
test_fetch-fetch[main]        23.6536 (1.00)      23.6536 (1.00)      23.6536 (1.00)     0.0000 (1.0)       23.6536 (1.00)     0.0000 (1.0)           0;0  0.0423 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8839 (1.00)     2.8839 (1.00)     2.8839 (1.00)     0.0000 (1.0)      2.8839 (1.00)     0.0000 (1.0)           0;0  0.3467 (1.00)          1           1
test_gc-gc[3.10.0]     3.1856 (1.10)     3.1856 (1.10)     3.1856 (1.10)     0.0000 (1.0)      3.1856 (1.10)     0.0000 (1.0)           0;0  0.3139 (0.91)          1           1
test_gc-gc[3.53.2]     2.9145 (1.01)     2.9145 (1.01)     2.9145 (1.01)     0.0000 (1.0)      2.9145 (1.01)     0.0000 (1.0)           0;0  0.3431 (0.99)          1           1
test_gc-gc[3.60.1]     2.9352 (1.02)     2.9352 (1.02)     2.9352 (1.02)     0.0000 (1.0)      2.9352 (1.02)     0.0000 (1.0)           0;0  0.3407 (0.98)          1           1
test_gc-gc[main]       2.8830 (1.0)      2.8830 (1.0)      2.8830 (1.0)      0.0000 (1.0)      2.8830 (1.0)      0.0000 (1.0)           0;0  0.3469 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     191.3306 (3.55)     191.3306 (3.55)     191.3306 (3.55)     0.0000 (1.0)      191.3306 (3.55)     0.0000 (1.0)           0;0  0.0052 (0.28)          1           1
test_get-get[3.10.0]     225.8230 (4.19)     225.8230 (4.19)     225.8230 (4.19)     0.0000 (1.0)      225.8230 (4.19)     0.0000 (1.0)           0;0  0.0044 (0.24)          1           1
test_get-get[3.53.2]     175.6041 (3.26)     175.6041 (3.26)     175.6041 (3.26)     0.0000 (1.0)      175.6041 (3.26)     0.0000 (1.0)           0;0  0.0057 (0.31)          1           1
test_get-get[3.60.1]      53.8502 (1.0)       53.8502 (1.0)       53.8502 (1.0)      0.0000 (1.0)       53.8502 (1.0)      0.0000 (1.0)           0;0  0.0186 (1.0)           1           1
test_get-get[main]        54.0519 (1.00)      54.0519 (1.00)      54.0519 (1.00)     0.0000 (1.0)       54.0519 (1.00)     0.0000 (1.0)           0;0  0.0185 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     86.3726 (5.16)     86.3726 (5.16)     86.3726 (5.16)     0.0000 (1.0)      86.3726 (5.16)     0.0000 (1.0)           0;0  0.0116 (0.19)          1           1
test_get_url-get-url[3.10.0]     88.8572 (5.31)     88.8572 (5.31)     88.8572 (5.31)     0.0000 (1.0)      88.8572 (5.31)     0.0000 (1.0)           0;0  0.0113 (0.19)          1           1
test_get_url-get-url[3.53.2]     16.7464 (1.0)      16.7464 (1.0)      16.7464 (1.0)      0.0000 (1.0)      16.7464 (1.0)      0.0000 (1.0)           0;0  0.0597 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.7541 (1.00)     16.7541 (1.00)     16.7541 (1.00)     0.0000 (1.0)      16.7541 (1.00)     0.0000 (1.0)           0;0  0.0597 (1.00)          1           1
test_get_url-get-url[main]       17.1423 (1.02)     17.1423 (1.02)     17.1423 (1.02)     0.0000 (1.0)      17.1423 (1.02)     0.0000 (1.0)           0;0  0.0583 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     155.5448 (1.02)     177.6131 (1.08)     162.5065 (1.03)     3.2790 (1.62)     162.1785 (1.03)     4.0955 (1.72)         27;1  6.1536 (0.97)        100           1
test_help---help[3.10.0]     160.8238 (1.05)     181.2744 (1.10)     170.3008 (1.08)     4.3767 (2.16)     169.9578 (1.08)     6.4426 (2.71)         29;0  5.8720 (0.93)        100           1
test_help---help[3.53.2]     161.7823 (1.06)     181.6354 (1.11)     169.1787 (1.07)     3.4413 (1.70)     168.8224 (1.07)     4.4544 (1.87)         28;3  5.9109 (0.93)        100           1
test_help---help[3.60.1]     162.2691 (1.06)     192.7998 (1.18)     169.1017 (1.07)     5.0106 (2.47)     168.5635 (1.07)     5.2477 (2.21)         17;4  5.9136 (0.93)        100           1
test_help---help[main]       153.1616 (1.0)      164.0791 (1.0)      157.8321 (1.0)      2.0245 (1.0)      157.6557 (1.0)      2.3775 (1.0)          31;2  6.3358 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     275.3337 (3.52)     275.3337 (3.52)     275.3337 (3.52)     0.0000 (1.0)      275.3337 (3.52)     0.0000 (1.0)           0;0  0.0036 (0.28)          1           1
test_import-import[3.10.0]     310.9259 (3.98)     310.9259 (3.98)     310.9259 (3.98)     0.0000 (1.0)      310.9259 (3.98)     0.0000 (1.0)           0;0  0.0032 (0.25)          1           1
test_import-import[3.60.1]      78.1218 (1.0)       78.1218 (1.0)       78.1218 (1.0)      0.0000 (1.0)       78.1218 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
test_import-import[main]        78.9172 (1.01)      78.9172 (1.01)      78.9172 (1.01)     0.0000 (1.0)       78.9172 (1.01)     0.0000 (1.0)           0;0  0.0127 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     198.3394 (4.30)     198.3394 (4.30)     198.3394 (4.30)     0.0000 (1.0)      198.3394 (4.30)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_import_url-import-url[3.10.0]     199.4901 (4.32)     199.4901 (4.32)     199.4901 (4.32)     0.0000 (1.0)      199.4901 (4.32)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_import_url-import-url[3.53.2]     113.8331 (2.47)     113.8331 (2.47)     113.8331 (2.47)     0.0000 (1.0)      113.8331 (2.47)     0.0000 (1.0)           0;0  0.0088 (0.41)          1           1
test_import_url-import-url[3.60.1]      46.1462 (1.0)       46.1462 (1.0)       46.1462 (1.0)      0.0000 (1.0)       46.1462 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_import_url-import-url[main]        47.1997 (1.02)      47.1997 (1.02)      47.1997 (1.02)     0.0000 (1.0)       47.1997 (1.02)     0.0000 (1.0)           0;0  0.0212 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     396.4612 (1.02)     444.2075 (1.04)     405.7037 (1.02)     7.3642 (1.91)     403.6707 (1.02)     5.9364 (1.36)        16;10  2.4649 (0.98)        100           1
test_init-init[3.10.0]     406.5244 (1.05)     428.0223 (1.0)      413.5113 (1.04)     3.8528 (1.0)      412.9069 (1.04)     4.3723 (1.0)          27;3  2.4183 (0.96)        100           1
test_init-init[3.53.2]     388.5885 (1.0)      440.4503 (1.03)     397.7740 (1.0)      6.2878 (1.63)     396.8379 (1.0)      5.4533 (1.25)         15;4  2.5140 (1.0)         100           1
test_init-init[3.60.1]     390.9021 (1.01)     449.9796 (1.05)     399.7672 (1.01)     6.6720 (1.73)     398.3589 (1.00)     5.6587 (1.29)         11;3  2.5015 (1.00)        100           1
test_init-init[main]       431.2051 (1.11)     484.4608 (1.13)     440.2518 (1.11)     6.2654 (1.63)     439.5709 (1.11)     4.6381 (1.06)         14;4  2.2714 (0.90)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     638.4881 (1.0)      638.4881 (1.0)      638.4881 (1.0)      0.0000 (1.0)      638.4881 (1.0)      0.0000 (1.0)           0;0  1.5662 (1.0)           1           1
test_list-list[3.10.0]     966.3415 (1.51)     966.3415 (1.51)     966.3415 (1.51)     0.0000 (1.0)      966.3415 (1.51)     0.0000 (1.0)           0;0  1.0348 (0.66)          1           1
test_list-list[3.53.2]     659.6027 (1.03)     659.6027 (1.03)     659.6027 (1.03)     0.0000 (1.0)      659.6027 (1.03)     0.0000 (1.0)           0;0  1.5161 (0.97)          1           1
test_list-list[3.60.1]     688.9859 (1.08)     688.9859 (1.08)     688.9859 (1.08)     0.0000 (1.0)      688.9859 (1.08)     0.0000 (1.0)           0;0  1.4514 (0.93)          1           1
test_list-list[main]       651.4003 (1.02)     651.4003 (1.02)     651.4003 (1.02)     0.0000 (1.0)      651.4003 (1.02)     0.0000 (1.0)           0;0  1.5352 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     453.4140 (1.08)     453.4140 (1.08)     453.4140 (1.08)     0.0000 (1.0)      453.4140 (1.08)     0.0000 (1.0)           0;0  2.2055 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     452.5883 (1.08)     452.5883 (1.08)     452.5883 (1.08)     0.0000 (1.0)      452.5883 (1.08)     0.0000 (1.0)           0;0  2.2095 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     420.1868 (1.0)      420.1868 (1.0)      420.1868 (1.0)      0.0000 (1.0)      420.1868 (1.0)      0.0000 (1.0)           0;0  2.3799 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     429.4483 (1.02)     429.4483 (1.02)     429.4483 (1.02)     0.0000 (1.0)      429.4483 (1.02)     0.0000 (1.0)           0;0  2.3286 (0.98)          1           1
test_list-list-dvc-only[main]       435.8594 (1.04)     435.8594 (1.04)     435.8594 (1.04)     0.0000 (1.0)      435.8594 (1.04)     0.0000 (1.0)           0;0  2.2943 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5476 (1.0)      2.5476 (1.0)      2.5476 (1.0)      0.0000 (1.0)      2.5476 (1.0)      0.0000 (1.0)           0;0  0.3925 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6536 (1.04)     2.6536 (1.04)     2.6536 (1.04)     0.0000 (1.0)      2.6536 (1.04)     0.0000 (1.0)           0;0  0.3768 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.7327 (1.07)     2.7327 (1.07)     2.7327 (1.07)     0.0000 (1.0)      2.7327 (1.07)     0.0000 (1.0)           0;0  0.3659 (0.93)          1           1
test_list-list-recursive[3.60.1]     2.7837 (1.09)     2.7837 (1.09)     2.7837 (1.09)     0.0000 (1.0)      2.7837 (1.09)     0.0000 (1.0)           0;0  0.3592 (0.92)          1           1
test_list-list-recursive[main]       2.6364 (1.03)     2.6364 (1.03)     2.6364 (1.03)     0.0000 (1.0)      2.6364 (1.03)     0.0000 (1.0)           0;0  0.3793 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     476.6918 (1.14)     476.6918 (1.14)     476.6918 (1.14)     0.0000 (1.0)      476.6918 (1.14)     0.0000 (1.0)           0;0  2.0978 (0.88)          1           1
test_list-list-shallow[3.10.0]     448.1705 (1.07)     448.1705 (1.07)     448.1705 (1.07)     0.0000 (1.0)      448.1705 (1.07)     0.0000 (1.0)           0;0  2.2313 (0.93)          1           1
test_list-list-shallow[3.53.2]     439.9356 (1.05)     439.9356 (1.05)     439.9356 (1.05)     0.0000 (1.0)      439.9356 (1.05)     0.0000 (1.0)           0;0  2.2731 (0.95)          1           1
test_list-list-shallow[3.60.1]     417.4601 (1.0)      417.4601 (1.0)      417.4601 (1.0)      0.0000 (1.0)      417.4601 (1.0)      0.0000 (1.0)           0;0  2.3954 (1.0)           1           1
test_list-list-shallow[main]       427.5665 (1.02)     427.5665 (1.02)     427.5665 (1.02)     0.0000 (1.0)      427.5665 (1.02)     0.0000 (1.0)           0;0  2.3388 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     11.9519 (3.10)     11.9519 (3.10)     11.9519 (3.10)     0.0000 (1.0)      11.9519 (3.10)     0.0000 (1.0)           0;0  0.0837 (0.32)          1           1
test_partial_add-add[3.10.0]     12.0316 (3.12)     12.0316 (3.12)     12.0316 (3.12)     0.0000 (1.0)      12.0316 (3.12)     0.0000 (1.0)           0;0  0.0831 (0.32)          1           1
test_partial_add-add[3.53.2]     10.6460 (2.76)     10.6460 (2.76)     10.6460 (2.76)     0.0000 (1.0)      10.6460 (2.76)     0.0000 (1.0)           0;0  0.0939 (0.36)          1           1
test_partial_add-add[3.60.1]      3.8602 (1.0)       3.8602 (1.0)       3.8602 (1.0)      0.0000 (1.0)       3.8602 (1.0)      0.0000 (1.0)           0;0  0.2591 (1.0)           1           1
test_partial_add-add[main]        4.6820 (1.21)      4.6820 (1.21)      4.6820 (1.21)     0.0000 (1.0)       4.6820 (1.21)     0.0000 (1.0)           0;0  0.2136 (0.82)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     78.0464 (3.94)     78.0464 (3.94)     78.0464 (3.94)     0.0000 (1.0)      78.0464 (3.94)     0.0000 (1.0)           0;0  0.0128 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     77.7472 (3.92)     77.7472 (3.92)     77.7472 (3.92)     0.0000 (1.0)      77.7472 (3.92)     0.0000 (1.0)           0;0  0.0129 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     69.3294 (3.50)     69.3294 (3.50)     69.3294 (3.50)     0.0000 (1.0)      69.3294 (3.50)     0.0000 (1.0)           0;0  0.0144 (0.29)          1           1
test_partial_add-add-partial[3.60.1]     19.8112 (1.0)      19.8112 (1.0)      19.8112 (1.0)      0.0000 (1.0)      19.8112 (1.0)      0.0000 (1.0)           0;0  0.0505 (1.0)           1           1
test_partial_add-add-partial[main]       20.2197 (1.02)     20.2197 (1.02)     20.2197 (1.02)     0.0000 (1.0)      20.2197 (1.02)     0.0000 (1.0)           0;0  0.0495 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6370 (1.0)      4.6370 (1.0)      4.6370 (1.0)      0.0000 (1.0)      4.6370 (1.0)      0.0000 (1.0)           0;0  0.2157 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.2779 (1.35)     6.2779 (1.35)     6.2779 (1.35)     0.0000 (1.0)      6.2779 (1.35)     0.0000 (1.0)           0;0  0.1593 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1255 (1.54)     7.1255 (1.54)     7.1255 (1.54)     0.0000 (1.0)      7.1255 (1.54)     0.0000 (1.0)           0;0  0.1403 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.2997 (1.57)     7.2997 (1.57)     7.2997 (1.57)     0.0000 (1.0)      7.2997 (1.57)     0.0000 (1.0)           0;0  0.1370 (0.64)          1           1
test_partial_add-gc-cloud-noop[main]       6.1788 (1.33)     6.1788 (1.33)     6.1788 (1.33)     0.0000 (1.0)      6.1788 (1.33)     0.0000 (1.0)           0;0  0.1618 (0.75)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6515 (1.0)      2.6515 (1.0)      2.6515 (1.0)      0.0000 (1.0)      2.6515 (1.0)      0.0000 (1.0)           0;0  0.3771 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9251 (1.48)     3.9251 (1.48)     3.9251 (1.48)     0.0000 (1.0)      3.9251 (1.48)     0.0000 (1.0)           0;0  0.2548 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.9045 (1.47)     3.9045 (1.47)     3.9045 (1.47)     0.0000 (1.0)      3.9045 (1.47)     0.0000 (1.0)           0;0  0.2561 (0.68)          1           1
test_partial_add-gc-noop[3.60.1]     4.0010 (1.51)     4.0010 (1.51)     4.0010 (1.51)     0.0000 (1.0)      4.0010 (1.51)     0.0000 (1.0)           0;0  0.2499 (0.66)          1           1
test_partial_add-gc-noop[main]       3.0405 (1.15)     3.0405 (1.15)     3.0405 (1.15)     0.0000 (1.0)      3.0405 (1.15)     0.0000 (1.0)           0;0  0.3289 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.3588 (4.01)     14.3588 (4.01)     14.3588 (4.01)     0.0000 (1.0)      14.3588 (4.01)     0.0000 (1.0)           0;0  0.0696 (0.25)          1           1
test_partial_add-push[3.10.0]      6.7033 (1.87)      6.7033 (1.87)      6.7033 (1.87)     0.0000 (1.0)       6.7033 (1.87)     0.0000 (1.0)           0;0  0.1492 (0.53)          1           1
test_partial_add-push[3.53.2]      3.6463 (1.02)      3.6463 (1.02)      3.6463 (1.02)     0.0000 (1.0)       3.6463 (1.02)     0.0000 (1.0)           0;0  0.2743 (0.98)          1           1
test_partial_add-push[3.60.1]      3.5789 (1.0)       3.5789 (1.0)       3.5789 (1.0)      0.0000 (1.0)       3.5789 (1.0)      0.0000 (1.0)           0;0  0.2794 (1.0)           1           1
test_partial_add-push[main]        3.9180 (1.09)      3.9180 (1.09)      3.9180 (1.09)     0.0000 (1.0)       3.9180 (1.09)     0.0000 (1.0)           0;0  0.2552 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     83.4857 (4.17)     83.4857 (4.17)     83.4857 (4.17)     0.0000 (1.0)      83.4857 (4.17)     0.0000 (1.0)           0;0  0.0120 (0.24)          1           1
test_partial_add-push-partial[3.10.0]     44.3985 (2.22)     44.3985 (2.22)     44.3985 (2.22)     0.0000 (1.0)      44.3985 (2.22)     0.0000 (1.0)           0;0  0.0225 (0.45)          1           1
test_partial_add-push-partial[3.53.2]     21.0234 (1.05)     21.0234 (1.05)     21.0234 (1.05)     0.0000 (1.0)      21.0234 (1.05)     0.0000 (1.0)           0;0  0.0476 (0.95)          1           1
test_partial_add-push-partial[3.60.1]     20.7913 (1.04)     20.7913 (1.04)     20.7913 (1.04)     0.0000 (1.0)      20.7913 (1.04)     0.0000 (1.0)           0;0  0.0481 (0.96)          1           1
test_partial_add-push-partial[main]       20.0132 (1.0)      20.0132 (1.0)      20.0132 (1.0)      0.0000 (1.0)      20.0132 (1.0)      0.0000 (1.0)           0;0  0.0500 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     81.3309 (3.63)     81.3309 (3.63)     81.3309 (3.63)     0.0000 (1.0)      81.3309 (3.63)     0.0000 (1.0)           0;0  0.0123 (0.28)          1           1
test_partial_remove-add[3.10.0]     82.1060 (3.66)     82.1060 (3.66)     82.1060 (3.66)     0.0000 (1.0)      82.1060 (3.66)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_partial_remove-add[3.53.2]     74.6670 (3.33)     74.6670 (3.33)     74.6670 (3.33)     0.0000 (1.0)      74.6670 (3.33)     0.0000 (1.0)           0;0  0.0134 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.4045 (1.0)      22.4045 (1.0)      22.4045 (1.0)      0.0000 (1.0)      22.4045 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_partial_remove-add[main]       23.7331 (1.06)     23.7331 (1.06)     23.7331 (1.06)     0.0000 (1.0)      23.7331 (1.06)     0.0000 (1.0)           0;0  0.0421 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     45.4319 (12.24)    45.4319 (12.24)    45.4319 (12.24)    0.0000 (1.0)      45.4319 (12.24)    0.0000 (1.0)           0;0  0.0220 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     45.9622 (12.38)    45.9622 (12.38)    45.9622 (12.38)    0.0000 (1.0)      45.9622 (12.38)    0.0000 (1.0)           0;0  0.0218 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     42.0477 (11.33)    42.0477 (11.33)    42.0477 (11.33)    0.0000 (1.0)      42.0477 (11.33)    0.0000 (1.0)           0;0  0.0238 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.7112 (1.0)       3.7112 (1.0)       3.7112 (1.0)      0.0000 (1.0)       3.7112 (1.0)      0.0000 (1.0)           0;0  0.2695 (1.0)           1           1
test_partial_remove-add-update[main]        3.8254 (1.03)      3.8254 (1.03)      3.8254 (1.03)     0.0000 (1.0)       3.8254 (1.03)     0.0000 (1.0)           0;0  0.2614 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5577 (1.0)      2.5577 (1.0)      2.5577 (1.0)      0.0000 (1.0)      2.5577 (1.0)      0.0000 (1.0)           0;0  0.3910 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7647 (1.47)     3.7647 (1.47)     3.7647 (1.47)     0.0000 (1.0)      3.7647 (1.47)     0.0000 (1.0)           0;0  0.2656 (0.68)          1           1
test_partial_remove-gc[3.53.2]     3.7590 (1.47)     3.7590 (1.47)     3.7590 (1.47)     0.0000 (1.0)      3.7590 (1.47)     0.0000 (1.0)           0;0  0.2660 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.8156 (1.49)     3.8156 (1.49)     3.8156 (1.49)     0.0000 (1.0)      3.8156 (1.49)     0.0000 (1.0)           0;0  0.2621 (0.67)          1           1
test_partial_remove-gc[main]       2.8910 (1.13)     2.8910 (1.13)     2.8910 (1.13)     0.0000 (1.0)      2.8910 (1.13)     0.0000 (1.0)           0;0  0.3459 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7806 (1.0)      4.7806 (1.0)      4.7806 (1.0)      0.0000 (1.0)      4.7806 (1.0)      0.0000 (1.0)           0;0  0.2092 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.5018 (1.36)     6.5018 (1.36)     6.5018 (1.36)     0.0000 (1.0)      6.5018 (1.36)     0.0000 (1.0)           0;0  0.1538 (0.74)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.6557 (1.39)     6.6557 (1.39)     6.6557 (1.39)     0.0000 (1.0)      6.6557 (1.39)     0.0000 (1.0)           0;0  0.1502 (0.72)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.7991 (1.42)     6.7991 (1.42)     6.7991 (1.42)     0.0000 (1.0)      6.7991 (1.42)     0.0000 (1.0)           0;0  0.1471 (0.70)          1           1
test_partial_remove-gc-cloud[main]       6.0010 (1.26)     6.0010 (1.26)     6.0010 (1.26)     0.0000 (1.0)      6.0010 (1.26)     0.0000 (1.0)           0;0  0.1666 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     97.0487 (4.35)     97.0487 (4.35)     97.0487 (4.35)     0.0000 (1.0)      97.0487 (4.35)     0.0000 (1.0)           0;0  0.0103 (0.23)          1           1
test_partial_remove-push[3.10.0]     45.4772 (2.04)     45.4772 (2.04)     45.4772 (2.04)     0.0000 (1.0)      45.4772 (2.04)     0.0000 (1.0)           0;0  0.0220 (0.49)          1           1
test_partial_remove-push[3.53.2]     22.8723 (1.02)     22.8723 (1.02)     22.8723 (1.02)     0.0000 (1.0)      22.8723 (1.02)     0.0000 (1.0)           0;0  0.0437 (0.98)          1           1
test_partial_remove-push[3.60.1]     22.3815 (1.00)     22.3815 (1.00)     22.3815 (1.00)     0.0000 (1.0)      22.3815 (1.00)     0.0000 (1.0)           0;0  0.0447 (1.00)          1           1
test_partial_remove-push[main]       22.3207 (1.0)      22.3207 (1.0)      22.3207 (1.0)      0.0000 (1.0)      22.3207 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8463 (1.01)     3.8463 (1.01)     3.8463 (1.01)     0.0000 (1.0)      3.8463 (1.01)     0.0000 (1.0)           0;0  0.2600 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     3.8123 (1.0)      3.8123 (1.0)      3.8123 (1.0)      0.0000 (1.0)      3.8123 (1.0)      0.0000 (1.0)           0;0  0.2623 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.0561 (1.85)     7.0561 (1.85)     7.0561 (1.85)     0.0000 (1.0)      7.0561 (1.85)     0.0000 (1.0)           0;0  0.1417 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     6.9413 (1.82)     6.9413 (1.82)     6.9413 (1.82)     0.0000 (1.0)      6.9413 (1.82)     0.0000 (1.0)           0;0  0.1441 (0.55)          1           1
test_partial_remove-push-update[main]       7.3036 (1.92)     7.3036 (1.92)     7.3036 (1.92)     0.0000 (1.0)      7.3036 (1.92)     0.0000 (1.0)           0;0  0.1369 (0.52)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]       577.0954 (1.0)        592.1948 (1.0)        584.4750 (1.0)       5.9020 (1.18)       582.3322 (1.0)       8.4063 (1.26)          2;0  1.7109 (1.0)           5           3
test_plots-plots-diff[3.10.0]     1,057.3017 (1.83)     1,069.4587 (1.81)     1,065.3901 (1.82)      5.0224 (1.0)      1,067.8153 (1.83)      6.6784 (1.0)           1;0  0.9386 (0.55)          5           3
test_plots-plots-diff[3.53.2]     1,014.6160 (1.76)     1,031.8745 (1.74)     1,025.4260 (1.75)      6.9178 (1.38)     1,028.5069 (1.77)      9.3652 (1.40)          1;0  0.9752 (0.57)          5           3
test_plots-plots-diff[3.60.1]     1,026.5825 (1.78)     1,053.0758 (1.78)     1,037.5215 (1.78)     10.8436 (2.16)     1,038.3755 (1.78)     16.8549 (2.52)          2;0  0.9638 (0.56)          5           3
test_plots-plots-diff[main]       1,028.2920 (1.78)     1,042.5611 (1.76)     1,037.2479 (1.77)      5.8446 (1.16)     1,037.1591 (1.78)      8.4543 (1.27)          1;0  0.9641 (0.56)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       604.6625 (1.0)        624.6124 (1.0)        612.3775 (1.0)       8.0911 (2.40)       610.1056 (1.0)      12.0996 (2.54)          1;0  1.6330 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,291.5500 (2.14)     1,299.7268 (2.08)     1,296.8297 (2.12)      3.3692 (1.0)      1,298.3081 (2.13)      4.7576 (1.0)           1;0  0.7711 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]     1,092.7673 (1.81)     1,117.4860 (1.79)     1,107.8225 (1.81)     10.0613 (2.99)     1,109.7305 (1.82)     15.3755 (3.23)          1;0  0.9027 (0.55)          5           3
test_plots-plots-diff-json[3.60.1]     1,100.2577 (1.82)     1,115.0149 (1.79)     1,108.2879 (1.81)      6.6713 (1.98)     1,110.9700 (1.82)     11.9151 (2.50)          2;0  0.9023 (0.55)          5           3
test_plots-plots-diff-json[main]       1,108.4887 (1.83)     1,134.1158 (1.82)     1,125.0670 (1.84)     10.1405 (3.01)     1,129.5437 (1.85)     12.2062 (2.57)          1;0  0.8888 (0.54)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     470.6031 (1.0)      483.2296 (1.0)      476.4901 (1.0)      5.2500 (2.20)     475.6562 (1.0)       8.9153 (2.19)          2;0  2.0987 (1.0)           5           3
test_plots-plots-show[3.10.0]     863.1920 (1.83)     868.9463 (1.80)     866.1513 (1.82)     2.3842 (1.0)      866.3413 (1.82)      4.0650 (1.0)           2;0  1.1545 (0.55)          5           3
test_plots-plots-show[3.53.2]     856.7565 (1.82)     871.3319 (1.80)     863.6977 (1.81)     6.4455 (2.70)     865.6243 (1.82)     11.3344 (2.79)          2;0  1.1578 (0.55)          5           3
test_plots-plots-show[3.60.1]     857.1882 (1.82)     864.5252 (1.79)     862.1065 (1.81)     3.0613 (1.28)     863.5455 (1.82)      4.1611 (1.02)          1;0  1.1599 (0.55)          5           3
test_plots-plots-show[main]       861.7255 (1.83)     881.4752 (1.82)     872.3687 (1.83)     7.6488 (3.21)     871.1299 (1.83)     10.9771 (2.70)          2;0  1.1463 (0.55)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                           Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     488.4631 (1.0)        514.9770 (1.0)        498.6870 (1.0)      11.3642 (3.97)       492.9880 (1.0)      17.9603 (6.63)          1;0  2.0053 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     990.9427 (2.03)     1,022.5277 (1.99)     1,004.7757 (2.01)     11.6771 (4.08)     1,003.8792 (2.04)     14.0414 (5.18)          2;0  0.9952 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     904.8413 (1.85)       917.6508 (1.78)       910.8496 (1.83)      5.8017 (2.03)       908.9356 (1.84)     10.5501 (3.89)          2;0  1.0979 (0.55)          5           3
test_plots-plots-show-json[3.60.1]     908.5658 (1.86)       916.4996 (1.78)       912.0756 (1.83)      2.8602 (1.0)        912.0096 (1.85)      2.7100 (1.0)           2;0  1.0964 (0.55)          5           3
test_plots-plots-show-json[main]       907.9393 (1.86)       924.4161 (1.80)       914.4765 (1.83)      7.5409 (2.64)       910.7131 (1.85)     13.1005 (4.83)          1;0  1.0935 (0.55)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     96.5161 (4.44)     96.5161 (4.44)     96.5161 (4.44)     0.0000 (1.0)      96.5161 (4.44)     0.0000 (1.0)           0;0  0.0104 (0.23)          1           1
test_push-push[3.10.0]     46.5827 (2.14)     46.5827 (2.14)     46.5827 (2.14)     0.0000 (1.0)      46.5827 (2.14)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_push-push[3.53.2]     23.2390 (1.07)     23.2390 (1.07)     23.2390 (1.07)     0.0000 (1.0)      23.2390 (1.07)     0.0000 (1.0)           0;0  0.0430 (0.94)          1           1
test_push-push[3.60.1]     21.7332 (1.0)      21.7332 (1.0)      21.7332 (1.0)      0.0000 (1.0)      21.7332 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
test_push-push[main]       22.2151 (1.02)     22.2151 (1.02)     22.2151 (1.02)     0.0000 (1.0)      22.2151 (1.02)     0.0000 (1.0)           0;0  0.0450 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     105.9775 (4.65)     105.9775 (4.65)     105.9775 (4.65)     0.0000 (1.0)      105.9775 (4.65)     0.0000 (1.0)           0;0  0.0094 (0.21)          1           1
test_sharing-fetch[3.10.0]     111.0299 (4.88)     111.0299 (4.88)     111.0299 (4.88)     0.0000 (1.0)      111.0299 (4.88)     0.0000 (1.0)           0;0  0.0090 (0.21)          1           1
test_sharing-fetch[3.53.2]      33.2161 (1.46)      33.2161 (1.46)      33.2161 (1.46)     0.0000 (1.0)       33.2161 (1.46)     0.0000 (1.0)           0;0  0.0301 (0.69)          1           1
test_sharing-fetch[3.60.1]      22.8180 (1.00)      22.8180 (1.00)      22.8180 (1.00)     0.0000 (1.0)       22.8180 (1.00)     0.0000 (1.0)           0;0  0.0438 (1.00)          1           1
test_sharing-fetch[main]        22.7683 (1.0)       22.7683 (1.0)       22.7683 (1.0)      0.0000 (1.0)       22.7683 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2424 (1.0)      1.2424 (1.0)      1.2424 (1.0)      0.0000 (1.0)      1.2424 (1.0)      0.0000 (1.0)           0;0  0.8049 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7367 (3.01)     3.7367 (3.01)     3.7367 (3.01)     0.0000 (1.0)      3.7367 (3.01)     0.0000 (1.0)           0;0  0.2676 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     5.8245 (4.69)     5.8245 (4.69)     5.8245 (4.69)     0.0000 (1.0)      5.8245 (4.69)     0.0000 (1.0)           0;0  0.1717 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.9399 (4.78)     5.9399 (4.78)     5.9399 (4.78)     0.0000 (1.0)      5.9399 (4.78)     0.0000 (1.0)           0;0  0.1684 (0.21)          1           1
test_sharing-fetch-noop[main]       6.0368 (4.86)     6.0368 (4.86)     6.0368 (4.86)     0.0000 (1.0)      6.0368 (4.86)     0.0000 (1.0)           0;0  0.1657 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     93.8788 (4.23)     93.8788 (4.23)     93.8788 (4.23)     0.0000 (1.0)      93.8788 (4.23)     0.0000 (1.0)           0;0  0.0107 (0.24)          1           1
test_sharing-push[3.10.0]     43.7583 (1.97)     43.7583 (1.97)     43.7583 (1.97)     0.0000 (1.0)      43.7583 (1.97)     0.0000 (1.0)           0;0  0.0229 (0.51)          1           1
test_sharing-push[3.53.2]     22.8303 (1.03)     22.8303 (1.03)     22.8303 (1.03)     0.0000 (1.0)      22.8303 (1.03)     0.0000 (1.0)           0;0  0.0438 (0.97)          1           1
test_sharing-push[3.60.1]     22.2147 (1.0)      22.2147 (1.0)      22.2147 (1.0)      0.0000 (1.0)      22.2147 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
test_sharing-push[main]       22.3435 (1.01)     22.3435 (1.01)     22.3435 (1.01)     0.0000 (1.0)      22.3435 (1.01)     0.0000 (1.0)           0;0  0.0448 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0128 (1.0)      2.0128 (1.0)      2.0128 (1.0)      0.0000 (1.0)      2.0128 (1.0)      0.0000 (1.0)           0;0  0.4968 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0945 (1.04)     2.0945 (1.04)     2.0945 (1.04)     0.0000 (1.0)      2.0945 (1.04)     0.0000 (1.0)           0;0  0.4774 (0.96)          1           1
test_sharing-push-noop[3.53.2]     6.0056 (2.98)     6.0056 (2.98)     6.0056 (2.98)     0.0000 (1.0)      6.0056 (2.98)     0.0000 (1.0)           0;0  0.1665 (0.34)          1           1
test_sharing-push-noop[3.60.1]     5.9449 (2.95)     5.9449 (2.95)     5.9449 (2.95)     0.0000 (1.0)      5.9449 (2.95)     0.0000 (1.0)           0;0  0.1682 (0.34)          1           1
test_sharing-push-noop[main]       5.8561 (2.91)     5.8561 (2.91)     5.8561 (2.91)     0.0000 (1.0)      5.8561 (2.91)     0.0000 (1.0)           0;0  0.1708 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     364.8273 (1.0)      364.8273 (1.0)      364.8273 (1.0)      0.0000 (1.0)      364.8273 (1.0)      0.0000 (1.0)           0;0  0.0027 (1.0)           1           1
test_sharing_azure-fetch[main]       365.4077 (1.00)     365.4077 (1.00)     365.4077 (1.00)     0.0000 (1.0)      365.4077 (1.00)     0.0000 (1.0)           0;0  0.0027 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3122 (1.0)      6.3122 (1.0)      6.3122 (1.0)      0.0000 (1.0)      6.3122 (1.0)      0.0000 (1.0)           0;0  0.1584 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7501 (1.07)     6.7501 (1.07)     6.7501 (1.07)     0.0000 (1.0)      6.7501 (1.07)     0.0000 (1.0)           0;0  0.1481 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     365.0072 (1.0)      365.0072 (1.0)      365.0072 (1.0)      0.0000 (1.0)      365.0072 (1.0)      0.0000 (1.0)           0;0  0.0027 (1.0)           1           1
test_sharing_azure-push[main]       371.5822 (1.02)     371.5822 (1.02)     371.5822 (1.02)     0.0000 (1.0)      371.5822 (1.02)     0.0000 (1.0)           0;0  0.0027 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.3790 (1.0)      7.3790 (1.0)      7.3790 (1.0)      0.0000 (1.0)      7.3790 (1.0)      0.0000 (1.0)           0;0  0.1355 (1.0)           1           1
test_sharing_azure-push-noop[main]       8.1007 (1.10)     8.1007 (1.10)     8.1007 (1.10)     0.0000 (1.0)      8.1007 (1.10)     0.0000 (1.0)           0;0  0.1234 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     472.6921 (1.02)     472.6921 (1.02)     472.6921 (1.02)     0.0000 (1.0)      472.6921 (1.02)     0.0000 (1.0)           0;0  0.0021 (0.98)          1           1
test_sharing_s3-fetch[main]       461.3691 (1.0)      461.3691 (1.0)      461.3691 (1.0)      0.0000 (1.0)      461.3691 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6366 (1.0)      6.6366 (1.0)      6.6366 (1.0)      0.0000 (1.0)      6.6366 (1.0)      0.0000 (1.0)           0;0  0.1507 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.8477 (1.03)     6.8477 (1.03)     6.8477 (1.03)     0.0000 (1.0)      6.8477 (1.03)     0.0000 (1.0)           0;0  0.1460 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     503.5748 (1.00)     503.5748 (1.00)     503.5748 (1.00)     0.0000 (1.0)      503.5748 (1.00)     0.0000 (1.0)           0;0  0.0020 (1.00)          1           1
test_sharing_s3-push[main]       502.1042 (1.0)      502.1042 (1.0)      502.1042 (1.0)      0.0000 (1.0)      502.1042 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.8980 (1.0)      6.8980 (1.0)      6.8980 (1.0)      0.0000 (1.0)      6.8980 (1.0)      0.0000 (1.0)           0;0  0.1450 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.0190 (1.02)     7.0190 (1.02)     7.0190 (1.02)     0.0000 (1.0)      7.0190 (1.02)     0.0000 (1.0)           0;0  0.1425 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.5794 (3.71)     20.5794 (3.71)     20.5794 (3.71)     0.0000 (1.0)      20.5794 (3.71)     0.0000 (1.0)           0;0  0.0486 (0.27)          1           1
test_status-status[3.10.0]     21.1431 (3.81)     21.1431 (3.81)     21.1431 (3.81)     0.0000 (1.0)      21.1431 (3.81)     0.0000 (1.0)           0;0  0.0473 (0.26)          1           1
test_status-status[3.53.2]     19.5112 (3.52)     19.5112 (3.52)     19.5112 (3.52)     0.0000 (1.0)      19.5112 (3.52)     0.0000 (1.0)           0;0  0.0513 (0.28)          1           1
test_status-status[3.60.1]      5.5456 (1.0)       5.5456 (1.0)       5.5456 (1.0)      0.0000 (1.0)       5.5456 (1.0)      0.0000 (1.0)           0;0  0.1803 (1.0)           1           1
test_status-status[main]        5.6787 (1.02)      5.6787 (1.02)      5.6787 (1.02)     0.0000 (1.0)       5.6787 (1.02)     0.0000 (1.0)           0;0  0.1761 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.1036 (1.83)     5.1036 (1.83)     5.1036 (1.83)     0.0000 (1.0)      5.1036 (1.83)     0.0000 (1.0)           0;0  0.1959 (0.55)          1           1
test_status-status-changed[3.10.0]     5.5241 (1.98)     5.5241 (1.98)     5.5241 (1.98)     0.0000 (1.0)      5.5241 (1.98)     0.0000 (1.0)           0;0  0.1810 (0.51)          1           1
test_status-status-changed[3.53.2]     5.4072 (1.93)     5.4072 (1.93)     5.4072 (1.93)     0.0000 (1.0)      5.4072 (1.93)     0.0000 (1.0)           0;0  0.1849 (0.52)          1           1
test_status-status-changed[3.60.1]     2.7950 (1.0)      2.7950 (1.0)      2.7950 (1.0)      0.0000 (1.0)      2.7950 (1.0)      0.0000 (1.0)           0;0  0.3578 (1.0)           1           1
test_status-status-changed[main]       2.9964 (1.07)     2.9964 (1.07)     2.9964 (1.07)     0.0000 (1.0)      2.9964 (1.07)     0.0000 (1.0)           0;0  0.3337 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0907 (1.92)     5.0907 (1.92)     5.0907 (1.92)     0.0000 (1.0)      5.0907 (1.92)     0.0000 (1.0)           0;0  0.1964 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.2523 (1.99)     5.2523 (1.99)     5.2523 (1.99)     0.0000 (1.0)      5.2523 (1.99)     0.0000 (1.0)           0;0  0.1904 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     5.1478 (1.95)     5.1478 (1.95)     5.1478 (1.95)     0.0000 (1.0)      5.1478 (1.95)     0.0000 (1.0)           0;0  0.1943 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.6455 (1.0)      2.6455 (1.0)      2.6455 (1.0)      0.0000 (1.0)      2.6455 (1.0)      0.0000 (1.0)           0;0  0.3780 (1.0)           1           1
test_status-status-changed-noop[main]       2.8240 (1.07)     2.8240 (1.07)     2.8240 (1.07)     0.0000 (1.0)      2.8240 (1.07)     0.0000 (1.0)           0;0  0.3541 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1442 (1.95)     5.1442 (1.95)     5.1442 (1.95)     0.0000 (1.0)      5.1442 (1.95)     0.0000 (1.0)           0;0  0.1944 (0.51)          1           1
test_status-status-noop[3.10.0]     5.3671 (2.03)     5.3671 (2.03)     5.3671 (2.03)     0.0000 (1.0)      5.3671 (2.03)     0.0000 (1.0)           0;0  0.1863 (0.49)          1           1
test_status-status-noop[3.53.2]     5.2435 (1.98)     5.2435 (1.98)     5.2435 (1.98)     0.0000 (1.0)      5.2435 (1.98)     0.0000 (1.0)           0;0  0.1907 (0.50)          1           1
test_status-status-noop[3.60.1]     2.6440 (1.0)      2.6440 (1.0)      2.6440 (1.0)      0.0000 (1.0)      2.6440 (1.0)      0.0000 (1.0)           0;0  0.3782 (1.0)           1           1
test_status-status-noop[main]       2.8201 (1.07)     2.8201 (1.07)     2.8201 (1.07)     0.0000 (1.0)      2.8201 (1.07)     0.0000 (1.0)           0;0  0.3546 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     200.6335 (4.34)     200.6335 (4.34)     200.6335 (4.34)     0.0000 (1.0)      200.6335 (4.34)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.10.0]     202.2923 (4.38)     202.2923 (4.38)     202.2923 (4.38)     0.0000 (1.0)      202.2923 (4.38)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.53.2]     113.3309 (2.45)     113.3309 (2.45)     113.3309 (2.45)     0.0000 (1.0)      113.3309 (2.45)     0.0000 (1.0)           0;0  0.0088 (0.41)          1           1
test_update-import-url[3.60.1]      46.2189 (1.0)       46.2189 (1.0)       46.2189 (1.0)      0.0000 (1.0)       46.2189 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        47.8462 (1.04)      47.8462 (1.04)      47.8462 (1.04)     0.0000 (1.0)       47.8462 (1.04)     0.0000 (1.0)           0;0  0.0209 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     186.1084 (5.26)     186.1084 (5.26)     186.1084 (5.26)     0.0000 (1.0)      186.1084 (5.26)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.10.0]     187.1812 (5.29)     187.1812 (5.29)     187.1812 (5.29)     0.0000 (1.0)      187.1812 (5.29)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.53.2]     107.0866 (3.02)     107.0866 (3.02)     107.0866 (3.02)     0.0000 (1.0)      107.0866 (3.02)     0.0000 (1.0)           0;0  0.0093 (0.33)          1           1
test_update-update[3.60.1]      35.4023 (1.0)       35.4023 (1.0)       35.4023 (1.0)      0.0000 (1.0)       35.4023 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.0780 (1.02)      36.0780 (1.02)      36.0780 (1.02)     0.0000 (1.0)       36.0780 (1.02)     0.0000 (1.0)           0;0  0.0277 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.7439 (2.20)     16.7439 (2.20)     16.7439 (2.20)     0.0000 (1.0)      16.7439 (2.20)     0.0000 (1.0)           0;0  0.0597 (0.45)          1           1
test_update-update-noop[3.10.0]     17.7707 (2.33)     17.7707 (2.33)     17.7707 (2.33)     0.0000 (1.0)      17.7707 (2.33)     0.0000 (1.0)           0;0  0.0563 (0.43)          1           1
test_update-update-noop[3.53.2]     17.5353 (2.30)     17.5353 (2.30)     17.5353 (2.30)     0.0000 (1.0)      17.5353 (2.30)     0.0000 (1.0)           0;0  0.0570 (0.43)          1           1
test_update-update-noop[3.60.1]      7.6121 (1.0)       7.6121 (1.0)       7.6121 (1.0)      0.0000 (1.0)       7.6121 (1.0)      0.0000 (1.0)           0;0  0.1314 (1.0)           1           1
test_update-update-noop[main]        8.3452 (1.10)      8.3452 (1.10)      8.3452 (1.10)     0.0000 (1.0)       8.3452 (1.10)     0.0000 (1.0)           0;0  0.1198 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean