Sat Mar 14 01:26:32 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.7904 (3.73)     85.7904 (3.73)     85.7904 (3.73)     0.0000 (1.0)      85.7904 (3.73)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_add_copy-add[3.10.0]     86.5828 (3.77)     86.5828 (3.77)     86.5828 (3.77)     0.0000 (1.0)      86.5828 (3.77)     0.0000 (1.0)           0;0  0.0115 (0.27)          1           1
test_add_copy-add[3.53.2]     76.7217 (3.34)     76.7217 (3.34)     76.7217 (3.34)     0.0000 (1.0)      76.7217 (3.34)     0.0000 (1.0)           0;0  0.0130 (0.30)          1           1
test_add_copy-add[3.60.1]     22.9825 (1.0)      22.9825 (1.0)      22.9825 (1.0)      0.0000 (1.0)      22.9825 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_add_copy-add[main]       24.3355 (1.06)     24.3355 (1.06)     24.3355 (1.06)     0.0000 (1.0)      24.3355 (1.06)     0.0000 (1.0)           0;0  0.0411 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.9908 (6.87)     27.9908 (6.87)     27.9908 (6.87)     0.0000 (1.0)      27.9908 (6.87)     0.0000 (1.0)           0;0  0.0357 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.0085 (6.88)     28.0085 (6.88)     28.0085 (6.88)     0.0000 (1.0)      28.0085 (6.88)     0.0000 (1.0)           0;0  0.0357 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.6650 (6.55)     26.6650 (6.55)     26.6650 (6.55)     0.0000 (1.0)      26.6650 (6.55)     0.0000 (1.0)           0;0  0.0375 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.0722 (1.0)       4.0722 (1.0)       4.0722 (1.0)      0.0000 (1.0)       4.0722 (1.0)      0.0000 (1.0)           0;0  0.2456 (1.0)           1           1
test_add_copy-add-noop[main]        4.3222 (1.06)      4.3222 (1.06)      4.3222 (1.06)     0.0000 (1.0)       4.3222 (1.06)     0.0000 (1.0)           0;0  0.2314 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     65.0588 (3.99)     65.0588 (3.99)     65.0588 (3.99)     0.0000 (1.0)      65.0588 (3.99)     0.0000 (1.0)           0;0  0.0154 (0.25)          1           1
test_add_hardlink-add[3.10.0]     66.1545 (4.06)     66.1545 (4.06)     66.1545 (4.06)     0.0000 (1.0)      66.1545 (4.06)     0.0000 (1.0)           0;0  0.0151 (0.25)          1           1
test_add_hardlink-add[3.53.2]     60.5160 (3.71)     60.5160 (3.71)     60.5160 (3.71)     0.0000 (1.0)      60.5160 (3.71)     0.0000 (1.0)           0;0  0.0165 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.3111 (1.0)      16.3111 (1.0)      16.3111 (1.0)      0.0000 (1.0)      16.3111 (1.0)      0.0000 (1.0)           0;0  0.0613 (1.0)           1           1
test_add_hardlink-add[main]       17.3353 (1.06)     17.3353 (1.06)     17.3353 (1.06)     0.0000 (1.0)      17.3353 (1.06)     0.0000 (1.0)           0;0  0.0577 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.3696 (7.57)     32.3696 (7.57)     32.3696 (7.57)     0.0000 (1.0)      32.3696 (7.57)     0.0000 (1.0)           0;0  0.0309 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.0742 (7.74)     33.0742 (7.74)     33.0742 (7.74)     0.0000 (1.0)      33.0742 (7.74)     0.0000 (1.0)           0;0  0.0302 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.2368 (7.31)     31.2368 (7.31)     31.2368 (7.31)     0.0000 (1.0)      31.2368 (7.31)     0.0000 (1.0)           0;0  0.0320 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2742 (1.0)       4.2742 (1.0)       4.2742 (1.0)      0.0000 (1.0)       4.2742 (1.0)      0.0000 (1.0)           0;0  0.2340 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4386 (1.04)      4.4386 (1.04)      4.4386 (1.04)     0.0000 (1.0)       4.4386 (1.04)     0.0000 (1.0)           0;0  0.2253 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     68.4745 (1.89)     68.4745 (1.89)     68.4745 (1.89)     0.0000 (1.0)      68.4745 (1.89)     0.0000 (1.0)           0;0  0.0146 (0.53)          1           1
test_add_symlink-add[3.10.0]     69.9357 (1.93)     69.9357 (1.93)     69.9357 (1.93)     0.0000 (1.0)      69.9357 (1.93)     0.0000 (1.0)           0;0  0.0143 (0.52)          1           1
test_add_symlink-add[3.53.2]     63.9553 (1.76)     63.9553 (1.76)     63.9553 (1.76)     0.0000 (1.0)      63.9553 (1.76)     0.0000 (1.0)           0;0  0.0156 (0.57)          1           1
test_add_symlink-add[3.60.1]     36.2934 (1.0)      36.2934 (1.0)      36.2934 (1.0)      0.0000 (1.0)      36.2934 (1.0)      0.0000 (1.0)           0;0  0.0276 (1.0)           1           1
test_add_symlink-add[main]       38.1579 (1.05)     38.1579 (1.05)     38.1579 (1.05)     0.0000 (1.0)      38.1579 (1.05)     0.0000 (1.0)           0;0  0.0262 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.0853 (8.58)     45.0853 (8.58)     45.0853 (8.58)     0.0000 (1.0)      45.0853 (8.58)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     44.9514 (8.55)     44.9514 (8.55)     44.9514 (8.55)     0.0000 (1.0)      44.9514 (8.55)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.8355 (8.53)     44.8355 (8.53)     44.8355 (8.53)     0.0000 (1.0)      44.8355 (8.53)     0.0000 (1.0)           0;0  0.0223 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.2565 (1.0)       5.2565 (1.0)       5.2565 (1.0)      0.0000 (1.0)       5.2565 (1.0)      0.0000 (1.0)           0;0  0.1902 (1.0)           1           1
test_add_symlink-add-noop[main]        5.4208 (1.03)      5.4208 (1.03)      5.4208 (1.03)     0.0000 (1.0)       5.4208 (1.03)     0.0000 (1.0)           0;0  0.1845 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.3542 (1.88)      40.3542 (1.88)      40.3542 (1.88)     0.0000 (1.0)       40.3542 (1.88)     0.0000 (1.0)           0;0  0.0248 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     110.1063 (5.13)     110.1063 (5.13)     110.1063 (5.13)     0.0000 (1.0)      110.1063 (5.13)     0.0000 (1.0)           0;0  0.0091 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      28.8116 (1.34)      28.8116 (1.34)      28.8116 (1.34)     0.0000 (1.0)       28.8116 (1.34)     0.0000 (1.0)           0;0  0.0347 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]      21.4744 (1.0)       21.4744 (1.0)       21.4744 (1.0)      0.0000 (1.0)       21.4744 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
test_checkout_copy-checkout[main]        22.7084 (1.06)      22.7084 (1.06)      22.7084 (1.06)     0.0000 (1.0)       22.7084 (1.06)     0.0000 (1.0)           0;0  0.0440 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6668 (1.71)     5.6668 (1.71)     5.6668 (1.71)     0.0000 (1.0)      5.6668 (1.71)     0.0000 (1.0)           0;0  0.1765 (0.58)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9260 (1.79)     5.9260 (1.79)     5.9260 (1.79)     0.0000 (1.0)      5.9260 (1.79)     0.0000 (1.0)           0;0  0.1687 (0.56)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8958 (1.78)     5.8958 (1.78)     5.8958 (1.78)     0.0000 (1.0)      5.8958 (1.78)     0.0000 (1.0)           0;0  0.1696 (0.56)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3129 (1.0)      3.3129 (1.0)      3.3129 (1.0)      0.0000 (1.0)      3.3129 (1.0)      0.0000 (1.0)           0;0  0.3019 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5706 (1.08)     3.5706 (1.08)     3.5706 (1.08)     0.0000 (1.0)      3.5706 (1.08)     0.0000 (1.0)           0;0  0.2801 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.7624 (1.98)     7.7624 (1.98)     7.7624 (1.98)     0.0000 (1.0)      7.7624 (1.98)     0.0000 (1.0)           0;0  0.1288 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6601 (1.70)     6.6601 (1.70)     6.6601 (1.70)     0.0000 (1.0)      6.6601 (1.70)     0.0000 (1.0)           0;0  0.1501 (0.59)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4867 (1.66)     6.4867 (1.66)     6.4867 (1.66)     0.0000 (1.0)      6.4867 (1.66)     0.0000 (1.0)           0;0  0.1542 (0.60)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9192 (1.0)      3.9192 (1.0)      3.9192 (1.0)      0.0000 (1.0)      3.9192 (1.0)      0.0000 (1.0)           0;0  0.2552 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3188 (1.10)     4.3188 (1.10)     4.3188 (1.10)     0.0000 (1.0)      4.3188 (1.10)     0.0000 (1.0)           0;0  0.2315 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.7728 (2.91)     21.7728 (2.91)     21.7728 (2.91)     0.0000 (1.0)      21.7728 (2.91)     0.0000 (1.0)           0;0  0.0459 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.4572 (2.20)     16.4572 (2.20)     16.4572 (2.20)     0.0000 (1.0)      16.4572 (2.20)     0.0000 (1.0)           0;0  0.0608 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.8307 (1.98)     14.8307 (1.98)     14.8307 (1.98)     0.0000 (1.0)      14.8307 (1.98)     0.0000 (1.0)           0;0  0.0674 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4857 (1.0)       7.4857 (1.0)       7.4857 (1.0)      0.0000 (1.0)       7.4857 (1.0)      0.0000 (1.0)           0;0  0.1336 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.4026 (1.12)      8.4026 (1.12)      8.4026 (1.12)     0.0000 (1.0)       8.4026 (1.12)     0.0000 (1.0)           0;0  0.1190 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6261 (1.77)     5.6261 (1.77)     5.6261 (1.77)     0.0000 (1.0)      5.6261 (1.77)     0.0000 (1.0)           0;0  0.1777 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7560 (1.81)     5.7560 (1.81)     5.7560 (1.81)     0.0000 (1.0)      5.7560 (1.81)     0.0000 (1.0)           0;0  0.1737 (0.55)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6035 (1.77)     5.6035 (1.77)     5.6035 (1.77)     0.0000 (1.0)      5.6035 (1.77)     0.0000 (1.0)           0;0  0.1785 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.1716 (1.0)      3.1716 (1.0)      3.1716 (1.0)      0.0000 (1.0)      3.1716 (1.0)      0.0000 (1.0)           0;0  0.3153 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3637 (1.06)     3.3637 (1.06)     3.3637 (1.06)     0.0000 (1.0)      3.3637 (1.06)     0.0000 (1.0)           0;0  0.2973 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6228 (2.01)     7.6228 (2.01)     7.6228 (2.01)     0.0000 (1.0)      7.6228 (2.01)     0.0000 (1.0)           0;0  0.1312 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6476 (1.75)     6.6476 (1.75)     6.6476 (1.75)     0.0000 (1.0)      6.6476 (1.75)     0.0000 (1.0)           0;0  0.1504 (0.57)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4009 (1.69)     6.4009 (1.69)     6.4009 (1.69)     0.0000 (1.0)      6.4009 (1.69)     0.0000 (1.0)           0;0  0.1562 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.7900 (1.0)      3.7900 (1.0)      3.7900 (1.0)      0.0000 (1.0)      3.7900 (1.0)      0.0000 (1.0)           0;0  0.2639 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3189 (1.14)     4.3189 (1.14)     4.3189 (1.14)     0.0000 (1.0)      4.3189 (1.14)     0.0000 (1.0)           0;0  0.2315 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.5275 (2.35)     24.5275 (2.35)     24.5275 (2.35)     0.0000 (1.0)      24.5275 (2.35)     0.0000 (1.0)           0;0  0.0408 (0.43)          1           1
test_checkout_symlink-checkout[3.10.0]     19.9806 (1.91)     19.9806 (1.91)     19.9806 (1.91)     0.0000 (1.0)      19.9806 (1.91)     0.0000 (1.0)           0;0  0.0500 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.8703 (1.71)     17.8703 (1.71)     17.8703 (1.71)     0.0000 (1.0)      17.8703 (1.71)     0.0000 (1.0)           0;0  0.0560 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.4401 (1.0)      10.4401 (1.0)      10.4401 (1.0)      0.0000 (1.0)      10.4401 (1.0)      0.0000 (1.0)           0;0  0.0958 (1.0)           1           1
test_checkout_symlink-checkout[main]       12.4988 (1.20)     12.4988 (1.20)     12.4988 (1.20)     0.0000 (1.0)      12.4988 (1.20)     0.0000 (1.0)           0;0  0.0800 (0.84)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.9534 (1.61)     6.9534 (1.61)     6.9534 (1.61)     0.0000 (1.0)      6.9534 (1.61)     0.0000 (1.0)           0;0  0.1438 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2950 (1.69)     7.2950 (1.69)     7.2950 (1.69)     0.0000 (1.0)      7.2950 (1.69)     0.0000 (1.0)           0;0  0.1371 (0.59)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9030 (1.60)     6.9030 (1.60)     6.9030 (1.60)     0.0000 (1.0)      6.9030 (1.60)     0.0000 (1.0)           0;0  0.1449 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3103 (1.0)      4.3103 (1.0)      4.3103 (1.0)      0.0000 (1.0)      4.3103 (1.0)      0.0000 (1.0)           0;0  0.2320 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.6906 (1.09)     4.6906 (1.09)     4.6906 (1.09)     0.0000 (1.0)      4.6906 (1.09)     0.0000 (1.0)           0;0  0.2132 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.0869 (1.71)     10.0869 (1.71)     10.0869 (1.71)     0.0000 (1.0)      10.0869 (1.71)     0.0000 (1.0)           0;0  0.0991 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.8936 (1.50)      8.8936 (1.50)      8.8936 (1.50)     0.0000 (1.0)       8.8936 (1.50)     0.0000 (1.0)           0;0  0.1124 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.8395 (1.49)      8.8395 (1.49)      8.8395 (1.49)     0.0000 (1.0)       8.8395 (1.49)     0.0000 (1.0)           0;0  0.1131 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9131 (1.0)       5.9131 (1.0)       5.9131 (1.0)      0.0000 (1.0)       5.9131 (1.0)      0.0000 (1.0)           0;0  0.1691 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.2232 (1.05)      6.2232 (1.05)      6.2232 (1.05)     0.0000 (1.0)       6.2232 (1.05)     0.0000 (1.0)           0;0  0.1607 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2157 (1.82)     4.2157 (1.82)     4.2157 (1.82)     0.0000 (1.0)      4.2157 (1.82)     0.0000 (1.0)           0;0  0.2372 (0.55)          1           1
test_data_status-data-changed[3.10.0]     5.0336 (2.17)     5.0336 (2.17)     5.0336 (2.17)     0.0000 (1.0)      5.0336 (2.17)     0.0000 (1.0)           0;0  0.1987 (0.46)          1           1
test_data_status-data-changed[3.53.2]     4.7624 (2.05)     4.7624 (2.05)     4.7624 (2.05)     0.0000 (1.0)      4.7624 (2.05)     0.0000 (1.0)           0;0  0.2100 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.3214 (1.0)      2.3214 (1.0)      2.3214 (1.0)      0.0000 (1.0)      2.3214 (1.0)      0.0000 (1.0)           0;0  0.4308 (1.0)           1           1
test_data_status-data-changed[main]       2.6347 (1.13)     2.6347 (1.13)     2.6347 (1.13)     0.0000 (1.0)      2.6347 (1.13)     0.0000 (1.0)           0;0  0.3796 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2157 (1.81)     4.2157 (1.81)     4.2157 (1.81)     0.0000 (1.0)      4.2157 (1.81)     0.0000 (1.0)           0;0  0.2372 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9934 (2.14)     4.9934 (2.14)     4.9934 (2.14)     0.0000 (1.0)      4.9934 (2.14)     0.0000 (1.0)           0;0  0.2003 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7649 (2.04)     4.7649 (2.04)     4.7649 (2.04)     0.0000 (1.0)      4.7649 (2.04)     0.0000 (1.0)           0;0  0.2099 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3312 (1.0)      2.3312 (1.0)      2.3312 (1.0)      0.0000 (1.0)      2.3312 (1.0)      0.0000 (1.0)           0;0  0.4290 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5279 (1.08)     2.5279 (1.08)     2.5279 (1.08)     0.0000 (1.0)      2.5279 (1.08)     0.0000 (1.0)           0;0  0.3956 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.8996 (3.63)     18.8996 (3.63)     18.8996 (3.63)     0.0000 (1.0)      18.8996 (3.63)     0.0000 (1.0)           0;0  0.0529 (0.28)          1           1
test_data_status-data-new[3.10.0]     20.3123 (3.90)     20.3123 (3.90)     20.3123 (3.90)     0.0000 (1.0)      20.3123 (3.90)     0.0000 (1.0)           0;0  0.0492 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.8663 (3.81)     19.8663 (3.81)     19.8663 (3.81)     0.0000 (1.0)      19.8663 (3.81)     0.0000 (1.0)           0;0  0.0503 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.2098 (1.0)       5.2098 (1.0)       5.2098 (1.0)      0.0000 (1.0)       5.2098 (1.0)      0.0000 (1.0)           0;0  0.1919 (1.0)           1           1
test_data_status-data-new[main]        5.4436 (1.04)      5.4436 (1.04)      5.4436 (1.04)     0.0000 (1.0)       5.4436 (1.04)     0.0000 (1.0)           0;0  0.1837 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1083 (1.79)     4.1083 (1.79)     4.1083 (1.79)     0.0000 (1.0)      4.1083 (1.79)     0.0000 (1.0)           0;0  0.2434 (0.56)          1           1
test_data_status-data-noop[3.10.0]     5.1043 (2.23)     5.1043 (2.23)     5.1043 (2.23)     0.0000 (1.0)      5.1043 (2.23)     0.0000 (1.0)           0;0  0.1959 (0.45)          1           1
test_data_status-data-noop[3.53.2]     4.9046 (2.14)     4.9046 (2.14)     4.9046 (2.14)     0.0000 (1.0)      4.9046 (2.14)     0.0000 (1.0)           0;0  0.2039 (0.47)          1           1
test_data_status-data-noop[3.60.1]     2.2903 (1.0)      2.2903 (1.0)      2.2903 (1.0)      0.0000 (1.0)      2.2903 (1.0)      0.0000 (1.0)           0;0  0.4366 (1.0)           1           1
test_data_status-data-noop[main]       2.5997 (1.14)     2.5997 (1.14)     2.5997 (1.14)     0.0000 (1.0)      2.5997 (1.14)     0.0000 (1.0)           0;0  0.3847 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.8591 (1.26)     6.8591 (1.26)     6.8591 (1.26)     0.0000 (1.0)      6.8591 (1.26)     0.0000 (1.0)           0;0  0.1458 (0.80)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6457 (1.40)     7.6457 (1.40)     7.6457 (1.40)     0.0000 (1.0)      7.6457 (1.40)     0.0000 (1.0)           0;0  0.1308 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6000 (1.39)     7.6000 (1.39)     7.6000 (1.39)     0.0000 (1.0)      7.6000 (1.39)     0.0000 (1.0)           0;0  0.1316 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4546 (1.0)      5.4546 (1.0)      5.4546 (1.0)      0.0000 (1.0)      5.4546 (1.0)      0.0000 (1.0)           0;0  0.1833 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.6534 (1.04)     5.6534 (1.04)     5.6534 (1.04)     0.0000 (1.0)      5.6534 (1.04)     0.0000 (1.0)           0;0  0.1769 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.8745 (1.26)     6.8745 (1.26)     6.8745 (1.26)     0.0000 (1.0)      6.8745 (1.26)     0.0000 (1.0)           0;0  0.1455 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7942 (1.43)     7.7942 (1.43)     7.7942 (1.43)     0.0000 (1.0)      7.7942 (1.43)     0.0000 (1.0)           0;0  0.1283 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7326 (1.41)     7.7326 (1.41)     7.7326 (1.41)     0.0000 (1.0)      7.7326 (1.41)     0.0000 (1.0)           0;0  0.1293 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.4668 (1.0)      5.4668 (1.0)      5.4668 (1.0)      0.0000 (1.0)      5.4668 (1.0)      0.0000 (1.0)           0;0  0.1829 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.7798 (1.06)     5.7798 (1.06)     5.7798 (1.06)     0.0000 (1.0)      5.7798 (1.06)     0.0000 (1.0)           0;0  0.1730 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.9667 (2.74)     21.9667 (2.74)     21.9667 (2.74)     0.0000 (1.0)      21.9667 (2.74)     0.0000 (1.0)           0;0  0.0455 (0.36)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.2584 (2.90)     23.2584 (2.90)     23.2584 (2.90)     0.0000 (1.0)      23.2584 (2.90)     0.0000 (1.0)           0;0  0.0430 (0.34)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.6803 (2.83)     22.6803 (2.83)     22.6803 (2.83)     0.0000 (1.0)      22.6803 (2.83)     0.0000 (1.0)           0;0  0.0441 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0108 (1.0)       8.0108 (1.0)       8.0108 (1.0)      0.0000 (1.0)       8.0108 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.5917 (1.07)      8.5917 (1.07)      8.5917 (1.07)     0.0000 (1.0)       8.5917 (1.07)     0.0000 (1.0)           0;0  0.1164 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.3571 (1.36)     6.3571 (1.36)     6.3571 (1.36)     0.0000 (1.0)      6.3571 (1.36)     0.0000 (1.0)           0;0  0.1573 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.4913 (1.60)     7.4913 (1.60)     7.4913 (1.60)     0.0000 (1.0)      7.4913 (1.60)     0.0000 (1.0)           0;0  0.1335 (0.62)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1593 (1.53)     7.1593 (1.53)     7.1593 (1.53)     0.0000 (1.0)      7.1593 (1.53)     0.0000 (1.0)           0;0  0.1397 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.6743 (1.0)      4.6743 (1.0)      4.6743 (1.0)      0.0000 (1.0)      4.6743 (1.0)      0.0000 (1.0)           0;0  0.2139 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0256 (1.08)     5.0256 (1.08)     5.0256 (1.08)     0.0000 (1.0)      5.0256 (1.08)     0.0000 (1.0)           0;0  0.1990 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.3039 (2.64)     18.3039 (2.64)     18.3039 (2.64)     0.0000 (1.0)      18.3039 (2.64)     0.0000 (1.0)           0;0  0.0546 (0.38)          1           1
test_diff-diff[3.10.0]     19.3394 (2.79)     19.3394 (2.79)     19.3394 (2.79)     0.0000 (1.0)      19.3394 (2.79)     0.0000 (1.0)           0;0  0.0517 (0.36)          1           1
test_diff-diff[3.53.2]     19.1556 (2.76)     19.1556 (2.76)     19.1556 (2.76)     0.0000 (1.0)      19.1556 (2.76)     0.0000 (1.0)           0;0  0.0522 (0.36)          1           1
test_diff-diff[3.60.1]      6.9377 (1.0)       6.9377 (1.0)       6.9377 (1.0)      0.0000 (1.0)       6.9377 (1.0)      0.0000 (1.0)           0;0  0.1441 (1.0)           1           1
test_diff-diff[main]        8.2186 (1.18)      8.2186 (1.18)      8.2186 (1.18)     0.0000 (1.0)       8.2186 (1.18)     0.0000 (1.0)           0;0  0.1217 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0483 (1.83)     6.0483 (1.83)     6.0483 (1.83)     0.0000 (1.0)      6.0483 (1.83)     0.0000 (1.0)           0;0  0.1653 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.6651 (2.01)     6.6651 (2.01)     6.6651 (2.01)     0.0000 (1.0)      6.6651 (2.01)     0.0000 (1.0)           0;0  0.1500 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.6211 (1.70)     5.6211 (1.70)     5.6211 (1.70)     0.0000 (1.0)      5.6211 (1.70)     0.0000 (1.0)           0;0  0.1779 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.3093 (1.0)      3.3093 (1.0)      3.3093 (1.0)      0.0000 (1.0)      3.3093 (1.0)      0.0000 (1.0)           0;0  0.3022 (1.0)           1           1
test_diff-diff-changed[main]       4.2475 (1.28)     4.2475 (1.28)     4.2475 (1.28)     0.0000 (1.0)      4.2475 (1.28)     0.0000 (1.0)           0;0  0.2354 (0.78)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5968 (1.69)     5.5968 (1.69)     5.5968 (1.69)     0.0000 (1.0)      5.5968 (1.69)     0.0000 (1.0)           0;0  0.1787 (0.59)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7482 (1.74)     5.7482 (1.74)     5.7482 (1.74)     0.0000 (1.0)      5.7482 (1.74)     0.0000 (1.0)           0;0  0.1740 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5309 (1.67)     5.5309 (1.67)     5.5309 (1.67)     0.0000 (1.0)      5.5309 (1.67)     0.0000 (1.0)           0;0  0.1808 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3047 (1.0)      3.3047 (1.0)      3.3047 (1.0)      0.0000 (1.0)      3.3047 (1.0)      0.0000 (1.0)           0;0  0.3026 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.3403 (1.31)     4.3403 (1.31)     4.3403 (1.31)     0.0000 (1.0)      4.3403 (1.31)     0.0000 (1.0)           0;0  0.2304 (0.76)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0710 (1.23)     4.0710 (1.23)     4.0710 (1.23)     0.0000 (1.0)      4.0710 (1.23)     0.0000 (1.0)           0;0  0.2456 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.9773 (1.50)     4.9773 (1.50)     4.9773 (1.50)     0.0000 (1.0)      4.9773 (1.50)     0.0000 (1.0)           0;0  0.2009 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.6341 (1.70)     5.6341 (1.70)     5.6341 (1.70)     0.0000 (1.0)      5.6341 (1.70)     0.0000 (1.0)           0;0  0.1775 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.3204 (1.0)      3.3204 (1.0)      3.3204 (1.0)      0.0000 (1.0)      3.3204 (1.0)      0.0000 (1.0)           0;0  0.3012 (1.0)           1           1
test_diff-diff-noop[main]       4.1949 (1.26)     4.1949 (1.26)     4.1949 (1.26)     0.0000 (1.0)      4.1949 (1.26)     0.0000 (1.0)           0;0  0.2384 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2209 (1.0)       1.2209 (1.0)       1.2209 (1.0)      0.0000 (1.0)       1.2209 (1.0)      0.0000 (1.0)           0;0  0.8191 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.1255 (8.29)     10.1255 (8.29)     10.1255 (8.29)     0.0000 (1.0)      10.1255 (8.29)     0.0000 (1.0)           0;0  0.0988 (0.12)          1           1
test_exp_show-exp[3.53.2]      5.4069 (4.43)      5.4069 (4.43)      5.4069 (4.43)     0.0000 (1.0)       5.4069 (4.43)     0.0000 (1.0)           0;0  0.1850 (0.23)          1           1
test_exp_show-exp[3.60.1]      5.4507 (4.46)      5.4507 (4.46)      5.4507 (4.46)     0.0000 (1.0)       5.4507 (4.46)     0.0000 (1.0)           0;0  0.1835 (0.22)          1           1
test_exp_show-exp[main]        7.8218 (6.41)      7.8218 (6.41)      7.8218 (6.41)     0.0000 (1.0)       7.8218 (6.41)     0.0000 (1.0)           0;0  0.1278 (0.16)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]      99.6552 (6.25)      99.6552 (6.25)      99.6552 (6.25)     0.0000 (1.0)       99.6552 (6.25)     0.0000 (1.0)           0;0  0.0100 (0.16)          1           1
test_fetch-fetch[3.10.0]     102.3379 (6.42)     102.3379 (6.42)     102.3379 (6.42)     0.0000 (1.0)      102.3379 (6.42)     0.0000 (1.0)           0;0  0.0098 (0.16)          1           1
test_fetch-fetch[3.53.2]      22.7318 (1.43)      22.7318 (1.43)      22.7318 (1.43)     0.0000 (1.0)       22.7318 (1.43)     0.0000 (1.0)           0;0  0.0440 (0.70)          1           1
test_fetch-fetch[3.60.1]      15.9396 (1.0)       15.9396 (1.0)       15.9396 (1.0)      0.0000 (1.0)       15.9396 (1.0)      0.0000 (1.0)           0;0  0.0627 (1.0)           1           1
test_fetch-fetch[main]        16.0846 (1.01)      16.0846 (1.01)      16.0846 (1.01)     0.0000 (1.0)       16.0846 (1.01)     0.0000 (1.0)           0;0  0.0622 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.0148 (1.0)      2.0148 (1.0)      2.0148 (1.0)      0.0000 (1.0)      2.0148 (1.0)      0.0000 (1.0)           0;0  0.4963 (1.0)           1           1
test_gc-gc[3.10.0]     2.3018 (1.14)     2.3018 (1.14)     2.3018 (1.14)     0.0000 (1.0)      2.3018 (1.14)     0.0000 (1.0)           0;0  0.4344 (0.88)          1           1
test_gc-gc[3.53.2]     2.0695 (1.03)     2.0695 (1.03)     2.0695 (1.03)     0.0000 (1.0)      2.0695 (1.03)     0.0000 (1.0)           0;0  0.4832 (0.97)          1           1
test_gc-gc[3.60.1]     2.0975 (1.04)     2.0975 (1.04)     2.0975 (1.04)     0.0000 (1.0)      2.0975 (1.04)     0.0000 (1.0)           0;0  0.4768 (0.96)          1           1
test_gc-gc[main]       2.3505 (1.17)     2.3505 (1.17)     2.3505 (1.17)     0.0000 (1.0)      2.3505 (1.17)     0.0000 (1.0)           0;0  0.4254 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     185.4804 (3.36)     185.4804 (3.36)     185.4804 (3.36)     0.0000 (1.0)      185.4804 (3.36)     0.0000 (1.0)           0;0  0.0054 (0.30)          1           1
test_get-get[3.10.0]     220.7552 (4.00)     220.7552 (4.00)     220.7552 (4.00)     0.0000 (1.0)      220.7552 (4.00)     0.0000 (1.0)           0;0  0.0045 (0.25)          1           1
test_get-get[3.53.2]     166.6206 (3.02)     166.6206 (3.02)     166.6206 (3.02)     0.0000 (1.0)      166.6206 (3.02)     0.0000 (1.0)           0;0  0.0060 (0.33)          1           1
test_get-get[3.60.1]      55.2206 (1.0)       55.2206 (1.0)       55.2206 (1.0)      0.0000 (1.0)       55.2206 (1.0)      0.0000 (1.0)           0;0  0.0181 (1.0)           1           1
test_get-get[main]        55.4426 (1.00)      55.4426 (1.00)      55.4426 (1.00)     0.0000 (1.0)       55.4426 (1.00)     0.0000 (1.0)           0;0  0.0180 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     90.2745 (5.23)     90.2745 (5.23)     90.2745 (5.23)     0.0000 (1.0)      90.2745 (5.23)     0.0000 (1.0)           0;0  0.0111 (0.19)          1           1
test_get_url-get-url[3.10.0]     92.5537 (5.36)     92.5537 (5.36)     92.5537 (5.36)     0.0000 (1.0)      92.5537 (5.36)     0.0000 (1.0)           0;0  0.0108 (0.19)          1           1
test_get_url-get-url[3.53.2]     17.2568 (1.0)      17.2568 (1.0)      17.2568 (1.0)      0.0000 (1.0)      17.2568 (1.0)      0.0000 (1.0)           0;0  0.0579 (1.0)           1           1
test_get_url-get-url[3.60.1]     17.6371 (1.02)     17.6371 (1.02)     17.6371 (1.02)     0.0000 (1.0)      17.6371 (1.02)     0.0000 (1.0)           0;0  0.0567 (0.98)          1           1
test_get_url-get-url[main]       17.4758 (1.01)     17.4758 (1.01)     17.4758 (1.01)     0.0000 (1.0)      17.4758 (1.01)     0.0000 (1.0)           0;0  0.0572 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     152.5535 (1.05)     166.3954 (1.02)     157.8863 (1.04)     3.1867 (1.10)     157.1591 (1.04)     3.5329 (1.0)          29;8  6.3337 (0.96)        100           1
test_help---help[3.10.0]     150.5405 (1.04)     162.9269 (1.0)      155.2924 (1.02)     2.9001 (1.0)      154.6170 (1.02)     4.8686 (1.38)         39;0  6.4395 (0.98)        100           1
test_help---help[3.53.2]     152.7756 (1.05)     173.5533 (1.07)     158.9105 (1.05)     3.5792 (1.23)     158.3346 (1.05)     4.6547 (1.32)         33;1  6.2929 (0.95)        100           1
test_help---help[3.60.1]     154.6994 (1.07)     219.6285 (1.35)     161.5123 (1.07)     8.2320 (2.84)     159.2270 (1.05)     6.8298 (1.93)          8;4  6.1915 (0.94)        100           1
test_help---help[main]       144.9170 (1.0)      169.4341 (1.04)     151.5721 (1.0)      3.7312 (1.29)     151.5053 (1.0)      5.3325 (1.51)         33;1  6.5975 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     270.7441 (3.38)     270.7441 (3.38)     270.7441 (3.38)     0.0000 (1.0)      270.7441 (3.38)     0.0000 (1.0)           0;0  0.0037 (0.30)          1           1
test_import-import[3.10.0]     308.9767 (3.86)     308.9767 (3.86)     308.9767 (3.86)     0.0000 (1.0)      308.9767 (3.86)     0.0000 (1.0)           0;0  0.0032 (0.26)          1           1
test_import-import[3.60.1]      80.0684 (1.0)       80.0684 (1.0)       80.0684 (1.0)      0.0000 (1.0)       80.0684 (1.0)      0.0000 (1.0)           0;0  0.0125 (1.0)           1           1
test_import-import[main]        80.8780 (1.01)      80.8780 (1.01)      80.8780 (1.01)     0.0000 (1.0)       80.8780 (1.01)     0.0000 (1.0)           0;0  0.0124 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     157.6690 (5.12)     157.6690 (5.12)     157.6690 (5.12)     0.0000 (1.0)      157.6690 (5.12)     0.0000 (1.0)           0;0  0.0063 (0.20)          1           1
test_import_url-import-url[3.10.0]     163.6799 (5.32)     163.6799 (5.32)     163.6799 (5.32)     0.0000 (1.0)      163.6799 (5.32)     0.0000 (1.0)           0;0  0.0061 (0.19)          1           1
test_import_url-import-url[3.53.2]      84.2360 (2.74)      84.2360 (2.74)      84.2360 (2.74)     0.0000 (1.0)       84.2360 (2.74)     0.0000 (1.0)           0;0  0.0119 (0.37)          1           1
test_import_url-import-url[3.60.1]      30.7706 (1.0)       30.7706 (1.0)       30.7706 (1.0)      0.0000 (1.0)       30.7706 (1.0)      0.0000 (1.0)           0;0  0.0325 (1.0)           1           1
test_import_url-import-url[main]        32.3680 (1.05)      32.3680 (1.05)      32.3680 (1.05)     0.0000 (1.0)       32.3680 (1.05)     0.0000 (1.0)           0;0  0.0309 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     403.9293 (1.03)     440.7739 (1.07)     415.4771 (1.04)      7.0907 (2.46)     414.7373 (1.04)     9.0194 (3.01)         34;1  2.4069 (0.96)        100           1
test_init-init[3.10.0]     413.8363 (1.05)     439.2268 (1.06)     422.0587 (1.06)      5.8922 (2.05)     421.4607 (1.06)     9.4201 (3.14)         31;0  2.3693 (0.95)        100           1
test_init-init[3.53.2]     393.8600 (1.0)      417.5727 (1.01)     399.6572 (1.00)      4.3353 (1.51)     398.7309 (1.00)     4.9732 (1.66)         15;5  2.5021 (1.00)        100           1
test_init-init[3.60.1]     394.6181 (1.00)     413.1257 (1.0)      398.9587 (1.0)       2.8769 (1.0)      398.4544 (1.0)      3.0520 (1.02)         20;5  2.5065 (1.0)         100           1
test_init-init[main]       432.9080 (1.10)     658.7777 (1.59)     445.0531 (1.12)     28.3093 (9.84)     439.3265 (1.10)     2.9976 (1.0)           4;8  2.2469 (0.90)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     642.0998 (1.0)      642.0998 (1.0)      642.0998 (1.0)      0.0000 (1.0)      642.0998 (1.0)      0.0000 (1.0)           0;0  1.5574 (1.0)           1           1
test_list-list[3.10.0]     936.6243 (1.46)     936.6243 (1.46)     936.6243 (1.46)     0.0000 (1.0)      936.6243 (1.46)     0.0000 (1.0)           0;0  1.0677 (0.69)          1           1
test_list-list[3.53.2]     685.2261 (1.07)     685.2261 (1.07)     685.2261 (1.07)     0.0000 (1.0)      685.2261 (1.07)     0.0000 (1.0)           0;0  1.4594 (0.94)          1           1
test_list-list[3.60.1]     653.2547 (1.02)     653.2547 (1.02)     653.2547 (1.02)     0.0000 (1.0)      653.2547 (1.02)     0.0000 (1.0)           0;0  1.5308 (0.98)          1           1
test_list-list[main]       644.4935 (1.00)     644.4935 (1.00)     644.4935 (1.00)     0.0000 (1.0)      644.4935 (1.00)     0.0000 (1.0)           0;0  1.5516 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     450.8342 (1.09)     450.8342 (1.09)     450.8342 (1.09)     0.0000 (1.0)      450.8342 (1.09)     0.0000 (1.0)           0;0  2.2181 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     450.5383 (1.09)     450.5383 (1.09)     450.5383 (1.09)     0.0000 (1.0)      450.5383 (1.09)     0.0000 (1.0)           0;0  2.2196 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     414.5754 (1.0)      414.5754 (1.0)      414.5754 (1.0)      0.0000 (1.0)      414.5754 (1.0)      0.0000 (1.0)           0;0  2.4121 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     415.1997 (1.00)     415.1997 (1.00)     415.1997 (1.00)     0.0000 (1.0)      415.1997 (1.00)     0.0000 (1.0)           0;0  2.4085 (1.00)          1           1
test_list-list-dvc-only[main]       425.3405 (1.03)     425.3405 (1.03)     425.3405 (1.03)     0.0000 (1.0)      425.3405 (1.03)     0.0000 (1.0)           0;0  2.3511 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5122 (1.0)      2.5122 (1.0)      2.5122 (1.0)      0.0000 (1.0)      2.5122 (1.0)      0.0000 (1.0)           0;0  0.3981 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5858 (1.03)     2.5858 (1.03)     2.5858 (1.03)     0.0000 (1.0)      2.5858 (1.03)     0.0000 (1.0)           0;0  0.3867 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.6495 (1.05)     2.6495 (1.05)     2.6495 (1.05)     0.0000 (1.0)      2.6495 (1.05)     0.0000 (1.0)           0;0  0.3774 (0.95)          1           1
test_list-list-recursive[3.60.1]     2.6860 (1.07)     2.6860 (1.07)     2.6860 (1.07)     0.0000 (1.0)      2.6860 (1.07)     0.0000 (1.0)           0;0  0.3723 (0.94)          1           1
test_list-list-recursive[main]       2.6168 (1.04)     2.6168 (1.04)     2.6168 (1.04)     0.0000 (1.0)      2.6168 (1.04)     0.0000 (1.0)           0;0  0.3821 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     440.8711 (1.05)     440.8711 (1.05)     440.8711 (1.05)     0.0000 (1.0)      440.8711 (1.05)     0.0000 (1.0)           0;0  2.2682 (0.95)          1           1
test_list-list-shallow[3.10.0]     436.3645 (1.04)     436.3645 (1.04)     436.3645 (1.04)     0.0000 (1.0)      436.3645 (1.04)     0.0000 (1.0)           0;0  2.2917 (0.96)          1           1
test_list-list-shallow[3.53.2]     421.9517 (1.01)     421.9517 (1.01)     421.9517 (1.01)     0.0000 (1.0)      421.9517 (1.01)     0.0000 (1.0)           0;0  2.3699 (0.99)          1           1
test_list-list-shallow[3.60.1]     418.9820 (1.0)      418.9820 (1.0)      418.9820 (1.0)      0.0000 (1.0)      418.9820 (1.0)      0.0000 (1.0)           0;0  2.3867 (1.0)           1           1
test_list-list-shallow[main]       428.2629 (1.02)     428.2629 (1.02)     428.2629 (1.02)     0.0000 (1.0)      428.2629 (1.02)     0.0000 (1.0)           0;0  2.3350 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.1906 (3.05)     12.1906 (3.05)     12.1906 (3.05)     0.0000 (1.0)      12.1906 (3.05)     0.0000 (1.0)           0;0  0.0820 (0.33)          1           1
test_partial_add-add[3.10.0]     12.5377 (3.14)     12.5377 (3.14)     12.5377 (3.14)     0.0000 (1.0)      12.5377 (3.14)     0.0000 (1.0)           0;0  0.0798 (0.32)          1           1
test_partial_add-add[3.53.2]     11.0652 (2.77)     11.0652 (2.77)     11.0652 (2.77)     0.0000 (1.0)      11.0652 (2.77)     0.0000 (1.0)           0;0  0.0904 (0.36)          1           1
test_partial_add-add[3.60.1]      3.9958 (1.0)       3.9958 (1.0)       3.9958 (1.0)      0.0000 (1.0)       3.9958 (1.0)      0.0000 (1.0)           0;0  0.2503 (1.0)           1           1
test_partial_add-add[main]        5.1755 (1.30)      5.1755 (1.30)      5.1755 (1.30)     0.0000 (1.0)       5.1755 (1.30)     0.0000 (1.0)           0;0  0.1932 (0.77)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     79.4399 (3.82)     79.4399 (3.82)     79.4399 (3.82)     0.0000 (1.0)      79.4399 (3.82)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add-partial[3.10.0]     79.2264 (3.81)     79.2264 (3.81)     79.2264 (3.81)     0.0000 (1.0)      79.2264 (3.81)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add-partial[3.53.2]     71.7293 (3.45)     71.7293 (3.45)     71.7293 (3.45)     0.0000 (1.0)      71.7293 (3.45)     0.0000 (1.0)           0;0  0.0139 (0.29)          1           1
test_partial_add-add-partial[3.60.1]     20.7764 (1.0)      20.7764 (1.0)      20.7764 (1.0)      0.0000 (1.0)      20.7764 (1.0)      0.0000 (1.0)           0;0  0.0481 (1.0)           1           1
test_partial_add-add-partial[main]       20.9036 (1.01)     20.9036 (1.01)     20.9036 (1.01)     0.0000 (1.0)      20.9036 (1.01)     0.0000 (1.0)           0;0  0.0478 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6469 (1.0)      4.6469 (1.0)      4.6469 (1.0)      0.0000 (1.0)      4.6469 (1.0)      0.0000 (1.0)           0;0  0.2152 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.0630 (1.30)     6.0630 (1.30)     6.0630 (1.30)     0.0000 (1.0)      6.0630 (1.30)     0.0000 (1.0)           0;0  0.1649 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.8897 (1.48)     6.8897 (1.48)     6.8897 (1.48)     0.0000 (1.0)      6.8897 (1.48)     0.0000 (1.0)           0;0  0.1451 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.9945 (1.51)     6.9945 (1.51)     6.9945 (1.51)     0.0000 (1.0)      6.9945 (1.51)     0.0000 (1.0)           0;0  0.1430 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.0681 (1.31)     6.0681 (1.31)     6.0681 (1.31)     0.0000 (1.0)      6.0681 (1.31)     0.0000 (1.0)           0;0  0.1648 (0.77)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6373 (1.0)      2.6373 (1.0)      2.6373 (1.0)      0.0000 (1.0)      2.6373 (1.0)      0.0000 (1.0)           0;0  0.3792 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.1194 (1.56)     4.1194 (1.56)     4.1194 (1.56)     0.0000 (1.0)      4.1194 (1.56)     0.0000 (1.0)           0;0  0.2428 (0.64)          1           1
test_partial_add-gc-noop[3.53.2]     3.9533 (1.50)     3.9533 (1.50)     3.9533 (1.50)     0.0000 (1.0)      3.9533 (1.50)     0.0000 (1.0)           0;0  0.2530 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     4.1019 (1.56)     4.1019 (1.56)     4.1019 (1.56)     0.0000 (1.0)      4.1019 (1.56)     0.0000 (1.0)           0;0  0.2438 (0.64)          1           1
test_partial_add-gc-noop[main]       3.0723 (1.16)     3.0723 (1.16)     3.0723 (1.16)     0.0000 (1.0)      3.0723 (1.16)     0.0000 (1.0)           0;0  0.3255 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.6578 (3.98)     14.6578 (3.98)     14.6578 (3.98)     0.0000 (1.0)      14.6578 (3.98)     0.0000 (1.0)           0;0  0.0682 (0.25)          1           1
test_partial_add-push[3.10.0]      7.2427 (1.97)      7.2427 (1.97)      7.2427 (1.97)     0.0000 (1.0)       7.2427 (1.97)     0.0000 (1.0)           0;0  0.1381 (0.51)          1           1
test_partial_add-push[3.53.2]      3.7608 (1.02)      3.7608 (1.02)      3.7608 (1.02)     0.0000 (1.0)       3.7608 (1.02)     0.0000 (1.0)           0;0  0.2659 (0.98)          1           1
test_partial_add-push[3.60.1]      3.6812 (1.0)       3.6812 (1.0)       3.6812 (1.0)      0.0000 (1.0)       3.6812 (1.0)      0.0000 (1.0)           0;0  0.2716 (1.0)           1           1
test_partial_add-push[main]        3.8245 (1.04)      3.8245 (1.04)      3.8245 (1.04)     0.0000 (1.0)       3.8245 (1.04)     0.0000 (1.0)           0;0  0.2615 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     86.5822 (4.13)     86.5822 (4.13)     86.5822 (4.13)     0.0000 (1.0)      86.5822 (4.13)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-push-partial[3.10.0]     42.0128 (2.00)     42.0128 (2.00)     42.0128 (2.00)     0.0000 (1.0)      42.0128 (2.00)     0.0000 (1.0)           0;0  0.0238 (0.50)          1           1
test_partial_add-push-partial[3.53.2]     22.5613 (1.08)     22.5613 (1.08)     22.5613 (1.08)     0.0000 (1.0)      22.5613 (1.08)     0.0000 (1.0)           0;0  0.0443 (0.93)          1           1
test_partial_add-push-partial[3.60.1]     20.9657 (1.0)      20.9657 (1.0)      20.9657 (1.0)      0.0000 (1.0)      20.9657 (1.0)      0.0000 (1.0)           0;0  0.0477 (1.0)           1           1
test_partial_add-push-partial[main]       21.0983 (1.01)     21.0983 (1.01)     21.0983 (1.01)     0.0000 (1.0)      21.0983 (1.01)     0.0000 (1.0)           0;0  0.0474 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.8139 (3.74)     85.8139 (3.74)     85.8139 (3.74)     0.0000 (1.0)      85.8139 (3.74)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     86.8083 (3.78)     86.8083 (3.78)     86.8083 (3.78)     0.0000 (1.0)      86.8083 (3.78)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_partial_remove-add[3.53.2]     78.5120 (3.42)     78.5120 (3.42)     78.5120 (3.42)     0.0000 (1.0)      78.5120 (3.42)     0.0000 (1.0)           0;0  0.0127 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.9382 (1.0)      22.9382 (1.0)      22.9382 (1.0)      0.0000 (1.0)      22.9382 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
test_partial_remove-add[main]       24.4446 (1.07)     24.4446 (1.07)     24.4446 (1.07)     0.0000 (1.0)      24.4446 (1.07)     0.0000 (1.0)           0;0  0.0409 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     47.8524 (13.02)    47.8524 (13.02)    47.8524 (13.02)    0.0000 (1.0)      47.8524 (13.02)    0.0000 (1.0)           0;0  0.0209 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     48.6537 (13.24)    48.6537 (13.24)    48.6537 (13.24)    0.0000 (1.0)      48.6537 (13.24)    0.0000 (1.0)           0;0  0.0206 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.9819 (11.97)    43.9819 (11.97)    43.9819 (11.97)    0.0000 (1.0)      43.9819 (11.97)    0.0000 (1.0)           0;0  0.0227 (0.08)          1           1
test_partial_remove-add-update[3.60.1]      3.8373 (1.04)      3.8373 (1.04)      3.8373 (1.04)     0.0000 (1.0)       3.8373 (1.04)     0.0000 (1.0)           0;0  0.2606 (0.96)          1           1
test_partial_remove-add-update[main]        3.6748 (1.0)       3.6748 (1.0)       3.6748 (1.0)      0.0000 (1.0)       3.6748 (1.0)      0.0000 (1.0)           0;0  0.2721 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6936 (1.0)      2.6936 (1.0)      2.6936 (1.0)      0.0000 (1.0)      2.6936 (1.0)      0.0000 (1.0)           0;0  0.3713 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7760 (1.40)     3.7760 (1.40)     3.7760 (1.40)     0.0000 (1.0)      3.7760 (1.40)     0.0000 (1.0)           0;0  0.2648 (0.71)          1           1
test_partial_remove-gc[3.53.2]     3.7219 (1.38)     3.7219 (1.38)     3.7219 (1.38)     0.0000 (1.0)      3.7219 (1.38)     0.0000 (1.0)           0;0  0.2687 (0.72)          1           1
test_partial_remove-gc[3.60.1]     3.7353 (1.39)     3.7353 (1.39)     3.7353 (1.39)     0.0000 (1.0)      3.7353 (1.39)     0.0000 (1.0)           0;0  0.2677 (0.72)          1           1
test_partial_remove-gc[main]       2.8583 (1.06)     2.8583 (1.06)     2.8583 (1.06)     0.0000 (1.0)      2.8583 (1.06)     0.0000 (1.0)           0;0  0.3499 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7892 (1.0)      4.7892 (1.0)      4.7892 (1.0)      0.0000 (1.0)      4.7892 (1.0)      0.0000 (1.0)           0;0  0.2088 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.1675 (1.29)     6.1675 (1.29)     6.1675 (1.29)     0.0000 (1.0)      6.1675 (1.29)     0.0000 (1.0)           0;0  0.1621 (0.78)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8958 (1.44)     6.8958 (1.44)     6.8958 (1.44)     0.0000 (1.0)      6.8958 (1.44)     0.0000 (1.0)           0;0  0.1450 (0.69)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.6058 (1.38)     6.6058 (1.38)     6.6058 (1.38)     0.0000 (1.0)      6.6058 (1.38)     0.0000 (1.0)           0;0  0.1514 (0.72)          1           1
test_partial_remove-gc-cloud[main]       5.7460 (1.20)     5.7460 (1.20)     5.7460 (1.20)     0.0000 (1.0)      5.7460 (1.20)     0.0000 (1.0)           0;0  0.1740 (0.83)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     96.8224 (4.28)     96.8224 (4.28)     96.8224 (4.28)     0.0000 (1.0)      96.8224 (4.28)     0.0000 (1.0)           0;0  0.0103 (0.23)          1           1
test_partial_remove-push[3.10.0]     45.9019 (2.03)     45.9019 (2.03)     45.9019 (2.03)     0.0000 (1.0)      45.9019 (2.03)     0.0000 (1.0)           0;0  0.0218 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.7467 (1.05)     23.7467 (1.05)     23.7467 (1.05)     0.0000 (1.0)      23.7467 (1.05)     0.0000 (1.0)           0;0  0.0421 (0.95)          1           1
test_partial_remove-push[3.60.1]     22.8668 (1.01)     22.8668 (1.01)     22.8668 (1.01)     0.0000 (1.0)      22.8668 (1.01)     0.0000 (1.0)           0;0  0.0437 (0.99)          1           1
test_partial_remove-push[main]       22.6203 (1.0)      22.6203 (1.0)      22.6203 (1.0)      0.0000 (1.0)      22.6203 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9994 (1.0)      3.9994 (1.0)      3.9994 (1.0)      0.0000 (1.0)      3.9994 (1.0)      0.0000 (1.0)           0;0  0.2500 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.0108 (1.00)     4.0108 (1.00)     4.0108 (1.00)     0.0000 (1.0)      4.0108 (1.00)     0.0000 (1.0)           0;0  0.2493 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     7.2724 (1.82)     7.2724 (1.82)     7.2724 (1.82)     0.0000 (1.0)      7.2724 (1.82)     0.0000 (1.0)           0;0  0.1375 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.1832 (1.80)     7.1832 (1.80)     7.1832 (1.80)     0.0000 (1.0)      7.1832 (1.80)     0.0000 (1.0)           0;0  0.1392 (0.56)          1           1
test_partial_remove-push-update[main]       7.3915 (1.85)     7.3915 (1.85)     7.3915 (1.85)     0.0000 (1.0)      7.3915 (1.85)     0.0000 (1.0)           0;0  0.1353 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]       551.8758 (1.0)        561.5499 (1.0)        554.9610 (1.0)       3.8997 (1.0)        553.4451 (1.0)       4.4378 (1.0)           1;0  1.8019 (1.0)           5           3
test_plots-plots-diff[3.10.0]     1,000.9233 (1.81)     1,026.6653 (1.83)     1,011.5526 (1.82)      9.3749 (2.40)     1,009.6973 (1.82)      8.3586 (1.88)          2;0  0.9886 (0.55)          5           3
test_plots-plots-diff[3.53.2]       971.7951 (1.76)       991.7316 (1.77)       983.1547 (1.77)      8.2434 (2.11)       986.9632 (1.78)     12.7916 (2.88)          2;0  1.0171 (0.56)          5           3
test_plots-plots-diff[3.60.1]       976.8053 (1.77)       996.6948 (1.77)       987.9453 (1.78)      7.5462 (1.94)       986.8681 (1.78)      9.7101 (2.19)          2;0  1.0122 (0.56)          5           3
test_plots-plots-diff[main]         978.2710 (1.77)     1,003.7497 (1.79)       993.1954 (1.79)     10.3432 (2.65)       997.7669 (1.80)     15.4243 (3.48)          2;0  1.0069 (0.56)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       562.5446 (1.0)        580.6535 (1.0)        570.9617 (1.0)       8.3869 (1.46)       568.9557 (1.0)      15.7668 (2.11)          2;0  1.7514 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,234.0879 (2.19)     1,249.1168 (2.15)     1,242.9100 (2.18)      5.7316 (1.0)      1,243.2486 (2.19)      7.4837 (1.0)           2;0  0.8046 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]     1,050.9044 (1.87)     1,066.6355 (1.84)     1,057.8126 (1.85)      6.1356 (1.07)     1,057.5145 (1.86)      9.0880 (1.21)          2;0  0.9453 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]     1,046.9496 (1.86)     1,068.0268 (1.84)     1,061.2040 (1.86)      8.5168 (1.49)     1,065.2644 (1.87)      9.7982 (1.31)          1;0  0.9423 (0.54)          5           3
test_plots-plots-diff-json[main]       1,053.5600 (1.87)     1,088.2695 (1.87)     1,072.8320 (1.88)     12.7081 (2.22)     1,074.8019 (1.89)     14.5484 (1.94)          2;0  0.9321 (0.53)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     443.6991 (1.0)      457.1820 (1.0)      447.0724 (1.0)       5.7054 (1.0)      445.2502 (1.0)       4.5468 (1.0)           1;1  2.2368 (1.0)           5           3
test_plots-plots-show[3.10.0]     822.3569 (1.85)     858.0306 (1.88)     834.5334 (1.87)     14.2583 (2.50)     827.5176 (1.86)     16.7363 (3.68)          1;0  1.1983 (0.54)          5           3
test_plots-plots-show[3.53.2]     807.4869 (1.82)     830.8342 (1.82)     820.8673 (1.84)      9.5623 (1.68)     825.1556 (1.85)     14.6221 (3.22)          2;0  1.2182 (0.54)          5           3
test_plots-plots-show[3.60.1]     811.5585 (1.83)     834.3297 (1.82)     821.0572 (1.84)     10.3120 (1.81)     814.7903 (1.83)     17.1451 (3.77)          1;0  1.2179 (0.54)          5           3
test_plots-plots-show[main]       825.9671 (1.86)     887.4200 (1.94)     844.2840 (1.89)     24.9562 (4.37)     837.1751 (1.88)     25.2943 (5.56)          1;0  1.1844 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     458.6518 (1.0)      476.6388 (1.0)      464.1649 (1.0)      7.4573 (1.28)     460.1124 (1.0)       8.7131 (1.22)          1;0  2.1544 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     941.6589 (2.05)     956.6768 (2.01)     947.3419 (2.04)     5.8207 (1.0)      947.0507 (2.06)      7.1678 (1.0)           1;0  1.0556 (0.49)          5           3
test_plots-plots-show-json[3.53.2]     849.6336 (1.85)     868.5892 (1.82)     858.8960 (1.85)     6.8683 (1.18)     858.5639 (1.87)      7.8909 (1.10)          2;0  1.1643 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     850.8248 (1.86)     868.7168 (1.82)     857.8662 (1.85)     8.1410 (1.40)     854.6276 (1.86)     14.3739 (2.01)          1;0  1.1657 (0.54)          5           3
test_plots-plots-show-json[main]       862.6364 (1.88)     888.1601 (1.86)     874.5794 (1.88)     9.5825 (1.65)     874.8346 (1.90)     12.9514 (1.81)          2;0  1.1434 (0.53)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     96.6868 (4.19)     96.6868 (4.19)     96.6868 (4.19)     0.0000 (1.0)      96.6868 (4.19)     0.0000 (1.0)           0;0  0.0103 (0.24)          1           1
test_push-push[3.10.0]     46.2823 (2.00)     46.2823 (2.00)     46.2823 (2.00)     0.0000 (1.0)      46.2823 (2.00)     0.0000 (1.0)           0;0  0.0216 (0.50)          1           1
test_push-push[3.53.2]     23.2682 (1.01)     23.2682 (1.01)     23.2682 (1.01)     0.0000 (1.0)      23.2682 (1.01)     0.0000 (1.0)           0;0  0.0430 (0.99)          1           1
test_push-push[3.60.1]     23.1065 (1.00)     23.1065 (1.00)     23.1065 (1.00)     0.0000 (1.0)      23.1065 (1.00)     0.0000 (1.0)           0;0  0.0433 (1.00)          1           1
test_push-push[main]       23.0922 (1.0)      23.0922 (1.0)      23.0922 (1.0)      0.0000 (1.0)      23.0922 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     92.0562 (6.29)     92.0562 (6.29)     92.0562 (6.29)     0.0000 (1.0)      92.0562 (6.29)     0.0000 (1.0)           0;0  0.0109 (0.16)          1           1
test_sharing-fetch[3.10.0]     96.1980 (6.57)     96.1980 (6.57)     96.1980 (6.57)     0.0000 (1.0)      96.1980 (6.57)     0.0000 (1.0)           0;0  0.0104 (0.15)          1           1
test_sharing-fetch[3.53.2]     21.2772 (1.45)     21.2772 (1.45)     21.2772 (1.45)     0.0000 (1.0)      21.2772 (1.45)     0.0000 (1.0)           0;0  0.0470 (0.69)          1           1
test_sharing-fetch[3.60.1]     14.7301 (1.01)     14.7301 (1.01)     14.7301 (1.01)     0.0000 (1.0)      14.7301 (1.01)     0.0000 (1.0)           0;0  0.0679 (0.99)          1           1
test_sharing-fetch[main]       14.6313 (1.0)      14.6313 (1.0)      14.6313 (1.0)      0.0000 (1.0)      14.6313 (1.0)      0.0000 (1.0)           0;0  0.0683 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.0953 (1.0)      1.0953 (1.0)      1.0953 (1.0)      0.0000 (1.0)      1.0953 (1.0)      0.0000 (1.0)           0;0  0.9130 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.2720 (2.99)     3.2720 (2.99)     3.2720 (2.99)     0.0000 (1.0)      3.2720 (2.99)     0.0000 (1.0)           0;0  0.3056 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     5.0613 (4.62)     5.0613 (4.62)     5.0613 (4.62)     0.0000 (1.0)      5.0613 (4.62)     0.0000 (1.0)           0;0  0.1976 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.1619 (4.71)     5.1619 (4.71)     5.1619 (4.71)     0.0000 (1.0)      5.1619 (4.71)     0.0000 (1.0)           0;0  0.1937 (0.21)          1           1
test_sharing-fetch-noop[main]       5.0956 (4.65)     5.0956 (4.65)     5.0956 (4.65)     0.0000 (1.0)      5.0956 (4.65)     0.0000 (1.0)           0;0  0.1962 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     83.9100 (5.88)     83.9100 (5.88)     83.9100 (5.88)     0.0000 (1.0)      83.9100 (5.88)     0.0000 (1.0)           0;0  0.0119 (0.17)          1           1
test_sharing-push[3.10.0]     35.7316 (2.50)     35.7316 (2.50)     35.7316 (2.50)     0.0000 (1.0)      35.7316 (2.50)     0.0000 (1.0)           0;0  0.0280 (0.40)          1           1
test_sharing-push[3.53.2]     15.0860 (1.06)     15.0860 (1.06)     15.0860 (1.06)     0.0000 (1.0)      15.0860 (1.06)     0.0000 (1.0)           0;0  0.0663 (0.95)          1           1
test_sharing-push[3.60.1]     14.6564 (1.03)     14.6564 (1.03)     14.6564 (1.03)     0.0000 (1.0)      14.6564 (1.03)     0.0000 (1.0)           0;0  0.0682 (0.97)          1           1
test_sharing-push[main]       14.2814 (1.0)      14.2814 (1.0)      14.2814 (1.0)      0.0000 (1.0)      14.2814 (1.0)      0.0000 (1.0)           0;0  0.0700 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     1.8319 (1.01)     1.8319 (1.01)     1.8319 (1.01)     0.0000 (1.0)      1.8319 (1.01)     0.0000 (1.0)           0;0  0.5459 (0.99)          1           1
test_sharing-push-noop[3.10.0]     1.8130 (1.0)      1.8130 (1.0)      1.8130 (1.0)      0.0000 (1.0)      1.8130 (1.0)      0.0000 (1.0)           0;0  0.5516 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.0429 (2.78)     5.0429 (2.78)     5.0429 (2.78)     0.0000 (1.0)      5.0429 (2.78)     0.0000 (1.0)           0;0  0.1983 (0.36)          1           1
test_sharing-push-noop[3.60.1]     5.1387 (2.83)     5.1387 (2.83)     5.1387 (2.83)     0.0000 (1.0)      5.1387 (2.83)     0.0000 (1.0)           0;0  0.1946 (0.35)          1           1
test_sharing-push-noop[main]       5.3113 (2.93)     5.3113 (2.93)     5.3113 (2.93)     0.0000 (1.0)      5.3113 (2.93)     0.0000 (1.0)           0;0  0.1883 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     147.0016 (1.07)     147.0016 (1.07)     147.0016 (1.07)     0.0000 (1.0)      147.0016 (1.07)     0.0000 (1.0)           0;0  0.0068 (0.94)          1           1
test_sharing_azure-fetch[main]       137.8288 (1.0)      137.8288 (1.0)      137.8288 (1.0)      0.0000 (1.0)      137.8288 (1.0)      0.0000 (1.0)           0;0  0.0073 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4572 (1.0)      6.4572 (1.0)      6.4572 (1.0)      0.0000 (1.0)      6.4572 (1.0)      0.0000 (1.0)           0;0  0.1549 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6393 (1.03)     6.6393 (1.03)     6.6393 (1.03)     0.0000 (1.0)      6.6393 (1.03)     0.0000 (1.0)           0;0  0.1506 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     125.3427 (1.00)     125.3427 (1.00)     125.3427 (1.00)     0.0000 (1.0)      125.3427 (1.00)     0.0000 (1.0)           0;0  0.0080 (1.00)          1           1
test_sharing_azure-push[main]       124.9269 (1.0)      124.9269 (1.0)      124.9269 (1.0)      0.0000 (1.0)      124.9269 (1.0)      0.0000 (1.0)           0;0  0.0080 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.5370 (1.0)      6.5370 (1.0)      6.5370 (1.0)      0.0000 (1.0)      6.5370 (1.0)      0.0000 (1.0)           0;0  0.1530 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.6309 (1.01)     6.6309 (1.01)     6.6309 (1.01)     0.0000 (1.0)      6.6309 (1.01)     0.0000 (1.0)           0;0  0.1508 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.6868 (3.65)     19.6868 (3.65)     19.6868 (3.65)     0.0000 (1.0)      19.6868 (3.65)     0.0000 (1.0)           0;0  0.0508 (0.27)          1           1
test_status-status[3.10.0]     20.0690 (3.72)     20.0690 (3.72)     20.0690 (3.72)     0.0000 (1.0)      20.0690 (3.72)     0.0000 (1.0)           0;0  0.0498 (0.27)          1           1
test_status-status[3.53.2]     18.4863 (3.43)     18.4863 (3.43)     18.4863 (3.43)     0.0000 (1.0)      18.4863 (3.43)     0.0000 (1.0)           0;0  0.0541 (0.29)          1           1
test_status-status[3.60.1]      5.3928 (1.0)       5.3928 (1.0)       5.3928 (1.0)      0.0000 (1.0)       5.3928 (1.0)      0.0000 (1.0)           0;0  0.1854 (1.0)           1           1
test_status-status[main]        5.6737 (1.05)      5.6737 (1.05)      5.6737 (1.05)     0.0000 (1.0)       5.6737 (1.05)     0.0000 (1.0)           0;0  0.1763 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7225 (1.78)     4.7225 (1.78)     4.7225 (1.78)     0.0000 (1.0)      4.7225 (1.78)     0.0000 (1.0)           0;0  0.2118 (0.56)          1           1
test_status-status-changed[3.10.0]     5.1193 (1.93)     5.1193 (1.93)     5.1193 (1.93)     0.0000 (1.0)      5.1193 (1.93)     0.0000 (1.0)           0;0  0.1953 (0.52)          1           1
test_status-status-changed[3.53.2]     4.9921 (1.88)     4.9921 (1.88)     4.9921 (1.88)     0.0000 (1.0)      4.9921 (1.88)     0.0000 (1.0)           0;0  0.2003 (0.53)          1           1
test_status-status-changed[3.60.1]     2.6517 (1.0)      2.6517 (1.0)      2.6517 (1.0)      0.0000 (1.0)      2.6517 (1.0)      0.0000 (1.0)           0;0  0.3771 (1.0)           1           1
test_status-status-changed[main]       2.9068 (1.10)     2.9068 (1.10)     2.9068 (1.10)     0.0000 (1.0)      2.9068 (1.10)     0.0000 (1.0)           0;0  0.3440 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9417 (1.97)     4.9417 (1.97)     4.9417 (1.97)     0.0000 (1.0)      4.9417 (1.97)     0.0000 (1.0)           0;0  0.2024 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.0521 (2.02)     5.0521 (2.02)     5.0521 (2.02)     0.0000 (1.0)      5.0521 (2.02)     0.0000 (1.0)           0;0  0.1979 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     5.0293 (2.01)     5.0293 (2.01)     5.0293 (2.01)     0.0000 (1.0)      5.0293 (2.01)     0.0000 (1.0)           0;0  0.1988 (0.50)          1           1
test_status-status-changed-noop[3.60.1]     2.5064 (1.0)      2.5064 (1.0)      2.5064 (1.0)      0.0000 (1.0)      2.5064 (1.0)      0.0000 (1.0)           0;0  0.3990 (1.0)           1           1
test_status-status-changed-noop[main]       2.7005 (1.08)     2.7005 (1.08)     2.7005 (1.08)     0.0000 (1.0)      2.7005 (1.08)     0.0000 (1.0)           0;0  0.3703 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0659 (2.00)     5.0659 (2.00)     5.0659 (2.00)     0.0000 (1.0)      5.0659 (2.00)     0.0000 (1.0)           0;0  0.1974 (0.50)          1           1
test_status-status-noop[3.10.0]     5.2105 (2.06)     5.2105 (2.06)     5.2105 (2.06)     0.0000 (1.0)      5.2105 (2.06)     0.0000 (1.0)           0;0  0.1919 (0.49)          1           1
test_status-status-noop[3.53.2]     5.1322 (2.03)     5.1322 (2.03)     5.1322 (2.03)     0.0000 (1.0)      5.1322 (2.03)     0.0000 (1.0)           0;0  0.1948 (0.49)          1           1
test_status-status-noop[3.60.1]     2.5298 (1.0)      2.5298 (1.0)      2.5298 (1.0)      0.0000 (1.0)      2.5298 (1.0)      0.0000 (1.0)           0;0  0.3953 (1.0)           1           1
test_status-status-noop[main]       2.7309 (1.08)     2.7309 (1.08)     2.7309 (1.08)     0.0000 (1.0)      2.7309 (1.08)     0.0000 (1.0)           0;0  0.3662 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     148.5004 (5.19)     148.5004 (5.19)     148.5004 (5.19)     0.0000 (1.0)      148.5004 (5.19)     0.0000 (1.0)           0;0  0.0067 (0.19)          1           1
test_update-import-url[3.10.0]     153.9269 (5.38)     153.9269 (5.38)     153.9269 (5.38)     0.0000 (1.0)      153.9269 (5.38)     0.0000 (1.0)           0;0  0.0065 (0.19)          1           1
test_update-import-url[3.53.2]      76.3040 (2.67)      76.3040 (2.67)      76.3040 (2.67)     0.0000 (1.0)       76.3040 (2.67)     0.0000 (1.0)           0;0  0.0131 (0.38)          1           1
test_update-import-url[3.60.1]      28.6284 (1.0)       28.6284 (1.0)       28.6284 (1.0)      0.0000 (1.0)       28.6284 (1.0)      0.0000 (1.0)           0;0  0.0349 (1.0)           1           1
test_update-import-url[main]        30.6196 (1.07)      30.6196 (1.07)      30.6196 (1.07)     0.0000 (1.0)       30.6196 (1.07)     0.0000 (1.0)           0;0  0.0327 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     140.9761 (5.98)     140.9761 (5.98)     140.9761 (5.98)     0.0000 (1.0)      140.9761 (5.98)     0.0000 (1.0)           0;0  0.0071 (0.17)          1           1
test_update-update[3.10.0]     144.6262 (6.13)     144.6262 (6.13)     144.6262 (6.13)     0.0000 (1.0)      144.6262 (6.13)     0.0000 (1.0)           0;0  0.0069 (0.16)          1           1
test_update-update[3.53.2]      70.8701 (3.01)      70.8701 (3.01)      70.8701 (3.01)     0.0000 (1.0)       70.8701 (3.01)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_update-update[3.60.1]      23.5772 (1.0)       23.5772 (1.0)       23.5772 (1.0)      0.0000 (1.0)       23.5772 (1.0)      0.0000 (1.0)           0;0  0.0424 (1.0)           1           1
test_update-update[main]        24.8599 (1.05)      24.8599 (1.05)      24.8599 (1.05)     0.0000 (1.0)       24.8599 (1.05)     0.0000 (1.0)           0;0  0.0402 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     11.9903 (1.79)     11.9903 (1.79)     11.9903 (1.79)     0.0000 (1.0)      11.9903 (1.79)     0.0000 (1.0)           0;0  0.0834 (0.56)          1           1
test_update-update-noop[3.10.0]     12.5295 (1.87)     12.5295 (1.87)     12.5295 (1.87)     0.0000 (1.0)      12.5295 (1.87)     0.0000 (1.0)           0;0  0.0798 (0.54)          1           1
test_update-update-noop[3.53.2]     12.2962 (1.83)     12.2962 (1.83)     12.2962 (1.83)     0.0000 (1.0)      12.2962 (1.83)     0.0000 (1.0)           0;0  0.0813 (0.55)          1           1
test_update-update-noop[3.60.1]      6.7166 (1.0)       6.7166 (1.0)       6.7166 (1.0)      0.0000 (1.0)       6.7166 (1.0)      0.0000 (1.0)           0;0  0.1489 (1.0)           1           1
test_update-update-noop[main]        7.3867 (1.10)      7.3867 (1.10)      7.3867 (1.10)     0.0000 (1.0)       7.3867 (1.10)     0.0000 (1.0)           0;0  0.1354 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean