Mon Mar  9 00:51:47 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.1081 (3.62)     84.1081 (3.62)     84.1081 (3.62)     0.0000 (1.0)      84.1081 (3.62)     0.0000 (1.0)           0;0  0.0119 (0.28)          1           1
test_add_copy-add[3.10.0]     85.4650 (3.68)     85.4650 (3.68)     85.4650 (3.68)     0.0000 (1.0)      85.4650 (3.68)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_add_copy-add[3.53.2]     75.6928 (3.26)     75.6928 (3.26)     75.6928 (3.26)     0.0000 (1.0)      75.6928 (3.26)     0.0000 (1.0)           0;0  0.0132 (0.31)          1           1
test_add_copy-add[3.60.1]     23.2393 (1.0)      23.2393 (1.0)      23.2393 (1.0)      0.0000 (1.0)      23.2393 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
test_add_copy-add[main]       25.4625 (1.10)     25.4625 (1.10)     25.4625 (1.10)     0.0000 (1.0)      25.4625 (1.10)     0.0000 (1.0)           0;0  0.0393 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.0433 (6.55)     28.0433 (6.55)     28.0433 (6.55)     0.0000 (1.0)      28.0433 (6.55)     0.0000 (1.0)           0;0  0.0357 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.1042 (6.57)     28.1042 (6.57)     28.1042 (6.57)     0.0000 (1.0)      28.1042 (6.57)     0.0000 (1.0)           0;0  0.0356 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.1058 (6.10)     26.1058 (6.10)     26.1058 (6.10)     0.0000 (1.0)      26.1058 (6.10)     0.0000 (1.0)           0;0  0.0383 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.2793 (1.0)       4.2793 (1.0)       4.2793 (1.0)      0.0000 (1.0)       4.2793 (1.0)      0.0000 (1.0)           0;0  0.2337 (1.0)           1           1
test_add_copy-add-noop[main]        4.5710 (1.07)      4.5710 (1.07)      4.5710 (1.07)     0.0000 (1.0)       4.5710 (1.07)     0.0000 (1.0)           0;0  0.2188 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     63.9321 (3.97)     63.9321 (3.97)     63.9321 (3.97)     0.0000 (1.0)      63.9321 (3.97)     0.0000 (1.0)           0;0  0.0156 (0.25)          1           1
test_add_hardlink-add[3.10.0]     64.7072 (4.02)     64.7072 (4.02)     64.7072 (4.02)     0.0000 (1.0)      64.7072 (4.02)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.53.2]     60.2125 (3.74)     60.2125 (3.74)     60.2125 (3.74)     0.0000 (1.0)      60.2125 (3.74)     0.0000 (1.0)           0;0  0.0166 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.1058 (1.0)      16.1058 (1.0)      16.1058 (1.0)      0.0000 (1.0)      16.1058 (1.0)      0.0000 (1.0)           0;0  0.0621 (1.0)           1           1
test_add_hardlink-add[main]       17.3374 (1.08)     17.3374 (1.08)     17.3374 (1.08)     0.0000 (1.0)      17.3374 (1.08)     0.0000 (1.0)           0;0  0.0577 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.0975 (7.50)     32.0975 (7.50)     32.0975 (7.50)     0.0000 (1.0)      32.0975 (7.50)     0.0000 (1.0)           0;0  0.0312 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     32.6233 (7.62)     32.6233 (7.62)     32.6233 (7.62)     0.0000 (1.0)      32.6233 (7.62)     0.0000 (1.0)           0;0  0.0307 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     30.4448 (7.11)     30.4448 (7.11)     30.4448 (7.11)     0.0000 (1.0)      30.4448 (7.11)     0.0000 (1.0)           0;0  0.0328 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2805 (1.0)       4.2805 (1.0)       4.2805 (1.0)      0.0000 (1.0)       4.2805 (1.0)      0.0000 (1.0)           0;0  0.2336 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4217 (1.03)      4.4217 (1.03)      4.4217 (1.03)     0.0000 (1.0)       4.4217 (1.03)     0.0000 (1.0)           0;0  0.2262 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.9344 (1.90)     72.9344 (1.90)     72.9344 (1.90)     0.0000 (1.0)      72.9344 (1.90)     0.0000 (1.0)           0;0  0.0137 (0.52)          1           1
test_add_symlink-add[3.10.0]     73.9695 (1.93)     73.9695 (1.93)     73.9695 (1.93)     0.0000 (1.0)      73.9695 (1.93)     0.0000 (1.0)           0;0  0.0135 (0.52)          1           1
test_add_symlink-add[3.53.2]     68.8647 (1.80)     68.8647 (1.80)     68.8647 (1.80)     0.0000 (1.0)      68.8647 (1.80)     0.0000 (1.0)           0;0  0.0145 (0.56)          1           1
test_add_symlink-add[3.60.1]     38.2868 (1.0)      38.2868 (1.0)      38.2868 (1.0)      0.0000 (1.0)      38.2868 (1.0)      0.0000 (1.0)           0;0  0.0261 (1.0)           1           1
test_add_symlink-add[main]       39.5738 (1.03)     39.5738 (1.03)     39.5738 (1.03)     0.0000 (1.0)      39.5738 (1.03)     0.0000 (1.0)           0;0  0.0253 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.3798 (8.07)     46.3798 (8.07)     46.3798 (8.07)     0.0000 (1.0)      46.3798 (8.07)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.5092 (8.26)     47.5092 (8.26)     47.5092 (8.26)     0.0000 (1.0)      47.5092 (8.26)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.6473 (8.11)     46.6473 (8.11)     46.6473 (8.11)     0.0000 (1.0)      46.6473 (8.11)     0.0000 (1.0)           0;0  0.0214 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.7483 (1.0)       5.7483 (1.0)       5.7483 (1.0)      0.0000 (1.0)       5.7483 (1.0)      0.0000 (1.0)           0;0  0.1740 (1.0)           1           1
test_add_symlink-add-noop[main]        6.0409 (1.05)      6.0409 (1.05)      6.0409 (1.05)     0.0000 (1.0)       6.0409 (1.05)     0.0000 (1.0)           0;0  0.1655 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.7976 (1.92)      40.7976 (1.92)      40.7976 (1.92)     0.0000 (1.0)       40.7976 (1.92)     0.0000 (1.0)           0;0  0.0245 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     103.8232 (4.90)     103.8232 (4.90)     103.8232 (4.90)     0.0000 (1.0)      103.8232 (4.90)     0.0000 (1.0)           0;0  0.0096 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      28.5857 (1.35)      28.5857 (1.35)      28.5857 (1.35)     0.0000 (1.0)       28.5857 (1.35)     0.0000 (1.0)           0;0  0.0350 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]      21.2024 (1.0)       21.2024 (1.0)       21.2024 (1.0)      0.0000 (1.0)       21.2024 (1.0)      0.0000 (1.0)           0;0  0.0472 (1.0)           1           1
test_checkout_copy-checkout[main]        22.8971 (1.08)      22.8971 (1.08)      22.8971 (1.08)     0.0000 (1.0)       22.8971 (1.08)     0.0000 (1.0)           0;0  0.0437 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5670 (1.69)     5.5670 (1.69)     5.5670 (1.69)     0.0000 (1.0)      5.5670 (1.69)     0.0000 (1.0)           0;0  0.1796 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7758 (1.76)     5.7758 (1.76)     5.7758 (1.76)     0.0000 (1.0)      5.7758 (1.76)     0.0000 (1.0)           0;0  0.1731 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5652 (1.69)     5.5652 (1.69)     5.5652 (1.69)     0.0000 (1.0)      5.5652 (1.69)     0.0000 (1.0)           0;0  0.1797 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2881 (1.0)      3.2881 (1.0)      3.2881 (1.0)      0.0000 (1.0)      3.2881 (1.0)      0.0000 (1.0)           0;0  0.3041 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6445 (1.11)     3.6445 (1.11)     3.6445 (1.11)     0.0000 (1.0)      3.6445 (1.11)     0.0000 (1.0)           0;0  0.2744 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.7108 (2.00)     7.7108 (2.00)     7.7108 (2.00)     0.0000 (1.0)      7.7108 (2.00)     0.0000 (1.0)           0;0  0.1297 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5638 (1.71)     6.5638 (1.71)     6.5638 (1.71)     0.0000 (1.0)      6.5638 (1.71)     0.0000 (1.0)           0;0  0.1523 (0.59)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3988 (1.66)     6.3988 (1.66)     6.3988 (1.66)     0.0000 (1.0)      6.3988 (1.66)     0.0000 (1.0)           0;0  0.1563 (0.60)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8476 (1.0)      3.8476 (1.0)      3.8476 (1.0)      0.0000 (1.0)      3.8476 (1.0)      0.0000 (1.0)           0;0  0.2599 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4672 (1.16)     4.4672 (1.16)     4.4672 (1.16)     0.0000 (1.0)      4.4672 (1.16)     0.0000 (1.0)           0;0  0.2239 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     20.9232 (2.78)     20.9232 (2.78)     20.9232 (2.78)     0.0000 (1.0)      20.9232 (2.78)     0.0000 (1.0)           0;0  0.0478 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.1524 (2.14)     16.1524 (2.14)     16.1524 (2.14)     0.0000 (1.0)      16.1524 (2.14)     0.0000 (1.0)           0;0  0.0619 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.7286 (1.95)     14.7286 (1.95)     14.7286 (1.95)     0.0000 (1.0)      14.7286 (1.95)     0.0000 (1.0)           0;0  0.0679 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5342 (1.0)       7.5342 (1.0)       7.5342 (1.0)      0.0000 (1.0)       7.5342 (1.0)      0.0000 (1.0)           0;0  0.1327 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.4020 (1.12)      8.4020 (1.12)      8.4020 (1.12)     0.0000 (1.0)       8.4020 (1.12)     0.0000 (1.0)           0;0  0.1190 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5240 (1.74)     5.5240 (1.74)     5.5240 (1.74)     0.0000 (1.0)      5.5240 (1.74)     0.0000 (1.0)           0;0  0.1810 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7471 (1.81)     5.7471 (1.81)     5.7471 (1.81)     0.0000 (1.0)      5.7471 (1.81)     0.0000 (1.0)           0;0  0.1740 (0.55)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4559 (1.72)     5.4559 (1.72)     5.4559 (1.72)     0.0000 (1.0)      5.4559 (1.72)     0.0000 (1.0)           0;0  0.1833 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.1669 (1.0)      3.1669 (1.0)      3.1669 (1.0)      0.0000 (1.0)      3.1669 (1.0)      0.0000 (1.0)           0;0  0.3158 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3161 (1.05)     3.3161 (1.05)     3.3161 (1.05)     0.0000 (1.0)      3.3161 (1.05)     0.0000 (1.0)           0;0  0.3016 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.5297 (1.99)     7.5297 (1.99)     7.5297 (1.99)     0.0000 (1.0)      7.5297 (1.99)     0.0000 (1.0)           0;0  0.1328 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6124 (1.74)     6.6124 (1.74)     6.6124 (1.74)     0.0000 (1.0)      6.6124 (1.74)     0.0000 (1.0)           0;0  0.1512 (0.57)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3045 (1.66)     6.3045 (1.66)     6.3045 (1.66)     0.0000 (1.0)      6.3045 (1.66)     0.0000 (1.0)           0;0  0.1586 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.7914 (1.0)      3.7914 (1.0)      3.7914 (1.0)      0.0000 (1.0)      3.7914 (1.0)      0.0000 (1.0)           0;0  0.2638 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.1817 (1.10)     4.1817 (1.10)     4.1817 (1.10)     0.0000 (1.0)      4.1817 (1.10)     0.0000 (1.0)           0;0  0.2391 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.6954 (2.38)     25.6954 (2.38)     25.6954 (2.38)     0.0000 (1.0)      25.6954 (2.38)     0.0000 (1.0)           0;0  0.0389 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     20.5389 (1.91)     20.5389 (1.91)     20.5389 (1.91)     0.0000 (1.0)      20.5389 (1.91)     0.0000 (1.0)           0;0  0.0487 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     18.3982 (1.71)     18.3982 (1.71)     18.3982 (1.71)     0.0000 (1.0)      18.3982 (1.71)     0.0000 (1.0)           0;0  0.0544 (0.59)          1           1
test_checkout_symlink-checkout[3.60.1]     10.7738 (1.0)      10.7738 (1.0)      10.7738 (1.0)      0.0000 (1.0)      10.7738 (1.0)      0.0000 (1.0)           0;0  0.0928 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.8301 (1.10)     11.8301 (1.10)     11.8301 (1.10)     0.0000 (1.0)      11.8301 (1.10)     0.0000 (1.0)           0;0  0.0845 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8327 (1.61)     6.8327 (1.61)     6.8327 (1.61)     0.0000 (1.0)      6.8327 (1.61)     0.0000 (1.0)           0;0  0.1464 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9650 (1.65)     6.9650 (1.65)     6.9650 (1.65)     0.0000 (1.0)      6.9650 (1.65)     0.0000 (1.0)           0;0  0.1436 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.8214 (1.61)     6.8214 (1.61)     6.8214 (1.61)     0.0000 (1.0)      6.8214 (1.61)     0.0000 (1.0)           0;0  0.1466 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2337 (1.0)      4.2337 (1.0)      4.2337 (1.0)      0.0000 (1.0)      4.2337 (1.0)      0.0000 (1.0)           0;0  0.2362 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4276 (1.05)     4.4276 (1.05)     4.4276 (1.05)     0.0000 (1.0)      4.4276 (1.05)     0.0000 (1.0)           0;0  0.2259 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.8837 (1.70)     9.8837 (1.70)     9.8837 (1.70)     0.0000 (1.0)      9.8837 (1.70)     0.0000 (1.0)           0;0  0.1012 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.8383 (1.52)     8.8383 (1.52)     8.8383 (1.52)     0.0000 (1.0)      8.8383 (1.52)     0.0000 (1.0)           0;0  0.1131 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.6258 (1.48)     8.6258 (1.48)     8.6258 (1.48)     0.0000 (1.0)      8.6258 (1.48)     0.0000 (1.0)           0;0  0.1159 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.8212 (1.0)      5.8212 (1.0)      5.8212 (1.0)      0.0000 (1.0)      5.8212 (1.0)      0.0000 (1.0)           0;0  0.1718 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.1476 (1.06)     6.1476 (1.06)     6.1476 (1.06)     0.0000 (1.0)      6.1476 (1.06)     0.0000 (1.0)           0;0  0.1627 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.4919 (1.72)     4.4919 (1.72)     4.4919 (1.72)     0.0000 (1.0)      4.4919 (1.72)     0.0000 (1.0)           0;0  0.2226 (0.58)          1           1
test_data_status-data-changed[3.10.0]     5.0864 (1.95)     5.0864 (1.95)     5.0864 (1.95)     0.0000 (1.0)      5.0864 (1.95)     0.0000 (1.0)           0;0  0.1966 (0.51)          1           1
test_data_status-data-changed[3.53.2]     5.1146 (1.96)     5.1146 (1.96)     5.1146 (1.96)     0.0000 (1.0)      5.1146 (1.96)     0.0000 (1.0)           0;0  0.1955 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.6086 (1.0)      2.6086 (1.0)      2.6086 (1.0)      0.0000 (1.0)      2.6086 (1.0)      0.0000 (1.0)           0;0  0.3833 (1.0)           1           1
test_data_status-data-changed[main]       2.8733 (1.10)     2.8733 (1.10)     2.8733 (1.10)     0.0000 (1.0)      2.8733 (1.10)     0.0000 (1.0)           0;0  0.3480 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.4997 (1.76)     4.4997 (1.76)     4.4997 (1.76)     0.0000 (1.0)      4.4997 (1.76)     0.0000 (1.0)           0;0  0.2222 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     5.3524 (2.09)     5.3524 (2.09)     5.3524 (2.09)     0.0000 (1.0)      5.3524 (2.09)     0.0000 (1.0)           0;0  0.1868 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     5.1613 (2.01)     5.1613 (2.01)     5.1613 (2.01)     0.0000 (1.0)      5.1613 (2.01)     0.0000 (1.0)           0;0  0.1937 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.5638 (1.0)      2.5638 (1.0)      2.5638 (1.0)      0.0000 (1.0)      2.5638 (1.0)      0.0000 (1.0)           0;0  0.3900 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.9409 (1.15)     2.9409 (1.15)     2.9409 (1.15)     0.0000 (1.0)      2.9409 (1.15)     0.0000 (1.0)           0;0  0.3400 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.4880 (3.65)     19.4880 (3.65)     19.4880 (3.65)     0.0000 (1.0)      19.4880 (3.65)     0.0000 (1.0)           0;0  0.0513 (0.27)          1           1
test_data_status-data-new[3.10.0]     20.9193 (3.92)     20.9193 (3.92)     20.9193 (3.92)     0.0000 (1.0)      20.9193 (3.92)     0.0000 (1.0)           0;0  0.0478 (0.26)          1           1
test_data_status-data-new[3.53.2]     20.4305 (3.82)     20.4305 (3.82)     20.4305 (3.82)     0.0000 (1.0)      20.4305 (3.82)     0.0000 (1.0)           0;0  0.0489 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.3429 (1.0)       5.3429 (1.0)       5.3429 (1.0)      0.0000 (1.0)       5.3429 (1.0)      0.0000 (1.0)           0;0  0.1872 (1.0)           1           1
test_data_status-data-new[main]        5.6252 (1.05)      5.6252 (1.05)      5.6252 (1.05)     0.0000 (1.0)       5.6252 (1.05)     0.0000 (1.0)           0;0  0.1778 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.6170 (1.81)     4.6170 (1.81)     4.6170 (1.81)     0.0000 (1.0)      4.6170 (1.81)     0.0000 (1.0)           0;0  0.2166 (0.55)          1           1
test_data_status-data-noop[3.10.0]     5.3943 (2.11)     5.3943 (2.11)     5.3943 (2.11)     0.0000 (1.0)      5.3943 (2.11)     0.0000 (1.0)           0;0  0.1854 (0.47)          1           1
test_data_status-data-noop[3.53.2]     5.1792 (2.03)     5.1792 (2.03)     5.1792 (2.03)     0.0000 (1.0)      5.1792 (2.03)     0.0000 (1.0)           0;0  0.1931 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.5507 (1.0)      2.5507 (1.0)      2.5507 (1.0)      0.0000 (1.0)      2.5507 (1.0)      0.0000 (1.0)           0;0  0.3920 (1.0)           1           1
test_data_status-data-noop[main]       2.9558 (1.16)     2.9558 (1.16)     2.9558 (1.16)     0.0000 (1.0)      2.9558 (1.16)     0.0000 (1.0)           0;0  0.3383 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.7747 (1.13)     6.7747 (1.13)     6.7747 (1.13)     0.0000 (1.0)      6.7747 (1.13)     0.0000 (1.0)           0;0  0.1476 (0.88)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.1138 (1.19)     7.1138 (1.19)     7.1138 (1.19)     0.0000 (1.0)      7.1138 (1.19)     0.0000 (1.0)           0;0  0.1406 (0.84)          1           1
test_data_status_all_flags-data-changed[3.53.2]     6.9352 (1.16)     6.9352 (1.16)     6.9352 (1.16)     0.0000 (1.0)      6.9352 (1.16)     0.0000 (1.0)           0;0  0.1442 (0.86)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.9732 (1.0)      5.9732 (1.0)      5.9732 (1.0)      0.0000 (1.0)      5.9732 (1.0)      0.0000 (1.0)           0;0  0.1674 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.3029 (1.06)     6.3029 (1.06)     6.3029 (1.06)     0.0000 (1.0)      6.3029 (1.06)     0.0000 (1.0)           0;0  0.1587 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.8159 (1.13)     6.8159 (1.13)     6.8159 (1.13)     0.0000 (1.0)      6.8159 (1.13)     0.0000 (1.0)           0;0  0.1467 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     6.8737 (1.14)     6.8737 (1.14)     6.8737 (1.14)     0.0000 (1.0)      6.8737 (1.14)     0.0000 (1.0)           0;0  0.1455 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     6.8445 (1.13)     6.8445 (1.13)     6.8445 (1.13)     0.0000 (1.0)      6.8445 (1.13)     0.0000 (1.0)           0;0  0.1461 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     6.0544 (1.0)      6.0544 (1.0)      6.0544 (1.0)      0.0000 (1.0)      6.0544 (1.0)      0.0000 (1.0)           0;0  0.1652 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.3459 (1.05)     6.3459 (1.05)     6.3459 (1.05)     0.0000 (1.0)      6.3459 (1.05)     0.0000 (1.0)           0;0  0.1576 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.2073 (2.47)     20.2073 (2.47)     20.2073 (2.47)     0.0000 (1.0)      20.2073 (2.47)     0.0000 (1.0)           0;0  0.0495 (0.40)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.7069 (2.66)     21.7069 (2.66)     21.7069 (2.66)     0.0000 (1.0)      21.7069 (2.66)     0.0000 (1.0)           0;0  0.0461 (0.38)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.4981 (2.63)     21.4981 (2.63)     21.4981 (2.63)     0.0000 (1.0)      21.4981 (2.63)     0.0000 (1.0)           0;0  0.0465 (0.38)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.1650 (1.0)       8.1650 (1.0)       8.1650 (1.0)      0.0000 (1.0)       8.1650 (1.0)      0.0000 (1.0)           0;0  0.1225 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6526 (1.06)      8.6526 (1.06)      8.6526 (1.06)     0.0000 (1.0)       8.6526 (1.06)     0.0000 (1.0)           0;0  0.1156 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.1851 (1.23)     6.1851 (1.23)     6.1851 (1.23)     0.0000 (1.0)      6.1851 (1.23)     0.0000 (1.0)           0;0  0.1617 (0.82)          1           1
test_data_status_all_flags-data-noop[3.10.0]     6.3668 (1.26)     6.3668 (1.26)     6.3668 (1.26)     0.0000 (1.0)      6.3668 (1.26)     0.0000 (1.0)           0;0  0.1571 (0.79)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.3609 (1.26)     6.3609 (1.26)     6.3609 (1.26)     0.0000 (1.0)      6.3609 (1.26)     0.0000 (1.0)           0;0  0.1572 (0.79)          1           1
test_data_status_all_flags-data-noop[3.60.1]     5.0481 (1.0)      5.0481 (1.0)      5.0481 (1.0)      0.0000 (1.0)      5.0481 (1.0)      0.0000 (1.0)           0;0  0.1981 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.4847 (1.09)     5.4847 (1.09)     5.4847 (1.09)     0.0000 (1.0)      5.4847 (1.09)     0.0000 (1.0)           0;0  0.1823 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.2116 (2.75)     18.2116 (2.75)     18.2116 (2.75)     0.0000 (1.0)      18.2116 (2.75)     0.0000 (1.0)           0;0  0.0549 (0.36)          1           1
test_diff-diff[3.10.0]     19.5965 (2.96)     19.5965 (2.96)     19.5965 (2.96)     0.0000 (1.0)      19.5965 (2.96)     0.0000 (1.0)           0;0  0.0510 (0.34)          1           1
test_diff-diff[3.53.2]     19.1526 (2.89)     19.1526 (2.89)     19.1526 (2.89)     0.0000 (1.0)      19.1526 (2.89)     0.0000 (1.0)           0;0  0.0522 (0.35)          1           1
test_diff-diff[3.60.1]      6.6247 (1.0)       6.6247 (1.0)       6.6247 (1.0)      0.0000 (1.0)       6.6247 (1.0)      0.0000 (1.0)           0;0  0.1510 (1.0)           1           1
test_diff-diff[main]        7.7202 (1.17)      7.7202 (1.17)      7.7202 (1.17)     0.0000 (1.0)       7.7202 (1.17)     0.0000 (1.0)           0;0  0.1295 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9849 (1.84)     5.9849 (1.84)     5.9849 (1.84)     0.0000 (1.0)      5.9849 (1.84)     0.0000 (1.0)           0;0  0.1671 (0.54)          1           1
test_diff-diff-changed[3.10.0]     6.7984 (2.09)     6.7984 (2.09)     6.7984 (2.09)     0.0000 (1.0)      6.7984 (2.09)     0.0000 (1.0)           0;0  0.1471 (0.48)          1           1
test_diff-diff-changed[3.53.2]     5.5031 (1.69)     5.5031 (1.69)     5.5031 (1.69)     0.0000 (1.0)      5.5031 (1.69)     0.0000 (1.0)           0;0  0.1817 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.2510 (1.0)      3.2510 (1.0)      3.2510 (1.0)      0.0000 (1.0)      3.2510 (1.0)      0.0000 (1.0)           0;0  0.3076 (1.0)           1           1
test_diff-diff-changed[main]       4.0130 (1.23)     4.0130 (1.23)     4.0130 (1.23)     0.0000 (1.0)      4.0130 (1.23)     0.0000 (1.0)           0;0  0.2492 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2600 (1.63)     5.2600 (1.63)     5.2600 (1.63)     0.0000 (1.0)      5.2600 (1.63)     0.0000 (1.0)           0;0  0.1901 (0.61)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8243 (1.81)     5.8243 (1.81)     5.8243 (1.81)     0.0000 (1.0)      5.8243 (1.81)     0.0000 (1.0)           0;0  0.1717 (0.55)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4090 (1.68)     5.4090 (1.68)     5.4090 (1.68)     0.0000 (1.0)      5.4090 (1.68)     0.0000 (1.0)           0;0  0.1849 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2188 (1.0)      3.2188 (1.0)      3.2188 (1.0)      0.0000 (1.0)      3.2188 (1.0)      0.0000 (1.0)           0;0  0.3107 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0242 (1.25)     4.0242 (1.25)     4.0242 (1.25)     0.0000 (1.0)      4.0242 (1.25)     0.0000 (1.0)           0;0  0.2485 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3330 (1.32)     4.3330 (1.32)     4.3330 (1.32)     0.0000 (1.0)      4.3330 (1.32)     0.0000 (1.0)           0;0  0.2308 (0.76)          1           1
test_diff-diff-noop[3.10.0]     4.8440 (1.48)     4.8440 (1.48)     4.8440 (1.48)     0.0000 (1.0)      4.8440 (1.48)     0.0000 (1.0)           0;0  0.2064 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.5866 (1.71)     5.5866 (1.71)     5.5866 (1.71)     0.0000 (1.0)      5.5866 (1.71)     0.0000 (1.0)           0;0  0.1790 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.2718 (1.0)      3.2718 (1.0)      3.2718 (1.0)      0.0000 (1.0)      3.2718 (1.0)      0.0000 (1.0)           0;0  0.3056 (1.0)           1           1
test_diff-diff-noop[main]       3.9622 (1.21)     3.9622 (1.21)     3.9622 (1.21)     0.0000 (1.0)      3.9622 (1.21)     0.0000 (1.0)           0;0  0.2524 (0.83)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.3595 (1.0)      1.3595 (1.0)      1.3595 (1.0)      0.0000 (1.0)      1.3595 (1.0)      0.0000 (1.0)           0;0  0.7356 (1.0)           1           1
test_exp_show-exp[3.10.0]     6.0823 (4.47)     6.0823 (4.47)     6.0823 (4.47)     0.0000 (1.0)      6.0823 (4.47)     0.0000 (1.0)           0;0  0.1644 (0.22)          1           1
test_exp_show-exp[3.53.2]     3.8500 (2.83)     3.8500 (2.83)     3.8500 (2.83)     0.0000 (1.0)      3.8500 (2.83)     0.0000 (1.0)           0;0  0.2597 (0.35)          1           1
test_exp_show-exp[3.60.1]     4.6571 (3.43)     4.6571 (3.43)     4.6571 (3.43)     0.0000 (1.0)      4.6571 (3.43)     0.0000 (1.0)           0;0  0.2147 (0.29)          1           1
test_exp_show-exp[main]       6.3405 (4.66)     6.3405 (4.66)     6.3405 (4.66)     0.0000 (1.0)      6.3405 (4.66)     0.0000 (1.0)           0;0  0.1577 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     113.2060 (4.74)     113.2060 (4.74)     113.2060 (4.74)     0.0000 (1.0)      113.2060 (4.74)     0.0000 (1.0)           0;0  0.0088 (0.21)          1           1
test_fetch-fetch[3.10.0]     119.0836 (4.99)     119.0836 (4.99)     119.0836 (4.99)     0.0000 (1.0)      119.0836 (4.99)     0.0000 (1.0)           0;0  0.0084 (0.20)          1           1
test_fetch-fetch[3.53.2]      34.2708 (1.44)      34.2708 (1.44)      34.2708 (1.44)     0.0000 (1.0)       34.2708 (1.44)     0.0000 (1.0)           0;0  0.0292 (0.70)          1           1
test_fetch-fetch[3.60.1]      23.8740 (1.00)      23.8740 (1.00)      23.8740 (1.00)     0.0000 (1.0)       23.8740 (1.00)     0.0000 (1.0)           0;0  0.0419 (1.00)          1           1
test_fetch-fetch[main]        23.8731 (1.0)       23.8731 (1.0)       23.8731 (1.0)      0.0000 (1.0)       23.8731 (1.0)      0.0000 (1.0)           0;0  0.0419 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9321 (1.0)      2.9321 (1.0)      2.9321 (1.0)      0.0000 (1.0)      2.9321 (1.0)      0.0000 (1.0)           0;0  0.3411 (1.0)           1           1
test_gc-gc[3.10.0]     3.2991 (1.13)     3.2991 (1.13)     3.2991 (1.13)     0.0000 (1.0)      3.2991 (1.13)     0.0000 (1.0)           0;0  0.3031 (0.89)          1           1
test_gc-gc[3.53.2]     3.0530 (1.04)     3.0530 (1.04)     3.0530 (1.04)     0.0000 (1.0)      3.0530 (1.04)     0.0000 (1.0)           0;0  0.3276 (0.96)          1           1
test_gc-gc[3.60.1]     2.9863 (1.02)     2.9863 (1.02)     2.9863 (1.02)     0.0000 (1.0)      2.9863 (1.02)     0.0000 (1.0)           0;0  0.3349 (0.98)          1           1
test_gc-gc[main]       3.1066 (1.06)     3.1066 (1.06)     3.1066 (1.06)     0.0000 (1.0)      3.1066 (1.06)     0.0000 (1.0)           0;0  0.3219 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     192.2765 (3.31)     192.2765 (3.31)     192.2765 (3.31)     0.0000 (1.0)      192.2765 (3.31)     0.0000 (1.0)           0;0  0.0052 (0.30)          1           1
test_get-get[3.10.0]     230.6174 (3.98)     230.6174 (3.98)     230.6174 (3.98)     0.0000 (1.0)      230.6174 (3.98)     0.0000 (1.0)           0;0  0.0043 (0.25)          1           1
test_get-get[3.53.2]     175.6137 (3.03)     175.6137 (3.03)     175.6137 (3.03)     0.0000 (1.0)      175.6137 (3.03)     0.0000 (1.0)           0;0  0.0057 (0.33)          1           1
test_get-get[3.60.1]      58.0167 (1.0)       58.0167 (1.0)       58.0167 (1.0)      0.0000 (1.0)       58.0167 (1.0)      0.0000 (1.0)           0;0  0.0172 (1.0)           1           1
test_get-get[main]        58.2751 (1.00)      58.2751 (1.00)      58.2751 (1.00)     0.0000 (1.0)       58.2751 (1.00)     0.0000 (1.0)           0;0  0.0172 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     93.8681 (5.41)     93.8681 (5.41)     93.8681 (5.41)     0.0000 (1.0)      93.8681 (5.41)     0.0000 (1.0)           0;0  0.0107 (0.18)          1           1
test_get_url-get-url[3.10.0]     97.2246 (5.61)     97.2246 (5.61)     97.2246 (5.61)     0.0000 (1.0)      97.2246 (5.61)     0.0000 (1.0)           0;0  0.0103 (0.18)          1           1
test_get_url-get-url[3.53.2]     17.3847 (1.00)     17.3847 (1.00)     17.3847 (1.00)     0.0000 (1.0)      17.3847 (1.00)     0.0000 (1.0)           0;0  0.0575 (1.00)          1           1
test_get_url-get-url[3.60.1]     17.3374 (1.0)      17.3374 (1.0)      17.3374 (1.0)      0.0000 (1.0)      17.3374 (1.0)      0.0000 (1.0)           0;0  0.0577 (1.0)           1           1
test_get_url-get-url[main]       17.6006 (1.02)     17.6006 (1.02)     17.6006 (1.02)     0.0000 (1.0)      17.6006 (1.02)     0.0000 (1.0)           0;0  0.0568 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     137.1169 (1.05)     144.9254 (1.05)     140.7562 (1.06)     1.4501 (1.04)     140.6999 (1.06)     2.0581 (1.20)         31;1  7.1045 (0.94)        100           1
test_help---help[3.10.0]     136.0932 (1.04)     142.9773 (1.03)     138.9556 (1.05)     1.3986 (1.0)      138.9694 (1.05)     1.7228 (1.01)         33;2  7.1965 (0.96)        100           1
test_help---help[3.53.2]     137.5911 (1.06)     148.0876 (1.07)     140.2156 (1.06)     1.6042 (1.15)     139.9768 (1.05)     1.8887 (1.11)         26;2  7.1319 (0.95)        100           1
test_help---help[3.60.1]     137.0013 (1.05)     171.5155 (1.24)     140.9822 (1.06)     3.4022 (2.43)     140.3935 (1.06)     1.8701 (1.09)          4;3  7.0931 (0.94)        100           1
test_help---help[main]       130.3519 (1.0)      138.5889 (1.0)      132.8494 (1.0)      1.4329 (1.02)     132.6844 (1.0)      1.7090 (1.0)          24;4  7.5273 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     274.6146 (3.30)     274.6146 (3.30)     274.6146 (3.30)     0.0000 (1.0)      274.6146 (3.30)     0.0000 (1.0)           0;0  0.0036 (0.30)          1           1
test_import-import[3.10.0]     316.6284 (3.80)     316.6284 (3.80)     316.6284 (3.80)     0.0000 (1.0)      316.6284 (3.80)     0.0000 (1.0)           0;0  0.0032 (0.26)          1           1
test_import-import[3.60.1]      83.2323 (1.0)       83.2323 (1.0)       83.2323 (1.0)      0.0000 (1.0)       83.2323 (1.0)      0.0000 (1.0)           0;0  0.0120 (1.0)           1           1
test_import-import[main]        83.9230 (1.01)      83.9230 (1.01)      83.9230 (1.01)     0.0000 (1.0)       83.9230 (1.01)     0.0000 (1.0)           0;0  0.0119 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     201.5666 (4.27)     201.5666 (4.27)     201.5666 (4.27)     0.0000 (1.0)      201.5666 (4.27)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_import_url-import-url[3.10.0]     204.5280 (4.33)     204.5280 (4.33)     204.5280 (4.33)     0.0000 (1.0)      204.5280 (4.33)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.53.2]     120.4940 (2.55)     120.4940 (2.55)     120.4940 (2.55)     0.0000 (1.0)      120.4940 (2.55)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_import_url-import-url[3.60.1]      47.1990 (1.0)       47.1990 (1.0)       47.1990 (1.0)      0.0000 (1.0)       47.1990 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
test_import_url-import-url[main]        48.5219 (1.03)      48.5219 (1.03)      48.5219 (1.03)     0.0000 (1.0)       48.5219 (1.03)     0.0000 (1.0)           0;0  0.0206 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     437.0048 (1.03)     489.2911 (1.00)     463.5812 (1.02)     10.9695 (1.0)      462.4711 (1.03)     17.5717 (1.15)         34;0  2.1571 (0.98)        100           1
test_init-init[3.10.0]     459.2763 (1.08)     518.2514 (1.06)     484.5903 (1.07)     13.1310 (1.20)     483.6865 (1.08)     16.9394 (1.11)         36;1  2.0636 (0.93)        100           1
test_init-init[3.53.2]     425.5180 (1.0)      487.6710 (1.0)      452.8620 (1.00)     12.8364 (1.17)     452.7399 (1.01)     18.3064 (1.20)         31;0  2.2082 (1.00)        100           1
test_init-init[3.60.1]     427.9880 (1.01)     502.3178 (1.03)     452.6019 (1.0)      15.7691 (1.44)     449.5179 (1.0)      22.6402 (1.49)         29;1  2.2094 (1.0)         100           1
test_init-init[main]       470.7681 (1.11)     619.2967 (1.27)     495.1882 (1.09)     19.2349 (1.75)     490.7072 (1.09)     15.2321 (1.0)          12;5  2.0194 (0.91)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     626.0857 (1.11)     626.0857 (1.11)     626.0857 (1.11)     0.0000 (1.0)      626.0857 (1.11)     0.0000 (1.0)           0;0  1.5972 (0.90)          1           1
test_list-list[3.10.0]     861.1104 (1.52)     861.1104 (1.52)     861.1104 (1.52)     0.0000 (1.0)      861.1104 (1.52)     0.0000 (1.0)           0;0  1.1613 (0.66)          1           1
test_list-list[3.53.2]     582.8834 (1.03)     582.8834 (1.03)     582.8834 (1.03)     0.0000 (1.0)      582.8834 (1.03)     0.0000 (1.0)           0;0  1.7156 (0.97)          1           1
test_list-list[3.60.1]     595.1445 (1.05)     595.1445 (1.05)     595.1445 (1.05)     0.0000 (1.0)      595.1445 (1.05)     0.0000 (1.0)           0;0  1.6803 (0.95)          1           1
test_list-list[main]       565.3925 (1.0)      565.3925 (1.0)      565.3925 (1.0)      0.0000 (1.0)      565.3925 (1.0)      0.0000 (1.0)           0;0  1.7687 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     414.8928 (1.07)     414.8928 (1.07)     414.8928 (1.07)     0.0000 (1.0)      414.8928 (1.07)     0.0000 (1.0)           0;0  2.4103 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     436.3769 (1.13)     436.3769 (1.13)     436.3769 (1.13)     0.0000 (1.0)      436.3769 (1.13)     0.0000 (1.0)           0;0  2.2916 (0.89)          1           1
test_list-list-dvc-only[3.53.2]     394.5644 (1.02)     394.5644 (1.02)     394.5644 (1.02)     0.0000 (1.0)      394.5644 (1.02)     0.0000 (1.0)           0;0  2.5344 (0.98)          1           1
test_list-list-dvc-only[3.60.1]     387.7050 (1.0)      387.7050 (1.0)      387.7050 (1.0)      0.0000 (1.0)      387.7050 (1.0)      0.0000 (1.0)           0;0  2.5793 (1.0)           1           1
test_list-list-dvc-only[main]       412.7445 (1.06)     412.7445 (1.06)     412.7445 (1.06)     0.0000 (1.0)      412.7445 (1.06)     0.0000 (1.0)           0;0  2.4228 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.2445 (1.0)      2.2445 (1.0)      2.2445 (1.0)      0.0000 (1.0)      2.2445 (1.0)      0.0000 (1.0)           0;0  0.4455 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.4746 (1.10)     2.4746 (1.10)     2.4746 (1.10)     0.0000 (1.0)      2.4746 (1.10)     0.0000 (1.0)           0;0  0.4041 (0.91)          1           1
test_list-list-recursive[3.53.2]     2.5340 (1.13)     2.5340 (1.13)     2.5340 (1.13)     0.0000 (1.0)      2.5340 (1.13)     0.0000 (1.0)           0;0  0.3946 (0.89)          1           1
test_list-list-recursive[3.60.1]     2.5594 (1.14)     2.5594 (1.14)     2.5594 (1.14)     0.0000 (1.0)      2.5594 (1.14)     0.0000 (1.0)           0;0  0.3907 (0.88)          1           1
test_list-list-recursive[main]       2.5714 (1.15)     2.5714 (1.15)     2.5714 (1.15)     0.0000 (1.0)      2.5714 (1.15)     0.0000 (1.0)           0;0  0.3889 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     386.7661 (1.0)      386.7661 (1.0)      386.7661 (1.0)      0.0000 (1.0)      386.7661 (1.0)      0.0000 (1.0)           0;0  2.5855 (1.0)           1           1
test_list-list-shallow[3.10.0]     407.7735 (1.05)     407.7735 (1.05)     407.7735 (1.05)     0.0000 (1.0)      407.7735 (1.05)     0.0000 (1.0)           0;0  2.4523 (0.95)          1           1
test_list-list-shallow[3.53.2]     395.6286 (1.02)     395.6286 (1.02)     395.6286 (1.02)     0.0000 (1.0)      395.6286 (1.02)     0.0000 (1.0)           0;0  2.5276 (0.98)          1           1
test_list-list-shallow[3.60.1]     397.6205 (1.03)     397.6205 (1.03)     397.6205 (1.03)     0.0000 (1.0)      397.6205 (1.03)     0.0000 (1.0)           0;0  2.5150 (0.97)          1           1
test_list-list-shallow[main]       401.1081 (1.04)     401.1081 (1.04)     401.1081 (1.04)     0.0000 (1.0)      401.1081 (1.04)     0.0000 (1.0)           0;0  2.4931 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.8439 (3.08)     12.8439 (3.08)     12.8439 (3.08)     0.0000 (1.0)      12.8439 (3.08)     0.0000 (1.0)           0;0  0.0779 (0.32)          1           1
test_partial_add-add[3.10.0]     13.1145 (3.14)     13.1145 (3.14)     13.1145 (3.14)     0.0000 (1.0)      13.1145 (3.14)     0.0000 (1.0)           0;0  0.0763 (0.32)          1           1
test_partial_add-add[3.53.2]     11.5812 (2.77)     11.5812 (2.77)     11.5812 (2.77)     0.0000 (1.0)      11.5812 (2.77)     0.0000 (1.0)           0;0  0.0863 (0.36)          1           1
test_partial_add-add[3.60.1]      4.1736 (1.0)       4.1736 (1.0)       4.1736 (1.0)      0.0000 (1.0)       4.1736 (1.0)      0.0000 (1.0)           0;0  0.2396 (1.0)           1           1
test_partial_add-add[main]        5.2647 (1.26)      5.2647 (1.26)      5.2647 (1.26)     0.0000 (1.0)       5.2647 (1.26)     0.0000 (1.0)           0;0  0.1899 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     83.3964 (3.87)     83.3964 (3.87)     83.3964 (3.87)     0.0000 (1.0)      83.3964 (3.87)     0.0000 (1.0)           0;0  0.0120 (0.26)          1           1
test_partial_add-add-partial[3.10.0]     83.5904 (3.88)     83.5904 (3.88)     83.5904 (3.88)     0.0000 (1.0)      83.5904 (3.88)     0.0000 (1.0)           0;0  0.0120 (0.26)          1           1
test_partial_add-add-partial[3.53.2]     75.6575 (3.51)     75.6575 (3.51)     75.6575 (3.51)     0.0000 (1.0)      75.6575 (3.51)     0.0000 (1.0)           0;0  0.0132 (0.28)          1           1
test_partial_add-add-partial[3.60.1]     21.5318 (1.0)      21.5318 (1.0)      21.5318 (1.0)      0.0000 (1.0)      21.5318 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_partial_add-add-partial[main]       21.8968 (1.02)     21.8968 (1.02)     21.8968 (1.02)     0.0000 (1.0)      21.8968 (1.02)     0.0000 (1.0)           0;0  0.0457 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.9443 (1.0)      4.9443 (1.0)      4.9443 (1.0)      0.0000 (1.0)      4.9443 (1.0)      0.0000 (1.0)           0;0  0.2023 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.5280 (1.32)     6.5280 (1.32)     6.5280 (1.32)     0.0000 (1.0)      6.5280 (1.32)     0.0000 (1.0)           0;0  0.1532 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.3734 (1.49)     7.3734 (1.49)     7.3734 (1.49)     0.0000 (1.0)      7.3734 (1.49)     0.0000 (1.0)           0;0  0.1356 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.2055 (1.46)     7.2055 (1.46)     7.2055 (1.46)     0.0000 (1.0)      7.2055 (1.46)     0.0000 (1.0)           0;0  0.1388 (0.69)          1           1
test_partial_add-gc-cloud-noop[main]       6.4207 (1.30)     6.4207 (1.30)     6.4207 (1.30)     0.0000 (1.0)      6.4207 (1.30)     0.0000 (1.0)           0;0  0.1557 (0.77)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7777 (1.0)      2.7777 (1.0)      2.7777 (1.0)      0.0000 (1.0)      2.7777 (1.0)      0.0000 (1.0)           0;0  0.3600 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.1108 (1.48)     4.1108 (1.48)     4.1108 (1.48)     0.0000 (1.0)      4.1108 (1.48)     0.0000 (1.0)           0;0  0.2433 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     4.1077 (1.48)     4.1077 (1.48)     4.1077 (1.48)     0.0000 (1.0)      4.1077 (1.48)     0.0000 (1.0)           0;0  0.2434 (0.68)          1           1
test_partial_add-gc-noop[3.60.1]     4.1336 (1.49)     4.1336 (1.49)     4.1336 (1.49)     0.0000 (1.0)      4.1336 (1.49)     0.0000 (1.0)           0;0  0.2419 (0.67)          1           1
test_partial_add-gc-noop[main]       3.3930 (1.22)     3.3930 (1.22)     3.3930 (1.22)     0.0000 (1.0)      3.3930 (1.22)     0.0000 (1.0)           0;0  0.2947 (0.82)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     15.8737 (4.09)     15.8737 (4.09)     15.8737 (4.09)     0.0000 (1.0)      15.8737 (4.09)     0.0000 (1.0)           0;0  0.0630 (0.24)          1           1
test_partial_add-push[3.10.0]      7.5563 (1.95)      7.5563 (1.95)      7.5563 (1.95)     0.0000 (1.0)       7.5563 (1.95)     0.0000 (1.0)           0;0  0.1323 (0.51)          1           1
test_partial_add-push[3.53.2]      3.9599 (1.02)      3.9599 (1.02)      3.9599 (1.02)     0.0000 (1.0)       3.9599 (1.02)     0.0000 (1.0)           0;0  0.2525 (0.98)          1           1
test_partial_add-push[3.60.1]      3.8775 (1.0)       3.8775 (1.0)       3.8775 (1.0)      0.0000 (1.0)       3.8775 (1.0)      0.0000 (1.0)           0;0  0.2579 (1.0)           1           1
test_partial_add-push[main]        4.0972 (1.06)      4.0972 (1.06)      4.0972 (1.06)     0.0000 (1.0)       4.0972 (1.06)     0.0000 (1.0)           0;0  0.2441 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     92.3142 (4.29)     92.3142 (4.29)     92.3142 (4.29)     0.0000 (1.0)      92.3142 (4.29)     0.0000 (1.0)           0;0  0.0108 (0.23)          1           1
test_partial_add-push-partial[3.10.0]     44.0655 (2.05)     44.0655 (2.05)     44.0655 (2.05)     0.0000 (1.0)      44.0655 (2.05)     0.0000 (1.0)           0;0  0.0227 (0.49)          1           1
test_partial_add-push-partial[3.53.2]     22.9367 (1.07)     22.9367 (1.07)     22.9367 (1.07)     0.0000 (1.0)      22.9367 (1.07)     0.0000 (1.0)           0;0  0.0436 (0.94)          1           1
test_partial_add-push-partial[3.60.1]     21.5265 (1.0)      21.5265 (1.0)      21.5265 (1.0)      0.0000 (1.0)      21.5265 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
test_partial_add-push-partial[main]       22.4197 (1.04)     22.4197 (1.04)     22.4197 (1.04)     0.0000 (1.0)      22.4197 (1.04)     0.0000 (1.0)           0;0  0.0446 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     57.3765 (4.06)     57.3765 (4.06)     57.3765 (4.06)     0.0000 (1.0)      57.3765 (4.06)     0.0000 (1.0)           0;0  0.0174 (0.25)          1           1
test_partial_remove-add[3.10.0]     58.6762 (4.15)     58.6762 (4.15)     58.6762 (4.15)     0.0000 (1.0)      58.6762 (4.15)     0.0000 (1.0)           0;0  0.0170 (0.24)          1           1
test_partial_remove-add[3.53.2]     50.5580 (3.57)     50.5580 (3.57)     50.5580 (3.57)     0.0000 (1.0)      50.5580 (3.57)     0.0000 (1.0)           0;0  0.0198 (0.28)          1           1
test_partial_remove-add[3.60.1]     14.1495 (1.0)      14.1495 (1.0)      14.1495 (1.0)      0.0000 (1.0)      14.1495 (1.0)      0.0000 (1.0)           0;0  0.0707 (1.0)           1           1
test_partial_remove-add[main]       15.3706 (1.09)     15.3706 (1.09)     15.3706 (1.09)     0.0000 (1.0)      15.3706 (1.09)     0.0000 (1.0)           0;0  0.0651 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     32.7138 (9.67)     32.7138 (9.67)     32.7138 (9.67)     0.0000 (1.0)      32.7138 (9.67)     0.0000 (1.0)           0;0  0.0306 (0.10)          1           1
test_partial_remove-add-update[3.10.0]     32.2515 (9.54)     32.2515 (9.54)     32.2515 (9.54)     0.0000 (1.0)      32.2515 (9.54)     0.0000 (1.0)           0;0  0.0310 (0.10)          1           1
test_partial_remove-add-update[3.53.2]     28.2884 (8.36)     28.2884 (8.36)     28.2884 (8.36)     0.0000 (1.0)      28.2884 (8.36)     0.0000 (1.0)           0;0  0.0354 (0.12)          1           1
test_partial_remove-add-update[3.60.1]      3.5033 (1.04)      3.5033 (1.04)      3.5033 (1.04)     0.0000 (1.0)       3.5033 (1.04)     0.0000 (1.0)           0;0  0.2854 (0.97)          1           1
test_partial_remove-add-update[main]        3.3822 (1.0)       3.3822 (1.0)       3.3822 (1.0)      0.0000 (1.0)       3.3822 (1.0)      0.0000 (1.0)           0;0  0.2957 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.2815 (1.0)      2.2815 (1.0)      2.2815 (1.0)      0.0000 (1.0)      2.2815 (1.0)      0.0000 (1.0)           0;0  0.4383 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.3452 (1.47)     3.3452 (1.47)     3.3452 (1.47)     0.0000 (1.0)      3.3452 (1.47)     0.0000 (1.0)           0;0  0.2989 (0.68)          1           1
test_partial_remove-gc[3.53.2]     3.3615 (1.47)     3.3615 (1.47)     3.3615 (1.47)     0.0000 (1.0)      3.3615 (1.47)     0.0000 (1.0)           0;0  0.2975 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.3224 (1.46)     3.3224 (1.46)     3.3224 (1.46)     0.0000 (1.0)      3.3224 (1.46)     0.0000 (1.0)           0;0  0.3010 (0.69)          1           1
test_partial_remove-gc[main]       2.5379 (1.11)     2.5379 (1.11)     2.5379 (1.11)     0.0000 (1.0)      2.5379 (1.11)     0.0000 (1.0)           0;0  0.3940 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.2717 (1.0)      4.2717 (1.0)      4.2717 (1.0)      0.0000 (1.0)      4.2717 (1.0)      0.0000 (1.0)           0;0  0.2341 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.3156 (1.24)     5.3156 (1.24)     5.3156 (1.24)     0.0000 (1.0)      5.3156 (1.24)     0.0000 (1.0)           0;0  0.1881 (0.80)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.2972 (1.47)     6.2972 (1.47)     6.2972 (1.47)     0.0000 (1.0)      6.2972 (1.47)     0.0000 (1.0)           0;0  0.1588 (0.68)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.0452 (1.42)     6.0452 (1.42)     6.0452 (1.42)     0.0000 (1.0)      6.0452 (1.42)     0.0000 (1.0)           0;0  0.1654 (0.71)          1           1
test_partial_remove-gc-cloud[main]       5.2278 (1.22)     5.2278 (1.22)     5.2278 (1.22)     0.0000 (1.0)      5.2278 (1.22)     0.0000 (1.0)           0;0  0.1913 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     81.6579 (5.76)     81.6579 (5.76)     81.6579 (5.76)     0.0000 (1.0)      81.6579 (5.76)     0.0000 (1.0)           0;0  0.0122 (0.17)          1           1
test_partial_remove-push[3.10.0]     35.0895 (2.47)     35.0895 (2.47)     35.0895 (2.47)     0.0000 (1.0)      35.0895 (2.47)     0.0000 (1.0)           0;0  0.0285 (0.40)          1           1
test_partial_remove-push[3.53.2]     14.9916 (1.06)     14.9916 (1.06)     14.9916 (1.06)     0.0000 (1.0)      14.9916 (1.06)     0.0000 (1.0)           0;0  0.0667 (0.95)          1           1
test_partial_remove-push[3.60.1]     14.1793 (1.0)      14.1793 (1.0)      14.1793 (1.0)      0.0000 (1.0)      14.1793 (1.0)      0.0000 (1.0)           0;0  0.0705 (1.0)           1           1
test_partial_remove-push[main]       14.6073 (1.03)     14.6073 (1.03)     14.6073 (1.03)     0.0000 (1.0)      14.6073 (1.03)     0.0000 (1.0)           0;0  0.0685 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.3955 (1.0)      3.3955 (1.0)      3.3955 (1.0)      0.0000 (1.0)      3.3955 (1.0)      0.0000 (1.0)           0;0  0.2945 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.4506 (1.02)     3.4506 (1.02)     3.4506 (1.02)     0.0000 (1.0)      3.4506 (1.02)     0.0000 (1.0)           0;0  0.2898 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     6.2244 (1.83)     6.2244 (1.83)     6.2244 (1.83)     0.0000 (1.0)      6.2244 (1.83)     0.0000 (1.0)           0;0  0.1607 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     6.1399 (1.81)     6.1399 (1.81)     6.1399 (1.81)     0.0000 (1.0)      6.1399 (1.81)     0.0000 (1.0)           0;0  0.1629 (0.55)          1           1
test_partial_remove-push-update[main]       6.1642 (1.82)     6.1642 (1.82)     6.1642 (1.82)     0.0000 (1.0)      6.1642 (1.82)     0.0000 (1.0)           0;0  0.1622 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     541.9616 (1.0)      546.2693 (1.0)      543.3246 (1.0)      1.7002 (1.0)      542.7853 (1.0)      1.5506 (1.0)           1;1  1.8405 (1.0)           5           3
test_plots-plots-diff[3.10.0]     984.2896 (1.82)     989.5046 (1.81)     986.3191 (1.82)     1.9526 (1.15)     986.0665 (1.82)     2.0639 (1.33)          2;0  1.0139 (0.55)          5           3
test_plots-plots-diff[3.53.2]     956.0893 (1.76)     964.6387 (1.77)     960.0389 (1.77)     3.7758 (2.22)     958.8947 (1.77)     6.7410 (4.35)          2;0  1.0416 (0.57)          5           3
test_plots-plots-diff[3.60.1]     965.7498 (1.78)     971.4638 (1.78)     968.7165 (1.78)     2.5740 (1.51)     967.8587 (1.78)     4.5815 (2.95)          3;0  1.0323 (0.56)          5           3
test_plots-plots-diff[main]       978.1640 (1.80)     985.9228 (1.80)     981.2908 (1.81)     3.2095 (1.89)     980.1226 (1.81)     5.0410 (3.25)          1;0  1.0191 (0.55)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       556.1216 (1.0)        569.0255 (1.0)        562.0156 (1.0)      6.0883 (2.98)       560.9510 (1.0)      11.6618 (3.18)          1;0  1.7793 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,221.9455 (2.20)     1,232.0531 (2.17)     1,225.8922 (2.18)     4.1977 (2.05)     1,224.7644 (2.18)      6.6466 (1.81)          1;0  0.8157 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]     1,032.5408 (1.86)     1,037.8603 (1.82)     1,035.2014 (1.84)     2.3495 (1.15)     1,035.2492 (1.85)      4.3166 (1.18)          2;0  0.9660 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]     1,045.4830 (1.88)     1,049.9923 (1.85)     1,047.8457 (1.86)     2.0428 (1.0)      1,048.6270 (1.87)      3.6667 (1.0)           2;0  0.9543 (0.54)          5           3
test_plots-plots-diff-json[main]       1,051.1025 (1.89)     1,069.5725 (1.88)     1,057.6876 (1.88)     7.0205 (3.44)     1,056.3823 (1.88)      6.4101 (1.75)          1;0  0.9455 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     436.5283 (1.0)      441.4157 (1.0)      438.4804 (1.0)       2.0067 (1.07)     437.9083 (1.0)       3.1394 (1.06)          1;0  2.2806 (1.0)           5           3
test_plots-plots-show[3.10.0]     803.8398 (1.84)     809.0596 (1.83)     806.4959 (1.84)      2.2411 (1.19)     805.7758 (1.84)      3.8181 (1.29)          2;0  1.2399 (0.54)          5           3
test_plots-plots-show[3.53.2]     796.0595 (1.82)     800.7421 (1.81)     798.6161 (1.82)      1.8821 (1.0)      799.1424 (1.82)      2.9553 (1.0)           2;0  1.2522 (0.55)          5           3
test_plots-plots-show[3.60.1]     799.9083 (1.83)     805.0926 (1.82)     802.6373 (1.83)      2.3225 (1.23)     802.5759 (1.83)      4.3035 (1.46)          2;0  1.2459 (0.55)          5           3
test_plots-plots-show[main]       821.3051 (1.88)     888.0286 (2.01)     849.1411 (1.94)     26.2341 (13.94)    850.6481 (1.94)     37.4846 (12.68)         2;0  1.1777 (0.52)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     454.6280 (1.0)      456.9719 (1.0)      456.2190 (1.0)      0.9224 (1.0)      456.5891 (1.0)      0.8435 (1.0)           1;0  2.1919 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     936.6689 (2.06)     942.9953 (2.06)     939.8154 (2.06)     2.3375 (2.53)     939.9700 (2.06)     3.0055 (3.56)          2;0  1.0640 (0.49)          5           3
test_plots-plots-show-json[3.53.2]     841.4187 (1.85)     858.0086 (1.88)     849.7764 (1.86)     6.1457 (6.66)     848.7174 (1.86)     7.7658 (9.21)          2;0  1.1768 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     844.4858 (1.86)     852.7481 (1.87)     847.4818 (1.86)     3.5440 (3.84)     845.6359 (1.85)     5.4250 (6.43)          1;0  1.1800 (0.54)          5           3
test_plots-plots-show-json[main]       861.8645 (1.90)     870.6099 (1.91)     866.0069 (1.90)     3.5373 (3.83)     864.5893 (1.89)     5.4097 (6.41)          2;0  1.1547 (0.53)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     100.8208 (4.48)     100.8208 (4.48)     100.8208 (4.48)     0.0000 (1.0)      100.8208 (4.48)     0.0000 (1.0)           0;0  0.0099 (0.22)          1           1
test_push-push[3.10.0]      48.4689 (2.15)      48.4689 (2.15)      48.4689 (2.15)     0.0000 (1.0)       48.4689 (2.15)     0.0000 (1.0)           0;0  0.0206 (0.46)          1           1
test_push-push[3.53.2]      23.2832 (1.03)      23.2832 (1.03)      23.2832 (1.03)     0.0000 (1.0)       23.2832 (1.03)     0.0000 (1.0)           0;0  0.0429 (0.97)          1           1
test_push-push[3.60.1]      22.5201 (1.0)       22.5201 (1.0)       22.5201 (1.0)      0.0000 (1.0)       22.5201 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_push-push[main]        23.1669 (1.03)      23.1669 (1.03)      23.1669 (1.03)     0.0000 (1.0)       23.1669 (1.03)     0.0000 (1.0)           0;0  0.0432 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.6703 (4.75)     110.6703 (4.75)     110.6703 (4.75)     0.0000 (1.0)      110.6703 (4.75)     0.0000 (1.0)           0;0  0.0090 (0.21)          1           1
test_sharing-fetch[3.10.0]     115.2906 (4.95)     115.2906 (4.95)     115.2906 (4.95)     0.0000 (1.0)      115.2906 (4.95)     0.0000 (1.0)           0;0  0.0087 (0.20)          1           1
test_sharing-fetch[3.53.2]      34.7871 (1.49)      34.7871 (1.49)      34.7871 (1.49)     0.0000 (1.0)       34.7871 (1.49)     0.0000 (1.0)           0;0  0.0287 (0.67)          1           1
test_sharing-fetch[3.60.1]      23.2866 (1.0)       23.2866 (1.0)       23.2866 (1.0)      0.0000 (1.0)       23.2866 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_sharing-fetch[main]        23.3667 (1.00)      23.3667 (1.00)      23.3667 (1.00)     0.0000 (1.0)       23.3667 (1.00)     0.0000 (1.0)           0;0  0.0428 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2706 (1.0)      1.2706 (1.0)      1.2706 (1.0)      0.0000 (1.0)      1.2706 (1.0)      0.0000 (1.0)           0;0  0.7871 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8364 (3.02)     3.8364 (3.02)     3.8364 (3.02)     0.0000 (1.0)      3.8364 (3.02)     0.0000 (1.0)           0;0  0.2607 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     6.0863 (4.79)     6.0863 (4.79)     6.0863 (4.79)     0.0000 (1.0)      6.0863 (4.79)     0.0000 (1.0)           0;0  0.1643 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     6.1472 (4.84)     6.1472 (4.84)     6.1472 (4.84)     0.0000 (1.0)      6.1472 (4.84)     0.0000 (1.0)           0;0  0.1627 (0.21)          1           1
test_sharing-fetch-noop[main]       6.0312 (4.75)     6.0312 (4.75)     6.0312 (4.75)     0.0000 (1.0)      6.0312 (4.75)     0.0000 (1.0)           0;0  0.1658 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     97.2402 (4.18)     97.2402 (4.18)     97.2402 (4.18)     0.0000 (1.0)      97.2402 (4.18)     0.0000 (1.0)           0;0  0.0103 (0.24)          1           1
test_sharing-push[3.10.0]     47.0647 (2.02)     47.0647 (2.02)     47.0647 (2.02)     0.0000 (1.0)      47.0647 (2.02)     0.0000 (1.0)           0;0  0.0212 (0.49)          1           1
test_sharing-push[3.53.2]     23.4351 (1.01)     23.4351 (1.01)     23.4351 (1.01)     0.0000 (1.0)      23.4351 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
test_sharing-push[3.60.1]     23.2536 (1.0)      23.2536 (1.0)      23.2536 (1.0)      0.0000 (1.0)      23.2536 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
test_sharing-push[main]       23.3450 (1.00)     23.3450 (1.00)     23.3450 (1.00)     0.0000 (1.0)      23.3450 (1.00)     0.0000 (1.0)           0;0  0.0428 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1330 (1.00)     2.1330 (1.00)     2.1330 (1.00)     0.0000 (1.0)      2.1330 (1.00)     0.0000 (1.0)           0;0  0.4688 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.1273 (1.0)      2.1273 (1.0)      2.1273 (1.0)      0.0000 (1.0)      2.1273 (1.0)      0.0000 (1.0)           0;0  0.4701 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.1916 (2.91)     6.1916 (2.91)     6.1916 (2.91)     0.0000 (1.0)      6.1916 (2.91)     0.0000 (1.0)           0;0  0.1615 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0796 (2.86)     6.0796 (2.86)     6.0796 (2.86)     0.0000 (1.0)      6.0796 (2.86)     0.0000 (1.0)           0;0  0.1645 (0.35)          1           1
test_sharing-push-noop[main]       6.4774 (3.04)     6.4774 (3.04)     6.4774 (3.04)     0.0000 (1.0)      6.4774 (3.04)     0.0000 (1.0)           0;0  0.1544 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     149.6580 (1.03)     149.6580 (1.03)     149.6580 (1.03)     0.0000 (1.0)      149.6580 (1.03)     0.0000 (1.0)           0;0  0.0067 (0.97)          1           1
test_sharing_azure-fetch[main]       144.8860 (1.0)      144.8860 (1.0)      144.8860 (1.0)      0.0000 (1.0)      144.8860 (1.0)      0.0000 (1.0)           0;0  0.0069 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3114 (1.0)      6.3114 (1.0)      6.3114 (1.0)      0.0000 (1.0)      6.3114 (1.0)      0.0000 (1.0)           0;0  0.1584 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6428 (1.05)     6.6428 (1.05)     6.6428 (1.05)     0.0000 (1.0)      6.6428 (1.05)     0.0000 (1.0)           0;0  0.1505 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     129.4341 (1.01)     129.4341 (1.01)     129.4341 (1.01)     0.0000 (1.0)      129.4341 (1.01)     0.0000 (1.0)           0;0  0.0077 (0.99)          1           1
test_sharing_azure-push[main]       128.3764 (1.0)      128.3764 (1.0)      128.3764 (1.0)      0.0000 (1.0)      128.3764 (1.0)      0.0000 (1.0)           0;0  0.0078 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.5883 (1.0)      6.5883 (1.0)      6.5883 (1.0)      0.0000 (1.0)      6.5883 (1.0)      0.0000 (1.0)           0;0  0.1518 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.8493 (1.04)     6.8493 (1.04)     6.8493 (1.04)     0.0000 (1.0)      6.8493 (1.04)     0.0000 (1.0)           0;0  0.1460 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     344.1100 (1.02)     344.1100 (1.02)     344.1100 (1.02)     0.0000 (1.0)      344.1100 (1.02)     0.0000 (1.0)           0;0  0.0029 (0.98)          1           1
test_sharing_s3-fetch[main]       336.3967 (1.0)      336.3967 (1.0)      336.3967 (1.0)      0.0000 (1.0)      336.3967 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5609 (1.0)      6.5609 (1.0)      6.5609 (1.0)      0.0000 (1.0)      6.5609 (1.0)      0.0000 (1.0)           0;0  0.1524 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7382 (1.03)     6.7382 (1.03)     6.7382 (1.03)     0.0000 (1.0)      6.7382 (1.03)     0.0000 (1.0)           0;0  0.1484 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     318.5421 (1.0)      318.5421 (1.0)      318.5421 (1.0)      0.0000 (1.0)      318.5421 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
test_sharing_s3-push[main]       318.9802 (1.00)     318.9802 (1.00)     318.9802 (1.00)     0.0000 (1.0)      318.9802 (1.00)     0.0000 (1.0)           0;0  0.0031 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.6682 (1.0)      6.6682 (1.0)      6.6682 (1.0)      0.0000 (1.0)      6.6682 (1.0)      0.0000 (1.0)           0;0  0.1500 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.7867 (1.02)     6.7867 (1.02)     6.7867 (1.02)     0.0000 (1.0)      6.7867 (1.02)     0.0000 (1.0)           0;0  0.1473 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.1734 (3.64)     20.1734 (3.64)     20.1734 (3.64)     0.0000 (1.0)      20.1734 (3.64)     0.0000 (1.0)           0;0  0.0496 (0.27)          1           1
test_status-status[3.10.0]     21.0961 (3.80)     21.0961 (3.80)     21.0961 (3.80)     0.0000 (1.0)      21.0961 (3.80)     0.0000 (1.0)           0;0  0.0474 (0.26)          1           1
test_status-status[3.53.2]     18.6724 (3.37)     18.6724 (3.37)     18.6724 (3.37)     0.0000 (1.0)      18.6724 (3.37)     0.0000 (1.0)           0;0  0.0536 (0.30)          1           1
test_status-status[3.60.1]      5.5469 (1.0)       5.5469 (1.0)       5.5469 (1.0)      0.0000 (1.0)       5.5469 (1.0)      0.0000 (1.0)           0;0  0.1803 (1.0)           1           1
test_status-status[main]        5.8555 (1.06)      5.8555 (1.06)      5.8555 (1.06)     0.0000 (1.0)       5.8555 (1.06)     0.0000 (1.0)           0;0  0.1708 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8569 (1.78)     4.8569 (1.78)     4.8569 (1.78)     0.0000 (1.0)      4.8569 (1.78)     0.0000 (1.0)           0;0  0.2059 (0.56)          1           1
test_status-status-changed[3.10.0]     5.3825 (1.97)     5.3825 (1.97)     5.3825 (1.97)     0.0000 (1.0)      5.3825 (1.97)     0.0000 (1.0)           0;0  0.1858 (0.51)          1           1
test_status-status-changed[3.53.2]     5.2961 (1.94)     5.2961 (1.94)     5.2961 (1.94)     0.0000 (1.0)      5.2961 (1.94)     0.0000 (1.0)           0;0  0.1888 (0.51)          1           1
test_status-status-changed[3.60.1]     2.7255 (1.0)      2.7255 (1.0)      2.7255 (1.0)      0.0000 (1.0)      2.7255 (1.0)      0.0000 (1.0)           0;0  0.3669 (1.0)           1           1
test_status-status-changed[main]       3.0411 (1.12)     3.0411 (1.12)     3.0411 (1.12)     0.0000 (1.0)      3.0411 (1.12)     0.0000 (1.0)           0;0  0.3288 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.1660 (1.97)     5.1660 (1.97)     5.1660 (1.97)     0.0000 (1.0)      5.1660 (1.97)     0.0000 (1.0)           0;0  0.1936 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.2544 (2.01)     5.2544 (2.01)     5.2544 (2.01)     0.0000 (1.0)      5.2544 (2.01)     0.0000 (1.0)           0;0  0.1903 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     5.1050 (1.95)     5.1050 (1.95)     5.1050 (1.95)     0.0000 (1.0)      5.1050 (1.95)     0.0000 (1.0)           0;0  0.1959 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.6202 (1.0)      2.6202 (1.0)      2.6202 (1.0)      0.0000 (1.0)      2.6202 (1.0)      0.0000 (1.0)           0;0  0.3817 (1.0)           1           1
test_status-status-changed-noop[main]       2.8060 (1.07)     2.8060 (1.07)     2.8060 (1.07)     0.0000 (1.0)      2.8060 (1.07)     0.0000 (1.0)           0;0  0.3564 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1757 (1.98)     5.1757 (1.98)     5.1757 (1.98)     0.0000 (1.0)      5.1757 (1.98)     0.0000 (1.0)           0;0  0.1932 (0.51)          1           1
test_status-status-noop[3.10.0]     5.3157 (2.03)     5.3157 (2.03)     5.3157 (2.03)     0.0000 (1.0)      5.3157 (2.03)     0.0000 (1.0)           0;0  0.1881 (0.49)          1           1
test_status-status-noop[3.53.2]     5.0812 (1.94)     5.0812 (1.94)     5.0812 (1.94)     0.0000 (1.0)      5.0812 (1.94)     0.0000 (1.0)           0;0  0.1968 (0.52)          1           1
test_status-status-noop[3.60.1]     2.6189 (1.0)      2.6189 (1.0)      2.6189 (1.0)      0.0000 (1.0)      2.6189 (1.0)      0.0000 (1.0)           0;0  0.3818 (1.0)           1           1
test_status-status-noop[main]       2.7870 (1.06)     2.7870 (1.06)     2.7870 (1.06)     0.0000 (1.0)      2.7870 (1.06)     0.0000 (1.0)           0;0  0.3588 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     202.8295 (4.23)     202.8295 (4.23)     202.8295 (4.23)     0.0000 (1.0)      202.8295 (4.23)     0.0000 (1.0)           0;0  0.0049 (0.24)          1           1
test_update-import-url[3.10.0]     207.3530 (4.32)     207.3530 (4.32)     207.3530 (4.32)     0.0000 (1.0)      207.3530 (4.32)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_update-import-url[3.53.2]     117.0864 (2.44)     117.0864 (2.44)     117.0864 (2.44)     0.0000 (1.0)      117.0864 (2.44)     0.0000 (1.0)           0;0  0.0085 (0.41)          1           1
test_update-import-url[3.60.1]      47.9779 (1.0)       47.9779 (1.0)       47.9779 (1.0)      0.0000 (1.0)       47.9779 (1.0)      0.0000 (1.0)           0;0  0.0208 (1.0)           1           1
test_update-import-url[main]        48.7396 (1.02)      48.7396 (1.02)      48.7396 (1.02)     0.0000 (1.0)       48.7396 (1.02)     0.0000 (1.0)           0;0  0.0205 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     189.8861 (5.36)     189.8861 (5.36)     189.8861 (5.36)     0.0000 (1.0)      189.8861 (5.36)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.10.0]     191.5414 (5.41)     191.5414 (5.41)     191.5414 (5.41)     0.0000 (1.0)      191.5414 (5.41)     0.0000 (1.0)           0;0  0.0052 (0.18)          1           1
test_update-update[3.53.2]     110.3239 (3.12)     110.3239 (3.12)     110.3239 (3.12)     0.0000 (1.0)      110.3239 (3.12)     0.0000 (1.0)           0;0  0.0091 (0.32)          1           1
test_update-update[3.60.1]      35.3992 (1.0)       35.3992 (1.0)       35.3992 (1.0)      0.0000 (1.0)       35.3992 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.0150 (1.02)      36.0150 (1.02)      36.0150 (1.02)     0.0000 (1.0)       36.0150 (1.02)     0.0000 (1.0)           0;0  0.0278 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.9947 (2.25)     16.9947 (2.25)     16.9947 (2.25)     0.0000 (1.0)      16.9947 (2.25)     0.0000 (1.0)           0;0  0.0588 (0.44)          1           1
test_update-update-noop[3.10.0]     18.0877 (2.40)     18.0877 (2.40)     18.0877 (2.40)     0.0000 (1.0)      18.0877 (2.40)     0.0000 (1.0)           0;0  0.0553 (0.42)          1           1
test_update-update-noop[3.53.2]     17.5313 (2.33)     17.5313 (2.33)     17.5313 (2.33)     0.0000 (1.0)      17.5313 (2.33)     0.0000 (1.0)           0;0  0.0570 (0.43)          1           1
test_update-update-noop[3.60.1]      7.5369 (1.0)       7.5369 (1.0)       7.5369 (1.0)      0.0000 (1.0)       7.5369 (1.0)      0.0000 (1.0)           0;0  0.1327 (1.0)           1           1
test_update-update-noop[main]        8.2137 (1.09)      8.2137 (1.09)      8.2137 (1.09)     0.0000 (1.0)       8.2137 (1.09)     0.0000 (1.0)           0;0  0.1217 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean