Sat Mar  7 01:01:55 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     82.8826 (3.62)     82.8826 (3.62)     82.8826 (3.62)     0.0000 (1.0)      82.8826 (3.62)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_add_copy-add[3.10.0]     82.9262 (3.62)     82.9262 (3.62)     82.9262 (3.62)     0.0000 (1.0)      82.9262 (3.62)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_add_copy-add[3.53.2]     74.1735 (3.24)     74.1735 (3.24)     74.1735 (3.24)     0.0000 (1.0)      74.1735 (3.24)     0.0000 (1.0)           0;0  0.0135 (0.31)          1           1
test_add_copy-add[3.60.1]     22.8770 (1.0)      22.8770 (1.0)      22.8770 (1.0)      0.0000 (1.0)      22.8770 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
test_add_copy-add[main]       24.0014 (1.05)     24.0014 (1.05)     24.0014 (1.05)     0.0000 (1.0)      24.0014 (1.05)     0.0000 (1.0)           0;0  0.0417 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     26.6006 (6.53)     26.6006 (6.53)     26.6006 (6.53)     0.0000 (1.0)      26.6006 (6.53)     0.0000 (1.0)           0;0  0.0376 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     27.0400 (6.64)     27.0400 (6.64)     27.0400 (6.64)     0.0000 (1.0)      27.0400 (6.64)     0.0000 (1.0)           0;0  0.0370 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     25.4663 (6.25)     25.4663 (6.25)     25.4663 (6.25)     0.0000 (1.0)      25.4663 (6.25)     0.0000 (1.0)           0;0  0.0393 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.0741 (1.0)       4.0741 (1.0)       4.0741 (1.0)      0.0000 (1.0)       4.0741 (1.0)      0.0000 (1.0)           0;0  0.2455 (1.0)           1           1
test_add_copy-add-noop[main]        4.2178 (1.04)      4.2178 (1.04)      4.2178 (1.04)     0.0000 (1.0)       4.2178 (1.04)     0.0000 (1.0)           0;0  0.2371 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     68.4151 (4.14)     68.4151 (4.14)     68.4151 (4.14)     0.0000 (1.0)      68.4151 (4.14)     0.0000 (1.0)           0;0  0.0146 (0.24)          1           1
test_add_hardlink-add[3.10.0]     69.2427 (4.19)     69.2427 (4.19)     69.2427 (4.19)     0.0000 (1.0)      69.2427 (4.19)     0.0000 (1.0)           0;0  0.0144 (0.24)          1           1
test_add_hardlink-add[3.53.2]     63.9487 (3.87)     63.9487 (3.87)     63.9487 (3.87)     0.0000 (1.0)      63.9487 (3.87)     0.0000 (1.0)           0;0  0.0156 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.5385 (1.0)      16.5385 (1.0)      16.5385 (1.0)      0.0000 (1.0)      16.5385 (1.0)      0.0000 (1.0)           0;0  0.0605 (1.0)           1           1
test_add_hardlink-add[main]       17.9376 (1.08)     17.9376 (1.08)     17.9376 (1.08)     0.0000 (1.0)      17.9376 (1.08)     0.0000 (1.0)           0;0  0.0557 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.4760 (7.91)     34.4760 (7.91)     34.4760 (7.91)     0.0000 (1.0)      34.4760 (7.91)     0.0000 (1.0)           0;0  0.0290 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.1089 (8.06)     35.1089 (8.06)     35.1089 (8.06)     0.0000 (1.0)      35.1089 (8.06)     0.0000 (1.0)           0;0  0.0285 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     32.7703 (7.52)     32.7703 (7.52)     32.7703 (7.52)     0.0000 (1.0)      32.7703 (7.52)     0.0000 (1.0)           0;0  0.0305 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3560 (1.0)       4.3560 (1.0)       4.3560 (1.0)      0.0000 (1.0)       4.3560 (1.0)      0.0000 (1.0)           0;0  0.2296 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.6120 (1.06)      4.6120 (1.06)      4.6120 (1.06)     0.0000 (1.0)       4.6120 (1.06)     0.0000 (1.0)           0;0  0.2168 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.0142 (1.97)     72.0142 (1.97)     72.0142 (1.97)     0.0000 (1.0)      72.0142 (1.97)     0.0000 (1.0)           0;0  0.0139 (0.51)          1           1
test_add_symlink-add[3.10.0]     73.0340 (1.99)     73.0340 (1.99)     73.0340 (1.99)     0.0000 (1.0)      73.0340 (1.99)     0.0000 (1.0)           0;0  0.0137 (0.50)          1           1
test_add_symlink-add[3.53.2]     68.4188 (1.87)     68.4188 (1.87)     68.4188 (1.87)     0.0000 (1.0)      68.4188 (1.87)     0.0000 (1.0)           0;0  0.0146 (0.54)          1           1
test_add_symlink-add[3.60.1]     36.6102 (1.0)      36.6102 (1.0)      36.6102 (1.0)      0.0000 (1.0)      36.6102 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
test_add_symlink-add[main]       38.7159 (1.06)     38.7159 (1.06)     38.7159 (1.06)     0.0000 (1.0)      38.7159 (1.06)     0.0000 (1.0)           0;0  0.0258 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.1968 (8.59)     45.1968 (8.59)     45.1968 (8.59)     0.0000 (1.0)      45.1968 (8.59)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.4687 (8.64)     45.4687 (8.64)     45.4687 (8.64)     0.0000 (1.0)      45.4687 (8.64)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     45.0889 (8.57)     45.0889 (8.57)     45.0889 (8.57)     0.0000 (1.0)      45.0889 (8.57)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.2606 (1.0)       5.2606 (1.0)       5.2606 (1.0)      0.0000 (1.0)       5.2606 (1.0)      0.0000 (1.0)           0;0  0.1901 (1.0)           1           1
test_add_symlink-add-noop[main]        5.5339 (1.05)      5.5339 (1.05)      5.5339 (1.05)     0.0000 (1.0)       5.5339 (1.05)     0.0000 (1.0)           0;0  0.1807 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.5287 (1.84)      40.5287 (1.84)      40.5287 (1.84)     0.0000 (1.0)       40.5287 (1.84)     0.0000 (1.0)           0;0  0.0247 (0.54)          1           1
test_checkout_copy-checkout[3.10.0]     110.1499 (5.01)     110.1499 (5.01)     110.1499 (5.01)     0.0000 (1.0)      110.1499 (5.01)     0.0000 (1.0)           0;0  0.0091 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      29.1193 (1.33)      29.1193 (1.33)      29.1193 (1.33)     0.0000 (1.0)       29.1193 (1.33)     0.0000 (1.0)           0;0  0.0343 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]      21.9701 (1.0)       21.9701 (1.0)       21.9701 (1.0)      0.0000 (1.0)       21.9701 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
test_checkout_copy-checkout[main]        22.6423 (1.03)      22.6423 (1.03)      22.6423 (1.03)     0.0000 (1.0)       22.6423 (1.03)     0.0000 (1.0)           0;0  0.0442 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.7159 (1.62)     5.7159 (1.62)     5.7159 (1.62)     0.0000 (1.0)      5.7159 (1.62)     0.0000 (1.0)           0;0  0.1750 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8060 (1.65)     5.8060 (1.65)     5.8060 (1.65)     0.0000 (1.0)      5.8060 (1.65)     0.0000 (1.0)           0;0  0.1722 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     6.0328 (1.72)     6.0328 (1.72)     6.0328 (1.72)     0.0000 (1.0)      6.0328 (1.72)     0.0000 (1.0)           0;0  0.1658 (0.58)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.6185 (1.03)     3.6185 (1.03)     3.6185 (1.03)     0.0000 (1.0)      3.6185 (1.03)     0.0000 (1.0)           0;0  0.2764 (0.97)          1           1
test_checkout_copy-checkout-noop[main]       3.5175 (1.0)      3.5175 (1.0)      3.5175 (1.0)      0.0000 (1.0)      3.5175 (1.0)      0.0000 (1.0)           0;0  0.2843 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.6483 (1.81)     7.6483 (1.81)     7.6483 (1.81)     0.0000 (1.0)      7.6483 (1.81)     0.0000 (1.0)           0;0  0.1307 (0.55)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5978 (1.56)     6.5978 (1.56)     6.5978 (1.56)     0.0000 (1.0)      6.5978 (1.56)     0.0000 (1.0)           0;0  0.1516 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.7600 (1.60)     6.7600 (1.60)     6.7600 (1.60)     0.0000 (1.0)      6.7600 (1.60)     0.0000 (1.0)           0;0  0.1479 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.2292 (1.0)      4.2292 (1.0)      4.2292 (1.0)      0.0000 (1.0)      4.2292 (1.0)      0.0000 (1.0)           0;0  0.2365 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4062 (1.04)     4.4062 (1.04)     4.4062 (1.04)     0.0000 (1.0)      4.4062 (1.04)     0.0000 (1.0)           0;0  0.2270 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.7663 (2.88)     21.7663 (2.88)     21.7663 (2.88)     0.0000 (1.0)      21.7663 (2.88)     0.0000 (1.0)           0;0  0.0459 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.4799 (2.18)     16.4799 (2.18)     16.4799 (2.18)     0.0000 (1.0)      16.4799 (2.18)     0.0000 (1.0)           0;0  0.0607 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.7994 (1.96)     14.7994 (1.96)     14.7994 (1.96)     0.0000 (1.0)      14.7994 (1.96)     0.0000 (1.0)           0;0  0.0676 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5648 (1.0)       7.5648 (1.0)       7.5648 (1.0)      0.0000 (1.0)       7.5648 (1.0)      0.0000 (1.0)           0;0  0.1322 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.3844 (1.11)      8.3844 (1.11)      8.3844 (1.11)     0.0000 (1.0)       8.3844 (1.11)     0.0000 (1.0)           0;0  0.1193 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4917 (1.72)     5.4917 (1.72)     5.4917 (1.72)     0.0000 (1.0)      5.4917 (1.72)     0.0000 (1.0)           0;0  0.1821 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7327 (1.80)     5.7327 (1.80)     5.7327 (1.80)     0.0000 (1.0)      5.7327 (1.80)     0.0000 (1.0)           0;0  0.1744 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5233 (1.73)     5.5233 (1.73)     5.5233 (1.73)     0.0000 (1.0)      5.5233 (1.73)     0.0000 (1.0)           0;0  0.1811 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.1847 (1.0)      3.1847 (1.0)      3.1847 (1.0)      0.0000 (1.0)      3.1847 (1.0)      0.0000 (1.0)           0;0  0.3140 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3333 (1.05)     3.3333 (1.05)     3.3333 (1.05)     0.0000 (1.0)      3.3333 (1.05)     0.0000 (1.0)           0;0  0.3000 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.7045 (2.01)     7.7045 (2.01)     7.7045 (2.01)     0.0000 (1.0)      7.7045 (2.01)     0.0000 (1.0)           0;0  0.1298 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7564 (1.77)     6.7564 (1.77)     6.7564 (1.77)     0.0000 (1.0)      6.7564 (1.77)     0.0000 (1.0)           0;0  0.1480 (0.57)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2882 (1.64)     6.2882 (1.64)     6.2882 (1.64)     0.0000 (1.0)      6.2882 (1.64)     0.0000 (1.0)           0;0  0.1590 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8258 (1.0)      3.8258 (1.0)      3.8258 (1.0)      0.0000 (1.0)      3.8258 (1.0)      0.0000 (1.0)           0;0  0.2614 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.1843 (1.09)     4.1843 (1.09)     4.1843 (1.09)     0.0000 (1.0)      4.1843 (1.09)     0.0000 (1.0)           0;0  0.2390 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     18.6013 (2.26)     18.6013 (2.26)     18.6013 (2.26)     0.0000 (1.0)      18.6013 (2.26)     0.0000 (1.0)           0;0  0.0538 (0.44)          1           1
test_checkout_symlink-checkout[3.10.0]     13.8681 (1.68)     13.8681 (1.68)     13.8681 (1.68)     0.0000 (1.0)      13.8681 (1.68)     0.0000 (1.0)           0;0  0.0721 (0.59)          1           1
test_checkout_symlink-checkout[3.53.2]     12.9087 (1.57)     12.9087 (1.57)     12.9087 (1.57)     0.0000 (1.0)      12.9087 (1.57)     0.0000 (1.0)           0;0  0.0775 (0.64)          1           1
test_checkout_symlink-checkout[3.60.1]      8.2377 (1.0)       8.2377 (1.0)       8.2377 (1.0)      0.0000 (1.0)       8.2377 (1.0)      0.0000 (1.0)           0;0  0.1214 (1.0)           1           1
test_checkout_symlink-checkout[main]        9.0320 (1.10)      9.0320 (1.10)      9.0320 (1.10)     0.0000 (1.0)       9.0320 (1.10)     0.0000 (1.0)           0;0  0.1107 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     4.8389 (1.37)     4.8389 (1.37)     4.8389 (1.37)     0.0000 (1.0)      4.8389 (1.37)     0.0000 (1.0)           0;0  0.2067 (0.73)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.0454 (1.42)     5.0454 (1.42)     5.0454 (1.42)     0.0000 (1.0)      5.0454 (1.42)     0.0000 (1.0)           0;0  0.1982 (0.70)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     4.9766 (1.40)     4.9766 (1.40)     4.9766 (1.40)     0.0000 (1.0)      4.9766 (1.40)     0.0000 (1.0)           0;0  0.2009 (0.71)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     3.5425 (1.0)      3.5425 (1.0)      3.5425 (1.0)      0.0000 (1.0)      3.5425 (1.0)      0.0000 (1.0)           0;0  0.2823 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       3.7340 (1.05)     3.7340 (1.05)     3.7340 (1.05)     0.0000 (1.0)      3.7340 (1.05)     0.0000 (1.0)           0;0  0.2678 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     7.2553 (1.56)     7.2553 (1.56)     7.2553 (1.56)     0.0000 (1.0)      7.2553 (1.56)     0.0000 (1.0)           0;0  0.1378 (0.64)          1           1
test_checkout_symlink-checkout-update[3.10.0]     6.2891 (1.35)     6.2891 (1.35)     6.2891 (1.35)     0.0000 (1.0)      6.2891 (1.35)     0.0000 (1.0)           0;0  0.1590 (0.74)          1           1
test_checkout_symlink-checkout-update[3.53.2]     6.1967 (1.33)     6.1967 (1.33)     6.1967 (1.33)     0.0000 (1.0)      6.1967 (1.33)     0.0000 (1.0)           0;0  0.1614 (0.75)          1           1
test_checkout_symlink-checkout-update[3.60.1]     4.6594 (1.0)      4.6594 (1.0)      4.6594 (1.0)      0.0000 (1.0)      4.6594 (1.0)      0.0000 (1.0)           0;0  0.2146 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       5.0213 (1.08)     5.0213 (1.08)     5.0213 (1.08)     0.0000 (1.0)      5.0213 (1.08)     0.0000 (1.0)           0;0  0.1992 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1488 (1.79)     4.1488 (1.79)     4.1488 (1.79)     0.0000 (1.0)      4.1488 (1.79)     0.0000 (1.0)           0;0  0.2410 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.9466 (2.13)     4.9466 (2.13)     4.9466 (2.13)     0.0000 (1.0)      4.9466 (2.13)     0.0000 (1.0)           0;0  0.2022 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.8561 (2.09)     4.8561 (2.09)     4.8561 (2.09)     0.0000 (1.0)      4.8561 (2.09)     0.0000 (1.0)           0;0  0.2059 (0.48)          1           1
test_data_status-data-changed[3.60.1]     2.3185 (1.0)      2.3185 (1.0)      2.3185 (1.0)      0.0000 (1.0)      2.3185 (1.0)      0.0000 (1.0)           0;0  0.4313 (1.0)           1           1
test_data_status-data-changed[main]       3.0577 (1.32)     3.0577 (1.32)     3.0577 (1.32)     0.0000 (1.0)      3.0577 (1.32)     0.0000 (1.0)           0;0  0.3270 (0.76)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1585 (1.78)     4.1585 (1.78)     4.1585 (1.78)     0.0000 (1.0)      4.1585 (1.78)     0.0000 (1.0)           0;0  0.2405 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9824 (2.13)     4.9824 (2.13)     4.9824 (2.13)     0.0000 (1.0)      4.9824 (2.13)     0.0000 (1.0)           0;0  0.2007 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7253 (2.02)     4.7253 (2.02)     4.7253 (2.02)     0.0000 (1.0)      4.7253 (2.02)     0.0000 (1.0)           0;0  0.2116 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3353 (1.0)      2.3353 (1.0)      2.3353 (1.0)      0.0000 (1.0)      2.3353 (1.0)      0.0000 (1.0)           0;0  0.4282 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5326 (1.08)     2.5326 (1.08)     2.5326 (1.08)     0.0000 (1.0)      2.5326 (1.08)     0.0000 (1.0)           0;0  0.3948 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2529 (3.61)     18.2529 (3.61)     18.2529 (3.61)     0.0000 (1.0)      18.2529 (3.61)     0.0000 (1.0)           0;0  0.0548 (0.28)          1           1
test_data_status-data-new[3.10.0]     19.7262 (3.90)     19.7262 (3.90)     19.7262 (3.90)     0.0000 (1.0)      19.7262 (3.90)     0.0000 (1.0)           0;0  0.0507 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.1760 (3.80)     19.1760 (3.80)     19.1760 (3.80)     0.0000 (1.0)      19.1760 (3.80)     0.0000 (1.0)           0;0  0.0521 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.0528 (1.0)       5.0528 (1.0)       5.0528 (1.0)      0.0000 (1.0)       5.0528 (1.0)      0.0000 (1.0)           0;0  0.1979 (1.0)           1           1
test_data_status-data-new[main]        5.5675 (1.10)      5.5675 (1.10)      5.5675 (1.10)     0.0000 (1.0)       5.5675 (1.10)     0.0000 (1.0)           0;0  0.1796 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1796 (1.81)     4.1796 (1.81)     4.1796 (1.81)     0.0000 (1.0)      4.1796 (1.81)     0.0000 (1.0)           0;0  0.2393 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.9132 (2.13)     4.9132 (2.13)     4.9132 (2.13)     0.0000 (1.0)      4.9132 (2.13)     0.0000 (1.0)           0;0  0.2035 (0.47)          1           1
test_data_status-data-noop[3.53.2]     5.0700 (2.20)     5.0700 (2.20)     5.0700 (2.20)     0.0000 (1.0)      5.0700 (2.20)     0.0000 (1.0)           0;0  0.1972 (0.45)          1           1
test_data_status-data-noop[3.60.1]     2.3036 (1.0)      2.3036 (1.0)      2.3036 (1.0)      0.0000 (1.0)      2.3036 (1.0)      0.0000 (1.0)           0;0  0.4341 (1.0)           1           1
test_data_status-data-noop[main]       2.5373 (1.10)     2.5373 (1.10)     2.5373 (1.10)     0.0000 (1.0)      2.5373 (1.10)     0.0000 (1.0)           0;0  0.3941 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.9170 (1.29)     6.9170 (1.29)     6.9170 (1.29)     0.0000 (1.0)      6.9170 (1.29)     0.0000 (1.0)           0;0  0.1446 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.9022 (1.47)     7.9022 (1.47)     7.9022 (1.47)     0.0000 (1.0)      7.9022 (1.47)     0.0000 (1.0)           0;0  0.1265 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7273 (1.44)     7.7273 (1.44)     7.7273 (1.44)     0.0000 (1.0)      7.7273 (1.44)     0.0000 (1.0)           0;0  0.1294 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.3618 (1.0)      5.3618 (1.0)      5.3618 (1.0)      0.0000 (1.0)      5.3618 (1.0)      0.0000 (1.0)           0;0  0.1865 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.7505 (1.07)     5.7505 (1.07)     5.7505 (1.07)     0.0000 (1.0)      5.7505 (1.07)     0.0000 (1.0)           0;0  0.1739 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.9092 (1.27)     6.9092 (1.27)     6.9092 (1.27)     0.0000 (1.0)      6.9092 (1.27)     0.0000 (1.0)           0;0  0.1447 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8232 (1.43)     7.8232 (1.43)     7.8232 (1.43)     0.0000 (1.0)      7.8232 (1.43)     0.0000 (1.0)           0;0  0.1278 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8209 (1.43)     7.8209 (1.43)     7.8209 (1.43)     0.0000 (1.0)      7.8209 (1.43)     0.0000 (1.0)           0;0  0.1279 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.4538 (1.0)      5.4538 (1.0)      5.4538 (1.0)      0.0000 (1.0)      5.4538 (1.0)      0.0000 (1.0)           0;0  0.1834 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.7519 (1.05)     5.7519 (1.05)     5.7519 (1.05)     0.0000 (1.0)      5.7519 (1.05)     0.0000 (1.0)           0;0  0.1739 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.5958 (2.64)     21.5958 (2.64)     21.5958 (2.64)     0.0000 (1.0)      21.5958 (2.64)     0.0000 (1.0)           0;0  0.0463 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.4408 (2.86)     23.4408 (2.86)     23.4408 (2.86)     0.0000 (1.0)      23.4408 (2.86)     0.0000 (1.0)           0;0  0.0427 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.4696 (2.75)     22.4696 (2.75)     22.4696 (2.75)     0.0000 (1.0)      22.4696 (2.75)     0.0000 (1.0)           0;0  0.0445 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.1825 (1.0)       8.1825 (1.0)       8.1825 (1.0)      0.0000 (1.0)       8.1825 (1.0)      0.0000 (1.0)           0;0  0.1222 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6001 (1.05)      8.6001 (1.05)      8.6001 (1.05)     0.0000 (1.0)       8.6001 (1.05)     0.0000 (1.0)           0;0  0.1163 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4081 (1.35)     6.4081 (1.35)     6.4081 (1.35)     0.0000 (1.0)      6.4081 (1.35)     0.0000 (1.0)           0;0  0.1561 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.3699 (1.56)     7.3699 (1.56)     7.3699 (1.56)     0.0000 (1.0)      7.3699 (1.56)     0.0000 (1.0)           0;0  0.1357 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.2558 (1.53)     7.2558 (1.53)     7.2558 (1.53)     0.0000 (1.0)      7.2558 (1.53)     0.0000 (1.0)           0;0  0.1378 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7317 (1.0)      4.7317 (1.0)      4.7317 (1.0)      0.0000 (1.0)      4.7317 (1.0)      0.0000 (1.0)           0;0  0.2113 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0457 (1.07)     5.0457 (1.07)     5.0457 (1.07)     0.0000 (1.0)      5.0457 (1.07)     0.0000 (1.0)           0;0  0.1982 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.2375 (2.67)     18.2375 (2.67)     18.2375 (2.67)     0.0000 (1.0)      18.2375 (2.67)     0.0000 (1.0)           0;0  0.0548 (0.37)          1           1
test_diff-diff[3.10.0]     19.5054 (2.86)     19.5054 (2.86)     19.5054 (2.86)     0.0000 (1.0)      19.5054 (2.86)     0.0000 (1.0)           0;0  0.0513 (0.35)          1           1
test_diff-diff[3.53.2]     19.3200 (2.83)     19.3200 (2.83)     19.3200 (2.83)     0.0000 (1.0)      19.3200 (2.83)     0.0000 (1.0)           0;0  0.0518 (0.35)          1           1
test_diff-diff[3.60.1]      6.8241 (1.0)       6.8241 (1.0)       6.8241 (1.0)      0.0000 (1.0)       6.8241 (1.0)      0.0000 (1.0)           0;0  0.1465 (1.0)           1           1
test_diff-diff[main]        7.8453 (1.15)      7.8453 (1.15)      7.8453 (1.15)     0.0000 (1.0)       7.8453 (1.15)     0.0000 (1.0)           0;0  0.1275 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9193 (1.84)     5.9193 (1.84)     5.9193 (1.84)     0.0000 (1.0)      5.9193 (1.84)     0.0000 (1.0)           0;0  0.1689 (0.54)          1           1
test_diff-diff-changed[3.10.0]     6.6240 (2.06)     6.6240 (2.06)     6.6240 (2.06)     0.0000 (1.0)      6.6240 (2.06)     0.0000 (1.0)           0;0  0.1510 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.6077 (1.74)     5.6077 (1.74)     5.6077 (1.74)     0.0000 (1.0)      5.6077 (1.74)     0.0000 (1.0)           0;0  0.1783 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.2190 (1.0)      3.2190 (1.0)      3.2190 (1.0)      0.0000 (1.0)      3.2190 (1.0)      0.0000 (1.0)           0;0  0.3107 (1.0)           1           1
test_diff-diff-changed[main]       3.9875 (1.24)     3.9875 (1.24)     3.9875 (1.24)     0.0000 (1.0)      3.9875 (1.24)     0.0000 (1.0)           0;0  0.2508 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1557 (1.58)     5.1557 (1.58)     5.1557 (1.58)     0.0000 (1.0)      5.1557 (1.58)     0.0000 (1.0)           0;0  0.1940 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7803 (1.77)     5.7803 (1.77)     5.7803 (1.77)     0.0000 (1.0)      5.7803 (1.77)     0.0000 (1.0)           0;0  0.1730 (0.56)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5658 (1.71)     5.5658 (1.71)     5.5658 (1.71)     0.0000 (1.0)      5.5658 (1.71)     0.0000 (1.0)           0;0  0.1797 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2617 (1.0)      3.2617 (1.0)      3.2617 (1.0)      0.0000 (1.0)      3.2617 (1.0)      0.0000 (1.0)           0;0  0.3066 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0210 (1.23)     4.0210 (1.23)     4.0210 (1.23)     0.0000 (1.0)      4.0210 (1.23)     0.0000 (1.0)           0;0  0.2487 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2150 (1.31)     4.2150 (1.31)     4.2150 (1.31)     0.0000 (1.0)      4.2150 (1.31)     0.0000 (1.0)           0;0  0.2372 (0.76)          1           1
test_diff-diff-noop[3.10.0]     4.8380 (1.50)     4.8380 (1.50)     4.8380 (1.50)     0.0000 (1.0)      4.8380 (1.50)     0.0000 (1.0)           0;0  0.2067 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.6405 (1.75)     5.6405 (1.75)     5.6405 (1.75)     0.0000 (1.0)      5.6405 (1.75)     0.0000 (1.0)           0;0  0.1773 (0.57)          1           1
test_diff-diff-noop[3.60.1]     3.2178 (1.0)      3.2178 (1.0)      3.2178 (1.0)      0.0000 (1.0)      3.2178 (1.0)      0.0000 (1.0)           0;0  0.3108 (1.0)           1           1
test_diff-diff-noop[main]       4.0676 (1.26)     4.0676 (1.26)     4.0676 (1.26)     0.0000 (1.0)      4.0676 (1.26)     0.0000 (1.0)           0;0  0.2458 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2509 (1.0)       1.2509 (1.0)       1.2509 (1.0)      0.0000 (1.0)       1.2509 (1.0)      0.0000 (1.0)           0;0  0.7994 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.0193 (8.01)     10.0193 (8.01)     10.0193 (8.01)     0.0000 (1.0)      10.0193 (8.01)     0.0000 (1.0)           0;0  0.0998 (0.12)          1           1
test_exp_show-exp[3.53.2]      5.5166 (4.41)      5.5166 (4.41)      5.5166 (4.41)     0.0000 (1.0)       5.5166 (4.41)     0.0000 (1.0)           0;0  0.1813 (0.23)          1           1
test_exp_show-exp[3.60.1]      5.5256 (4.42)      5.5256 (4.42)      5.5256 (4.42)     0.0000 (1.0)       5.5256 (4.42)     0.0000 (1.0)           0;0  0.1810 (0.23)          1           1
test_exp_show-exp[main]        7.7660 (6.21)      7.7660 (6.21)      7.7660 (6.21)     0.0000 (1.0)       7.7660 (6.21)     0.0000 (1.0)           0;0  0.1288 (0.16)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     91.3629 (5.90)     91.3629 (5.90)     91.3629 (5.90)     0.0000 (1.0)      91.3629 (5.90)     0.0000 (1.0)           0;0  0.0109 (0.17)          1           1
test_fetch-fetch[3.10.0]     96.0309 (6.20)     96.0309 (6.20)     96.0309 (6.20)     0.0000 (1.0)      96.0309 (6.20)     0.0000 (1.0)           0;0  0.0104 (0.16)          1           1
test_fetch-fetch[3.53.2]     23.1674 (1.50)     23.1674 (1.50)     23.1674 (1.50)     0.0000 (1.0)      23.1674 (1.50)     0.0000 (1.0)           0;0  0.0432 (0.67)          1           1
test_fetch-fetch[3.60.1]     15.4906 (1.0)      15.4906 (1.0)      15.4906 (1.0)      0.0000 (1.0)      15.4906 (1.0)      0.0000 (1.0)           0;0  0.0646 (1.0)           1           1
test_fetch-fetch[main]       15.5189 (1.00)     15.5189 (1.00)     15.5189 (1.00)     0.0000 (1.0)      15.5189 (1.00)     0.0000 (1.0)           0;0  0.0644 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8381 (1.0)      2.8381 (1.0)      2.8381 (1.0)      0.0000 (1.0)      2.8381 (1.0)      0.0000 (1.0)           0;0  0.3524 (1.0)           1           1
test_gc-gc[3.10.0]     3.1781 (1.12)     3.1781 (1.12)     3.1781 (1.12)     0.0000 (1.0)      3.1781 (1.12)     0.0000 (1.0)           0;0  0.3147 (0.89)          1           1
test_gc-gc[3.53.2]     2.8831 (1.02)     2.8831 (1.02)     2.8831 (1.02)     0.0000 (1.0)      2.8831 (1.02)     0.0000 (1.0)           0;0  0.3468 (0.98)          1           1
test_gc-gc[3.60.1]     2.8987 (1.02)     2.8987 (1.02)     2.8987 (1.02)     0.0000 (1.0)      2.8987 (1.02)     0.0000 (1.0)           0;0  0.3450 (0.98)          1           1
test_gc-gc[main]       3.1796 (1.12)     3.1796 (1.12)     3.1796 (1.12)     0.0000 (1.0)      3.1796 (1.12)     0.0000 (1.0)           0;0  0.3145 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     182.5344 (3.45)     182.5344 (3.45)     182.5344 (3.45)     0.0000 (1.0)      182.5344 (3.45)     0.0000 (1.0)           0;0  0.0055 (0.29)          1           1
test_get-get[3.10.0]     217.8997 (4.11)     217.8997 (4.11)     217.8997 (4.11)     0.0000 (1.0)      217.8997 (4.11)     0.0000 (1.0)           0;0  0.0046 (0.24)          1           1
test_get-get[3.53.2]     162.9362 (3.08)     162.9362 (3.08)     162.9362 (3.08)     0.0000 (1.0)      162.9362 (3.08)     0.0000 (1.0)           0;0  0.0061 (0.33)          1           1
test_get-get[3.60.1]      52.9630 (1.0)       52.9630 (1.0)       52.9630 (1.0)      0.0000 (1.0)       52.9630 (1.0)      0.0000 (1.0)           0;0  0.0189 (1.0)           1           1
test_get-get[main]        54.1114 (1.02)      54.1114 (1.02)      54.1114 (1.02)     0.0000 (1.0)       54.1114 (1.02)     0.0000 (1.0)           0;0  0.0185 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     92.1925 (5.32)     92.1925 (5.32)     92.1925 (5.32)     0.0000 (1.0)      92.1925 (5.32)     0.0000 (1.0)           0;0  0.0108 (0.19)          1           1
test_get_url-get-url[3.10.0]     93.8752 (5.42)     93.8752 (5.42)     93.8752 (5.42)     0.0000 (1.0)      93.8752 (5.42)     0.0000 (1.0)           0;0  0.0107 (0.18)          1           1
test_get_url-get-url[3.53.2]     17.5322 (1.01)     17.5322 (1.01)     17.5322 (1.01)     0.0000 (1.0)      17.5322 (1.01)     0.0000 (1.0)           0;0  0.0570 (0.99)          1           1
test_get_url-get-url[3.60.1]     17.3283 (1.0)      17.3283 (1.0)      17.3283 (1.0)      0.0000 (1.0)      17.3283 (1.0)      0.0000 (1.0)           0;0  0.0577 (1.0)           1           1
test_get_url-get-url[main]       17.6270 (1.02)     17.6270 (1.02)     17.6270 (1.02)     0.0000 (1.0)      17.6270 (1.02)     0.0000 (1.0)           0;0  0.0567 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     150.0540 (1.06)     155.8744 (1.01)     152.2735 (1.04)     1.3505 (1.01)     152.1145 (1.06)     1.7323 (1.0)          28;3  6.5671 (0.96)        100           1
test_help---help[3.10.0]     148.5376 (1.05)     154.8591 (1.0)      150.4306 (1.03)     1.3331 (1.0)      150.2619 (1.05)     1.7833 (1.03)         27;4  6.6476 (0.97)        100           1
test_help---help[3.53.2]     149.7866 (1.05)     162.2461 (1.05)     152.7075 (1.05)     2.3320 (1.75)     152.2156 (1.06)     2.4296 (1.40)         15;6  6.5485 (0.96)        100           1
test_help---help[3.60.1]     150.0888 (1.06)     160.2733 (1.03)     153.5744 (1.05)     2.3322 (1.75)     152.8747 (1.06)     2.5910 (1.50)         35;5  6.5115 (0.95)        100           1
test_help---help[main]       142.0185 (1.0)      187.7302 (1.21)     145.9098 (1.0)      6.7741 (5.08)     143.7082 (1.0)      2.0183 (1.17)         9;12  6.8535 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     273.2733 (3.32)     273.2733 (3.32)     273.2733 (3.32)     0.0000 (1.0)      273.2733 (3.32)     0.0000 (1.0)           0;0  0.0037 (0.30)          1           1
test_import-import[3.10.0]     312.7002 (3.80)     312.7002 (3.80)     312.7002 (3.80)     0.0000 (1.0)      312.7002 (3.80)     0.0000 (1.0)           0;0  0.0032 (0.26)          1           1
test_import-import[3.60.1]      82.2206 (1.0)       82.2206 (1.0)       82.2206 (1.0)      0.0000 (1.0)       82.2206 (1.0)      0.0000 (1.0)           0;0  0.0122 (1.0)           1           1
test_import-import[main]        82.4177 (1.00)      82.4177 (1.00)      82.4177 (1.00)     0.0000 (1.0)       82.4177 (1.00)     0.0000 (1.0)           0;0  0.0121 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     209.3037 (4.35)     209.3037 (4.35)     209.3037 (4.35)     0.0000 (1.0)      209.3037 (4.35)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_import_url-import-url[3.10.0]     209.6232 (4.35)     209.6232 (4.35)     209.6232 (4.35)     0.0000 (1.0)      209.6232 (4.35)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_import_url-import-url[3.53.2]     122.4440 (2.54)     122.4440 (2.54)     122.4440 (2.54)     0.0000 (1.0)      122.4440 (2.54)     0.0000 (1.0)           0;0  0.0082 (0.39)          1           1
test_import_url-import-url[3.60.1]      48.1693 (1.0)       48.1693 (1.0)       48.1693 (1.0)      0.0000 (1.0)       48.1693 (1.0)      0.0000 (1.0)           0;0  0.0208 (1.0)           1           1
test_import_url-import-url[main]        50.4073 (1.05)      50.4073 (1.05)      50.4073 (1.05)     0.0000 (1.0)       50.4073 (1.05)     0.0000 (1.0)           0;0  0.0198 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     419.7280 (1.03)     465.4402 (1.03)     435.6402 (1.02)     8.8367 (1.11)     433.3224 (1.02)     11.9725 (1.32)         26;2  2.2955 (0.98)        100           1
test_init-init[3.10.0]     427.2125 (1.05)     471.4746 (1.04)     444.1399 (1.04)     8.0674 (1.01)     443.0895 (1.05)      9.0481 (1.0)          28;4  2.2515 (0.96)        100           1
test_init-init[3.53.2]     406.5600 (1.0)      451.5154 (1.0)      425.3268 (1.0)      7.9914 (1.0)      423.8834 (1.0)      10.5348 (1.16)         31;1  2.3511 (1.0)         100           1
test_init-init[3.60.1]     411.3413 (1.01)     466.6381 (1.03)     428.5378 (1.01)     9.0954 (1.14)     426.7640 (1.01)      9.9003 (1.09)         23;3  2.3335 (0.99)        100           1
test_init-init[main]       459.1607 (1.13)     513.1794 (1.14)     474.3588 (1.12)     9.0518 (1.13)     472.8929 (1.12)     11.3049 (1.25)         31;2  2.1081 (0.90)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     621.4636 (1.05)     621.4636 (1.05)     621.4636 (1.05)     0.0000 (1.0)      621.4636 (1.05)     0.0000 (1.0)           0;0  1.6091 (0.95)          1           1
test_list-list[3.10.0]     961.7768 (1.62)     961.7768 (1.62)     961.7768 (1.62)     0.0000 (1.0)      961.7768 (1.62)     0.0000 (1.0)           0;0  1.0397 (0.62)          1           1
test_list-list[3.53.2]     624.9414 (1.05)     624.9414 (1.05)     624.9414 (1.05)     0.0000 (1.0)      624.9414 (1.05)     0.0000 (1.0)           0;0  1.6001 (0.95)          1           1
test_list-list[3.60.1]     667.2491 (1.12)     667.2491 (1.12)     667.2491 (1.12)     0.0000 (1.0)      667.2491 (1.12)     0.0000 (1.0)           0;0  1.4987 (0.89)          1           1
test_list-list[main]       593.1655 (1.0)      593.1655 (1.0)      593.1655 (1.0)      0.0000 (1.0)      593.1655 (1.0)      0.0000 (1.0)           0;0  1.6859 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     439.5644 (1.07)     439.5644 (1.07)     439.5644 (1.07)     0.0000 (1.0)      439.5644 (1.07)     0.0000 (1.0)           0;0  2.2750 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     438.3615 (1.06)     438.3615 (1.06)     438.3615 (1.06)     0.0000 (1.0)      438.3615 (1.06)     0.0000 (1.0)           0;0  2.2812 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     428.3432 (1.04)     428.3432 (1.04)     428.3432 (1.04)     0.0000 (1.0)      428.3432 (1.04)     0.0000 (1.0)           0;0  2.3346 (0.96)          1           1
test_list-list-dvc-only[3.60.1]     445.7353 (1.08)     445.7353 (1.08)     445.7353 (1.08)     0.0000 (1.0)      445.7353 (1.08)     0.0000 (1.0)           0;0  2.2435 (0.92)          1           1
test_list-list-dvc-only[main]       411.7571 (1.0)      411.7571 (1.0)      411.7571 (1.0)      0.0000 (1.0)      411.7571 (1.0)      0.0000 (1.0)           0;0  2.4286 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4822 (1.0)      2.4822 (1.0)      2.4822 (1.0)      0.0000 (1.0)      2.4822 (1.0)      0.0000 (1.0)           0;0  0.4029 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5292 (1.02)     2.5292 (1.02)     2.5292 (1.02)     0.0000 (1.0)      2.5292 (1.02)     0.0000 (1.0)           0;0  0.3954 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.5633 (1.03)     2.5633 (1.03)     2.5633 (1.03)     0.0000 (1.0)      2.5633 (1.03)     0.0000 (1.0)           0;0  0.3901 (0.97)          1           1
test_list-list-recursive[3.60.1]     2.6536 (1.07)     2.6536 (1.07)     2.6536 (1.07)     0.0000 (1.0)      2.6536 (1.07)     0.0000 (1.0)           0;0  0.3768 (0.94)          1           1
test_list-list-recursive[main]       2.6931 (1.08)     2.6931 (1.08)     2.6931 (1.08)     0.0000 (1.0)      2.6931 (1.08)     0.0000 (1.0)           0;0  0.3713 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     431.6919 (1.07)     431.6919 (1.07)     431.6919 (1.07)     0.0000 (1.0)      431.6919 (1.07)     0.0000 (1.0)           0;0  2.3165 (0.93)          1           1
test_list-list-shallow[3.10.0]     431.2818 (1.07)     431.2818 (1.07)     431.2818 (1.07)     0.0000 (1.0)      431.2818 (1.07)     0.0000 (1.0)           0;0  2.3187 (0.93)          1           1
test_list-list-shallow[3.53.2]     402.9601 (1.0)      402.9601 (1.0)      402.9601 (1.0)      0.0000 (1.0)      402.9601 (1.0)      0.0000 (1.0)           0;0  2.4816 (1.0)           1           1
test_list-list-shallow[3.60.1]     425.9871 (1.06)     425.9871 (1.06)     425.9871 (1.06)     0.0000 (1.0)      425.9871 (1.06)     0.0000 (1.0)           0;0  2.3475 (0.95)          1           1
test_list-list-shallow[main]       416.8857 (1.03)     416.8857 (1.03)     416.8857 (1.03)     0.0000 (1.0)      416.8857 (1.03)     0.0000 (1.0)           0;0  2.3987 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     11.5116 (2.95)     11.5116 (2.95)     11.5116 (2.95)     0.0000 (1.0)      11.5116 (2.95)     0.0000 (1.0)           0;0  0.0869 (0.34)          1           1
test_partial_add-add[3.10.0]     11.9408 (3.06)     11.9408 (3.06)     11.9408 (3.06)     0.0000 (1.0)      11.9408 (3.06)     0.0000 (1.0)           0;0  0.0837 (0.33)          1           1
test_partial_add-add[3.53.2]     10.5226 (2.70)     10.5226 (2.70)     10.5226 (2.70)     0.0000 (1.0)      10.5226 (2.70)     0.0000 (1.0)           0;0  0.0950 (0.37)          1           1
test_partial_add-add[3.60.1]      3.8990 (1.0)       3.8990 (1.0)       3.8990 (1.0)      0.0000 (1.0)       3.8990 (1.0)      0.0000 (1.0)           0;0  0.2565 (1.0)           1           1
test_partial_add-add[main]        5.0678 (1.30)      5.0678 (1.30)      5.0678 (1.30)     0.0000 (1.0)       5.0678 (1.30)     0.0000 (1.0)           0;0  0.1973 (0.77)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     74.7543 (3.78)     74.7543 (3.78)     74.7543 (3.78)     0.0000 (1.0)      74.7543 (3.78)     0.0000 (1.0)           0;0  0.0134 (0.26)          1           1
test_partial_add-add-partial[3.10.0]     74.9431 (3.79)     74.9431 (3.79)     74.9431 (3.79)     0.0000 (1.0)      74.9431 (3.79)     0.0000 (1.0)           0;0  0.0133 (0.26)          1           1
test_partial_add-add-partial[3.53.2]     67.3228 (3.41)     67.3228 (3.41)     67.3228 (3.41)     0.0000 (1.0)      67.3228 (3.41)     0.0000 (1.0)           0;0  0.0149 (0.29)          1           1
test_partial_add-add-partial[3.60.1]     19.7664 (1.0)      19.7664 (1.0)      19.7664 (1.0)      0.0000 (1.0)      19.7664 (1.0)      0.0000 (1.0)           0;0  0.0506 (1.0)           1           1
test_partial_add-add-partial[main]       20.2184 (1.02)     20.2184 (1.02)     20.2184 (1.02)     0.0000 (1.0)      20.2184 (1.02)     0.0000 (1.0)           0;0  0.0495 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4779 (1.0)      4.4779 (1.0)      4.4779 (1.0)      0.0000 (1.0)      4.4779 (1.0)      0.0000 (1.0)           0;0  0.2233 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8126 (1.30)     5.8126 (1.30)     5.8126 (1.30)     0.0000 (1.0)      5.8126 (1.30)     0.0000 (1.0)           0;0  0.1720 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6191 (1.48)     6.6191 (1.48)     6.6191 (1.48)     0.0000 (1.0)      6.6191 (1.48)     0.0000 (1.0)           0;0  0.1511 (0.68)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6118 (1.48)     6.6118 (1.48)     6.6118 (1.48)     0.0000 (1.0)      6.6118 (1.48)     0.0000 (1.0)           0;0  0.1512 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       6.0544 (1.35)     6.0544 (1.35)     6.0544 (1.35)     0.0000 (1.0)      6.0544 (1.35)     0.0000 (1.0)           0;0  0.1652 (0.74)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5148 (1.0)      2.5148 (1.0)      2.5148 (1.0)      0.0000 (1.0)      2.5148 (1.0)      0.0000 (1.0)           0;0  0.3976 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6827 (1.46)     3.6827 (1.46)     3.6827 (1.46)     0.0000 (1.0)      3.6827 (1.46)     0.0000 (1.0)           0;0  0.2715 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.7746 (1.50)     3.7746 (1.50)     3.7746 (1.50)     0.0000 (1.0)      3.7746 (1.50)     0.0000 (1.0)           0;0  0.2649 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.8373 (1.53)     3.8373 (1.53)     3.8373 (1.53)     0.0000 (1.0)      3.8373 (1.53)     0.0000 (1.0)           0;0  0.2606 (0.66)          1           1
test_partial_add-gc-noop[main]       3.0019 (1.19)     3.0019 (1.19)     3.0019 (1.19)     0.0000 (1.0)      3.0019 (1.19)     0.0000 (1.0)           0;0  0.3331 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     13.9916 (3.89)     13.9916 (3.89)     13.9916 (3.89)     0.0000 (1.0)      13.9916 (3.89)     0.0000 (1.0)           0;0  0.0715 (0.26)          1           1
test_partial_add-push[3.10.0]      6.9287 (1.93)      6.9287 (1.93)      6.9287 (1.93)     0.0000 (1.0)       6.9287 (1.93)     0.0000 (1.0)           0;0  0.1443 (0.52)          1           1
test_partial_add-push[3.53.2]      3.5993 (1.0)       3.5993 (1.0)       3.5993 (1.0)      0.0000 (1.0)       3.5993 (1.0)      0.0000 (1.0)           0;0  0.2778 (1.0)           1           1
test_partial_add-push[3.60.1]      3.6387 (1.01)      3.6387 (1.01)      3.6387 (1.01)     0.0000 (1.0)       3.6387 (1.01)     0.0000 (1.0)           0;0  0.2748 (0.99)          1           1
test_partial_add-push[main]        3.7422 (1.04)      3.7422 (1.04)      3.7422 (1.04)     0.0000 (1.0)       3.7422 (1.04)     0.0000 (1.0)           0;0  0.2672 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     81.9971 (4.02)     81.9971 (4.02)     81.9971 (4.02)     0.0000 (1.0)      81.9971 (4.02)     0.0000 (1.0)           0;0  0.0122 (0.25)          1           1
test_partial_add-push-partial[3.10.0]     40.1325 (1.97)     40.1325 (1.97)     40.1325 (1.97)     0.0000 (1.0)      40.1325 (1.97)     0.0000 (1.0)           0;0  0.0249 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     20.4188 (1.0)      20.4188 (1.0)      20.4188 (1.0)      0.0000 (1.0)      20.4188 (1.0)      0.0000 (1.0)           0;0  0.0490 (1.0)           1           1
test_partial_add-push-partial[3.60.1]     20.7573 (1.02)     20.7573 (1.02)     20.7573 (1.02)     0.0000 (1.0)      20.7573 (1.02)     0.0000 (1.0)           0;0  0.0482 (0.98)          1           1
test_partial_add-push-partial[main]       20.6879 (1.01)     20.6879 (1.01)     20.6879 (1.01)     0.0000 (1.0)      20.6879 (1.01)     0.0000 (1.0)           0;0  0.0483 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     61.2272 (4.39)     61.2272 (4.39)     61.2272 (4.39)     0.0000 (1.0)      61.2272 (4.39)     0.0000 (1.0)           0;0  0.0163 (0.23)          1           1
test_partial_remove-add[3.10.0]     61.4882 (4.41)     61.4882 (4.41)     61.4882 (4.41)     0.0000 (1.0)      61.4882 (4.41)     0.0000 (1.0)           0;0  0.0163 (0.23)          1           1
test_partial_remove-add[3.53.2]     54.0029 (3.87)     54.0029 (3.87)     54.0029 (3.87)     0.0000 (1.0)      54.0029 (3.87)     0.0000 (1.0)           0;0  0.0185 (0.26)          1           1
test_partial_remove-add[3.60.1]     13.9410 (1.0)      13.9410 (1.0)      13.9410 (1.0)      0.0000 (1.0)      13.9410 (1.0)      0.0000 (1.0)           0;0  0.0717 (1.0)           1           1
test_partial_remove-add[main]       15.0906 (1.08)     15.0906 (1.08)     15.0906 (1.08)     0.0000 (1.0)      15.0906 (1.08)     0.0000 (1.0)           0;0  0.0663 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     34.2873 (10.85)    34.2873 (10.85)    34.2873 (10.85)    0.0000 (1.0)      34.2873 (10.85)    0.0000 (1.0)           0;0  0.0292 (0.09)          1           1
test_partial_remove-add-update[3.10.0]     34.4945 (10.92)    34.4945 (10.92)    34.4945 (10.92)    0.0000 (1.0)      34.4945 (10.92)    0.0000 (1.0)           0;0  0.0290 (0.09)          1           1
test_partial_remove-add-update[3.53.2]     30.1171 (9.53)     30.1171 (9.53)     30.1171 (9.53)     0.0000 (1.0)      30.1171 (9.53)     0.0000 (1.0)           0;0  0.0332 (0.10)          1           1
test_partial_remove-add-update[3.60.1]      3.1592 (1.0)       3.1592 (1.0)       3.1592 (1.0)      0.0000 (1.0)       3.1592 (1.0)      0.0000 (1.0)           0;0  0.3165 (1.0)           1           1
test_partial_remove-add-update[main]        3.1948 (1.01)      3.1948 (1.01)      3.1948 (1.01)     0.0000 (1.0)       3.1948 (1.01)     0.0000 (1.0)           0;0  0.3130 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.3214 (1.0)      2.3214 (1.0)      2.3214 (1.0)      0.0000 (1.0)      2.3214 (1.0)      0.0000 (1.0)           0;0  0.4308 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.3328 (1.44)     3.3328 (1.44)     3.3328 (1.44)     0.0000 (1.0)      3.3328 (1.44)     0.0000 (1.0)           0;0  0.3000 (0.70)          1           1
test_partial_remove-gc[3.53.2]     3.4057 (1.47)     3.4057 (1.47)     3.4057 (1.47)     0.0000 (1.0)      3.4057 (1.47)     0.0000 (1.0)           0;0  0.2936 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.2969 (1.42)     3.2969 (1.42)     3.2969 (1.42)     0.0000 (1.0)      3.2969 (1.42)     0.0000 (1.0)           0;0  0.3033 (0.70)          1           1
test_partial_remove-gc[main]       2.5048 (1.08)     2.5048 (1.08)     2.5048 (1.08)     0.0000 (1.0)      2.5048 (1.08)     0.0000 (1.0)           0;0  0.3992 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.1863 (1.0)      4.1863 (1.0)      4.1863 (1.0)      0.0000 (1.0)      4.1863 (1.0)      0.0000 (1.0)           0;0  0.2389 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.6445 (1.35)     5.6445 (1.35)     5.6445 (1.35)     0.0000 (1.0)      5.6445 (1.35)     0.0000 (1.0)           0;0  0.1772 (0.74)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.4623 (1.54)     6.4623 (1.54)     6.4623 (1.54)     0.0000 (1.0)      6.4623 (1.54)     0.0000 (1.0)           0;0  0.1547 (0.65)          1           1
test_partial_remove-gc-cloud[3.60.1]     5.9764 (1.43)     5.9764 (1.43)     5.9764 (1.43)     0.0000 (1.0)      5.9764 (1.43)     0.0000 (1.0)           0;0  0.1673 (0.70)          1           1
test_partial_remove-gc-cloud[main]       5.2193 (1.25)     5.2193 (1.25)     5.2193 (1.25)     0.0000 (1.0)      5.2193 (1.25)     0.0000 (1.0)           0;0  0.1916 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     80.1789 (5.75)     80.1789 (5.75)     80.1789 (5.75)     0.0000 (1.0)      80.1789 (5.75)     0.0000 (1.0)           0;0  0.0125 (0.17)          1           1
test_partial_remove-push[3.10.0]     33.5352 (2.41)     33.5352 (2.41)     33.5352 (2.41)     0.0000 (1.0)      33.5352 (2.41)     0.0000 (1.0)           0;0  0.0298 (0.42)          1           1
test_partial_remove-push[3.53.2]     15.0602 (1.08)     15.0602 (1.08)     15.0602 (1.08)     0.0000 (1.0)      15.0602 (1.08)     0.0000 (1.0)           0;0  0.0664 (0.93)          1           1
test_partial_remove-push[3.60.1]     13.9338 (1.0)      13.9338 (1.0)      13.9338 (1.0)      0.0000 (1.0)      13.9338 (1.0)      0.0000 (1.0)           0;0  0.0718 (1.0)           1           1
test_partial_remove-push[main]       14.2208 (1.02)     14.2208 (1.02)     14.2208 (1.02)     0.0000 (1.0)      14.2208 (1.02)     0.0000 (1.0)           0;0  0.0703 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.3170 (1.0)      3.3170 (1.0)      3.3170 (1.0)      0.0000 (1.0)      3.3170 (1.0)      0.0000 (1.0)           0;0  0.3015 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.3593 (1.01)     3.3593 (1.01)     3.3593 (1.01)     0.0000 (1.0)      3.3593 (1.01)     0.0000 (1.0)           0;0  0.2977 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     6.0882 (1.84)     6.0882 (1.84)     6.0882 (1.84)     0.0000 (1.0)      6.0882 (1.84)     0.0000 (1.0)           0;0  0.1643 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     6.0949 (1.84)     6.0949 (1.84)     6.0949 (1.84)     0.0000 (1.0)      6.0949 (1.84)     0.0000 (1.0)           0;0  0.1641 (0.54)          1           1
test_partial_remove-push-update[main]       6.0451 (1.82)     6.0451 (1.82)     6.0451 (1.82)     0.0000 (1.0)      6.0451 (1.82)     0.0000 (1.0)           0;0  0.1654 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     557.3080 (1.0)        572.1326 (1.0)        564.0500 (1.0)       6.7012 (1.45)       562.5826 (1.0)      12.3673 (2.85)          2;0  1.7729 (1.0)           5           3
test_plots-plots-diff[3.10.0]     993.6202 (1.78)     1,028.6738 (1.80)     1,005.7840 (1.78)     13.7882 (2.98)     1,002.2648 (1.78)     16.2790 (3.76)          1;0  0.9942 (0.56)          5           3
test_plots-plots-diff[3.53.2]     969.6762 (1.74)       998.7083 (1.75)       982.9498 (1.74)     13.2121 (2.85)       978.5234 (1.74)     24.1037 (5.56)          2;0  1.0173 (0.57)          5           3
test_plots-plots-diff[3.60.1]     974.9381 (1.75)       987.4695 (1.73)       982.5338 (1.74)      4.6294 (1.0)        983.5631 (1.75)      4.3335 (1.0)           2;0  1.0178 (0.57)          5           3
test_plots-plots-diff[main]       988.7271 (1.77)     1,039.3656 (1.82)     1,008.8069 (1.79)     22.6825 (4.90)       994.6402 (1.77)     36.6936 (8.47)          1;0  0.9913 (0.56)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       567.2043 (1.0)        581.3736 (1.0)        573.3383 (1.0)       5.2709 (1.11)       572.8063 (1.0)       6.4887 (1.0)           2;0  1.7442 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,227.6723 (2.16)     1,264.3887 (2.17)     1,249.3818 (2.18)     16.3243 (3.43)     1,253.6309 (2.19)     28.9755 (4.47)          1;0  0.8004 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]     1,064.5775 (1.88)     1,132.0136 (1.95)     1,092.3663 (1.91)     25.3657 (5.34)     1,086.1247 (1.90)     30.8830 (4.76)          2;0  0.9154 (0.52)          5           3
test_plots-plots-diff-json[3.60.1]     1,054.6030 (1.86)     1,071.2648 (1.84)     1,062.4660 (1.85)      7.4347 (1.56)     1,059.5111 (1.85)     13.1080 (2.02)          2;0  0.9412 (0.54)          5           3
test_plots-plots-diff-json[main]       1,064.3698 (1.88)     1,075.7631 (1.85)     1,069.6422 (1.87)      4.7529 (1.0)      1,071.1226 (1.87)      7.6147 (1.17)          2;0  0.9349 (0.54)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     443.7590 (1.0)      459.8516 (1.0)      450.3112 (1.0)       5.9458 (1.29)     449.7694 (1.0)       6.1909 (1.0)           2;0  2.2207 (1.0)           5           3
test_plots-plots-show[3.10.0]     826.7251 (1.86)     856.6894 (1.86)     837.4414 (1.86)     12.2718 (2.67)     837.3616 (1.86)     17.0570 (2.76)          1;0  1.1941 (0.54)          5           3
test_plots-plots-show[3.53.2]     813.3853 (1.83)     834.2049 (1.81)     824.9961 (1.83)      9.1430 (1.99)     825.2111 (1.83)     16.4463 (2.66)          2;0  1.2121 (0.55)          5           3
test_plots-plots-show[3.60.1]     802.5363 (1.81)     814.2212 (1.77)     808.6205 (1.80)      4.6038 (1.0)      807.9201 (1.80)      7.0569 (1.14)          2;0  1.2367 (0.56)          5           3
test_plots-plots-show[main]       818.5514 (1.84)     838.5054 (1.82)     826.4496 (1.84)      7.7018 (1.67)     824.5645 (1.83)     10.1206 (1.63)          2;0  1.2100 (0.54)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     458.8524 (1.0)      462.2390 (1.0)      461.0462 (1.0)       1.4622 (1.0)      461.7452 (1.0)       2.2629 (1.0)           1;0  2.1690 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     942.1373 (2.05)     965.2771 (2.09)     951.9247 (2.06)     10.2927 (7.04)     950.8423 (2.06)     18.5757 (8.21)          1;0  1.0505 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     847.4231 (1.85)     865.9077 (1.87)     854.1266 (1.85)      8.0844 (5.53)     850.8153 (1.84)     13.1839 (5.83)          1;0  1.1708 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     850.3409 (1.85)     881.0648 (1.91)     861.9452 (1.87)     13.0493 (8.92)     854.7216 (1.85)     19.7137 (8.71)          1;0  1.1602 (0.53)          5           3
test_plots-plots-show-json[main]       869.8430 (1.90)     926.1404 (2.00)     894.5989 (1.94)     23.3513 (15.97)    897.5397 (1.94)     38.2020 (16.88)         2;0  1.1178 (0.52)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     101.1842 (4.51)     101.1842 (4.51)     101.1842 (4.51)     0.0000 (1.0)      101.1842 (4.51)     0.0000 (1.0)           0;0  0.0099 (0.22)          1           1
test_push-push[3.10.0]      48.7741 (2.17)      48.7741 (2.17)      48.7741 (2.17)     0.0000 (1.0)       48.7741 (2.17)     0.0000 (1.0)           0;0  0.0205 (0.46)          1           1
test_push-push[3.53.2]      23.3274 (1.04)      23.3274 (1.04)      23.3274 (1.04)     0.0000 (1.0)       23.3274 (1.04)     0.0000 (1.0)           0;0  0.0429 (0.96)          1           1
test_push-push[3.60.1]      22.4455 (1.0)       22.4455 (1.0)       22.4455 (1.0)      0.0000 (1.0)       22.4455 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_push-push[main]        22.6655 (1.01)      22.6655 (1.01)      22.6655 (1.01)     0.0000 (1.0)       22.6655 (1.01)     0.0000 (1.0)           0;0  0.0441 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     113.8622 (4.92)     113.8622 (4.92)     113.8622 (4.92)     0.0000 (1.0)      113.8622 (4.92)     0.0000 (1.0)           0;0  0.0088 (0.20)          1           1
test_sharing-fetch[3.10.0]     118.2730 (5.11)     118.2730 (5.11)     118.2730 (5.11)     0.0000 (1.0)      118.2730 (5.11)     0.0000 (1.0)           0;0  0.0085 (0.20)          1           1
test_sharing-fetch[3.53.2]      33.3654 (1.44)      33.3654 (1.44)      33.3654 (1.44)     0.0000 (1.0)       33.3654 (1.44)     0.0000 (1.0)           0;0  0.0300 (0.69)          1           1
test_sharing-fetch[3.60.1]      23.3437 (1.01)      23.3437 (1.01)      23.3437 (1.01)     0.0000 (1.0)       23.3437 (1.01)     0.0000 (1.0)           0;0  0.0428 (0.99)          1           1
test_sharing-fetch[main]        23.1393 (1.0)       23.1393 (1.0)       23.1393 (1.0)      0.0000 (1.0)       23.1393 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3476 (1.0)      1.3476 (1.0)      1.3476 (1.0)      0.0000 (1.0)      1.3476 (1.0)      0.0000 (1.0)           0;0  0.7421 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7868 (2.81)     3.7868 (2.81)     3.7868 (2.81)     0.0000 (1.0)      3.7868 (2.81)     0.0000 (1.0)           0;0  0.2641 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     5.9306 (4.40)     5.9306 (4.40)     5.9306 (4.40)     0.0000 (1.0)      5.9306 (4.40)     0.0000 (1.0)           0;0  0.1686 (0.23)          1           1
test_sharing-fetch-noop[3.60.1]     6.1041 (4.53)     6.1041 (4.53)     6.1041 (4.53)     0.0000 (1.0)      6.1041 (4.53)     0.0000 (1.0)           0;0  0.1638 (0.22)          1           1
test_sharing-fetch-noop[main]       6.0567 (4.49)     6.0567 (4.49)     6.0567 (4.49)     0.0000 (1.0)      6.0567 (4.49)     0.0000 (1.0)           0;0  0.1651 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     101.1960 (4.43)     101.1960 (4.43)     101.1960 (4.43)     0.0000 (1.0)      101.1960 (4.43)     0.0000 (1.0)           0;0  0.0099 (0.23)          1           1
test_sharing-push[3.10.0]      48.8939 (2.14)      48.8939 (2.14)      48.8939 (2.14)     0.0000 (1.0)       48.8939 (2.14)     0.0000 (1.0)           0;0  0.0205 (0.47)          1           1
test_sharing-push[3.53.2]      23.1092 (1.01)      23.1092 (1.01)      23.1092 (1.01)     0.0000 (1.0)       23.1092 (1.01)     0.0000 (1.0)           0;0  0.0433 (0.99)          1           1
test_sharing-push[3.60.1]      22.8217 (1.0)       22.8217 (1.0)       22.8217 (1.0)      0.0000 (1.0)       22.8217 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
test_sharing-push[main]        23.0308 (1.01)      23.0308 (1.01)      23.0308 (1.01)     0.0000 (1.0)       23.0308 (1.01)     0.0000 (1.0)           0;0  0.0434 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1279 (1.03)     2.1279 (1.03)     2.1279 (1.03)     0.0000 (1.0)      2.1279 (1.03)     0.0000 (1.0)           0;0  0.4699 (0.97)          1           1
test_sharing-push-noop[3.10.0]     2.0746 (1.0)      2.0746 (1.0)      2.0746 (1.0)      0.0000 (1.0)      2.0746 (1.0)      0.0000 (1.0)           0;0  0.4820 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.4761 (3.12)     6.4761 (3.12)     6.4761 (3.12)     0.0000 (1.0)      6.4761 (3.12)     0.0000 (1.0)           0;0  0.1544 (0.32)          1           1
test_sharing-push-noop[3.60.1]     6.1608 (2.97)     6.1608 (2.97)     6.1608 (2.97)     0.0000 (1.0)      6.1608 (2.97)     0.0000 (1.0)           0;0  0.1623 (0.34)          1           1
test_sharing-push-noop[main]       6.0533 (2.92)     6.0533 (2.92)     6.0533 (2.92)     0.0000 (1.0)      6.0533 (2.92)     0.0000 (1.0)           0;0  0.1652 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     165.6860 (1.08)     165.6860 (1.08)     165.6860 (1.08)     0.0000 (1.0)      165.6860 (1.08)     0.0000 (1.0)           0;0  0.0060 (0.93)          1           1
test_sharing_azure-fetch[main]       153.6431 (1.0)      153.6431 (1.0)      153.6431 (1.0)      0.0000 (1.0)      153.6431 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.6288 (1.02)     6.6288 (1.02)     6.6288 (1.02)     0.0000 (1.0)      6.6288 (1.02)     0.0000 (1.0)           0;0  0.1509 (0.98)          1           1
test_sharing_azure-fetch-noop[main]       6.4871 (1.0)      6.4871 (1.0)      6.4871 (1.0)      0.0000 (1.0)      6.4871 (1.0)      0.0000 (1.0)           0;0  0.1542 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     153.5806 (1.03)     153.5806 (1.03)     153.5806 (1.03)     0.0000 (1.0)      153.5806 (1.03)     0.0000 (1.0)           0;0  0.0065 (0.98)          1           1
test_sharing_azure-push[main]       149.7669 (1.0)      149.7669 (1.0)      149.7669 (1.0)      0.0000 (1.0)      149.7669 (1.0)      0.0000 (1.0)           0;0  0.0067 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6917 (1.0)      6.6917 (1.0)      6.6917 (1.0)      0.0000 (1.0)      6.6917 (1.0)      0.0000 (1.0)           0;0  0.1494 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.7487 (1.01)     6.7487 (1.01)     6.7487 (1.01)     0.0000 (1.0)      6.7487 (1.01)     0.0000 (1.0)           0;0  0.1482 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     460.4828 (1.02)     460.4828 (1.02)     460.4828 (1.02)     0.0000 (1.0)      460.4828 (1.02)     0.0000 (1.0)           0;0  0.0022 (0.98)          1           1
test_sharing_s3-fetch[main]       452.0705 (1.0)      452.0705 (1.0)      452.0705 (1.0)      0.0000 (1.0)      452.0705 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.4401 (1.0)      6.4401 (1.0)      6.4401 (1.0)      0.0000 (1.0)      6.4401 (1.0)      0.0000 (1.0)           0;0  0.1553 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.6370 (1.03)     6.6370 (1.03)     6.6370 (1.03)     0.0000 (1.0)      6.6370 (1.03)     0.0000 (1.0)           0;0  0.1507 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     538.2366 (1.0)      538.2366 (1.0)      538.2366 (1.0)      0.0000 (1.0)      538.2366 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
test_sharing_s3-push[main]       543.6262 (1.01)     543.6262 (1.01)     543.6262 (1.01)     0.0000 (1.0)      543.6262 (1.01)     0.0000 (1.0)           0;0  0.0018 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.7088 (1.0)      6.7088 (1.0)      6.7088 (1.0)      0.0000 (1.0)      6.7088 (1.0)      0.0000 (1.0)           0;0  0.1491 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.7815 (1.01)     6.7815 (1.01)     6.7815 (1.01)     0.0000 (1.0)      6.7815 (1.01)     0.0000 (1.0)           0;0  0.1475 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.8573 (3.61)     19.8573 (3.61)     19.8573 (3.61)     0.0000 (1.0)      19.8573 (3.61)     0.0000 (1.0)           0;0  0.0504 (0.28)          1           1
test_status-status[3.10.0]     20.3836 (3.70)     20.3836 (3.70)     20.3836 (3.70)     0.0000 (1.0)      20.3836 (3.70)     0.0000 (1.0)           0;0  0.0491 (0.27)          1           1
test_status-status[3.53.2]     18.7569 (3.41)     18.7569 (3.41)     18.7569 (3.41)     0.0000 (1.0)      18.7569 (3.41)     0.0000 (1.0)           0;0  0.0533 (0.29)          1           1
test_status-status[3.60.1]      5.5023 (1.0)       5.5023 (1.0)       5.5023 (1.0)      0.0000 (1.0)       5.5023 (1.0)      0.0000 (1.0)           0;0  0.1817 (1.0)           1           1
test_status-status[main]        5.5315 (1.01)      5.5315 (1.01)      5.5315 (1.01)     0.0000 (1.0)       5.5315 (1.01)     0.0000 (1.0)           0;0  0.1808 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9430 (1.86)     4.9430 (1.86)     4.9430 (1.86)     0.0000 (1.0)      4.9430 (1.86)     0.0000 (1.0)           0;0  0.2023 (0.54)          1           1
test_status-status-changed[3.10.0]     5.1680 (1.94)     5.1680 (1.94)     5.1680 (1.94)     0.0000 (1.0)      5.1680 (1.94)     0.0000 (1.0)           0;0  0.1935 (0.51)          1           1
test_status-status-changed[3.53.2]     5.0390 (1.90)     5.0390 (1.90)     5.0390 (1.90)     0.0000 (1.0)      5.0390 (1.90)     0.0000 (1.0)           0;0  0.1985 (0.53)          1           1
test_status-status-changed[3.60.1]     2.6589 (1.0)      2.6589 (1.0)      2.6589 (1.0)      0.0000 (1.0)      2.6589 (1.0)      0.0000 (1.0)           0;0  0.3761 (1.0)           1           1
test_status-status-changed[main]       2.8313 (1.06)     2.8313 (1.06)     2.8313 (1.06)     0.0000 (1.0)      2.8313 (1.06)     0.0000 (1.0)           0;0  0.3532 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8802 (1.90)     4.8802 (1.90)     4.8802 (1.90)     0.0000 (1.0)      4.8802 (1.90)     0.0000 (1.0)           0;0  0.2049 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     5.1944 (2.03)     5.1944 (2.03)     5.1944 (2.03)     0.0000 (1.0)      5.1944 (2.03)     0.0000 (1.0)           0;0  0.1925 (0.49)          1           1
test_status-status-changed-noop[3.53.2]     4.9723 (1.94)     4.9723 (1.94)     4.9723 (1.94)     0.0000 (1.0)      4.9723 (1.94)     0.0000 (1.0)           0;0  0.2011 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.5643 (1.0)      2.5643 (1.0)      2.5643 (1.0)      0.0000 (1.0)      2.5643 (1.0)      0.0000 (1.0)           0;0  0.3900 (1.0)           1           1
test_status-status-changed-noop[main]       2.7143 (1.06)     2.7143 (1.06)     2.7143 (1.06)     0.0000 (1.0)      2.7143 (1.06)     0.0000 (1.0)           0;0  0.3684 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0161 (1.96)     5.0161 (1.96)     5.0161 (1.96)     0.0000 (1.0)      5.0161 (1.96)     0.0000 (1.0)           0;0  0.1994 (0.51)          1           1
test_status-status-noop[3.10.0]     5.2450 (2.05)     5.2450 (2.05)     5.2450 (2.05)     0.0000 (1.0)      5.2450 (2.05)     0.0000 (1.0)           0;0  0.1907 (0.49)          1           1
test_status-status-noop[3.53.2]     5.0798 (1.99)     5.0798 (1.99)     5.0798 (1.99)     0.0000 (1.0)      5.0798 (1.99)     0.0000 (1.0)           0;0  0.1969 (0.50)          1           1
test_status-status-noop[3.60.1]     2.5572 (1.0)      2.5572 (1.0)      2.5572 (1.0)      0.0000 (1.0)      2.5572 (1.0)      0.0000 (1.0)           0;0  0.3910 (1.0)           1           1
test_status-status-noop[main]       2.7170 (1.06)     2.7170 (1.06)     2.7170 (1.06)     0.0000 (1.0)      2.7170 (1.06)     0.0000 (1.0)           0;0  0.3681 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     201.6342 (4.29)     201.6342 (4.29)     201.6342 (4.29)     0.0000 (1.0)      201.6342 (4.29)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.10.0]     205.6386 (4.37)     205.6386 (4.37)     205.6386 (4.37)     0.0000 (1.0)      205.6386 (4.37)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.53.2]     120.9190 (2.57)     120.9190 (2.57)     120.9190 (2.57)     0.0000 (1.0)      120.9190 (2.57)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_update-import-url[3.60.1]      47.0201 (1.0)       47.0201 (1.0)       47.0201 (1.0)      0.0000 (1.0)       47.0201 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_update-import-url[main]        48.6709 (1.04)      48.6709 (1.04)      48.6709 (1.04)     0.0000 (1.0)       48.6709 (1.04)     0.0000 (1.0)           0;0  0.0205 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     186.2733 (5.25)     186.2733 (5.25)     186.2733 (5.25)     0.0000 (1.0)      186.2733 (5.25)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.10.0]     188.6725 (5.32)     188.6725 (5.32)     188.6725 (5.32)     0.0000 (1.0)      188.6725 (5.32)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.53.2]     112.3505 (3.17)     112.3505 (3.17)     112.3505 (3.17)     0.0000 (1.0)      112.3505 (3.17)     0.0000 (1.0)           0;0  0.0089 (0.32)          1           1
test_update-update[3.60.1]      35.4540 (1.0)       35.4540 (1.0)       35.4540 (1.0)      0.0000 (1.0)       35.4540 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.4266 (1.03)      36.4266 (1.03)      36.4266 (1.03)     0.0000 (1.0)       36.4266 (1.03)     0.0000 (1.0)           0;0  0.0275 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.9895 (2.21)     16.9895 (2.21)     16.9895 (2.21)     0.0000 (1.0)      16.9895 (2.21)     0.0000 (1.0)           0;0  0.0589 (0.45)          1           1
test_update-update-noop[3.10.0]     17.7115 (2.30)     17.7115 (2.30)     17.7115 (2.30)     0.0000 (1.0)      17.7115 (2.30)     0.0000 (1.0)           0;0  0.0565 (0.43)          1           1
test_update-update-noop[3.53.2]     17.0073 (2.21)     17.0073 (2.21)     17.0073 (2.21)     0.0000 (1.0)      17.0073 (2.21)     0.0000 (1.0)           0;0  0.0588 (0.45)          1           1
test_update-update-noop[3.60.1]      7.6984 (1.0)       7.6984 (1.0)       7.6984 (1.0)      0.0000 (1.0)       7.6984 (1.0)      0.0000 (1.0)           0;0  0.1299 (1.0)           1           1
test_update-update-noop[main]        8.1716 (1.06)      8.1716 (1.06)      8.1716 (1.06)     0.0000 (1.0)       8.1716 (1.06)     0.0000 (1.0)           0;0  0.1224 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean