Mon Mar  2 00:58:35 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     55.3724 (3.91)     55.3724 (3.91)     55.3724 (3.91)     0.0000 (1.0)      55.3724 (3.91)     0.0000 (1.0)           0;0  0.0181 (0.26)          1           1
test_add_copy-add[3.10.0]     55.5812 (3.93)     55.5812 (3.93)     55.5812 (3.93)     0.0000 (1.0)      55.5812 (3.93)     0.0000 (1.0)           0;0  0.0180 (0.25)          1           1
test_add_copy-add[3.53.2]     49.0520 (3.47)     49.0520 (3.47)     49.0520 (3.47)     0.0000 (1.0)      49.0520 (3.47)     0.0000 (1.0)           0;0  0.0204 (0.29)          1           1
test_add_copy-add[3.60.1]     14.1496 (1.0)      14.1496 (1.0)      14.1496 (1.0)      0.0000 (1.0)      14.1496 (1.0)      0.0000 (1.0)           0;0  0.0707 (1.0)           1           1
test_add_copy-add[main]       15.4872 (1.09)     15.4872 (1.09)     15.4872 (1.09)     0.0000 (1.0)      15.4872 (1.09)     0.0000 (1.0)           0;0  0.0646 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     19.2643 (5.58)     19.2643 (5.58)     19.2643 (5.58)     0.0000 (1.0)      19.2643 (5.58)     0.0000 (1.0)           0;0  0.0519 (0.18)          1           1
test_add_copy-add-noop[3.10.0]     19.5639 (5.67)     19.5639 (5.67)     19.5639 (5.67)     0.0000 (1.0)      19.5639 (5.67)     0.0000 (1.0)           0;0  0.0511 (0.18)          1           1
test_add_copy-add-noop[3.53.2]     19.1364 (5.54)     19.1364 (5.54)     19.1364 (5.54)     0.0000 (1.0)      19.1364 (5.54)     0.0000 (1.0)           0;0  0.0523 (0.18)          1           1
test_add_copy-add-noop[3.60.1]      3.4521 (1.0)       3.4521 (1.0)       3.4521 (1.0)      0.0000 (1.0)       3.4521 (1.0)      0.0000 (1.0)           0;0  0.2897 (1.0)           1           1
test_add_copy-add-noop[main]        3.6741 (1.06)      3.6741 (1.06)      3.6741 (1.06)     0.0000 (1.0)       3.6741 (1.06)     0.0000 (1.0)           0;0  0.2722 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.2173 (3.98)     66.2173 (3.98)     66.2173 (3.98)     0.0000 (1.0)      66.2173 (3.98)     0.0000 (1.0)           0;0  0.0151 (0.25)          1           1
test_add_hardlink-add[3.10.0]     67.4809 (4.05)     67.4809 (4.05)     67.4809 (4.05)     0.0000 (1.0)      67.4809 (4.05)     0.0000 (1.0)           0;0  0.0148 (0.25)          1           1
test_add_hardlink-add[3.53.2]     61.7418 (3.71)     61.7418 (3.71)     61.7418 (3.71)     0.0000 (1.0)      61.7418 (3.71)     0.0000 (1.0)           0;0  0.0162 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.6499 (1.0)      16.6499 (1.0)      16.6499 (1.0)      0.0000 (1.0)      16.6499 (1.0)      0.0000 (1.0)           0;0  0.0601 (1.0)           1           1
test_add_hardlink-add[main]       18.0439 (1.08)     18.0439 (1.08)     18.0439 (1.08)     0.0000 (1.0)      18.0439 (1.08)     0.0000 (1.0)           0;0  0.0554 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.5970 (7.64)     33.5970 (7.64)     33.5970 (7.64)     0.0000 (1.0)      33.5970 (7.64)     0.0000 (1.0)           0;0  0.0298 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.9119 (7.71)     33.9119 (7.71)     33.9119 (7.71)     0.0000 (1.0)      33.9119 (7.71)     0.0000 (1.0)           0;0  0.0295 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.9110 (7.26)     31.9110 (7.26)     31.9110 (7.26)     0.0000 (1.0)      31.9110 (7.26)     0.0000 (1.0)           0;0  0.0313 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3958 (1.0)       4.3958 (1.0)       4.3958 (1.0)      0.0000 (1.0)       4.3958 (1.0)      0.0000 (1.0)           0;0  0.2275 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.6679 (1.06)      4.6679 (1.06)      4.6679 (1.06)     0.0000 (1.0)       4.6679 (1.06)     0.0000 (1.0)           0;0  0.2142 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     68.8329 (1.88)     68.8329 (1.88)     68.8329 (1.88)     0.0000 (1.0)      68.8329 (1.88)     0.0000 (1.0)           0;0  0.0145 (0.53)          1           1
test_add_symlink-add[3.10.0]     68.3562 (1.86)     68.3562 (1.86)     68.3562 (1.86)     0.0000 (1.0)      68.3562 (1.86)     0.0000 (1.0)           0;0  0.0146 (0.54)          1           1
test_add_symlink-add[3.53.2]     63.8012 (1.74)     63.8012 (1.74)     63.8012 (1.74)     0.0000 (1.0)      63.8012 (1.74)     0.0000 (1.0)           0;0  0.0157 (0.57)          1           1
test_add_symlink-add[3.60.1]     36.6704 (1.0)      36.6704 (1.0)      36.6704 (1.0)      0.0000 (1.0)      36.6704 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
test_add_symlink-add[main]       37.7778 (1.03)     37.7778 (1.03)     37.7778 (1.03)     0.0000 (1.0)      37.7778 (1.03)     0.0000 (1.0)           0;0  0.0265 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.1926 (8.29)     45.1926 (8.29)     45.1926 (8.29)     0.0000 (1.0)      45.1926 (8.29)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     44.9698 (8.25)     44.9698 (8.25)     44.9698 (8.25)     0.0000 (1.0)      44.9698 (8.25)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.3914 (8.15)     44.3914 (8.15)     44.3914 (8.15)     0.0000 (1.0)      44.3914 (8.15)     0.0000 (1.0)           0;0  0.0225 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5007 (1.01)      5.5007 (1.01)      5.5007 (1.01)     0.0000 (1.0)       5.5007 (1.01)     0.0000 (1.0)           0;0  0.1818 (0.99)          1           1
test_add_symlink-add-noop[main]        5.4492 (1.0)       5.4492 (1.0)       5.4492 (1.0)      0.0000 (1.0)       5.4492 (1.0)      0.0000 (1.0)           0;0  0.1835 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.6780 (1.89)      40.6780 (1.89)      40.6780 (1.89)     0.0000 (1.0)       40.6780 (1.89)     0.0000 (1.0)           0;0  0.0246 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     111.6122 (5.18)     111.6122 (5.18)     111.6122 (5.18)     0.0000 (1.0)      111.6122 (5.18)     0.0000 (1.0)           0;0  0.0090 (0.19)          1           1
test_checkout_copy-checkout[3.53.2]      28.4098 (1.32)      28.4098 (1.32)      28.4098 (1.32)     0.0000 (1.0)       28.4098 (1.32)     0.0000 (1.0)           0;0  0.0352 (0.76)          1           1
test_checkout_copy-checkout[3.60.1]      21.5316 (1.0)       21.5316 (1.0)       21.5316 (1.0)      0.0000 (1.0)       21.5316 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_checkout_copy-checkout[main]        22.8047 (1.06)      22.8047 (1.06)      22.8047 (1.06)     0.0000 (1.0)       22.8047 (1.06)     0.0000 (1.0)           0;0  0.0439 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6133 (1.72)     5.6133 (1.72)     5.6133 (1.72)     0.0000 (1.0)      5.6133 (1.72)     0.0000 (1.0)           0;0  0.1781 (0.58)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8581 (1.80)     5.8581 (1.80)     5.8581 (1.80)     0.0000 (1.0)      5.8581 (1.80)     0.0000 (1.0)           0;0  0.1707 (0.56)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6762 (1.74)     5.6762 (1.74)     5.6762 (1.74)     0.0000 (1.0)      5.6762 (1.74)     0.0000 (1.0)           0;0  0.1762 (0.57)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2557 (1.0)      3.2557 (1.0)      3.2557 (1.0)      0.0000 (1.0)      3.2557 (1.0)      0.0000 (1.0)           0;0  0.3071 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5521 (1.09)     3.5521 (1.09)     3.5521 (1.09)     0.0000 (1.0)      3.5521 (1.09)     0.0000 (1.0)           0;0  0.2815 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.7230 (2.02)     7.7230 (2.02)     7.7230 (2.02)     0.0000 (1.0)      7.7230 (2.02)     0.0000 (1.0)           0;0  0.1295 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5672 (1.72)     6.5672 (1.72)     6.5672 (1.72)     0.0000 (1.0)      6.5672 (1.72)     0.0000 (1.0)           0;0  0.1523 (0.58)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4433 (1.69)     6.4433 (1.69)     6.4433 (1.69)     0.0000 (1.0)      6.4433 (1.69)     0.0000 (1.0)           0;0  0.1552 (0.59)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8207 (1.0)      3.8207 (1.0)      3.8207 (1.0)      0.0000 (1.0)      3.8207 (1.0)      0.0000 (1.0)           0;0  0.2617 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3004 (1.13)     4.3004 (1.13)     4.3004 (1.13)     0.0000 (1.0)      4.3004 (1.13)     0.0000 (1.0)           0;0  0.2325 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.2440 (2.78)     21.2440 (2.78)     21.2440 (2.78)     0.0000 (1.0)      21.2440 (2.78)     0.0000 (1.0)           0;0  0.0471 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.1864 (2.11)     16.1864 (2.11)     16.1864 (2.11)     0.0000 (1.0)      16.1864 (2.11)     0.0000 (1.0)           0;0  0.0618 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.8703 (1.94)     14.8703 (1.94)     14.8703 (1.94)     0.0000 (1.0)      14.8703 (1.94)     0.0000 (1.0)           0;0  0.0672 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6555 (1.0)       7.6555 (1.0)       7.6555 (1.0)      0.0000 (1.0)       7.6555 (1.0)      0.0000 (1.0)           0;0  0.1306 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1046 (1.06)      8.1046 (1.06)      8.1046 (1.06)     0.0000 (1.0)       8.1046 (1.06)     0.0000 (1.0)           0;0  0.1234 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6618 (1.76)     5.6618 (1.76)     5.6618 (1.76)     0.0000 (1.0)      5.6618 (1.76)     0.0000 (1.0)           0;0  0.1766 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7159 (1.78)     5.7159 (1.78)     5.7159 (1.78)     0.0000 (1.0)      5.7159 (1.78)     0.0000 (1.0)           0;0  0.1749 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7321 (1.79)     5.7321 (1.79)     5.7321 (1.79)     0.0000 (1.0)      5.7321 (1.79)     0.0000 (1.0)           0;0  0.1745 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2105 (1.0)      3.2105 (1.0)      3.2105 (1.0)      0.0000 (1.0)      3.2105 (1.0)      0.0000 (1.0)           0;0  0.3115 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3604 (1.05)     3.3604 (1.05)     3.3604 (1.05)     0.0000 (1.0)      3.3604 (1.05)     0.0000 (1.0)           0;0  0.2976 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.8113 (2.03)     7.8113 (2.03)     7.8113 (2.03)     0.0000 (1.0)      7.8113 (2.03)     0.0000 (1.0)           0;0  0.1280 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4598 (1.68)     6.4598 (1.68)     6.4598 (1.68)     0.0000 (1.0)      6.4598 (1.68)     0.0000 (1.0)           0;0  0.1548 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4895 (1.69)     6.4895 (1.69)     6.4895 (1.69)     0.0000 (1.0)      6.4895 (1.69)     0.0000 (1.0)           0;0  0.1541 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8441 (1.0)      3.8441 (1.0)      3.8441 (1.0)      0.0000 (1.0)      3.8441 (1.0)      0.0000 (1.0)           0;0  0.2601 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3334 (1.13)     4.3334 (1.13)     4.3334 (1.13)     0.0000 (1.0)      4.3334 (1.13)     0.0000 (1.0)           0;0  0.2308 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.0307 (2.51)     26.0307 (2.51)     26.0307 (2.51)     0.0000 (1.0)      26.0307 (2.51)     0.0000 (1.0)           0;0  0.0384 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     20.3318 (1.96)     20.3318 (1.96)     20.3318 (1.96)     0.0000 (1.0)      20.3318 (1.96)     0.0000 (1.0)           0;0  0.0492 (0.51)          1           1
test_checkout_symlink-checkout[3.53.2]     18.5792 (1.79)     18.5792 (1.79)     18.5792 (1.79)     0.0000 (1.0)      18.5792 (1.79)     0.0000 (1.0)           0;0  0.0538 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]     10.3634 (1.0)      10.3634 (1.0)      10.3634 (1.0)      0.0000 (1.0)      10.3634 (1.0)      0.0000 (1.0)           0;0  0.0965 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.3581 (1.10)     11.3581 (1.10)     11.3581 (1.10)     0.0000 (1.0)      11.3581 (1.10)     0.0000 (1.0)           0;0  0.0880 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.0867 (1.61)     7.0867 (1.61)     7.0867 (1.61)     0.0000 (1.0)      7.0867 (1.61)     0.0000 (1.0)           0;0  0.1411 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2955 (1.66)     7.2955 (1.66)     7.2955 (1.66)     0.0000 (1.0)      7.2955 (1.66)     0.0000 (1.0)           0;0  0.1371 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.0552 (1.61)     7.0552 (1.61)     7.0552 (1.61)     0.0000 (1.0)      7.0552 (1.61)     0.0000 (1.0)           0;0  0.1417 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3957 (1.0)      4.3957 (1.0)      4.3957 (1.0)      0.0000 (1.0)      4.3957 (1.0)      0.0000 (1.0)           0;0  0.2275 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.8029 (1.09)     4.8029 (1.09)     4.8029 (1.09)     0.0000 (1.0)      4.8029 (1.09)     0.0000 (1.0)           0;0  0.2082 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.2927 (1.70)     10.2927 (1.70)     10.2927 (1.70)     0.0000 (1.0)      10.2927 (1.70)     0.0000 (1.0)           0;0  0.0972 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.1009 (1.51)      9.1009 (1.51)      9.1009 (1.51)     0.0000 (1.0)       9.1009 (1.51)     0.0000 (1.0)           0;0  0.1099 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]      9.0225 (1.49)      9.0225 (1.49)      9.0225 (1.49)     0.0000 (1.0)       9.0225 (1.49)     0.0000 (1.0)           0;0  0.1108 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]      6.0427 (1.0)       6.0427 (1.0)       6.0427 (1.0)      0.0000 (1.0)       6.0427 (1.0)      0.0000 (1.0)           0;0  0.1655 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.4483 (1.07)      6.4483 (1.07)      6.4483 (1.07)     0.0000 (1.0)       6.4483 (1.07)     0.0000 (1.0)           0;0  0.1551 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2532 (1.85)     4.2532 (1.85)     4.2532 (1.85)     0.0000 (1.0)      4.2532 (1.85)     0.0000 (1.0)           0;0  0.2351 (0.54)          1           1
test_data_status-data-changed[3.10.0]     5.0841 (2.21)     5.0841 (2.21)     5.0841 (2.21)     0.0000 (1.0)      5.0841 (2.21)     0.0000 (1.0)           0;0  0.1967 (0.45)          1           1
test_data_status-data-changed[3.53.2]     4.7326 (2.06)     4.7326 (2.06)     4.7326 (2.06)     0.0000 (1.0)      4.7326 (2.06)     0.0000 (1.0)           0;0  0.2113 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.3021 (1.0)      2.3021 (1.0)      2.3021 (1.0)      0.0000 (1.0)      2.3021 (1.0)      0.0000 (1.0)           0;0  0.4344 (1.0)           1           1
test_data_status-data-changed[main]       2.6756 (1.16)     2.6756 (1.16)     2.6756 (1.16)     0.0000 (1.0)      2.6756 (1.16)     0.0000 (1.0)           0;0  0.3738 (0.86)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1222 (1.79)     4.1222 (1.79)     4.1222 (1.79)     0.0000 (1.0)      4.1222 (1.79)     0.0000 (1.0)           0;0  0.2426 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9308 (2.14)     4.9308 (2.14)     4.9308 (2.14)     0.0000 (1.0)      4.9308 (2.14)     0.0000 (1.0)           0;0  0.2028 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8456 (2.10)     4.8456 (2.10)     4.8456 (2.10)     0.0000 (1.0)      4.8456 (2.10)     0.0000 (1.0)           0;0  0.2064 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3086 (1.0)      2.3086 (1.0)      2.3086 (1.0)      0.0000 (1.0)      2.3086 (1.0)      0.0000 (1.0)           0;0  0.4332 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5381 (1.10)     2.5381 (1.10)     2.5381 (1.10)     0.0000 (1.0)      2.5381 (1.10)     0.0000 (1.0)           0;0  0.3940 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.8224 (3.76)     18.8224 (3.76)     18.8224 (3.76)     0.0000 (1.0)      18.8224 (3.76)     0.0000 (1.0)           0;0  0.0531 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.7158 (3.94)     19.7158 (3.94)     19.7158 (3.94)     0.0000 (1.0)      19.7158 (3.94)     0.0000 (1.0)           0;0  0.0507 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.1498 (3.83)     19.1498 (3.83)     19.1498 (3.83)     0.0000 (1.0)      19.1498 (3.83)     0.0000 (1.0)           0;0  0.0522 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.0013 (1.0)       5.0013 (1.0)       5.0013 (1.0)      0.0000 (1.0)       5.0013 (1.0)      0.0000 (1.0)           0;0  0.1999 (1.0)           1           1
test_data_status-data-new[main]        5.4001 (1.08)      5.4001 (1.08)      5.4001 (1.08)     0.0000 (1.0)       5.4001 (1.08)     0.0000 (1.0)           0;0  0.1852 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1061 (1.79)     4.1061 (1.79)     4.1061 (1.79)     0.0000 (1.0)      4.1061 (1.79)     0.0000 (1.0)           0;0  0.2435 (0.56)          1           1
test_data_status-data-noop[3.10.0]     5.0644 (2.20)     5.0644 (2.20)     5.0644 (2.20)     0.0000 (1.0)      5.0644 (2.20)     0.0000 (1.0)           0;0  0.1975 (0.45)          1           1
test_data_status-data-noop[3.53.2]     5.0265 (2.19)     5.0265 (2.19)     5.0265 (2.19)     0.0000 (1.0)      5.0265 (2.19)     0.0000 (1.0)           0;0  0.1989 (0.46)          1           1
test_data_status-data-noop[3.60.1]     2.2994 (1.0)      2.2994 (1.0)      2.2994 (1.0)      0.0000 (1.0)      2.2994 (1.0)      0.0000 (1.0)           0;0  0.4349 (1.0)           1           1
test_data_status-data-noop[main]       2.5396 (1.10)     2.5396 (1.10)     2.5396 (1.10)     0.0000 (1.0)      2.5396 (1.10)     0.0000 (1.0)           0;0  0.3938 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.8322 (1.30)     6.8322 (1.30)     6.8322 (1.30)     0.0000 (1.0)      6.8322 (1.30)     0.0000 (1.0)           0;0  0.1464 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8243 (1.49)     7.8243 (1.49)     7.8243 (1.49)     0.0000 (1.0)      7.8243 (1.49)     0.0000 (1.0)           0;0  0.1278 (0.67)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5405 (1.43)     7.5405 (1.43)     7.5405 (1.43)     0.0000 (1.0)      7.5405 (1.43)     0.0000 (1.0)           0;0  0.1326 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.2618 (1.0)      5.2618 (1.0)      5.2618 (1.0)      0.0000 (1.0)      5.2618 (1.0)      0.0000 (1.0)           0;0  0.1900 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5542 (1.06)     5.5542 (1.06)     5.5542 (1.06)     0.0000 (1.0)      5.5542 (1.06)     0.0000 (1.0)           0;0  0.1800 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.8859 (1.27)     6.8859 (1.27)     6.8859 (1.27)     0.0000 (1.0)      6.8859 (1.27)     0.0000 (1.0)           0;0  0.1452 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6337 (1.41)     7.6337 (1.41)     7.6337 (1.41)     0.0000 (1.0)      7.6337 (1.41)     0.0000 (1.0)           0;0  0.1310 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6403 (1.41)     7.6403 (1.41)     7.6403 (1.41)     0.0000 (1.0)      7.6403 (1.41)     0.0000 (1.0)           0;0  0.1309 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.4189 (1.0)      5.4189 (1.0)      5.4189 (1.0)      0.0000 (1.0)      5.4189 (1.0)      0.0000 (1.0)           0;0  0.1845 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.7539 (1.06)     5.7539 (1.06)     5.7539 (1.06)     0.0000 (1.0)      5.7539 (1.06)     0.0000 (1.0)           0;0  0.1738 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.2132 (2.68)     21.2132 (2.68)     21.2132 (2.68)     0.0000 (1.0)      21.2132 (2.68)     0.0000 (1.0)           0;0  0.0471 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.7419 (2.87)     22.7419 (2.87)     22.7419 (2.87)     0.0000 (1.0)      22.7419 (2.87)     0.0000 (1.0)           0;0  0.0440 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.2070 (2.81)     22.2070 (2.81)     22.2070 (2.81)     0.0000 (1.0)      22.2070 (2.81)     0.0000 (1.0)           0;0  0.0450 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9157 (1.0)       7.9157 (1.0)       7.9157 (1.0)      0.0000 (1.0)       7.9157 (1.0)      0.0000 (1.0)           0;0  0.1263 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6495 (1.09)      8.6495 (1.09)      8.6495 (1.09)     0.0000 (1.0)       8.6495 (1.09)     0.0000 (1.0)           0;0  0.1156 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4035 (1.40)     6.4035 (1.40)     6.4035 (1.40)     0.0000 (1.0)      6.4035 (1.40)     0.0000 (1.0)           0;0  0.1562 (0.71)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2265 (1.58)     7.2265 (1.58)     7.2265 (1.58)     0.0000 (1.0)      7.2265 (1.58)     0.0000 (1.0)           0;0  0.1384 (0.63)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1186 (1.56)     7.1186 (1.56)     7.1186 (1.56)     0.0000 (1.0)      7.1186 (1.56)     0.0000 (1.0)           0;0  0.1405 (0.64)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5735 (1.0)      4.5735 (1.0)      4.5735 (1.0)      0.0000 (1.0)      4.5735 (1.0)      0.0000 (1.0)           0;0  0.2186 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0076 (1.09)     5.0076 (1.09)     5.0076 (1.09)     0.0000 (1.0)      5.0076 (1.09)     0.0000 (1.0)           0;0  0.1997 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.7493 (2.68)     18.7493 (2.68)     18.7493 (2.68)     0.0000 (1.0)      18.7493 (2.68)     0.0000 (1.0)           0;0  0.0533 (0.37)          1           1
test_diff-diff[3.10.0]     20.0373 (2.87)     20.0373 (2.87)     20.0373 (2.87)     0.0000 (1.0)      20.0373 (2.87)     0.0000 (1.0)           0;0  0.0499 (0.35)          1           1
test_diff-diff[3.53.2]     19.7742 (2.83)     19.7742 (2.83)     19.7742 (2.83)     0.0000 (1.0)      19.7742 (2.83)     0.0000 (1.0)           0;0  0.0506 (0.35)          1           1
test_diff-diff[3.60.1]      6.9865 (1.0)       6.9865 (1.0)       6.9865 (1.0)      0.0000 (1.0)       6.9865 (1.0)      0.0000 (1.0)           0;0  0.1431 (1.0)           1           1
test_diff-diff[main]        7.8206 (1.12)      7.8206 (1.12)      7.8206 (1.12)     0.0000 (1.0)       7.8206 (1.12)     0.0000 (1.0)           0;0  0.1279 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9703 (1.78)     5.9703 (1.78)     5.9703 (1.78)     0.0000 (1.0)      5.9703 (1.78)     0.0000 (1.0)           0;0  0.1675 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.7495 (2.01)     6.7495 (2.01)     6.7495 (2.01)     0.0000 (1.0)      6.7495 (2.01)     0.0000 (1.0)           0;0  0.1482 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.7765 (1.72)     5.7765 (1.72)     5.7765 (1.72)     0.0000 (1.0)      5.7765 (1.72)     0.0000 (1.0)           0;0  0.1731 (0.58)          1           1
test_diff-diff-changed[3.60.1]     3.3540 (1.0)      3.3540 (1.0)      3.3540 (1.0)      0.0000 (1.0)      3.3540 (1.0)      0.0000 (1.0)           0;0  0.2981 (1.0)           1           1
test_diff-diff-changed[main]       4.0942 (1.22)     4.0942 (1.22)     4.0942 (1.22)     0.0000 (1.0)      4.0942 (1.22)     0.0000 (1.0)           0;0  0.2443 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2902 (1.59)     5.2902 (1.59)     5.2902 (1.59)     0.0000 (1.0)      5.2902 (1.59)     0.0000 (1.0)           0;0  0.1890 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7362 (1.72)     5.7362 (1.72)     5.7362 (1.72)     0.0000 (1.0)      5.7362 (1.72)     0.0000 (1.0)           0;0  0.1743 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5583 (1.67)     5.5583 (1.67)     5.5583 (1.67)     0.0000 (1.0)      5.5583 (1.67)     0.0000 (1.0)           0;0  0.1799 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3278 (1.0)      3.3278 (1.0)      3.3278 (1.0)      0.0000 (1.0)      3.3278 (1.0)      0.0000 (1.0)           0;0  0.3005 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0788 (1.23)     4.0788 (1.23)     4.0788 (1.23)     0.0000 (1.0)      4.0788 (1.23)     0.0000 (1.0)           0;0  0.2452 (0.82)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2758 (1.28)     4.2758 (1.28)     4.2758 (1.28)     0.0000 (1.0)      4.2758 (1.28)     0.0000 (1.0)           0;0  0.2339 (0.78)          1           1
test_diff-diff-noop[3.10.0]     5.0639 (1.52)     5.0639 (1.52)     5.0639 (1.52)     0.0000 (1.0)      5.0639 (1.52)     0.0000 (1.0)           0;0  0.1975 (0.66)          1           1
test_diff-diff-noop[3.53.2]     5.5397 (1.66)     5.5397 (1.66)     5.5397 (1.66)     0.0000 (1.0)      5.5397 (1.66)     0.0000 (1.0)           0;0  0.1805 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3367 (1.0)      3.3367 (1.0)      3.3367 (1.0)      0.0000 (1.0)      3.3367 (1.0)      0.0000 (1.0)           0;0  0.2997 (1.0)           1           1
test_diff-diff-noop[main]       4.2654 (1.28)     4.2654 (1.28)     4.2654 (1.28)     0.0000 (1.0)      4.2654 (1.28)     0.0000 (1.0)           0;0  0.2344 (0.78)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.1490 (1.0)       1.1490 (1.0)       1.1490 (1.0)      0.0000 (1.0)       1.1490 (1.0)      0.0000 (1.0)           0;0  0.8703 (1.0)           1           1
test_exp_show-exp[3.10.0]     11.3489 (9.88)     11.3489 (9.88)     11.3489 (9.88)     0.0000 (1.0)      11.3489 (9.88)     0.0000 (1.0)           0;0  0.0881 (0.10)          1           1
test_exp_show-exp[3.53.2]      6.4456 (5.61)      6.4456 (5.61)      6.4456 (5.61)     0.0000 (1.0)       6.4456 (5.61)     0.0000 (1.0)           0;0  0.1551 (0.18)          1           1
test_exp_show-exp[3.60.1]      6.5047 (5.66)      6.5047 (5.66)      6.5047 (5.66)     0.0000 (1.0)       6.5047 (5.66)     0.0000 (1.0)           0;0  0.1537 (0.18)          1           1
test_exp_show-exp[main]        9.5897 (8.35)      9.5897 (8.35)      9.5897 (8.35)     0.0000 (1.0)       9.5897 (8.35)     0.0000 (1.0)           0;0  0.1043 (0.12)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     112.8095 (4.68)     112.8095 (4.68)     112.8095 (4.68)     0.0000 (1.0)      112.8095 (4.68)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_fetch-fetch[3.10.0]     118.5257 (4.91)     118.5257 (4.91)     118.5257 (4.91)     0.0000 (1.0)      118.5257 (4.91)     0.0000 (1.0)           0;0  0.0084 (0.20)          1           1
test_fetch-fetch[3.53.2]      36.1523 (1.50)      36.1523 (1.50)      36.1523 (1.50)     0.0000 (1.0)       36.1523 (1.50)     0.0000 (1.0)           0;0  0.0277 (0.67)          1           1
test_fetch-fetch[3.60.1]      24.1222 (1.0)       24.1222 (1.0)       24.1222 (1.0)      0.0000 (1.0)       24.1222 (1.0)      0.0000 (1.0)           0;0  0.0415 (1.0)           1           1
test_fetch-fetch[main]        24.3608 (1.01)      24.3608 (1.01)      24.3608 (1.01)     0.0000 (1.0)       24.3608 (1.01)     0.0000 (1.0)           0;0  0.0410 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9198 (1.01)     2.9198 (1.01)     2.9198 (1.01)     0.0000 (1.0)      2.9198 (1.01)     0.0000 (1.0)           0;0  0.3425 (0.99)          1           1
test_gc-gc[3.10.0]     3.1631 (1.09)     3.1631 (1.09)     3.1631 (1.09)     0.0000 (1.0)      3.1631 (1.09)     0.0000 (1.0)           0;0  0.3161 (0.91)          1           1
test_gc-gc[3.53.2]     2.8936 (1.0)      2.8936 (1.0)      2.8936 (1.0)      0.0000 (1.0)      2.8936 (1.0)      0.0000 (1.0)           0;0  0.3456 (1.0)           1           1
test_gc-gc[3.60.1]     2.9652 (1.02)     2.9652 (1.02)     2.9652 (1.02)     0.0000 (1.0)      2.9652 (1.02)     0.0000 (1.0)           0;0  0.3372 (0.98)          1           1
test_gc-gc[main]       3.1634 (1.09)     3.1634 (1.09)     3.1634 (1.09)     0.0000 (1.0)      3.1634 (1.09)     0.0000 (1.0)           0;0  0.3161 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     184.8567 (3.36)     184.8567 (3.36)     184.8567 (3.36)     0.0000 (1.0)      184.8567 (3.36)     0.0000 (1.0)           0;0  0.0054 (0.30)          1           1
test_get-get[3.10.0]     219.9792 (4.00)     219.9792 (4.00)     219.9792 (4.00)     0.0000 (1.0)      219.9792 (4.00)     0.0000 (1.0)           0;0  0.0045 (0.25)          1           1
test_get-get[3.53.2]     167.1602 (3.04)     167.1602 (3.04)     167.1602 (3.04)     0.0000 (1.0)      167.1602 (3.04)     0.0000 (1.0)           0;0  0.0060 (0.33)          1           1
test_get-get[3.60.1]      55.0210 (1.00)      55.0210 (1.00)      55.0210 (1.00)     0.0000 (1.0)       55.0210 (1.00)     0.0000 (1.0)           0;0  0.0182 (1.00)          1           1
test_get-get[main]        54.9377 (1.0)       54.9377 (1.0)       54.9377 (1.0)      0.0000 (1.0)       54.9377 (1.0)      0.0000 (1.0)           0;0  0.0182 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     93.9730 (5.46)     93.9730 (5.46)     93.9730 (5.46)     0.0000 (1.0)      93.9730 (5.46)     0.0000 (1.0)           0;0  0.0106 (0.18)          1           1
test_get_url-get-url[3.10.0]     97.4273 (5.66)     97.4273 (5.66)     97.4273 (5.66)     0.0000 (1.0)      97.4273 (5.66)     0.0000 (1.0)           0;0  0.0103 (0.18)          1           1
test_get_url-get-url[3.53.2]     17.2204 (1.0)      17.2204 (1.0)      17.2204 (1.0)      0.0000 (1.0)      17.2204 (1.0)      0.0000 (1.0)           0;0  0.0581 (1.0)           1           1
test_get_url-get-url[3.60.1]     17.4660 (1.01)     17.4660 (1.01)     17.4660 (1.01)     0.0000 (1.0)      17.4660 (1.01)     0.0000 (1.0)           0;0  0.0573 (0.99)          1           1
test_get_url-get-url[main]       17.2754 (1.00)     17.2754 (1.00)     17.2754 (1.00)     0.0000 (1.0)      17.2754 (1.00)     0.0000 (1.0)           0;0  0.0579 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     154.0462 (1.04)     163.7120 (1.01)     157.6013 (1.03)     1.7835 (1.0)      157.3713 (1.03)     2.5324 (1.03)         31;1  6.3451 (0.97)        100           1
test_help---help[3.10.0]     151.4596 (1.02)     169.6047 (1.05)     156.5256 (1.03)     2.6154 (1.47)     155.9006 (1.02)     2.4839 (1.01)         25;5  6.3887 (0.97)        100           1
test_help---help[3.53.2]     154.2649 (1.04)     175.9451 (1.09)     159.3568 (1.05)     2.5972 (1.46)     159.1296 (1.05)     2.6915 (1.10)         16;2  6.2752 (0.96)        100           1
test_help---help[3.60.1]     155.9599 (1.05)     214.4625 (1.33)     161.6607 (1.06)     8.0264 (4.50)     159.8572 (1.05)     3.1673 (1.29)          4;6  6.1858 (0.94)        100           1
test_help---help[main]       148.2821 (1.0)      161.5949 (1.0)      152.4560 (1.0)      2.2977 (1.29)     152.1710 (1.0)      2.4555 (1.0)          26;3  6.5593 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     276.3052 (3.31)     276.3052 (3.31)     276.3052 (3.31)     0.0000 (1.0)      276.3052 (3.31)     0.0000 (1.0)           0;0  0.0036 (0.30)          1           1
test_import-import[3.10.0]     314.0684 (3.77)     314.0684 (3.77)     314.0684 (3.77)     0.0000 (1.0)      314.0684 (3.77)     0.0000 (1.0)           0;0  0.0032 (0.27)          1           1
test_import-import[3.60.1]      83.3614 (1.0)       83.3614 (1.0)       83.3614 (1.0)      0.0000 (1.0)       83.3614 (1.0)      0.0000 (1.0)           0;0  0.0120 (1.0)           1           1
test_import-import[main]        83.9314 (1.01)      83.9314 (1.01)      83.9314 (1.01)     0.0000 (1.0)       83.9314 (1.01)     0.0000 (1.0)           0;0  0.0119 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     201.7034 (4.29)     201.7034 (4.29)     201.7034 (4.29)     0.0000 (1.0)      201.7034 (4.29)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_import_url-import-url[3.10.0]     204.7587 (4.35)     204.7587 (4.35)     204.7587 (4.35)     0.0000 (1.0)      204.7587 (4.35)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.53.2]     118.6727 (2.52)     118.6727 (2.52)     118.6727 (2.52)     0.0000 (1.0)      118.6727 (2.52)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_import_url-import-url[3.60.1]      47.0528 (1.0)       47.0528 (1.0)       47.0528 (1.0)      0.0000 (1.0)       47.0528 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_import_url-import-url[main]        48.6708 (1.03)      48.6708 (1.03)      48.6708 (1.03)     0.0000 (1.0)       48.6708 (1.03)     0.0000 (1.0)           0;0  0.0205 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     409.1510 (1.03)     440.0860 (1.05)     416.1013 (1.03)     6.0401 (1.58)     414.4723 (1.03)     7.8832 (2.19)         24;3  2.4033 (0.97)        100           1
test_init-init[3.10.0]     416.9133 (1.05)     445.4779 (1.06)     424.9215 (1.05)     5.6482 (1.47)     423.5010 (1.05)     5.5230 (1.53)         17;8  2.3534 (0.95)        100           1
test_init-init[3.53.2]     396.6704 (1.0)      421.1486 (1.00)     403.2713 (1.0)      5.0718 (1.32)     402.0698 (1.0)      4.3826 (1.22)         19;8  2.4797 (1.0)         100           1
test_init-init[3.60.1]     400.4352 (1.01)     420.2931 (1.0)      405.5955 (1.01)     3.8322 (1.0)      404.7741 (1.01)     3.5992 (1.0)          17;9  2.4655 (0.99)        100           1
test_init-init[main]       441.1963 (1.11)     473.1143 (1.13)     448.7856 (1.11)     5.9397 (1.55)     447.2355 (1.11)     5.5739 (1.55)         22;9  2.2282 (0.90)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     613.5154 (1.01)     613.5154 (1.01)     613.5154 (1.01)     0.0000 (1.0)      613.5154 (1.01)     0.0000 (1.0)           0;0  1.6300 (0.99)          1           1
test_list-list[3.10.0]     915.2796 (1.51)     915.2796 (1.51)     915.2796 (1.51)     0.0000 (1.0)      915.2796 (1.51)     0.0000 (1.0)           0;0  1.0926 (0.66)          1           1
test_list-list[3.53.2]     613.4550 (1.01)     613.4550 (1.01)     613.4550 (1.01)     0.0000 (1.0)      613.4550 (1.01)     0.0000 (1.0)           0;0  1.6301 (0.99)          1           1
test_list-list[3.60.1]     638.5085 (1.05)     638.5085 (1.05)     638.5085 (1.05)     0.0000 (1.0)      638.5085 (1.05)     0.0000 (1.0)           0;0  1.5661 (0.95)          1           1
test_list-list[main]       606.3867 (1.0)      606.3867 (1.0)      606.3867 (1.0)      0.0000 (1.0)      606.3867 (1.0)      0.0000 (1.0)           0;0  1.6491 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     437.7527 (1.07)     437.7527 (1.07)     437.7527 (1.07)     0.0000 (1.0)      437.7527 (1.07)     0.0000 (1.0)           0;0  2.2844 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     430.7218 (1.06)     430.7218 (1.06)     430.7218 (1.06)     0.0000 (1.0)      430.7218 (1.06)     0.0000 (1.0)           0;0  2.3217 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     407.8950 (1.0)      407.8950 (1.0)      407.8950 (1.0)      0.0000 (1.0)      407.8950 (1.0)      0.0000 (1.0)           0;0  2.4516 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     410.0242 (1.01)     410.0242 (1.01)     410.0242 (1.01)     0.0000 (1.0)      410.0242 (1.01)     0.0000 (1.0)           0;0  2.4389 (0.99)          1           1
test_list-list-dvc-only[main]       436.2658 (1.07)     436.2658 (1.07)     436.2658 (1.07)     0.0000 (1.0)      436.2658 (1.07)     0.0000 (1.0)           0;0  2.2922 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4312 (1.0)      2.4312 (1.0)      2.4312 (1.0)      0.0000 (1.0)      2.4312 (1.0)      0.0000 (1.0)           0;0  0.4113 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5048 (1.03)     2.5048 (1.03)     2.5048 (1.03)     0.0000 (1.0)      2.5048 (1.03)     0.0000 (1.0)           0;0  0.3992 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.4635 (1.01)     2.4635 (1.01)     2.4635 (1.01)     0.0000 (1.0)      2.4635 (1.01)     0.0000 (1.0)           0;0  0.4059 (0.99)          1           1
test_list-list-recursive[3.60.1]     2.4879 (1.02)     2.4879 (1.02)     2.4879 (1.02)     0.0000 (1.0)      2.4879 (1.02)     0.0000 (1.0)           0;0  0.4019 (0.98)          1           1
test_list-list-recursive[main]       2.7619 (1.14)     2.7619 (1.14)     2.7619 (1.14)     0.0000 (1.0)      2.7619 (1.14)     0.0000 (1.0)           0;0  0.3621 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     428.7960 (1.05)     428.7960 (1.05)     428.7960 (1.05)     0.0000 (1.0)      428.7960 (1.05)     0.0000 (1.0)           0;0  2.3321 (0.95)          1           1
test_list-list-shallow[3.10.0]     429.5769 (1.06)     429.5769 (1.06)     429.5769 (1.06)     0.0000 (1.0)      429.5769 (1.06)     0.0000 (1.0)           0;0  2.3279 (0.95)          1           1
test_list-list-shallow[3.53.2]     406.4434 (1.0)      406.4434 (1.0)      406.4434 (1.0)      0.0000 (1.0)      406.4434 (1.0)      0.0000 (1.0)           0;0  2.4604 (1.0)           1           1
test_list-list-shallow[3.60.1]     409.7528 (1.01)     409.7528 (1.01)     409.7528 (1.01)     0.0000 (1.0)      409.7528 (1.01)     0.0000 (1.0)           0;0  2.4405 (0.99)          1           1
test_list-list-shallow[main]       439.5548 (1.08)     439.5548 (1.08)     439.5548 (1.08)     0.0000 (1.0)      439.5548 (1.08)     0.0000 (1.0)           0;0  2.2750 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.4446 (3.09)     12.4446 (3.09)     12.4446 (3.09)     0.0000 (1.0)      12.4446 (3.09)     0.0000 (1.0)           0;0  0.0804 (0.32)          1           1
test_partial_add-add[3.10.0]     12.8498 (3.19)     12.8498 (3.19)     12.8498 (3.19)     0.0000 (1.0)      12.8498 (3.19)     0.0000 (1.0)           0;0  0.0778 (0.31)          1           1
test_partial_add-add[3.53.2]     11.2041 (2.78)     11.2041 (2.78)     11.2041 (2.78)     0.0000 (1.0)      11.2041 (2.78)     0.0000 (1.0)           0;0  0.0893 (0.36)          1           1
test_partial_add-add[3.60.1]      4.0245 (1.0)       4.0245 (1.0)       4.0245 (1.0)      0.0000 (1.0)       4.0245 (1.0)      0.0000 (1.0)           0;0  0.2485 (1.0)           1           1
test_partial_add-add[main]        5.0626 (1.26)      5.0626 (1.26)      5.0626 (1.26)     0.0000 (1.0)       5.0626 (1.26)     0.0000 (1.0)           0;0  0.1975 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     82.2716 (3.94)     82.2716 (3.94)     82.2716 (3.94)     0.0000 (1.0)      82.2716 (3.94)     0.0000 (1.0)           0;0  0.0122 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     83.8129 (4.01)     83.8129 (4.01)     83.8129 (4.01)     0.0000 (1.0)      83.8129 (4.01)     0.0000 (1.0)           0;0  0.0119 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     75.9151 (3.64)     75.9151 (3.64)     75.9151 (3.64)     0.0000 (1.0)      75.9151 (3.64)     0.0000 (1.0)           0;0  0.0132 (0.28)          1           1
test_partial_add-add-partial[3.60.1]     20.8826 (1.0)      20.8826 (1.0)      20.8826 (1.0)      0.0000 (1.0)      20.8826 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_partial_add-add-partial[main]       21.7035 (1.04)     21.7035 (1.04)     21.7035 (1.04)     0.0000 (1.0)      21.7035 (1.04)     0.0000 (1.0)           0;0  0.0461 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.7578 (1.0)      4.7578 (1.0)      4.7578 (1.0)      0.0000 (1.0)      4.7578 (1.0)      0.0000 (1.0)           0;0  0.2102 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.5036 (1.37)     6.5036 (1.37)     6.5036 (1.37)     0.0000 (1.0)      6.5036 (1.37)     0.0000 (1.0)           0;0  0.1538 (0.73)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1414 (1.50)     7.1414 (1.50)     7.1414 (1.50)     0.0000 (1.0)      7.1414 (1.50)     0.0000 (1.0)           0;0  0.1400 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.1550 (1.50)     7.1550 (1.50)     7.1550 (1.50)     0.0000 (1.0)      7.1550 (1.50)     0.0000 (1.0)           0;0  0.1398 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.3508 (1.33)     6.3508 (1.33)     6.3508 (1.33)     0.0000 (1.0)      6.3508 (1.33)     0.0000 (1.0)           0;0  0.1575 (0.75)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6950 (1.0)      2.6950 (1.0)      2.6950 (1.0)      0.0000 (1.0)      2.6950 (1.0)      0.0000 (1.0)           0;0  0.3711 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.0504 (1.50)     4.0504 (1.50)     4.0504 (1.50)     0.0000 (1.0)      4.0504 (1.50)     0.0000 (1.0)           0;0  0.2469 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     4.0479 (1.50)     4.0479 (1.50)     4.0479 (1.50)     0.0000 (1.0)      4.0479 (1.50)     0.0000 (1.0)           0;0  0.2470 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     4.0177 (1.49)     4.0177 (1.49)     4.0177 (1.49)     0.0000 (1.0)      4.0177 (1.49)     0.0000 (1.0)           0;0  0.2489 (0.67)          1           1
test_partial_add-gc-noop[main]       3.1852 (1.18)     3.1852 (1.18)     3.1852 (1.18)     0.0000 (1.0)      3.1852 (1.18)     0.0000 (1.0)           0;0  0.3140 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.9370 (4.02)     14.9370 (4.02)     14.9370 (4.02)     0.0000 (1.0)      14.9370 (4.02)     0.0000 (1.0)           0;0  0.0669 (0.25)          1           1
test_partial_add-push[3.10.0]      7.0210 (1.89)      7.0210 (1.89)      7.0210 (1.89)     0.0000 (1.0)       7.0210 (1.89)     0.0000 (1.0)           0;0  0.1424 (0.53)          1           1
test_partial_add-push[3.53.2]      3.8134 (1.03)      3.8134 (1.03)      3.8134 (1.03)     0.0000 (1.0)       3.8134 (1.03)     0.0000 (1.0)           0;0  0.2622 (0.97)          1           1
test_partial_add-push[3.60.1]      3.7113 (1.0)       3.7113 (1.0)       3.7113 (1.0)      0.0000 (1.0)       3.7113 (1.0)      0.0000 (1.0)           0;0  0.2694 (1.0)           1           1
test_partial_add-push[main]        3.8968 (1.05)      3.8968 (1.05)      3.8968 (1.05)     0.0000 (1.0)       3.8968 (1.05)     0.0000 (1.0)           0;0  0.2566 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     86.6411 (4.05)     86.6411 (4.05)     86.6411 (4.05)     0.0000 (1.0)      86.6411 (4.05)     0.0000 (1.0)           0;0  0.0115 (0.25)          1           1
test_partial_add-push-partial[3.10.0]     40.9581 (1.91)     40.9581 (1.91)     40.9581 (1.91)     0.0000 (1.0)      40.9581 (1.91)     0.0000 (1.0)           0;0  0.0244 (0.52)          1           1
test_partial_add-push-partial[3.53.2]     22.0981 (1.03)     22.0981 (1.03)     22.0981 (1.03)     0.0000 (1.0)      22.0981 (1.03)     0.0000 (1.0)           0;0  0.0453 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     21.6738 (1.01)     21.6738 (1.01)     21.6738 (1.01)     0.0000 (1.0)      21.6738 (1.01)     0.0000 (1.0)           0;0  0.0461 (0.99)          1           1
test_partial_add-push-partial[main]       21.4183 (1.0)      21.4183 (1.0)      21.4183 (1.0)      0.0000 (1.0)      21.4183 (1.0)      0.0000 (1.0)           0;0  0.0467 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.5065 (3.79)     86.5065 (3.79)     86.5065 (3.79)     0.0000 (1.0)      86.5065 (3.79)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.10.0]     87.3565 (3.83)     87.3565 (3.83)     87.3565 (3.83)     0.0000 (1.0)      87.3565 (3.83)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_partial_remove-add[3.53.2]     79.2369 (3.47)     79.2369 (3.47)     79.2369 (3.47)     0.0000 (1.0)      79.2369 (3.47)     0.0000 (1.0)           0;0  0.0126 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.8301 (1.0)      22.8301 (1.0)      22.8301 (1.0)      0.0000 (1.0)      22.8301 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
test_partial_remove-add[main]       23.8496 (1.04)     23.8496 (1.04)     23.8496 (1.04)     0.0000 (1.0)      23.8496 (1.04)     0.0000 (1.0)           0;0  0.0419 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     48.4422 (13.51)    48.4422 (13.51)    48.4422 (13.51)    0.0000 (1.0)      48.4422 (13.51)    0.0000 (1.0)           0;0  0.0206 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     48.6747 (13.57)    48.6747 (13.57)    48.6747 (13.57)    0.0000 (1.0)      48.6747 (13.57)    0.0000 (1.0)           0;0  0.0205 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     44.4772 (12.40)    44.4772 (12.40)    44.4772 (12.40)    0.0000 (1.0)      44.4772 (12.40)    0.0000 (1.0)           0;0  0.0225 (0.08)          1           1
test_partial_remove-add-update[3.60.1]      3.5859 (1.0)       3.5859 (1.0)       3.5859 (1.0)      0.0000 (1.0)       3.5859 (1.0)      0.0000 (1.0)           0;0  0.2789 (1.0)           1           1
test_partial_remove-add-update[main]        3.6694 (1.02)      3.6694 (1.02)      3.6694 (1.02)     0.0000 (1.0)       3.6694 (1.02)     0.0000 (1.0)           0;0  0.2725 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6042 (1.0)      2.6042 (1.0)      2.6042 (1.0)      0.0000 (1.0)      2.6042 (1.0)      0.0000 (1.0)           0;0  0.3840 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7178 (1.43)     3.7178 (1.43)     3.7178 (1.43)     0.0000 (1.0)      3.7178 (1.43)     0.0000 (1.0)           0;0  0.2690 (0.70)          1           1
test_partial_remove-gc[3.53.2]     3.8044 (1.46)     3.8044 (1.46)     3.8044 (1.46)     0.0000 (1.0)      3.8044 (1.46)     0.0000 (1.0)           0;0  0.2629 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.7741 (1.45)     3.7741 (1.45)     3.7741 (1.45)     0.0000 (1.0)      3.7741 (1.45)     0.0000 (1.0)           0;0  0.2650 (0.69)          1           1
test_partial_remove-gc[main]       2.8715 (1.10)     2.8715 (1.10)     2.8715 (1.10)     0.0000 (1.0)      2.8715 (1.10)     0.0000 (1.0)           0;0  0.3483 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8272 (1.0)      4.8272 (1.0)      4.8272 (1.0)      0.0000 (1.0)      4.8272 (1.0)      0.0000 (1.0)           0;0  0.2072 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.4784 (1.34)     6.4784 (1.34)     6.4784 (1.34)     0.0000 (1.0)      6.4784 (1.34)     0.0000 (1.0)           0;0  0.1544 (0.75)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.1635 (1.48)     7.1635 (1.48)     7.1635 (1.48)     0.0000 (1.0)      7.1635 (1.48)     0.0000 (1.0)           0;0  0.1396 (0.67)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.9021 (1.43)     6.9021 (1.43)     6.9021 (1.43)     0.0000 (1.0)      6.9021 (1.43)     0.0000 (1.0)           0;0  0.1449 (0.70)          1           1
test_partial_remove-gc-cloud[main]       5.7436 (1.19)     5.7436 (1.19)     5.7436 (1.19)     0.0000 (1.0)      5.7436 (1.19)     0.0000 (1.0)           0;0  0.1741 (0.84)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     96.4974 (4.28)     96.4974 (4.28)     96.4974 (4.28)     0.0000 (1.0)      96.4974 (4.28)     0.0000 (1.0)           0;0  0.0104 (0.23)          1           1
test_partial_remove-push[3.10.0]     45.5604 (2.02)     45.5604 (2.02)     45.5604 (2.02)     0.0000 (1.0)      45.5604 (2.02)     0.0000 (1.0)           0;0  0.0219 (0.49)          1           1
test_partial_remove-push[3.53.2]     24.2937 (1.08)     24.2937 (1.08)     24.2937 (1.08)     0.0000 (1.0)      24.2937 (1.08)     0.0000 (1.0)           0;0  0.0412 (0.93)          1           1
test_partial_remove-push[3.60.1]     22.8765 (1.01)     22.8765 (1.01)     22.8765 (1.01)     0.0000 (1.0)      22.8765 (1.01)     0.0000 (1.0)           0;0  0.0437 (0.99)          1           1
test_partial_remove-push[main]       22.5434 (1.0)      22.5434 (1.0)      22.5434 (1.0)      0.0000 (1.0)      22.5434 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9757 (1.0)      3.9757 (1.0)      3.9757 (1.0)      0.0000 (1.0)      3.9757 (1.0)      0.0000 (1.0)           0;0  0.2515 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.9914 (1.00)     3.9914 (1.00)     3.9914 (1.00)     0.0000 (1.0)      3.9914 (1.00)     0.0000 (1.0)           0;0  0.2505 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     7.3971 (1.86)     7.3971 (1.86)     7.3971 (1.86)     0.0000 (1.0)      7.3971 (1.86)     0.0000 (1.0)           0;0  0.1352 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     7.3042 (1.84)     7.3042 (1.84)     7.3042 (1.84)     0.0000 (1.0)      7.3042 (1.84)     0.0000 (1.0)           0;0  0.1369 (0.54)          1           1
test_partial_remove-push-update[main]       7.4034 (1.86)     7.4034 (1.86)     7.4034 (1.86)     0.0000 (1.0)      7.4034 (1.86)     0.0000 (1.0)           0;0  0.1351 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]       629.0169 (1.0)        639.1703 (1.0)        633.5969 (1.0)       3.7781 (1.0)        632.7407 (1.0)       4.7414 (1.0)           2;0  1.5783 (1.0)           5           3
test_plots-plots-diff[3.10.0]     1,113.6285 (1.77)     1,141.6705 (1.79)     1,122.2683 (1.77)     11.7296 (3.10)     1,117.3618 (1.77)     15.0896 (3.18)          1;0  0.8911 (0.56)          5           3
test_plots-plots-diff[3.53.2]     1,097.1591 (1.74)     1,122.3113 (1.76)     1,113.9889 (1.76)      9.8704 (2.61)     1,116.6286 (1.76)     10.1146 (2.13)          1;0  0.8977 (0.57)          5           3
test_plots-plots-diff[3.60.1]     1,113.8855 (1.77)     1,134.4531 (1.77)     1,121.9965 (1.77)      9.6939 (2.57)     1,115.7231 (1.76)     16.4528 (3.47)          1;0  0.8913 (0.56)          5           3
test_plots-plots-diff[main]       1,000.8120 (1.59)     1,078.7590 (1.69)     1,055.0188 (1.67)     33.4917 (8.86)     1,072.9426 (1.70)     45.1377 (9.52)          1;0  0.9479 (0.60)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       624.7997 (1.0)        657.1230 (1.0)        645.5949 (1.0)      13.2708 (1.67)       647.9892 (1.0)      19.1936 (1.43)          1;0  1.5490 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,344.4354 (2.15)     1,533.8334 (2.33)     1,391.4090 (2.16)     80.4618 (10.10)    1,352.8317 (2.09)     65.7094 (4.90)          1;1  0.7187 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]     1,155.7464 (1.85)     1,199.2760 (1.83)     1,181.1209 (1.83)     15.8092 (1.99)     1,184.4198 (1.83)     13.8226 (1.03)          2;0  0.8467 (0.55)          5           3
test_plots-plots-diff-json[3.60.1]     1,171.3310 (1.87)     1,187.7799 (1.81)     1,181.9280 (1.83)      7.9632 (1.0)      1,187.3932 (1.83)     13.4184 (1.0)           1;0  0.8461 (0.55)          5           3
test_plots-plots-diff-json[main]       1,169.9277 (1.87)     1,198.6755 (1.82)     1,183.9045 (1.83)     11.6787 (1.47)     1,184.5914 (1.83)     19.3019 (1.44)          2;0  0.8447 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     504.3322 (1.0)      522.5419 (1.0)      513.2015 (1.0)      7.3065 (2.06)     511.5941 (1.0)      11.6202 (2.69)          2;0  1.9486 (1.0)           5           3
test_plots-plots-show[3.10.0]     922.7359 (1.83)     933.0822 (1.79)     929.2095 (1.81)     3.9845 (1.12)     929.6327 (1.82)      4.7212 (1.09)          1;0  1.0762 (0.55)          5           3
test_plots-plots-show[3.53.2]     912.2541 (1.81)     921.2588 (1.76)     915.5395 (1.78)     3.5442 (1.0)      913.9279 (1.79)      4.3206 (1.0)           1;0  1.0923 (0.56)          5           3
test_plots-plots-show[3.60.1]     915.5291 (1.82)     929.8585 (1.78)     920.1273 (1.79)     5.6703 (1.60)     919.0257 (1.80)      5.5462 (1.28)          1;0  1.0868 (0.56)          5           3
test_plots-plots-show[main]       820.6920 (1.63)     835.9744 (1.60)     827.9419 (1.61)     7.0098 (1.98)     827.5052 (1.62)     13.2608 (3.07)          2;0  1.2078 (0.62)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]       529.7787 (1.0)        535.7277 (1.0)        532.9449 (1.0)       2.4895 (1.0)        534.0305 (1.0)       3.9964 (1.0)           2;0  1.8764 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     1,049.6580 (1.98)     1,074.6842 (2.01)     1,061.5027 (1.99)     10.4214 (4.19)     1,059.6625 (1.98)     17.7225 (4.43)          2;0  0.9421 (0.50)          5           3
test_plots-plots-show-json[3.53.2]       960.5267 (1.81)       981.7745 (1.83)       968.7021 (1.82)      7.9443 (3.19)       967.2299 (1.81)      8.0557 (2.02)          2;0  1.0323 (0.55)          5           3
test_plots-plots-show-json[3.60.1]       967.0801 (1.83)       994.1283 (1.86)       975.6107 (1.83)     10.6005 (4.26)       972.4542 (1.82)      7.5264 (1.88)          1;1  1.0250 (0.55)          5           3
test_plots-plots-show-json[main]         864.8246 (1.63)       887.0889 (1.66)       871.9433 (1.64)      9.2831 (3.73)       867.0236 (1.62)     11.8951 (2.98)          1;0  1.1469 (0.61)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     101.1713 (4.42)     101.1713 (4.42)     101.1713 (4.42)     0.0000 (1.0)      101.1713 (4.42)     0.0000 (1.0)           0;0  0.0099 (0.23)          1           1
test_push-push[3.10.0]      49.5948 (2.17)      49.5948 (2.17)      49.5948 (2.17)     0.0000 (1.0)       49.5948 (2.17)     0.0000 (1.0)           0;0  0.0202 (0.46)          1           1
test_push-push[3.53.2]      23.9840 (1.05)      23.9840 (1.05)      23.9840 (1.05)     0.0000 (1.0)       23.9840 (1.05)     0.0000 (1.0)           0;0  0.0417 (0.95)          1           1
test_push-push[3.60.1]      22.8688 (1.0)       22.8688 (1.0)       22.8688 (1.0)      0.0000 (1.0)       22.8688 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
test_push-push[main]        23.3561 (1.02)      23.3561 (1.02)      23.3561 (1.02)     0.0000 (1.0)       23.3561 (1.02)     0.0000 (1.0)           0;0  0.0428 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.2261 (4.75)     110.2261 (4.75)     110.2261 (4.75)     0.0000 (1.0)      110.2261 (4.75)     0.0000 (1.0)           0;0  0.0091 (0.21)          1           1
test_sharing-fetch[3.10.0]     114.7631 (4.94)     114.7631 (4.94)     114.7631 (4.94)     0.0000 (1.0)      114.7631 (4.94)     0.0000 (1.0)           0;0  0.0087 (0.20)          1           1
test_sharing-fetch[3.53.2]      35.0063 (1.51)      35.0063 (1.51)      35.0063 (1.51)     0.0000 (1.0)       35.0063 (1.51)     0.0000 (1.0)           0;0  0.0286 (0.66)          1           1
test_sharing-fetch[3.60.1]      23.4338 (1.01)      23.4338 (1.01)      23.4338 (1.01)     0.0000 (1.0)       23.4338 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
test_sharing-fetch[main]        23.2251 (1.0)       23.2251 (1.0)       23.2251 (1.0)      0.0000 (1.0)       23.2251 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2770 (1.0)      1.2770 (1.0)      1.2770 (1.0)      0.0000 (1.0)      1.2770 (1.0)      0.0000 (1.0)           0;0  0.7831 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8504 (3.02)     3.8504 (3.02)     3.8504 (3.02)     0.0000 (1.0)      3.8504 (3.02)     0.0000 (1.0)           0;0  0.2597 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     6.1592 (4.82)     6.1592 (4.82)     6.1592 (4.82)     0.0000 (1.0)      6.1592 (4.82)     0.0000 (1.0)           0;0  0.1624 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     6.1595 (4.82)     6.1595 (4.82)     6.1595 (4.82)     0.0000 (1.0)      6.1595 (4.82)     0.0000 (1.0)           0;0  0.1624 (0.21)          1           1
test_sharing-fetch-noop[main]       6.0123 (4.71)     6.0123 (4.71)     6.0123 (4.71)     0.0000 (1.0)      6.0123 (4.71)     0.0000 (1.0)           0;0  0.1663 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     96.3443 (4.27)     96.3443 (4.27)     96.3443 (4.27)     0.0000 (1.0)      96.3443 (4.27)     0.0000 (1.0)           0;0  0.0104 (0.23)          1           1
test_sharing-push[3.10.0]     46.4224 (2.06)     46.4224 (2.06)     46.4224 (2.06)     0.0000 (1.0)      46.4224 (2.06)     0.0000 (1.0)           0;0  0.0215 (0.49)          1           1
test_sharing-push[3.53.2]     23.3463 (1.04)     23.3463 (1.04)     23.3463 (1.04)     0.0000 (1.0)      23.3463 (1.04)     0.0000 (1.0)           0;0  0.0428 (0.97)          1           1
test_sharing-push[3.60.1]     22.7536 (1.01)     22.7536 (1.01)     22.7536 (1.01)     0.0000 (1.0)      22.7536 (1.01)     0.0000 (1.0)           0;0  0.0439 (0.99)          1           1
test_sharing-push[main]       22.5419 (1.0)      22.5419 (1.0)      22.5419 (1.0)      0.0000 (1.0)      22.5419 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0551 (1.0)      2.0551 (1.0)      2.0551 (1.0)      0.0000 (1.0)      2.0551 (1.0)      0.0000 (1.0)           0;0  0.4866 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0601 (1.00)     2.0601 (1.00)     2.0601 (1.00)     0.0000 (1.0)      2.0601 (1.00)     0.0000 (1.0)           0;0  0.4854 (1.00)          1           1
test_sharing-push-noop[3.53.2]     5.9947 (2.92)     5.9947 (2.92)     5.9947 (2.92)     0.0000 (1.0)      5.9947 (2.92)     0.0000 (1.0)           0;0  0.1668 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0648 (2.95)     6.0648 (2.95)     6.0648 (2.95)     0.0000 (1.0)      6.0648 (2.95)     0.0000 (1.0)           0;0  0.1649 (0.34)          1           1
test_sharing-push-noop[main]       6.1046 (2.97)     6.1046 (2.97)     6.1046 (2.97)     0.0000 (1.0)      6.1046 (2.97)     0.0000 (1.0)           0;0  0.1638 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     150.0267 (1.07)     150.0267 (1.07)     150.0267 (1.07)     0.0000 (1.0)      150.0267 (1.07)     0.0000 (1.0)           0;0  0.0067 (0.93)          1           1
test_sharing_azure-fetch[main]       139.7129 (1.0)      139.7129 (1.0)      139.7129 (1.0)      0.0000 (1.0)      139.7129 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3551 (1.0)      6.3551 (1.0)      6.3551 (1.0)      0.0000 (1.0)      6.3551 (1.0)      0.0000 (1.0)           0;0  0.1574 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6023 (1.04)     6.6023 (1.04)     6.6023 (1.04)     0.0000 (1.0)      6.6023 (1.04)     0.0000 (1.0)           0;0  0.1515 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     125.2751 (1.0)      125.2751 (1.0)      125.2751 (1.0)      0.0000 (1.0)      125.2751 (1.0)      0.0000 (1.0)           0;0  0.0080 (1.0)           1           1
test_sharing_azure-push[main]       126.6831 (1.01)     126.6831 (1.01)     126.6831 (1.01)     0.0000 (1.0)      126.6831 (1.01)     0.0000 (1.0)           0;0  0.0079 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.5004 (1.0)      6.5004 (1.0)      6.5004 (1.0)      0.0000 (1.0)      6.5004 (1.0)      0.0000 (1.0)           0;0  0.1538 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.5167 (1.00)     6.5167 (1.00)     6.5167 (1.00)     0.0000 (1.0)      6.5167 (1.00)     0.0000 (1.0)           0;0  0.1535 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     415.0851 (1.01)     415.0851 (1.01)     415.0851 (1.01)     0.0000 (1.0)      415.0851 (1.01)     0.0000 (1.0)           0;0  0.0024 (0.99)          1           1
test_sharing_s3-fetch[main]       410.1428 (1.0)      410.1428 (1.0)      410.1428 (1.0)      0.0000 (1.0)      410.1428 (1.0)      0.0000 (1.0)           0;0  0.0024 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5673 (1.0)      6.5673 (1.0)      6.5673 (1.0)      0.0000 (1.0)      6.5673 (1.0)      0.0000 (1.0)           0;0  0.1523 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.6633 (1.01)     6.6633 (1.01)     6.6633 (1.01)     0.0000 (1.0)      6.6633 (1.01)     0.0000 (1.0)           0;0  0.1501 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     461.6152 (1.0)      461.6152 (1.0)      461.6152 (1.0)      0.0000 (1.0)      461.6152 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
test_sharing_s3-push[main]       462.7637 (1.00)     462.7637 (1.00)     462.7637 (1.00)     0.0000 (1.0)      462.7637 (1.00)     0.0000 (1.0)           0;0  0.0022 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.6788 (1.0)      6.6788 (1.0)      6.6788 (1.0)      0.0000 (1.0)      6.6788 (1.0)      0.0000 (1.0)           0;0  0.1497 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.7937 (1.02)     6.7937 (1.02)     6.7937 (1.02)     0.0000 (1.0)      6.7937 (1.02)     0.0000 (1.0)           0;0  0.1472 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.4281 (3.86)     20.4281 (3.86)     20.4281 (3.86)     0.0000 (1.0)      20.4281 (3.86)     0.0000 (1.0)           0;0  0.0490 (0.26)          1           1
test_status-status[3.10.0]     20.9621 (3.96)     20.9621 (3.96)     20.9621 (3.96)     0.0000 (1.0)      20.9621 (3.96)     0.0000 (1.0)           0;0  0.0477 (0.25)          1           1
test_status-status[3.53.2]     18.5728 (3.51)     18.5728 (3.51)     18.5728 (3.51)     0.0000 (1.0)      18.5728 (3.51)     0.0000 (1.0)           0;0  0.0538 (0.28)          1           1
test_status-status[3.60.1]      5.2895 (1.0)       5.2895 (1.0)       5.2895 (1.0)      0.0000 (1.0)       5.2895 (1.0)      0.0000 (1.0)           0;0  0.1891 (1.0)           1           1
test_status-status[main]        5.8939 (1.11)      5.8939 (1.11)      5.8939 (1.11)     0.0000 (1.0)       5.8939 (1.11)     0.0000 (1.0)           0;0  0.1697 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8924 (1.85)     4.8924 (1.85)     4.8924 (1.85)     0.0000 (1.0)      4.8924 (1.85)     0.0000 (1.0)           0;0  0.2044 (0.54)          1           1
test_status-status-changed[3.10.0]     5.3395 (2.01)     5.3395 (2.01)     5.3395 (2.01)     0.0000 (1.0)      5.3395 (2.01)     0.0000 (1.0)           0;0  0.1873 (0.50)          1           1
test_status-status-changed[3.53.2]     5.2077 (1.96)     5.2077 (1.96)     5.2077 (1.96)     0.0000 (1.0)      5.2077 (1.96)     0.0000 (1.0)           0;0  0.1920 (0.51)          1           1
test_status-status-changed[3.60.1]     2.6504 (1.0)      2.6504 (1.0)      2.6504 (1.0)      0.0000 (1.0)      2.6504 (1.0)      0.0000 (1.0)           0;0  0.3773 (1.0)           1           1
test_status-status-changed[main]       2.8678 (1.08)     2.8678 (1.08)     2.8678 (1.08)     0.0000 (1.0)      2.8678 (1.08)     0.0000 (1.0)           0;0  0.3487 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0078 (1.95)     5.0078 (1.95)     5.0078 (1.95)     0.0000 (1.0)      5.0078 (1.95)     0.0000 (1.0)           0;0  0.1997 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.1618 (2.01)     5.1618 (2.01)     5.1618 (2.01)     0.0000 (1.0)      5.1618 (2.01)     0.0000 (1.0)           0;0  0.1937 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     5.0017 (1.95)     5.0017 (1.95)     5.0017 (1.95)     0.0000 (1.0)      5.0017 (1.95)     0.0000 (1.0)           0;0  0.1999 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.5630 (1.0)      2.5630 (1.0)      2.5630 (1.0)      0.0000 (1.0)      2.5630 (1.0)      0.0000 (1.0)           0;0  0.3902 (1.0)           1           1
test_status-status-changed-noop[main]       2.8122 (1.10)     2.8122 (1.10)     2.8122 (1.10)     0.0000 (1.0)      2.8122 (1.10)     0.0000 (1.0)           0;0  0.3556 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.2150 (2.05)     5.2150 (2.05)     5.2150 (2.05)     0.0000 (1.0)      5.2150 (2.05)     0.0000 (1.0)           0;0  0.1918 (0.49)          1           1
test_status-status-noop[3.10.0]     5.3193 (2.10)     5.3193 (2.10)     5.3193 (2.10)     0.0000 (1.0)      5.3193 (2.10)     0.0000 (1.0)           0;0  0.1880 (0.48)          1           1
test_status-status-noop[3.53.2]     5.2740 (2.08)     5.2740 (2.08)     5.2740 (2.08)     0.0000 (1.0)      5.2740 (2.08)     0.0000 (1.0)           0;0  0.1896 (0.48)          1           1
test_status-status-noop[3.60.1]     2.5377 (1.0)      2.5377 (1.0)      2.5377 (1.0)      0.0000 (1.0)      2.5377 (1.0)      0.0000 (1.0)           0;0  0.3941 (1.0)           1           1
test_status-status-noop[main]       2.7892 (1.10)     2.7892 (1.10)     2.7892 (1.10)     0.0000 (1.0)      2.7892 (1.10)     0.0000 (1.0)           0;0  0.3585 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     199.8207 (4.20)     199.8207 (4.20)     199.8207 (4.20)     0.0000 (1.0)      199.8207 (4.20)     0.0000 (1.0)           0;0  0.0050 (0.24)          1           1
test_update-import-url[3.10.0]     205.8223 (4.33)     205.8223 (4.33)     205.8223 (4.33)     0.0000 (1.0)      205.8223 (4.33)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.53.2]     117.4039 (2.47)     117.4039 (2.47)     117.4039 (2.47)     0.0000 (1.0)      117.4039 (2.47)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_update-import-url[3.60.1]      47.5476 (1.0)       47.5476 (1.0)       47.5476 (1.0)      0.0000 (1.0)       47.5476 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
test_update-import-url[main]        49.5276 (1.04)      49.5276 (1.04)      49.5276 (1.04)     0.0000 (1.0)       49.5276 (1.04)     0.0000 (1.0)           0;0  0.0202 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     186.4673 (5.25)     186.4673 (5.25)     186.4673 (5.25)     0.0000 (1.0)      186.4673 (5.25)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.10.0]     189.8287 (5.34)     189.8287 (5.34)     189.8287 (5.34)     0.0000 (1.0)      189.8287 (5.34)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.53.2]     110.1492 (3.10)     110.1492 (3.10)     110.1492 (3.10)     0.0000 (1.0)      110.1492 (3.10)     0.0000 (1.0)           0;0  0.0091 (0.32)          1           1
test_update-update[3.60.1]      35.5227 (1.0)       35.5227 (1.0)       35.5227 (1.0)      0.0000 (1.0)       35.5227 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.5814 (1.03)      36.5814 (1.03)      36.5814 (1.03)     0.0000 (1.0)       36.5814 (1.03)     0.0000 (1.0)           0;0  0.0273 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.1467 (2.21)     17.1467 (2.21)     17.1467 (2.21)     0.0000 (1.0)      17.1467 (2.21)     0.0000 (1.0)           0;0  0.0583 (0.45)          1           1
test_update-update-noop[3.10.0]     18.3034 (2.36)     18.3034 (2.36)     18.3034 (2.36)     0.0000 (1.0)      18.3034 (2.36)     0.0000 (1.0)           0;0  0.0546 (0.42)          1           1
test_update-update-noop[3.53.2]     17.2882 (2.23)     17.2882 (2.23)     17.2882 (2.23)     0.0000 (1.0)      17.2882 (2.23)     0.0000 (1.0)           0;0  0.0578 (0.45)          1           1
test_update-update-noop[3.60.1]      7.7630 (1.0)       7.7630 (1.0)       7.7630 (1.0)      0.0000 (1.0)       7.7630 (1.0)      0.0000 (1.0)           0;0  0.1288 (1.0)           1           1
test_update-update-noop[main]        8.4610 (1.09)      8.4610 (1.09)      8.4610 (1.09)     0.0000 (1.0)       8.4610 (1.09)     0.0000 (1.0)           0;0  0.1182 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean