Wed Oct 22 01:10:14 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     81.9587 (3.61)     81.9587 (3.61)     81.9587 (3.61)     0.0000 (1.0)      81.9587 (3.61)     0.0000 (1.0)           0;0  0.0122 (0.28)          1           1
test_add_copy-add[3.10.0]     82.4731 (3.63)     82.4731 (3.63)     82.4731 (3.63)     0.0000 (1.0)      82.4731 (3.63)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_add_copy-add[3.53.2]     73.0756 (3.22)     73.0756 (3.22)     73.0756 (3.22)     0.0000 (1.0)      73.0756 (3.22)     0.0000 (1.0)           0;0  0.0137 (0.31)          1           1
test_add_copy-add[3.60.1]     22.7217 (1.0)      22.7217 (1.0)      22.7217 (1.0)      0.0000 (1.0)      22.7217 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_add_copy-add[main]       23.9342 (1.05)     23.9342 (1.05)     23.9342 (1.05)     0.0000 (1.0)      23.9342 (1.05)     0.0000 (1.0)           0;0  0.0418 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     26.4997 (5.86)     26.4997 (5.86)     26.4997 (5.86)     0.0000 (1.0)      26.4997 (5.86)     0.0000 (1.0)           0;0  0.0377 (0.17)          1           1
test_add_copy-add-noop[3.10.0]     27.1604 (6.00)     27.1604 (6.00)     27.1604 (6.00)     0.0000 (1.0)      27.1604 (6.00)     0.0000 (1.0)           0;0  0.0368 (0.17)          1           1
test_add_copy-add-noop[3.53.2]     25.5622 (5.65)     25.5622 (5.65)     25.5622 (5.65)     0.0000 (1.0)      25.5622 (5.65)     0.0000 (1.0)           0;0  0.0391 (0.18)          1           1
test_add_copy-add-noop[3.60.1]      4.5260 (1.0)       4.5260 (1.0)       4.5260 (1.0)      0.0000 (1.0)       4.5260 (1.0)      0.0000 (1.0)           0;0  0.2209 (1.0)           1           1
test_add_copy-add-noop[main]        4.8765 (1.08)      4.8765 (1.08)      4.8765 (1.08)     0.0000 (1.0)       4.8765 (1.08)     0.0000 (1.0)           0;0  0.2051 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     61.2518 (3.89)     61.2518 (3.89)     61.2518 (3.89)     0.0000 (1.0)      61.2518 (3.89)     0.0000 (1.0)           0;0  0.0163 (0.26)          1           1
test_add_hardlink-add[3.10.0]     62.2840 (3.96)     62.2840 (3.96)     62.2840 (3.96)     0.0000 (1.0)      62.2840 (3.96)     0.0000 (1.0)           0;0  0.0161 (0.25)          1           1
test_add_hardlink-add[3.53.2]     56.8946 (3.61)     56.8946 (3.61)     56.8946 (3.61)     0.0000 (1.0)      56.8946 (3.61)     0.0000 (1.0)           0;0  0.0176 (0.28)          1           1
test_add_hardlink-add[3.60.1]     15.7414 (1.0)      15.7414 (1.0)      15.7414 (1.0)      0.0000 (1.0)      15.7414 (1.0)      0.0000 (1.0)           0;0  0.0635 (1.0)           1           1
test_add_hardlink-add[main]       17.0668 (1.08)     17.0668 (1.08)     17.0668 (1.08)     0.0000 (1.0)      17.0668 (1.08)     0.0000 (1.0)           0;0  0.0586 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     31.2529 (7.13)     31.2529 (7.13)     31.2529 (7.13)     0.0000 (1.0)      31.2529 (7.13)     0.0000 (1.0)           0;0  0.0320 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     31.6708 (7.22)     31.6708 (7.22)     31.6708 (7.22)     0.0000 (1.0)      31.6708 (7.22)     0.0000 (1.0)           0;0  0.0316 (0.14)          1           1
test_add_hardlink-add-noop[3.53.2]     29.6338 (6.76)     29.6338 (6.76)     29.6338 (6.76)     0.0000 (1.0)      29.6338 (6.76)     0.0000 (1.0)           0;0  0.0337 (0.15)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3862 (1.0)       4.3862 (1.0)       4.3862 (1.0)      0.0000 (1.0)       4.3862 (1.0)      0.0000 (1.0)           0;0  0.2280 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.7069 (1.07)      4.7069 (1.07)      4.7069 (1.07)     0.0000 (1.0)       4.7069 (1.07)     0.0000 (1.0)           0;0  0.2125 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     67.2853 (1.94)     67.2853 (1.94)     67.2853 (1.94)     0.0000 (1.0)      67.2853 (1.94)     0.0000 (1.0)           0;0  0.0149 (0.52)          1           1
test_add_symlink-add[3.10.0]     67.1156 (1.93)     67.1156 (1.93)     67.1156 (1.93)     0.0000 (1.0)      67.1156 (1.93)     0.0000 (1.0)           0;0  0.0149 (0.52)          1           1
test_add_symlink-add[3.53.2]     62.9952 (1.81)     62.9952 (1.81)     62.9952 (1.81)     0.0000 (1.0)      62.9952 (1.81)     0.0000 (1.0)           0;0  0.0159 (0.55)          1           1
test_add_symlink-add[3.60.1]     34.7133 (1.0)      34.7133 (1.0)      34.7133 (1.0)      0.0000 (1.0)      34.7133 (1.0)      0.0000 (1.0)           0;0  0.0288 (1.0)           1           1
test_add_symlink-add[main]       36.0841 (1.04)     36.0841 (1.04)     36.0841 (1.04)     0.0000 (1.0)      36.0841 (1.04)     0.0000 (1.0)           0;0  0.0277 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.4321 (7.64)     45.4321 (7.64)     45.4321 (7.64)     0.0000 (1.0)      45.4321 (7.64)     0.0000 (1.0)           0;0  0.0220 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     46.9076 (7.89)     46.9076 (7.89)     46.9076 (7.89)     0.0000 (1.0)      46.9076 (7.89)     0.0000 (1.0)           0;0  0.0213 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     45.3180 (7.62)     45.3180 (7.62)     45.3180 (7.62)     0.0000 (1.0)      45.3180 (7.62)     0.0000 (1.0)           0;0  0.0221 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.9455 (1.0)       5.9455 (1.0)       5.9455 (1.0)      0.0000 (1.0)       5.9455 (1.0)      0.0000 (1.0)           0;0  0.1682 (1.0)           1           1
test_add_symlink-add-noop[main]        6.3100 (1.06)      6.3100 (1.06)      6.3100 (1.06)     0.0000 (1.0)       6.3100 (1.06)     0.0000 (1.0)           0;0  0.1585 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.7617 (1.91)     39.7617 (1.91)     39.7617 (1.91)     0.0000 (1.0)      39.7617 (1.91)     0.0000 (1.0)           0;0  0.0251 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     62.1504 (2.98)     62.1504 (2.98)     62.1504 (2.98)     0.0000 (1.0)      62.1504 (2.98)     0.0000 (1.0)           0;0  0.0161 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     27.9928 (1.34)     27.9928 (1.34)     27.9928 (1.34)     0.0000 (1.0)      27.9928 (1.34)     0.0000 (1.0)           0;0  0.0357 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.8615 (1.0)      20.8615 (1.0)      20.8615 (1.0)      0.0000 (1.0)      20.8615 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]       22.1110 (1.06)     22.1110 (1.06)     22.1110 (1.06)     0.0000 (1.0)      22.1110 (1.06)     0.0000 (1.0)           0;0  0.0452 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5727 (1.66)     5.5727 (1.66)     5.5727 (1.66)     0.0000 (1.0)      5.5727 (1.66)     0.0000 (1.0)           0;0  0.1794 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7596 (1.71)     5.7596 (1.71)     5.7596 (1.71)     0.0000 (1.0)      5.7596 (1.71)     0.0000 (1.0)           0;0  0.1736 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5924 (1.66)     5.5924 (1.66)     5.5924 (1.66)     0.0000 (1.0)      5.5924 (1.66)     0.0000 (1.0)           0;0  0.1788 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3597 (1.0)      3.3597 (1.0)      3.3597 (1.0)      0.0000 (1.0)      3.3597 (1.0)      0.0000 (1.0)           0;0  0.2976 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6645 (1.09)     3.6645 (1.09)     3.6645 (1.09)     0.0000 (1.0)      3.6645 (1.09)     0.0000 (1.0)           0;0  0.2729 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.0180 (1.97)     8.0180 (1.97)     8.0180 (1.97)     0.0000 (1.0)      8.0180 (1.97)     0.0000 (1.0)           0;0  0.1247 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4981 (1.59)     6.4981 (1.59)     6.4981 (1.59)     0.0000 (1.0)      6.4981 (1.59)     0.0000 (1.0)           0;0  0.1539 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3712 (1.56)     6.3712 (1.56)     6.3712 (1.56)     0.0000 (1.0)      6.3712 (1.56)     0.0000 (1.0)           0;0  0.1570 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0763 (1.0)      4.0763 (1.0)      4.0763 (1.0)      0.0000 (1.0)      4.0763 (1.0)      0.0000 (1.0)           0;0  0.2453 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5763 (1.12)     4.5763 (1.12)     4.5763 (1.12)     0.0000 (1.0)      4.5763 (1.12)     0.0000 (1.0)           0;0  0.2185 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.6002 (2.99)     21.6002 (2.99)     21.6002 (2.99)     0.0000 (1.0)      21.6002 (2.99)     0.0000 (1.0)           0;0  0.0463 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.2051 (2.24)     16.2051 (2.24)     16.2051 (2.24)     0.0000 (1.0)      16.2051 (2.24)     0.0000 (1.0)           0;0  0.0617 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.6855 (2.03)     14.6855 (2.03)     14.6855 (2.03)     0.0000 (1.0)      14.6855 (2.03)     0.0000 (1.0)           0;0  0.0681 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2325 (1.0)       7.2325 (1.0)       7.2325 (1.0)      0.0000 (1.0)       7.2325 (1.0)      0.0000 (1.0)           0;0  0.1383 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.9971 (1.11)      7.9971 (1.11)      7.9971 (1.11)     0.0000 (1.0)       7.9971 (1.11)     0.0000 (1.0)           0;0  0.1250 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4868 (1.64)     5.4868 (1.64)     5.4868 (1.64)     0.0000 (1.0)      5.4868 (1.64)     0.0000 (1.0)           0;0  0.1823 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7289 (1.71)     5.7289 (1.71)     5.7289 (1.71)     0.0000 (1.0)      5.7289 (1.71)     0.0000 (1.0)           0;0  0.1746 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4765 (1.64)     5.4765 (1.64)     5.4765 (1.64)     0.0000 (1.0)      5.4765 (1.64)     0.0000 (1.0)           0;0  0.1826 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3428 (1.0)      3.3428 (1.0)      3.3428 (1.0)      0.0000 (1.0)      3.3428 (1.0)      0.0000 (1.0)           0;0  0.2992 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.7275 (1.12)     3.7275 (1.12)     3.7275 (1.12)     0.0000 (1.0)      3.7275 (1.12)     0.0000 (1.0)           0;0  0.2683 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.8978 (2.02)     7.8978 (2.02)     7.8978 (2.02)     0.0000 (1.0)      7.8978 (2.02)     0.0000 (1.0)           0;0  0.1266 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4320 (1.65)     6.4320 (1.65)     6.4320 (1.65)     0.0000 (1.0)      6.4320 (1.65)     0.0000 (1.0)           0;0  0.1555 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2515 (1.60)     6.2515 (1.60)     6.2515 (1.60)     0.0000 (1.0)      6.2515 (1.60)     0.0000 (1.0)           0;0  0.1600 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9039 (1.0)      3.9039 (1.0)      3.9039 (1.0)      0.0000 (1.0)      3.9039 (1.0)      0.0000 (1.0)           0;0  0.2562 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.5298 (1.16)     4.5298 (1.16)     4.5298 (1.16)     0.0000 (1.0)      4.5298 (1.16)     0.0000 (1.0)           0;0  0.2208 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.7478 (2.48)     24.7478 (2.48)     24.7478 (2.48)     0.0000 (1.0)      24.7478 (2.48)     0.0000 (1.0)           0;0  0.0404 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     19.4854 (1.96)     19.4854 (1.96)     19.4854 (1.96)     0.0000 (1.0)      19.4854 (1.96)     0.0000 (1.0)           0;0  0.0513 (0.51)          1           1
test_checkout_symlink-checkout[3.53.2]     17.7053 (1.78)     17.7053 (1.78)     17.7053 (1.78)     0.0000 (1.0)      17.7053 (1.78)     0.0000 (1.0)           0;0  0.0565 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]      9.9627 (1.0)       9.9627 (1.0)       9.9627 (1.0)      0.0000 (1.0)       9.9627 (1.0)      0.0000 (1.0)           0;0  0.1004 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.9985 (1.10)     10.9985 (1.10)     10.9985 (1.10)     0.0000 (1.0)      10.9985 (1.10)     0.0000 (1.0)           0;0  0.0909 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8382 (1.56)     6.8382 (1.56)     6.8382 (1.56)     0.0000 (1.0)      6.8382 (1.56)     0.0000 (1.0)           0;0  0.1462 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8870 (1.58)     6.8870 (1.58)     6.8870 (1.58)     0.0000 (1.0)      6.8870 (1.58)     0.0000 (1.0)           0;0  0.1452 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7334 (1.54)     6.7334 (1.54)     6.7334 (1.54)     0.0000 (1.0)      6.7334 (1.54)     0.0000 (1.0)           0;0  0.1485 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3705 (1.0)      4.3705 (1.0)      4.3705 (1.0)      0.0000 (1.0)      4.3705 (1.0)      0.0000 (1.0)           0;0  0.2288 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.6157 (1.06)     4.6157 (1.06)     4.6157 (1.06)     0.0000 (1.0)      4.6157 (1.06)     0.0000 (1.0)           0;0  0.2167 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.9479 (1.68)     9.9479 (1.68)     9.9479 (1.68)     0.0000 (1.0)      9.9479 (1.68)     0.0000 (1.0)           0;0  0.1005 (0.60)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.5622 (1.44)     8.5622 (1.44)     8.5622 (1.44)     0.0000 (1.0)      8.5622 (1.44)     0.0000 (1.0)           0;0  0.1168 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.5181 (1.44)     8.5181 (1.44)     8.5181 (1.44)     0.0000 (1.0)      8.5181 (1.44)     0.0000 (1.0)           0;0  0.1174 (0.70)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.9297 (1.0)      5.9297 (1.0)      5.9297 (1.0)      0.0000 (1.0)      5.9297 (1.0)      0.0000 (1.0)           0;0  0.1686 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.5179 (1.10)     6.5179 (1.10)     6.5179 (1.10)     0.0000 (1.0)      6.5179 (1.10)     0.0000 (1.0)           0;0  0.1534 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0147 (1.72)     4.0147 (1.72)     4.0147 (1.72)     0.0000 (1.0)      4.0147 (1.72)     0.0000 (1.0)           0;0  0.2491 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7187 (2.02)     4.7187 (2.02)     4.7187 (2.02)     0.0000 (1.0)      4.7187 (2.02)     0.0000 (1.0)           0;0  0.2119 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.4936 (1.92)     4.4936 (1.92)     4.4936 (1.92)     0.0000 (1.0)      4.4936 (1.92)     0.0000 (1.0)           0;0  0.2225 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.3359 (1.0)      2.3359 (1.0)      2.3359 (1.0)      0.0000 (1.0)      2.3359 (1.0)      0.0000 (1.0)           0;0  0.4281 (1.0)           1           1
test_data_status-data-changed[main]       2.5783 (1.10)     2.5783 (1.10)     2.5783 (1.10)     0.0000 (1.0)      2.5783 (1.10)     0.0000 (1.0)           0;0  0.3878 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1704 (1.78)     4.1704 (1.78)     4.1704 (1.78)     0.0000 (1.0)      4.1704 (1.78)     0.0000 (1.0)           0;0  0.2398 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8369 (2.06)     4.8369 (2.06)     4.8369 (2.06)     0.0000 (1.0)      4.8369 (2.06)     0.0000 (1.0)           0;0  0.2067 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6596 (1.99)     4.6596 (1.99)     4.6596 (1.99)     0.0000 (1.0)      4.6596 (1.99)     0.0000 (1.0)           0;0  0.2146 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3424 (1.0)      2.3424 (1.0)      2.3424 (1.0)      0.0000 (1.0)      2.3424 (1.0)      0.0000 (1.0)           0;0  0.4269 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5757 (1.10)     2.5757 (1.10)     2.5757 (1.10)     0.0000 (1.0)      2.5757 (1.10)     0.0000 (1.0)           0;0  0.3882 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2536 (3.71)     18.2536 (3.71)     18.2536 (3.71)     0.0000 (1.0)      18.2536 (3.71)     0.0000 (1.0)           0;0  0.0548 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.0238 (3.86)     19.0238 (3.86)     19.0238 (3.86)     0.0000 (1.0)      19.0238 (3.86)     0.0000 (1.0)           0;0  0.0526 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.8520 (3.83)     18.8520 (3.83)     18.8520 (3.83)     0.0000 (1.0)      18.8520 (3.83)     0.0000 (1.0)           0;0  0.0530 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9265 (1.0)       4.9265 (1.0)       4.9265 (1.0)      0.0000 (1.0)       4.9265 (1.0)      0.0000 (1.0)           0;0  0.2030 (1.0)           1           1
test_data_status-data-new[main]        5.2260 (1.06)      5.2260 (1.06)      5.2260 (1.06)     0.0000 (1.0)       5.2260 (1.06)     0.0000 (1.0)           0;0  0.1914 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2235 (1.82)     4.2235 (1.82)     4.2235 (1.82)     0.0000 (1.0)      4.2235 (1.82)     0.0000 (1.0)           0;0  0.2368 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.8373 (2.08)     4.8373 (2.08)     4.8373 (2.08)     0.0000 (1.0)      4.8373 (2.08)     0.0000 (1.0)           0;0  0.2067 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6851 (2.01)     4.6851 (2.01)     4.6851 (2.01)     0.0000 (1.0)      4.6851 (2.01)     0.0000 (1.0)           0;0  0.2134 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.3265 (1.0)      2.3265 (1.0)      2.3265 (1.0)      0.0000 (1.0)      2.3265 (1.0)      0.0000 (1.0)           0;0  0.4298 (1.0)           1           1
test_data_status-data-noop[main]       2.5738 (1.11)     2.5738 (1.11)     2.5738 (1.11)     0.0000 (1.0)      2.5738 (1.11)     0.0000 (1.0)           0;0  0.3885 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1394 (1.30)     7.1394 (1.30)     7.1394 (1.30)     0.0000 (1.0)      7.1394 (1.30)     0.0000 (1.0)           0;0  0.1401 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8113 (1.42)     7.8113 (1.42)     7.8113 (1.42)     0.0000 (1.0)      7.8113 (1.42)     0.0000 (1.0)           0;0  0.1280 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6485 (1.39)     7.6485 (1.39)     7.6485 (1.39)     0.0000 (1.0)      7.6485 (1.39)     0.0000 (1.0)           0;0  0.1307 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5016 (1.0)      5.5016 (1.0)      5.5016 (1.0)      0.0000 (1.0)      5.5016 (1.0)      0.0000 (1.0)           0;0  0.1818 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9163 (1.08)     5.9163 (1.08)     5.9163 (1.08)     0.0000 (1.0)      5.9163 (1.08)     0.0000 (1.0)           0;0  0.1690 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1952 (1.29)     7.1952 (1.29)     7.1952 (1.29)     0.0000 (1.0)      7.1952 (1.29)     0.0000 (1.0)           0;0  0.1390 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7612 (1.39)     7.7612 (1.39)     7.7612 (1.39)     0.0000 (1.0)      7.7612 (1.39)     0.0000 (1.0)           0;0  0.1288 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7213 (1.38)     7.7213 (1.38)     7.7213 (1.38)     0.0000 (1.0)      7.7213 (1.38)     0.0000 (1.0)           0;0  0.1295 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5938 (1.0)      5.5938 (1.0)      5.5938 (1.0)      0.0000 (1.0)      5.5938 (1.0)      0.0000 (1.0)           0;0  0.1788 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.1110 (1.09)     6.1110 (1.09)     6.1110 (1.09)     0.0000 (1.0)      6.1110 (1.09)     0.0000 (1.0)           0;0  0.1636 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.2395 (2.66)     21.2395 (2.66)     21.2395 (2.66)     0.0000 (1.0)      21.2395 (2.66)     0.0000 (1.0)           0;0  0.0471 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.8844 (2.74)     21.8844 (2.74)     21.8844 (2.74)     0.0000 (1.0)      21.8844 (2.74)     0.0000 (1.0)           0;0  0.0457 (0.37)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.8774 (2.74)     21.8774 (2.74)     21.8774 (2.74)     0.0000 (1.0)      21.8774 (2.74)     0.0000 (1.0)           0;0  0.0457 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9930 (1.0)       7.9930 (1.0)       7.9930 (1.0)      0.0000 (1.0)       7.9930 (1.0)      0.0000 (1.0)           0;0  0.1251 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3737 (1.05)      8.3737 (1.05)      8.3737 (1.05)     0.0000 (1.0)       8.3737 (1.05)     0.0000 (1.0)           0;0  0.1194 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4092 (1.34)     6.4092 (1.34)     6.4092 (1.34)     0.0000 (1.0)      6.4092 (1.34)     0.0000 (1.0)           0;0  0.1560 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1782 (1.50)     7.1782 (1.50)     7.1782 (1.50)     0.0000 (1.0)      7.1782 (1.50)     0.0000 (1.0)           0;0  0.1393 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9302 (1.45)     6.9302 (1.45)     6.9302 (1.45)     0.0000 (1.0)      6.9302 (1.45)     0.0000 (1.0)           0;0  0.1443 (0.69)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7808 (1.0)      4.7808 (1.0)      4.7808 (1.0)      0.0000 (1.0)      4.7808 (1.0)      0.0000 (1.0)           0;0  0.2092 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2251 (1.09)     5.2251 (1.09)     5.2251 (1.09)     0.0000 (1.0)      5.2251 (1.09)     0.0000 (1.0)           0;0  0.1914 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.7982 (2.57)     17.7982 (2.57)     17.7982 (2.57)     0.0000 (1.0)      17.7982 (2.57)     0.0000 (1.0)           0;0  0.0562 (0.39)          1           1
test_diff-diff[3.10.0]     18.9869 (2.75)     18.9869 (2.75)     18.9869 (2.75)     0.0000 (1.0)      18.9869 (2.75)     0.0000 (1.0)           0;0  0.0527 (0.36)          1           1
test_diff-diff[3.53.2]     18.8311 (2.72)     18.8311 (2.72)     18.8311 (2.72)     0.0000 (1.0)      18.8311 (2.72)     0.0000 (1.0)           0;0  0.0531 (0.37)          1           1
test_diff-diff[3.60.1]      6.9123 (1.0)       6.9123 (1.0)       6.9123 (1.0)      0.0000 (1.0)       6.9123 (1.0)      0.0000 (1.0)           0;0  0.1447 (1.0)           1           1
test_diff-diff[main]        8.0237 (1.16)      8.0237 (1.16)      8.0237 (1.16)     0.0000 (1.0)       8.0237 (1.16)     0.0000 (1.0)           0;0  0.1246 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1814 (1.78)     6.1814 (1.78)     6.1814 (1.78)     0.0000 (1.0)      6.1814 (1.78)     0.0000 (1.0)           0;0  0.1618 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.6518 (1.91)     6.6518 (1.91)     6.6518 (1.91)     0.0000 (1.0)      6.6518 (1.91)     0.0000 (1.0)           0;0  0.1503 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.6763 (1.63)     5.6763 (1.63)     5.6763 (1.63)     0.0000 (1.0)      5.6763 (1.63)     0.0000 (1.0)           0;0  0.1762 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4768 (1.0)      3.4768 (1.0)      3.4768 (1.0)      0.0000 (1.0)      3.4768 (1.0)      0.0000 (1.0)           0;0  0.2876 (1.0)           1           1
test_diff-diff-changed[main]       4.3208 (1.24)     4.3208 (1.24)     4.3208 (1.24)     0.0000 (1.0)      4.3208 (1.24)     0.0000 (1.0)           0;0  0.2314 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1862 (1.51)     5.1862 (1.51)     5.1862 (1.51)     0.0000 (1.0)      5.1862 (1.51)     0.0000 (1.0)           0;0  0.1928 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9205 (1.72)     5.9205 (1.72)     5.9205 (1.72)     0.0000 (1.0)      5.9205 (1.72)     0.0000 (1.0)           0;0  0.1689 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6706 (1.65)     5.6706 (1.65)     5.6706 (1.65)     0.0000 (1.0)      5.6706 (1.65)     0.0000 (1.0)           0;0  0.1763 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4385 (1.0)      3.4385 (1.0)      3.4385 (1.0)      0.0000 (1.0)      3.4385 (1.0)      0.0000 (1.0)           0;0  0.2908 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2913 (1.25)     4.2913 (1.25)     4.2913 (1.25)     0.0000 (1.0)      4.2913 (1.25)     0.0000 (1.0)           0;0  0.2330 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0180 (1.17)     4.0180 (1.17)     4.0180 (1.17)     0.0000 (1.0)      4.0180 (1.17)     0.0000 (1.0)           0;0  0.2489 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.8348 (1.41)     4.8348 (1.41)     4.8348 (1.41)     0.0000 (1.0)      4.8348 (1.41)     0.0000 (1.0)           0;0  0.2068 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.6987 (1.67)     5.6987 (1.67)     5.6987 (1.67)     0.0000 (1.0)      5.6987 (1.67)     0.0000 (1.0)           0;0  0.1755 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.4214 (1.0)      3.4214 (1.0)      3.4214 (1.0)      0.0000 (1.0)      3.4214 (1.0)      0.0000 (1.0)           0;0  0.2923 (1.0)           1           1
test_diff-diff-noop[main]       4.3196 (1.26)     4.3196 (1.26)     4.3196 (1.26)     0.0000 (1.0)      4.3196 (1.26)     0.0000 (1.0)           0;0  0.2315 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0196 (1.0)       1.0196 (1.0)       1.0196 (1.0)      0.0000 (1.0)       1.0196 (1.0)      0.0000 (1.0)           0;0  0.9808 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.9798 (10.77)    10.9798 (10.77)    10.9798 (10.77)    0.0000 (1.0)      10.9798 (10.77)    0.0000 (1.0)           0;0  0.0911 (0.09)          1           1
test_exp_show-exp[3.53.2]      5.9607 (5.85)      5.9607 (5.85)      5.9607 (5.85)     0.0000 (1.0)       5.9607 (5.85)     0.0000 (1.0)           0;0  0.1678 (0.17)          1           1
test_exp_show-exp[3.60.1]      5.8968 (5.78)      5.8968 (5.78)      5.8968 (5.78)     0.0000 (1.0)       5.8968 (5.78)     0.0000 (1.0)           0;0  0.1696 (0.17)          1           1
test_exp_show-exp[main]       12.7841 (12.54)    12.7841 (12.54)    12.7841 (12.54)    0.0000 (1.0)      12.7841 (12.54)    0.0000 (1.0)           0;0  0.0782 (0.08)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.7627 (2.83)     66.7627 (2.83)     66.7627 (2.83)     0.0000 (1.0)      66.7627 (2.83)     0.0000 (1.0)           0;0  0.0150 (0.35)          1           1
test_fetch-fetch[3.10.0]     72.7180 (3.08)     72.7180 (3.08)     72.7180 (3.08)     0.0000 (1.0)      72.7180 (3.08)     0.0000 (1.0)           0;0  0.0138 (0.32)          1           1
test_fetch-fetch[3.53.2]     33.2638 (1.41)     33.2638 (1.41)     33.2638 (1.41)     0.0000 (1.0)      33.2638 (1.41)     0.0000 (1.0)           0;0  0.0301 (0.71)          1           1
test_fetch-fetch[3.60.1]     23.5874 (1.0)      23.5874 (1.0)      23.5874 (1.0)      0.0000 (1.0)      23.5874 (1.0)      0.0000 (1.0)           0;0  0.0424 (1.0)           1           1
test_fetch-fetch[main]       23.8844 (1.01)     23.8844 (1.01)     23.8844 (1.01)     0.0000 (1.0)      23.8844 (1.01)     0.0000 (1.0)           0;0  0.0419 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8088 (1.0)      2.8088 (1.0)      2.8088 (1.0)      0.0000 (1.0)      2.8088 (1.0)      0.0000 (1.0)           0;0  0.3560 (1.0)           1           1
test_gc-gc[3.10.0]     2.9375 (1.05)     2.9375 (1.05)     2.9375 (1.05)     0.0000 (1.0)      2.9375 (1.05)     0.0000 (1.0)           0;0  0.3404 (0.96)          1           1
test_gc-gc[3.53.2]     2.8744 (1.02)     2.8744 (1.02)     2.8744 (1.02)     0.0000 (1.0)      2.8744 (1.02)     0.0000 (1.0)           0;0  0.3479 (0.98)          1           1
test_gc-gc[3.60.1]     2.8297 (1.01)     2.8297 (1.01)     2.8297 (1.01)     0.0000 (1.0)      2.8297 (1.01)     0.0000 (1.0)           0;0  0.3534 (0.99)          1           1
test_gc-gc[main]       3.0160 (1.07)     3.0160 (1.07)     3.0160 (1.07)     0.0000 (1.0)      3.0160 (1.07)     0.0000 (1.0)           0;0  0.3316 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     133.2168 (2.67)     133.2168 (2.67)     133.2168 (2.67)     0.0000 (1.0)      133.2168 (2.67)     0.0000 (1.0)           0;0  0.0075 (0.37)          1           1
test_get-get[3.10.0]     161.5344 (3.23)     161.5344 (3.23)     161.5344 (3.23)     0.0000 (1.0)      161.5344 (3.23)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     142.0264 (2.84)     142.0264 (2.84)     142.0264 (2.84)     0.0000 (1.0)      142.0264 (2.84)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      49.9533 (1.0)       49.9533 (1.0)       49.9533 (1.0)      0.0000 (1.0)       49.9533 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
test_get-get[main]        49.9896 (1.00)      49.9896 (1.00)      49.9896 (1.00)     0.0000 (1.0)       49.9896 (1.00)     0.0000 (1.0)           0;0  0.0200 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.9301 (2.75)     45.9301 (2.75)     45.9301 (2.75)     0.0000 (1.0)      45.9301 (2.75)     0.0000 (1.0)           0;0  0.0218 (0.36)          1           1
test_get_url-get-url[3.10.0]     49.2189 (2.95)     49.2189 (2.95)     49.2189 (2.95)     0.0000 (1.0)      49.2189 (2.95)     0.0000 (1.0)           0;0  0.0203 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.6814 (1.0)      16.6814 (1.0)      16.6814 (1.0)      0.0000 (1.0)      16.6814 (1.0)      0.0000 (1.0)           0;0  0.0599 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.7396 (1.00)     16.7396 (1.00)     16.7396 (1.00)     0.0000 (1.0)      16.7396 (1.00)     0.0000 (1.0)           0;0  0.0597 (1.00)          1           1
test_get_url-get-url[main]       16.9729 (1.02)     16.9729 (1.02)     16.9729 (1.02)     0.0000 (1.0)      16.9729 (1.02)     0.0000 (1.0)           0;0  0.0589 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     122.4582 (1.06)     128.8552 (1.01)     124.1608 (1.03)     1.4203 (1.27)     123.8221 (1.04)     1.3637 (1.0)          22;8  8.0541 (0.97)        100           1
test_help---help[3.10.0]     121.1054 (1.05)     127.4051 (1.0)      122.9640 (1.02)     1.1180 (1.0)      122.8342 (1.03)     1.5908 (1.17)         30;1  8.1325 (0.98)        100           1
test_help---help[3.53.2]     122.8599 (1.06)     137.5711 (1.08)     126.7015 (1.05)     3.1416 (2.81)     125.6088 (1.05)     4.0909 (3.00)         23;3  7.8926 (0.95)        100           1
test_help---help[3.60.1]     123.9472 (1.07)     132.6490 (1.04)     126.0469 (1.05)     1.9219 (1.72)     125.3348 (1.05)     2.2060 (1.62)         20;5  7.9336 (0.96)        100           1
test_help---help[main]       115.5740 (1.0)      144.9035 (1.14)     120.3941 (1.0)      5.8091 (5.20)     119.1893 (1.0)      5.0401 (3.70)          9;6  8.3061 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     222.8648 (2.87)     222.8648 (2.87)     222.8648 (2.87)     0.0000 (1.0)      222.8648 (2.87)     0.0000 (1.0)           0;0  0.0045 (0.35)          1           1
test_import-import[3.10.0]     252.5498 (3.25)     252.5498 (3.25)     252.5498 (3.25)     0.0000 (1.0)      252.5498 (3.25)     0.0000 (1.0)           0;0  0.0040 (0.31)          1           1
test_import-import[3.60.1]      77.7501 (1.0)       77.7501 (1.0)       77.7501 (1.0)      0.0000 (1.0)       77.7501 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
test_import-import[main]        80.6056 (1.04)      80.6056 (1.04)      80.6056 (1.04)     0.0000 (1.0)       80.6056 (1.04)     0.0000 (1.0)           0;0  0.0124 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     151.9170 (3.24)     151.9170 (3.24)     151.9170 (3.24)     0.0000 (1.0)      151.9170 (3.24)     0.0000 (1.0)           0;0  0.0066 (0.31)          1           1
test_import_url-import-url[3.10.0]     154.2758 (3.29)     154.2758 (3.29)     154.2758 (3.29)     0.0000 (1.0)      154.2758 (3.29)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.53.2]     112.1523 (2.39)     112.1523 (2.39)     112.1523 (2.39)     0.0000 (1.0)      112.1523 (2.39)     0.0000 (1.0)           0;0  0.0089 (0.42)          1           1
test_import_url-import-url[3.60.1]      46.9054 (1.0)       46.9054 (1.0)       46.9054 (1.0)      0.0000 (1.0)       46.9054 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_import_url-import-url[main]        48.4386 (1.03)      48.4386 (1.03)      48.4386 (1.03)     0.0000 (1.0)       48.4386 (1.03)     0.0000 (1.0)           0;0  0.0206 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     396.7683 (1.00)     450.2443 (1.0)      409.3967 (1.0)       7.4310 (1.0)      408.2189 (1.0)       7.7606 (1.03)         21;2  2.4426 (1.0)         100           1
test_init-init[3.10.0]     405.8187 (1.02)     467.9403 (1.04)     420.5943 (1.03)      7.5078 (1.01)     419.7020 (1.03)      7.8886 (1.05)         20;2  2.3776 (0.97)        100           1
test_init-init[3.53.2]     396.2153 (1.0)      473.4282 (1.05)     411.0415 (1.00)      8.6817 (1.17)     410.3790 (1.01)      7.5437 (1.0)          15;4  2.4328 (1.00)        100           1
test_init-init[3.60.1]     397.0306 (1.00)     452.0653 (1.00)     416.1594 (1.02)      7.7783 (1.05)     416.2186 (1.02)      9.3877 (1.24)         28;1  2.4029 (0.98)        100           1
test_init-init[main]       429.3914 (1.08)     552.8358 (1.23)     448.7111 (1.10)     17.1127 (2.30)     446.6099 (1.09)     10.4616 (1.39)          9;6  2.2286 (0.91)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     585.9179 (1.08)     585.9179 (1.08)     585.9179 (1.08)     0.0000 (1.0)      585.9179 (1.08)     0.0000 (1.0)           0;0  1.7067 (0.93)          1           1
test_list-list[3.10.0]     664.6442 (1.22)     664.6442 (1.22)     664.6442 (1.22)     0.0000 (1.0)      664.6442 (1.22)     0.0000 (1.0)           0;0  1.5046 (0.82)          1           1
test_list-list[3.53.2]     581.1163 (1.07)     581.1163 (1.07)     581.1163 (1.07)     0.0000 (1.0)      581.1163 (1.07)     0.0000 (1.0)           0;0  1.7208 (0.94)          1           1
test_list-list[3.60.1]     544.9825 (1.0)      544.9825 (1.0)      544.9825 (1.0)      0.0000 (1.0)      544.9825 (1.0)      0.0000 (1.0)           0;0  1.8349 (1.0)           1           1
test_list-list[main]       545.4439 (1.00)     545.4439 (1.00)     545.4439 (1.00)     0.0000 (1.0)      545.4439 (1.00)     0.0000 (1.0)           0;0  1.8334 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     420.9026 (1.05)     420.9026 (1.05)     420.9026 (1.05)     0.0000 (1.0)      420.9026 (1.05)     0.0000 (1.0)           0;0  2.3758 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     418.1213 (1.04)     418.1213 (1.04)     418.1213 (1.04)     0.0000 (1.0)      418.1213 (1.04)     0.0000 (1.0)           0;0  2.3917 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     402.3403 (1.0)      402.3403 (1.0)      402.3403 (1.0)      0.0000 (1.0)      402.3403 (1.0)      0.0000 (1.0)           0;0  2.4855 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     423.2616 (1.05)     423.2616 (1.05)     423.2616 (1.05)     0.0000 (1.0)      423.2616 (1.05)     0.0000 (1.0)           0;0  2.3626 (0.95)          1           1
test_list-list-dvc-only[main]       409.9513 (1.02)     409.9513 (1.02)     409.9513 (1.02)     0.0000 (1.0)      409.9513 (1.02)     0.0000 (1.0)           0;0  2.4393 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7822 (1.03)     2.7822 (1.03)     2.7822 (1.03)     0.0000 (1.0)      2.7822 (1.03)     0.0000 (1.0)           0;0  0.3594 (0.97)          1           1
test_list-list-recursive[3.10.0]     2.6979 (1.0)      2.6979 (1.0)      2.6979 (1.0)      0.0000 (1.0)      2.6979 (1.0)      0.0000 (1.0)           0;0  0.3707 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.7713 (1.03)     2.7713 (1.03)     2.7713 (1.03)     0.0000 (1.0)      2.7713 (1.03)     0.0000 (1.0)           0;0  0.3608 (0.97)          1           1
test_list-list-recursive[3.60.1]     2.9526 (1.09)     2.9526 (1.09)     2.9526 (1.09)     0.0000 (1.0)      2.9526 (1.09)     0.0000 (1.0)           0;0  0.3387 (0.91)          1           1
test_list-list-recursive[main]       2.9357 (1.09)     2.9357 (1.09)     2.9357 (1.09)     0.0000 (1.0)      2.9357 (1.09)     0.0000 (1.0)           0;0  0.3406 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     448.9148 (1.10)     448.9148 (1.10)     448.9148 (1.10)     0.0000 (1.0)      448.9148 (1.10)     0.0000 (1.0)           0;0  2.2276 (0.91)          1           1
test_list-list-shallow[3.10.0]     423.5299 (1.03)     423.5299 (1.03)     423.5299 (1.03)     0.0000 (1.0)      423.5299 (1.03)     0.0000 (1.0)           0;0  2.3611 (0.97)          1           1
test_list-list-shallow[3.53.2]     409.2770 (1.0)      409.2770 (1.0)      409.2770 (1.0)      0.0000 (1.0)      409.2770 (1.0)      0.0000 (1.0)           0;0  2.4433 (1.0)           1           1
test_list-list-shallow[3.60.1]     416.5285 (1.02)     416.5285 (1.02)     416.5285 (1.02)     0.0000 (1.0)      416.5285 (1.02)     0.0000 (1.0)           0;0  2.4008 (0.98)          1           1
test_list-list-shallow[main]       416.4103 (1.02)     416.4103 (1.02)     416.4103 (1.02)     0.0000 (1.0)      416.4103 (1.02)     0.0000 (1.0)           0;0  2.4015 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.4704 (3.64)     71.4704 (3.64)     71.4704 (3.64)     0.0000 (1.0)      71.4704 (3.64)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.10.0]     73.0684 (3.73)     73.0684 (3.73)     73.0684 (3.73)     0.0000 (1.0)      73.0684 (3.73)     0.0000 (1.0)           0;0  0.0137 (0.27)          1           1
test_partial_add-add[3.53.2]     64.3869 (3.28)     64.3869 (3.28)     64.3869 (3.28)     0.0000 (1.0)      64.3869 (3.28)     0.0000 (1.0)           0;0  0.0155 (0.30)          1           1
test_partial_add-add[3.60.1]     19.6150 (1.0)      19.6150 (1.0)      19.6150 (1.0)      0.0000 (1.0)      19.6150 (1.0)      0.0000 (1.0)           0;0  0.0510 (1.0)           1           1
test_partial_add-add[main]       20.6444 (1.05)     20.6444 (1.05)     20.6444 (1.05)     0.0000 (1.0)      20.6444 (1.05)     0.0000 (1.0)           0;0  0.0484 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     60.5672 (7.81)     60.5672 (7.81)     60.5672 (7.81)     0.0000 (1.0)      60.5672 (7.81)     0.0000 (1.0)           0;0  0.0165 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     61.1441 (7.88)     61.1441 (7.88)     61.1441 (7.88)     0.0000 (1.0)      61.1441 (7.88)     0.0000 (1.0)           0;0  0.0164 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     55.0538 (7.09)     55.0538 (7.09)     55.0538 (7.09)     0.0000 (1.0)      55.0538 (7.09)     0.0000 (1.0)           0;0  0.0182 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.7597 (1.0)       7.7597 (1.0)       7.7597 (1.0)      0.0000 (1.0)       7.7597 (1.0)      0.0000 (1.0)           0;0  0.1289 (1.0)           1           1
test_partial_add-add-partial[main]        8.1797 (1.05)      8.1797 (1.05)      8.1797 (1.05)     0.0000 (1.0)       8.1797 (1.05)     0.0000 (1.0)           0;0  0.1223 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4045 (1.0)      4.4045 (1.0)      4.4045 (1.0)      0.0000 (1.0)      4.4045 (1.0)      0.0000 (1.0)           0;0  0.2270 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9335 (1.35)     5.9335 (1.35)     5.9335 (1.35)     0.0000 (1.0)      5.9335 (1.35)     0.0000 (1.0)           0;0  0.1685 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.8622 (1.56)     6.8622 (1.56)     6.8622 (1.56)     0.0000 (1.0)      6.8622 (1.56)     0.0000 (1.0)           0;0  0.1457 (0.64)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5538 (1.49)     6.5538 (1.49)     6.5538 (1.49)     0.0000 (1.0)      6.5538 (1.49)     0.0000 (1.0)           0;0  0.1526 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.6934 (1.52)     6.6934 (1.52)     6.6934 (1.52)     0.0000 (1.0)      6.6934 (1.52)     0.0000 (1.0)           0;0  0.1494 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3763 (1.0)      2.3763 (1.0)      2.3763 (1.0)      0.0000 (1.0)      2.3763 (1.0)      0.0000 (1.0)           0;0  0.4208 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6535 (1.54)     3.6535 (1.54)     3.6535 (1.54)     0.0000 (1.0)      3.6535 (1.54)     0.0000 (1.0)           0;0  0.2737 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.6507 (1.54)     3.6507 (1.54)     3.6507 (1.54)     0.0000 (1.0)      3.6507 (1.54)     0.0000 (1.0)           0;0  0.2739 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.8002 (1.60)     3.8002 (1.60)     3.8002 (1.60)     0.0000 (1.0)      3.8002 (1.60)     0.0000 (1.0)           0;0  0.2631 (0.63)          1           1
test_partial_add-gc-noop[main]       3.6976 (1.56)     3.6976 (1.56)     3.6976 (1.56)     0.0000 (1.0)      3.6976 (1.56)     0.0000 (1.0)           0;0  0.2704 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.3204 (2.37)     44.3204 (2.37)     44.3204 (2.37)     0.0000 (1.0)      44.3204 (2.37)     0.0000 (1.0)           0;0  0.0226 (0.42)          1           1
test_partial_add-push[3.10.0]     39.4995 (2.11)     39.4995 (2.11)     39.4995 (2.11)     0.0000 (1.0)      39.4995 (2.11)     0.0000 (1.0)           0;0  0.0253 (0.47)          1           1
test_partial_add-push[3.53.2]     19.1800 (1.03)     19.1800 (1.03)     19.1800 (1.03)     0.0000 (1.0)      19.1800 (1.03)     0.0000 (1.0)           0;0  0.0521 (0.97)          1           1
test_partial_add-push[3.60.1]     18.6902 (1.0)      18.6902 (1.0)      18.6902 (1.0)      0.0000 (1.0)      18.6902 (1.0)      0.0000 (1.0)           0;0  0.0535 (1.0)           1           1
test_partial_add-push[main]       18.8945 (1.01)     18.8945 (1.01)     18.8945 (1.01)     0.0000 (1.0)      18.8945 (1.01)     0.0000 (1.0)           0;0  0.0529 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.2813 (1.12)     11.2813 (1.12)     11.2813 (1.12)     0.0000 (1.0)      11.2813 (1.12)     0.0000 (1.0)           0;0  0.0886 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.6525 (1.05)     10.6525 (1.05)     10.6525 (1.05)     0.0000 (1.0)      10.6525 (1.05)     0.0000 (1.0)           0;0  0.0939 (0.95)          1           1
test_partial_add-push-partial[3.53.2]     10.4247 (1.03)     10.4247 (1.03)     10.4247 (1.03)     0.0000 (1.0)      10.4247 (1.03)     0.0000 (1.0)           0;0  0.0959 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.1048 (1.0)      10.1048 (1.0)      10.1048 (1.0)      0.0000 (1.0)      10.1048 (1.0)      0.0000 (1.0)           0;0  0.0990 (1.0)           1           1
test_partial_add-push-partial[main]       10.1676 (1.01)     10.1676 (1.01)     10.1676 (1.01)     0.0000 (1.0)      10.1676 (1.01)     0.0000 (1.0)           0;0  0.0984 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.8054 (3.69)     83.8054 (3.69)     83.8054 (3.69)     0.0000 (1.0)      83.8054 (3.69)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.6093 (3.73)     84.6093 (3.73)     84.6093 (3.73)     0.0000 (1.0)      84.6093 (3.73)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.8421 (3.34)     75.8421 (3.34)     75.8421 (3.34)     0.0000 (1.0)      75.8421 (3.34)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.7052 (1.0)      22.7052 (1.0)      22.7052 (1.0)      0.0000 (1.0)      22.7052 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_partial_remove-add[main]       23.7477 (1.05)     23.7477 (1.05)     23.7477 (1.05)     0.0000 (1.0)      23.7477 (1.05)     0.0000 (1.0)           0;0  0.0421 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.4717 (8.01)     8.4717 (8.01)     8.4717 (8.01)     0.0000 (1.0)      8.4717 (8.01)     0.0000 (1.0)           0;0  0.1180 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.5294 (8.06)     8.5294 (8.06)     8.5294 (8.06)     0.0000 (1.0)      8.5294 (8.06)     0.0000 (1.0)           0;0  0.1172 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.4489 (7.04)     7.4489 (7.04)     7.4489 (7.04)     0.0000 (1.0)      7.4489 (7.04)     0.0000 (1.0)           0;0  0.1342 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0579 (1.0)      1.0579 (1.0)      1.0579 (1.0)      0.0000 (1.0)      1.0579 (1.0)      0.0000 (1.0)           0;0  0.9453 (1.0)           1           1
test_partial_remove-add-update[main]       1.0956 (1.04)     1.0956 (1.04)     1.0956 (1.04)     0.0000 (1.0)      1.0956 (1.04)     0.0000 (1.0)           0;0  0.9127 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2952 (1.0)      3.2952 (1.0)      3.2952 (1.0)      0.0000 (1.0)      3.2952 (1.0)      0.0000 (1.0)           0;0  0.3035 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5365 (1.07)     3.5365 (1.07)     3.5365 (1.07)     0.0000 (1.0)      3.5365 (1.07)     0.0000 (1.0)           0;0  0.2828 (0.93)          1           1
test_partial_remove-gc[3.53.2]     3.7265 (1.13)     3.7265 (1.13)     3.7265 (1.13)     0.0000 (1.0)      3.7265 (1.13)     0.0000 (1.0)           0;0  0.2683 (0.88)          1           1
test_partial_remove-gc[3.60.1]     3.5287 (1.07)     3.5287 (1.07)     3.5287 (1.07)     0.0000 (1.0)      3.5287 (1.07)     0.0000 (1.0)           0;0  0.2834 (0.93)          1           1
test_partial_remove-gc[main]       3.6421 (1.11)     3.6421 (1.11)     3.6421 (1.11)     0.0000 (1.0)      3.6421 (1.11)     0.0000 (1.0)           0;0  0.2746 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8627 (1.03)     4.8627 (1.03)     4.8627 (1.03)     0.0000 (1.0)      4.8627 (1.03)     0.0000 (1.0)           0;0  0.2056 (0.97)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.0292 (1.07)     5.0292 (1.07)     5.0292 (1.07)     0.0000 (1.0)      5.0292 (1.07)     0.0000 (1.0)           0;0  0.1988 (0.94)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0284 (1.07)     5.0284 (1.07)     5.0284 (1.07)     0.0000 (1.0)      5.0284 (1.07)     0.0000 (1.0)           0;0  0.1989 (0.94)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.7351 (1.00)     4.7351 (1.00)     4.7351 (1.00)     0.0000 (1.0)      4.7351 (1.00)     0.0000 (1.0)           0;0  0.2112 (1.00)          1           1
test_partial_remove-gc-cloud[main]       4.7182 (1.0)      4.7182 (1.0)      4.7182 (1.0)      0.0000 (1.0)      4.7182 (1.0)      0.0000 (1.0)           0;0  0.2119 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.3487 (2.31)     51.3487 (2.31)     51.3487 (2.31)     0.0000 (1.0)      51.3487 (2.31)     0.0000 (1.0)           0;0  0.0195 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.1655 (2.07)     46.1655 (2.07)     46.1655 (2.07)     0.0000 (1.0)      46.1655 (2.07)     0.0000 (1.0)           0;0  0.0217 (0.48)          1           1
test_partial_remove-push[3.53.2]     23.1220 (1.04)     23.1220 (1.04)     23.1220 (1.04)     0.0000 (1.0)      23.1220 (1.04)     0.0000 (1.0)           0;0  0.0432 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.3541 (1.00)     22.3541 (1.00)     22.3541 (1.00)     0.0000 (1.0)      22.3541 (1.00)     0.0000 (1.0)           0;0  0.0447 (1.00)          1           1
test_partial_remove-push[main]       22.2659 (1.0)      22.2659 (1.0)      22.2659 (1.0)      0.0000 (1.0)      22.2659 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8592 (1.01)     1.8592 (1.01)     1.8592 (1.01)     0.0000 (1.0)      1.8592 (1.01)     0.0000 (1.0)           0;0  0.5379 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     1.8403 (1.0)      1.8403 (1.0)      1.8403 (1.0)      0.0000 (1.0)      1.8403 (1.0)      0.0000 (1.0)           0;0  0.5434 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5128 (1.37)     2.5128 (1.37)     2.5128 (1.37)     0.0000 (1.0)      2.5128 (1.37)     0.0000 (1.0)           0;0  0.3980 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.6013 (1.41)     2.6013 (1.41)     2.6013 (1.41)     0.0000 (1.0)      2.6013 (1.41)     0.0000 (1.0)           0;0  0.3844 (0.71)          1           1
test_partial_remove-push-update[main]       2.5220 (1.37)     2.5220 (1.37)     2.5220 (1.37)     0.0000 (1.0)      2.5220 (1.37)     0.0000 (1.0)           0;0  0.3965 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     493.8344 (1.0)      497.0480 (1.0)      495.7801 (1.0)      1.2937 (1.0)      496.2239 (1.0)      1.9038 (1.05)          1;0  2.0170 (1.0)           5           3
test_plots-plots-diff[3.10.0]     890.7839 (1.80)     898.5783 (1.81)     895.4243 (1.81)     3.1851 (2.46)     896.3123 (1.81)     4.9731 (2.75)          1;0  1.1168 (0.55)          5           3
test_plots-plots-diff[3.53.2]     809.5099 (1.64)     818.1833 (1.65)     814.0488 (1.64)     3.7914 (2.93)     813.0180 (1.64)     6.6320 (3.66)          2;0  1.2284 (0.61)          5           3
test_plots-plots-diff[3.60.1]     811.9786 (1.64)     819.9429 (1.65)     815.3117 (1.64)     3.9218 (3.03)     812.7975 (1.64)     6.9550 (3.84)          1;0  1.2265 (0.61)          5           3
test_plots-plots-diff[main]       811.7007 (1.64)     815.2174 (1.64)     813.2520 (1.64)     1.3345 (1.03)     813.2475 (1.64)     1.8105 (1.0)           2;0  1.2296 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       509.7284 (1.0)        527.9407 (1.0)        514.5903 (1.0)       7.5504 (4.95)       511.6097 (1.0)       6.0934 (2.52)          1;1  1.9433 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,120.8812 (2.20)     1,127.7600 (2.14)     1,123.9942 (2.18)      2.7066 (1.78)     1,124.1823 (2.20)      4.1014 (1.69)          2;0  0.8897 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       885.5947 (1.74)       893.6761 (1.69)       888.7655 (1.73)      3.3478 (2.20)       889.2014 (1.74)      5.0402 (2.08)          1;0  1.1252 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]       889.6174 (1.75)       893.3809 (1.69)       891.4901 (1.73)      1.5241 (1.0)        891.0693 (1.74)      2.4225 (1.0)           2;0  1.1217 (0.58)          5           3
test_plots-plots-diff-json[main]         887.4448 (1.74)       933.7111 (1.77)       899.3442 (1.75)     19.3095 (12.67)      891.6328 (1.74)     12.2481 (5.06)          1;1  1.1119 (0.57)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     418.4975 (1.0)      430.7571 (1.0)      422.0652 (1.0)       5.0611 (3.13)     419.6673 (1.0)       5.3684 (2.40)          1;0  2.3693 (1.0)           5           3
test_plots-plots-show[3.10.0]     720.2212 (1.72)     726.5844 (1.69)     722.7089 (1.71)      2.7290 (1.69)     722.1214 (1.72)      4.5748 (2.04)          1;0  1.3837 (0.58)          5           3
test_plots-plots-show[3.53.2]     692.2105 (1.65)     696.2028 (1.62)     693.6329 (1.64)      1.6155 (1.0)      693.2129 (1.65)      2.2397 (1.0)           1;0  1.4417 (0.61)          5           3
test_plots-plots-show[3.60.1]     701.7093 (1.68)     714.5753 (1.66)     709.8317 (1.68)      5.3359 (3.30)     712.0307 (1.70)      7.9458 (3.55)          1;0  1.4088 (0.59)          5           3
test_plots-plots-show[main]       704.9772 (1.68)     738.7994 (1.72)     716.1223 (1.70)     13.7980 (8.54)     711.6855 (1.70)     17.8361 (7.96)          1;0  1.3964 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     432.4211 (1.0)      451.8765 (1.0)      436.8396 (1.0)      8.4359 (8.27)     433.0886 (1.0)      6.1077 (4.30)          1;1  2.2892 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     847.2723 (1.96)     854.0598 (1.89)     851.3425 (1.95)     2.7489 (2.70)     852.6043 (1.97)     3.9912 (2.81)          1;0  1.1746 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     738.4695 (1.71)     741.0678 (1.64)     739.9417 (1.69)     1.0197 (1.0)      740.3800 (1.71)     1.4199 (1.0)           2;0  1.3515 (0.59)          5           3
test_plots-plots-show-json[3.60.1]     743.1321 (1.72)     754.2608 (1.67)     749.4158 (1.72)     4.1211 (4.04)     750.7139 (1.73)     4.7031 (3.31)          2;0  1.3344 (0.58)          5           3
test_plots-plots-show-json[main]       741.8518 (1.72)     752.8052 (1.67)     745.3586 (1.71)     4.3024 (4.22)     744.2332 (1.72)     3.8332 (2.70)          1;1  1.3416 (0.59)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.6514 (2.46)     52.6514 (2.46)     52.6514 (2.46)     0.0000 (1.0)      52.6514 (2.46)     0.0000 (1.0)           0;0  0.0190 (0.41)          1           1
test_push-push[3.10.0]     47.2219 (2.21)     47.2219 (2.21)     47.2219 (2.21)     0.0000 (1.0)      47.2219 (2.21)     0.0000 (1.0)           0;0  0.0212 (0.45)          1           1
test_push-push[3.53.2]     22.6486 (1.06)     22.6486 (1.06)     22.6486 (1.06)     0.0000 (1.0)      22.6486 (1.06)     0.0000 (1.0)           0;0  0.0442 (0.94)          1           1
test_push-push[3.60.1]     21.4017 (1.0)      21.4017 (1.0)      21.4017 (1.0)      0.0000 (1.0)      21.4017 (1.0)      0.0000 (1.0)           0;0  0.0467 (1.0)           1           1
test_push-push[main]       21.9832 (1.03)     21.9832 (1.03)     21.9832 (1.03)     0.0000 (1.0)      21.9832 (1.03)     0.0000 (1.0)           0;0  0.0455 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.7307 (2.76)     64.7307 (2.76)     64.7307 (2.76)     0.0000 (1.0)      64.7307 (2.76)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.8897 (2.98)     69.8897 (2.98)     69.8897 (2.98)     0.0000 (1.0)      69.8897 (2.98)     0.0000 (1.0)           0;0  0.0143 (0.34)          1           1
test_sharing-fetch[3.53.2]     33.7864 (1.44)     33.7864 (1.44)     33.7864 (1.44)     0.0000 (1.0)      33.7864 (1.44)     0.0000 (1.0)           0;0  0.0296 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.4253 (1.0)      23.4253 (1.0)      23.4253 (1.0)      0.0000 (1.0)      23.4253 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
test_sharing-fetch[main]       23.7668 (1.01)     23.7668 (1.01)     23.7668 (1.01)     0.0000 (1.0)      23.7668 (1.01)     0.0000 (1.0)           0;0  0.0421 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2753 (1.0)      1.2753 (1.0)      1.2753 (1.0)      0.0000 (1.0)      1.2753 (1.0)      0.0000 (1.0)           0;0  0.7841 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5573 (2.79)     3.5573 (2.79)     3.5573 (2.79)     0.0000 (1.0)      3.5573 (2.79)     0.0000 (1.0)           0;0  0.2811 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     5.7196 (4.48)     5.7196 (4.48)     5.7196 (4.48)     0.0000 (1.0)      5.7196 (4.48)     0.0000 (1.0)           0;0  0.1748 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9203 (4.64)     5.9203 (4.64)     5.9203 (4.64)     0.0000 (1.0)      5.9203 (4.64)     0.0000 (1.0)           0;0  0.1689 (0.22)          1           1
test_sharing-fetch-noop[main]       5.9240 (4.65)     5.9240 (4.65)     5.9240 (4.65)     0.0000 (1.0)      5.9240 (4.65)     0.0000 (1.0)           0;0  0.1688 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.8373 (2.40)     52.8373 (2.40)     52.8373 (2.40)     0.0000 (1.0)      52.8373 (2.40)     0.0000 (1.0)           0;0  0.0189 (0.42)          1           1
test_sharing-push[3.10.0]     46.8157 (2.12)     46.8157 (2.12)     46.8157 (2.12)     0.0000 (1.0)      46.8157 (2.12)     0.0000 (1.0)           0;0  0.0214 (0.47)          1           1
test_sharing-push[3.53.2]     22.6104 (1.03)     22.6104 (1.03)     22.6104 (1.03)     0.0000 (1.0)      22.6104 (1.03)     0.0000 (1.0)           0;0  0.0442 (0.98)          1           1
test_sharing-push[3.60.1]     22.0588 (1.0)      22.0588 (1.0)      22.0588 (1.0)      0.0000 (1.0)      22.0588 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
test_sharing-push[main]       22.7398 (1.03)     22.7398 (1.03)     22.7398 (1.03)     0.0000 (1.0)      22.7398 (1.03)     0.0000 (1.0)           0;0  0.0440 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1374 (1.00)     2.1374 (1.00)     2.1374 (1.00)     0.0000 (1.0)      2.1374 (1.00)     0.0000 (1.0)           0;0  0.4679 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.1362 (1.0)      2.1362 (1.0)      2.1362 (1.0)      0.0000 (1.0)      2.1362 (1.0)      0.0000 (1.0)           0;0  0.4681 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9946 (2.81)     5.9946 (2.81)     5.9946 (2.81)     0.0000 (1.0)      5.9946 (2.81)     0.0000 (1.0)           0;0  0.1668 (0.36)          1           1
test_sharing-push-noop[3.60.1]     6.3095 (2.95)     6.3095 (2.95)     6.3095 (2.95)     0.0000 (1.0)      6.3095 (2.95)     0.0000 (1.0)           0;0  0.1585 (0.34)          1           1
test_sharing-push-noop[main]       6.0287 (2.82)     6.0287 (2.82)     6.0287 (2.82)     0.0000 (1.0)      6.0287 (2.82)     0.0000 (1.0)           0;0  0.1659 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     346.5284 (1.04)     346.5284 (1.04)     346.5284 (1.04)     0.0000 (1.0)      346.5284 (1.04)     0.0000 (1.0)           0;0  0.0029 (0.96)          1           1
test_sharing_azure-fetch[main]       332.9620 (1.0)      332.9620 (1.0)      332.9620 (1.0)      0.0000 (1.0)      332.9620 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.5184 (1.0)      6.5184 (1.0)      6.5184 (1.0)      0.0000 (1.0)      6.5184 (1.0)      0.0000 (1.0)           0;0  0.1534 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6942 (1.03)     6.6942 (1.03)     6.6942 (1.03)     0.0000 (1.0)      6.6942 (1.03)     0.0000 (1.0)           0;0  0.1494 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     340.5632 (1.00)     340.5632 (1.00)     340.5632 (1.00)     0.0000 (1.0)      340.5632 (1.00)     0.0000 (1.0)           0;0  0.0029 (1.00)          1           1
test_sharing_azure-push[main]       339.1262 (1.0)      339.1262 (1.0)      339.1262 (1.0)      0.0000 (1.0)      339.1262 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.7744 (1.0)      7.7744 (1.0)      7.7744 (1.0)      0.0000 (1.0)      7.7744 (1.0)      0.0000 (1.0)           0;0  0.1286 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.8478 (1.01)     7.8478 (1.01)     7.8478 (1.01)     0.0000 (1.0)      7.8478 (1.01)     0.0000 (1.0)           0;0  0.1274 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     338.8566 (1.0)      338.8566 (1.0)      338.8566 (1.0)      0.0000 (1.0)      338.8566 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
test_sharing_gs-fetch[main]       349.1725 (1.03)     349.1725 (1.03)     349.1725 (1.03)     0.0000 (1.0)      349.1725 (1.03)     0.0000 (1.0)           0;0  0.0029 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     19.4683 (1.12)     19.4683 (1.12)     19.4683 (1.12)     0.0000 (1.0)      19.4683 (1.12)     0.0000 (1.0)           0;0  0.0514 (0.89)          1           1
test_sharing_gs-fetch-noop[main]       17.3927 (1.0)      17.3927 (1.0)      17.3927 (1.0)      0.0000 (1.0)      17.3927 (1.0)      0.0000 (1.0)           0;0  0.0575 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     532.8200 (1.00)     532.8200 (1.00)     532.8200 (1.00)     0.0000 (1.0)      532.8200 (1.00)     0.0000 (1.0)           0;0  0.0019 (1.00)          1           1
test_sharing_gs-push[main]       531.3279 (1.0)      531.3279 (1.0)      531.3279 (1.0)      0.0000 (1.0)      531.3279 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8353 (1.0)      6.8353 (1.0)      6.8353 (1.0)      0.0000 (1.0)      6.8353 (1.0)      0.0000 (1.0)           0;0  0.1463 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.9511 (1.02)     6.9511 (1.02)     6.9511 (1.02)     0.0000 (1.0)      6.9511 (1.02)     0.0000 (1.0)           0;0  0.1439 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     582.8268 (1.01)     582.8268 (1.01)     582.8268 (1.01)     0.0000 (1.0)      582.8268 (1.01)     0.0000 (1.0)           0;0  0.0017 (0.99)          1           1
test_sharing_s3-fetch[main]       578.0216 (1.0)      578.0216 (1.0)      578.0216 (1.0)      0.0000 (1.0)      578.0216 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     5.8448 (1.0)      5.8448 (1.0)      5.8448 (1.0)      0.0000 (1.0)      5.8448 (1.0)      0.0000 (1.0)           0;0  0.1711 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       5.9786 (1.02)     5.9786 (1.02)     5.9786 (1.02)     0.0000 (1.0)      5.9786 (1.02)     0.0000 (1.0)           0;0  0.1673 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     860.5925 (1.00)     860.5925 (1.00)     860.5925 (1.00)     0.0000 (1.0)      860.5925 (1.00)     0.0000 (1.0)           0;0  0.0012 (1.00)          1           1
test_sharing_s3-push[main]       859.6298 (1.0)      859.6298 (1.0)      859.6298 (1.0)      0.0000 (1.0)      859.6298 (1.0)      0.0000 (1.0)           0;0  0.0012 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5854 (1.02)     6.5854 (1.02)     6.5854 (1.02)     0.0000 (1.0)      6.5854 (1.02)     0.0000 (1.0)           0;0  0.1519 (0.98)          1           1
test_sharing_s3-push-noop[main]       6.4696 (1.0)      6.4696 (1.0)      6.4696 (1.0)      0.0000 (1.0)      6.4696 (1.0)      0.0000 (1.0)           0;0  0.1546 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.1478 (3.70)     19.1478 (3.70)     19.1478 (3.70)     0.0000 (1.0)      19.1478 (3.70)     0.0000 (1.0)           0;0  0.0522 (0.27)          1           1
test_status-status[3.10.0]     19.3941 (3.74)     19.3941 (3.74)     19.3941 (3.74)     0.0000 (1.0)      19.3941 (3.74)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_status-status[3.53.2]     17.6551 (3.41)     17.6551 (3.41)     17.6551 (3.41)     0.0000 (1.0)      17.6551 (3.41)     0.0000 (1.0)           0;0  0.0566 (0.29)          1           1
test_status-status[3.60.1]      5.1799 (1.0)       5.1799 (1.0)       5.1799 (1.0)      0.0000 (1.0)       5.1799 (1.0)      0.0000 (1.0)           0;0  0.1931 (1.0)           1           1
test_status-status[main]        5.4324 (1.05)      5.4324 (1.05)      5.4324 (1.05)     0.0000 (1.0)       5.4324 (1.05)     0.0000 (1.0)           0;0  0.1841 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7795 (1.79)     4.7795 (1.79)     4.7795 (1.79)     0.0000 (1.0)      4.7795 (1.79)     0.0000 (1.0)           0;0  0.2092 (0.56)          1           1
test_status-status-changed[3.10.0]     5.0059 (1.87)     5.0059 (1.87)     5.0059 (1.87)     0.0000 (1.0)      5.0059 (1.87)     0.0000 (1.0)           0;0  0.1998 (0.53)          1           1
test_status-status-changed[3.53.2]     4.8796 (1.82)     4.8796 (1.82)     4.8796 (1.82)     0.0000 (1.0)      4.8796 (1.82)     0.0000 (1.0)           0;0  0.2049 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6747 (1.0)      2.6747 (1.0)      2.6747 (1.0)      0.0000 (1.0)      2.6747 (1.0)      0.0000 (1.0)           0;0  0.3739 (1.0)           1           1
test_status-status-changed[main]       2.9432 (1.10)     2.9432 (1.10)     2.9432 (1.10)     0.0000 (1.0)      2.9432 (1.10)     0.0000 (1.0)           0;0  0.3398 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7976 (1.84)     4.7976 (1.84)     4.7976 (1.84)     0.0000 (1.0)      4.7976 (1.84)     0.0000 (1.0)           0;0  0.2084 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.9040 (1.88)     4.9040 (1.88)     4.9040 (1.88)     0.0000 (1.0)      4.9040 (1.88)     0.0000 (1.0)           0;0  0.2039 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.7464 (1.82)     4.7464 (1.82)     4.7464 (1.82)     0.0000 (1.0)      4.7464 (1.82)     0.0000 (1.0)           0;0  0.2107 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.6044 (1.0)      2.6044 (1.0)      2.6044 (1.0)      0.0000 (1.0)      2.6044 (1.0)      0.0000 (1.0)           0;0  0.3840 (1.0)           1           1
test_status-status-changed-noop[main]       2.8402 (1.09)     2.8402 (1.09)     2.8402 (1.09)     0.0000 (1.0)      2.8402 (1.09)     0.0000 (1.0)           0;0  0.3521 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7297 (1.83)     4.7297 (1.83)     4.7297 (1.83)     0.0000 (1.0)      4.7297 (1.83)     0.0000 (1.0)           0;0  0.2114 (0.55)          1           1
test_status-status-noop[3.10.0]     4.8639 (1.88)     4.8639 (1.88)     4.8639 (1.88)     0.0000 (1.0)      4.8639 (1.88)     0.0000 (1.0)           0;0  0.2056 (0.53)          1           1
test_status-status-noop[3.53.2]     4.7311 (1.83)     4.7311 (1.83)     4.7311 (1.83)     0.0000 (1.0)      4.7311 (1.83)     0.0000 (1.0)           0;0  0.2114 (0.55)          1           1
test_status-status-noop[3.60.1]     2.5875 (1.0)      2.5875 (1.0)      2.5875 (1.0)      0.0000 (1.0)      2.5875 (1.0)      0.0000 (1.0)           0;0  0.3865 (1.0)           1           1
test_status-status-noop[main]       2.8377 (1.10)     2.8377 (1.10)     2.8377 (1.10)     0.0000 (1.0)      2.8377 (1.10)     0.0000 (1.0)           0;0  0.3524 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     153.2172 (3.31)     153.2172 (3.31)     153.2172 (3.31)     0.0000 (1.0)      153.2172 (3.31)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.10.0]     155.9595 (3.37)     155.9595 (3.37)     155.9595 (3.37)     0.0000 (1.0)      155.9595 (3.37)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.53.2]     115.7691 (2.50)     115.7691 (2.50)     115.7691 (2.50)     0.0000 (1.0)      115.7691 (2.50)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.2344 (1.0)       46.2344 (1.0)       46.2344 (1.0)      0.0000 (1.0)       46.2344 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        48.0285 (1.04)      48.0285 (1.04)      48.0285 (1.04)     0.0000 (1.0)       48.0285 (1.04)     0.0000 (1.0)           0;0  0.0208 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     137.5518 (3.85)     137.5518 (3.85)     137.5518 (3.85)     0.0000 (1.0)      137.5518 (3.85)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     140.4023 (3.93)     140.4023 (3.93)     140.4023 (3.93)     0.0000 (1.0)      140.4023 (3.93)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.53.2]     107.0128 (2.99)     107.0128 (2.99)     107.0128 (2.99)     0.0000 (1.0)      107.0128 (2.99)     0.0000 (1.0)           0;0  0.0093 (0.33)          1           1
test_update-update[3.60.1]      35.7463 (1.0)       35.7463 (1.0)       35.7463 (1.0)      0.0000 (1.0)       35.7463 (1.0)      0.0000 (1.0)           0;0  0.0280 (1.0)           1           1
test_update-update[main]        37.0562 (1.04)      37.0562 (1.04)      37.0562 (1.04)     0.0000 (1.0)       37.0562 (1.04)     0.0000 (1.0)           0;0  0.0270 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.7247 (2.00)     15.7247 (2.00)     15.7247 (2.00)     0.0000 (1.0)      15.7247 (2.00)     0.0000 (1.0)           0;0  0.0636 (0.50)          1           1
test_update-update-noop[3.10.0]     16.9235 (2.16)     16.9235 (2.16)     16.9235 (2.16)     0.0000 (1.0)      16.9235 (2.16)     0.0000 (1.0)           0;0  0.0591 (0.46)          1           1
test_update-update-noop[3.53.2]     16.5030 (2.10)     16.5030 (2.10)     16.5030 (2.10)     0.0000 (1.0)      16.5030 (2.10)     0.0000 (1.0)           0;0  0.0606 (0.48)          1           1
test_update-update-noop[3.60.1]      7.8525 (1.0)       7.8525 (1.0)       7.8525 (1.0)      0.0000 (1.0)       7.8525 (1.0)      0.0000 (1.0)           0;0  0.1273 (1.0)           1           1
test_update-update-noop[main]        8.6321 (1.10)      8.6321 (1.10)      8.6321 (1.10)     0.0000 (1.0)       8.6321 (1.10)     0.0000 (1.0)           0;0  0.1158 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean