Thu Oct  2 00:46:43 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.8667 (3.86)     92.8667 (3.86)     92.8667 (3.86)     0.0000 (1.0)      92.8667 (3.86)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_add_copy-add[3.10.0]     90.3876 (3.76)     90.3876 (3.76)     90.3876 (3.76)     0.0000 (1.0)      90.3876 (3.76)     0.0000 (1.0)           0;0  0.0111 (0.27)          1           1
test_add_copy-add[3.53.2]     81.2055 (3.38)     81.2055 (3.38)     81.2055 (3.38)     0.0000 (1.0)      81.2055 (3.38)     0.0000 (1.0)           0;0  0.0123 (0.30)          1           1
test_add_copy-add[3.60.1]     24.0336 (1.0)      24.0336 (1.0)      24.0336 (1.0)      0.0000 (1.0)      24.0336 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
test_add_copy-add[main]       25.4519 (1.06)     25.4519 (1.06)     25.4519 (1.06)     0.0000 (1.0)      25.4519 (1.06)     0.0000 (1.0)           0;0  0.0393 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.7489 (6.23)     31.7489 (6.23)     31.7489 (6.23)     0.0000 (1.0)      31.7489 (6.23)     0.0000 (1.0)           0;0  0.0315 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     31.2739 (6.14)     31.2739 (6.14)     31.2739 (6.14)     0.0000 (1.0)      31.2739 (6.14)     0.0000 (1.0)           0;0  0.0320 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     30.5667 (6.00)     30.5667 (6.00)     30.5667 (6.00)     0.0000 (1.0)      30.5667 (6.00)     0.0000 (1.0)           0;0  0.0327 (0.17)          1           1
test_add_copy-add-noop[3.60.1]      5.2548 (1.03)      5.2548 (1.03)      5.2548 (1.03)     0.0000 (1.0)       5.2548 (1.03)     0.0000 (1.0)           0;0  0.1903 (0.97)          1           1
test_add_copy-add-noop[main]        5.0957 (1.0)       5.0957 (1.0)       5.0957 (1.0)      0.0000 (1.0)       5.0957 (1.0)      0.0000 (1.0)           0;0  0.1962 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.4468 (4.04)     64.4468 (4.04)     64.4468 (4.04)     0.0000 (1.0)      64.4468 (4.04)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.10.0]     64.4335 (4.04)     64.4335 (4.04)     64.4335 (4.04)     0.0000 (1.0)      64.4335 (4.04)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.53.2]     59.2503 (3.72)     59.2503 (3.72)     59.2503 (3.72)     0.0000 (1.0)      59.2503 (3.72)     0.0000 (1.0)           0;0  0.0169 (0.27)          1           1
test_add_hardlink-add[3.60.1]     15.9376 (1.0)      15.9376 (1.0)      15.9376 (1.0)      0.0000 (1.0)      15.9376 (1.0)      0.0000 (1.0)           0;0  0.0627 (1.0)           1           1
test_add_hardlink-add[main]       17.2432 (1.08)     17.2432 (1.08)     17.2432 (1.08)     0.0000 (1.0)      17.2432 (1.08)     0.0000 (1.0)           0;0  0.0580 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.2118 (7.58)     34.2118 (7.58)     34.2118 (7.58)     0.0000 (1.0)      34.2118 (7.58)     0.0000 (1.0)           0;0  0.0292 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.8136 (7.49)     33.8136 (7.49)     33.8136 (7.49)     0.0000 (1.0)      33.8136 (7.49)     0.0000 (1.0)           0;0  0.0296 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.6563 (7.01)     31.6563 (7.01)     31.6563 (7.01)     0.0000 (1.0)      31.6563 (7.01)     0.0000 (1.0)           0;0  0.0316 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5155 (1.0)       4.5155 (1.0)       4.5155 (1.0)      0.0000 (1.0)       4.5155 (1.0)      0.0000 (1.0)           0;0  0.2215 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8187 (1.07)      4.8187 (1.07)      4.8187 (1.07)     0.0000 (1.0)       4.8187 (1.07)     0.0000 (1.0)           0;0  0.2075 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.5737 (2.03)     71.5737 (2.03)     71.5737 (2.03)     0.0000 (1.0)      71.5737 (2.03)     0.0000 (1.0)           0;0  0.0140 (0.49)          1           1
test_add_symlink-add[3.10.0]     72.5823 (2.06)     72.5823 (2.06)     72.5823 (2.06)     0.0000 (1.0)      72.5823 (2.06)     0.0000 (1.0)           0;0  0.0138 (0.49)          1           1
test_add_symlink-add[3.53.2]     67.4174 (1.91)     67.4174 (1.91)     67.4174 (1.91)     0.0000 (1.0)      67.4174 (1.91)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.60.1]     35.2376 (1.0)      35.2376 (1.0)      35.2376 (1.0)      0.0000 (1.0)      35.2376 (1.0)      0.0000 (1.0)           0;0  0.0284 (1.0)           1           1
test_add_symlink-add[main]       37.2335 (1.06)     37.2335 (1.06)     37.2335 (1.06)     0.0000 (1.0)      37.2335 (1.06)     0.0000 (1.0)           0;0  0.0269 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.2279 (7.90)     48.2279 (7.90)     48.2279 (7.90)     0.0000 (1.0)      48.2279 (7.90)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     48.6737 (7.98)     48.6737 (7.98)     48.6737 (7.98)     0.0000 (1.0)      48.6737 (7.98)     0.0000 (1.0)           0;0  0.0205 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     47.8172 (7.84)     47.8172 (7.84)     47.8172 (7.84)     0.0000 (1.0)      47.8172 (7.84)     0.0000 (1.0)           0;0  0.0209 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      6.1025 (1.0)       6.1025 (1.0)       6.1025 (1.0)      0.0000 (1.0)       6.1025 (1.0)      0.0000 (1.0)           0;0  0.1639 (1.0)           1           1
test_add_symlink-add-noop[main]        6.2915 (1.03)      6.2915 (1.03)      6.2915 (1.03)     0.0000 (1.0)       6.2915 (1.03)     0.0000 (1.0)           0;0  0.1589 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.0026 (1.97)     43.0026 (1.97)     43.0026 (1.97)     0.0000 (1.0)      43.0026 (1.97)     0.0000 (1.0)           0;0  0.0233 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     61.5122 (2.82)     61.5122 (2.82)     61.5122 (2.82)     0.0000 (1.0)      61.5122 (2.82)     0.0000 (1.0)           0;0  0.0163 (0.36)          1           1
test_checkout_copy-checkout[3.53.2]     28.7703 (1.32)     28.7703 (1.32)     28.7703 (1.32)     0.0000 (1.0)      28.7703 (1.32)     0.0000 (1.0)           0;0  0.0348 (0.76)          1           1
test_checkout_copy-checkout[3.60.1]     21.8487 (1.0)      21.8487 (1.0)      21.8487 (1.0)      0.0000 (1.0)      21.8487 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
test_checkout_copy-checkout[main]       22.9225 (1.05)     22.9225 (1.05)     22.9225 (1.05)     0.0000 (1.0)      22.9225 (1.05)     0.0000 (1.0)           0;0  0.0436 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.7330 (1.64)     6.7330 (1.64)     6.7330 (1.64)     0.0000 (1.0)      6.7330 (1.64)     0.0000 (1.0)           0;0  0.1485 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.0779 (1.48)     6.0779 (1.48)     6.0779 (1.48)     0.0000 (1.0)      6.0779 (1.48)     0.0000 (1.0)           0;0  0.1645 (0.67)          1           1
test_checkout_copy-checkout-noop[3.53.2]     6.0999 (1.49)     6.0999 (1.49)     6.0999 (1.49)     0.0000 (1.0)      6.0999 (1.49)     0.0000 (1.0)           0;0  0.1639 (0.67)          1           1
test_checkout_copy-checkout-noop[3.60.1]     4.0948 (1.0)      4.0948 (1.0)      4.0948 (1.0)      0.0000 (1.0)      4.0948 (1.0)      0.0000 (1.0)           0;0  0.2442 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       4.6727 (1.14)     4.6727 (1.14)     4.6727 (1.14)     0.0000 (1.0)      4.6727 (1.14)     0.0000 (1.0)           0;0  0.2140 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.3856 (2.09)     10.3856 (2.09)     10.3856 (2.09)     0.0000 (1.0)      10.3856 (2.09)     0.0000 (1.0)           0;0  0.0963 (0.48)          1           1
test_checkout_copy-checkout-update[3.10.0]      6.7852 (1.37)      6.7852 (1.37)      6.7852 (1.37)     0.0000 (1.0)       6.7852 (1.37)     0.0000 (1.0)           0;0  0.1474 (0.73)          1           1
test_checkout_copy-checkout-update[3.53.2]      7.0534 (1.42)      7.0534 (1.42)      7.0534 (1.42)     0.0000 (1.0)       7.0534 (1.42)     0.0000 (1.0)           0;0  0.1418 (0.70)          1           1
test_checkout_copy-checkout-update[3.60.1]      4.9574 (1.0)       4.9574 (1.0)       4.9574 (1.0)      0.0000 (1.0)       4.9574 (1.0)      0.0000 (1.0)           0;0  0.2017 (1.0)           1           1
test_checkout_copy-checkout-update[main]        5.6630 (1.14)      5.6630 (1.14)      5.6630 (1.14)     0.0000 (1.0)       5.6630 (1.14)     0.0000 (1.0)           0;0  0.1766 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     23.1272 (3.06)     23.1272 (3.06)     23.1272 (3.06)     0.0000 (1.0)      23.1272 (3.06)     0.0000 (1.0)           0;0  0.0432 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.7234 (2.21)     16.7234 (2.21)     16.7234 (2.21)     0.0000 (1.0)      16.7234 (2.21)     0.0000 (1.0)           0;0  0.0598 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.0209 (1.99)     15.0209 (1.99)     15.0209 (1.99)     0.0000 (1.0)      15.0209 (1.99)     0.0000 (1.0)           0;0  0.0666 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5555 (1.0)       7.5555 (1.0)       7.5555 (1.0)      0.0000 (1.0)       7.5555 (1.0)      0.0000 (1.0)           0;0  0.1324 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.4994 (1.12)      8.4994 (1.12)      8.4994 (1.12)     0.0000 (1.0)       8.4994 (1.12)     0.0000 (1.0)           0;0  0.1177 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6942 (1.56)     5.6942 (1.56)     5.6942 (1.56)     0.0000 (1.0)      5.6942 (1.56)     0.0000 (1.0)           0;0  0.1756 (0.64)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.9495 (1.63)     5.9495 (1.63)     5.9495 (1.63)     0.0000 (1.0)      5.9495 (1.63)     0.0000 (1.0)           0;0  0.1681 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7289 (1.57)     5.7289 (1.57)     5.7289 (1.57)     0.0000 (1.0)      5.7289 (1.57)     0.0000 (1.0)           0;0  0.1746 (0.64)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.6401 (1.0)      3.6401 (1.0)      3.6401 (1.0)      0.0000 (1.0)      3.6401 (1.0)      0.0000 (1.0)           0;0  0.2747 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.9732 (1.09)     3.9732 (1.09)     3.9732 (1.09)     0.0000 (1.0)      3.9732 (1.09)     0.0000 (1.0)           0;0  0.2517 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     9.1636 (2.09)     9.1636 (2.09)     9.1636 (2.09)     0.0000 (1.0)      9.1636 (2.09)     0.0000 (1.0)           0;0  0.1091 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7772 (1.55)     6.7772 (1.55)     6.7772 (1.55)     0.0000 (1.0)      6.7772 (1.55)     0.0000 (1.0)           0;0  0.1476 (0.65)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.7412 (1.54)     6.7412 (1.54)     6.7412 (1.54)     0.0000 (1.0)      6.7412 (1.54)     0.0000 (1.0)           0;0  0.1483 (0.65)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.3843 (1.0)      4.3843 (1.0)      4.3843 (1.0)      0.0000 (1.0)      4.3843 (1.0)      0.0000 (1.0)           0;0  0.2281 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       5.0065 (1.14)     5.0065 (1.14)     5.0065 (1.14)     0.0000 (1.0)      5.0065 (1.14)     0.0000 (1.0)           0;0  0.1997 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.2710 (2.53)     25.2710 (2.53)     25.2710 (2.53)     0.0000 (1.0)      25.2710 (2.53)     0.0000 (1.0)           0;0  0.0396 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     19.1746 (1.92)     19.1746 (1.92)     19.1746 (1.92)     0.0000 (1.0)      19.1746 (1.92)     0.0000 (1.0)           0;0  0.0522 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.8611 (1.79)     17.8611 (1.79)     17.8611 (1.79)     0.0000 (1.0)      17.8611 (1.79)     0.0000 (1.0)           0;0  0.0560 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]      9.9921 (1.0)       9.9921 (1.0)       9.9921 (1.0)      0.0000 (1.0)       9.9921 (1.0)      0.0000 (1.0)           0;0  0.1001 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.6902 (1.07)     10.6902 (1.07)     10.6902 (1.07)     0.0000 (1.0)      10.6902 (1.07)     0.0000 (1.0)           0;0  0.0935 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6586 (1.56)     6.6586 (1.56)     6.6586 (1.56)     0.0000 (1.0)      6.6586 (1.56)     0.0000 (1.0)           0;0  0.1502 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8951 (1.61)     6.8951 (1.61)     6.8951 (1.61)     0.0000 (1.0)      6.8951 (1.61)     0.0000 (1.0)           0;0  0.1450 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6553 (1.56)     6.6553 (1.56)     6.6553 (1.56)     0.0000 (1.0)      6.6553 (1.56)     0.0000 (1.0)           0;0  0.1503 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2745 (1.0)      4.2745 (1.0)      4.2745 (1.0)      0.0000 (1.0)      4.2745 (1.0)      0.0000 (1.0)           0;0  0.2339 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5969 (1.08)     4.5969 (1.08)     4.5969 (1.08)     0.0000 (1.0)      4.5969 (1.08)     0.0000 (1.0)           0;0  0.2175 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.7594 (1.87)     10.7594 (1.87)     10.7594 (1.87)     0.0000 (1.0)      10.7594 (1.87)     0.0000 (1.0)           0;0  0.0929 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.5283 (1.48)      8.5283 (1.48)      8.5283 (1.48)     0.0000 (1.0)       8.5283 (1.48)     0.0000 (1.0)           0;0  0.1173 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3924 (1.46)      8.3924 (1.46)      8.3924 (1.46)     0.0000 (1.0)       8.3924 (1.46)     0.0000 (1.0)           0;0  0.1192 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7498 (1.0)       5.7498 (1.0)       5.7498 (1.0)      0.0000 (1.0)       5.7498 (1.0)      0.0000 (1.0)           0;0  0.1739 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.3346 (1.10)      6.3346 (1.10)      6.3346 (1.10)     0.0000 (1.0)       6.3346 (1.10)     0.0000 (1.0)           0;0  0.1579 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0067 (1.75)     4.0067 (1.75)     4.0067 (1.75)     0.0000 (1.0)      4.0067 (1.75)     0.0000 (1.0)           0;0  0.2496 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.7488 (2.08)     4.7488 (2.08)     4.7488 (2.08)     0.0000 (1.0)      4.7488 (2.08)     0.0000 (1.0)           0;0  0.2106 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.5149 (1.98)     4.5149 (1.98)     4.5149 (1.98)     0.0000 (1.0)      4.5149 (1.98)     0.0000 (1.0)           0;0  0.2215 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.2847 (1.0)      2.2847 (1.0)      2.2847 (1.0)      0.0000 (1.0)      2.2847 (1.0)      0.0000 (1.0)           0;0  0.4377 (1.0)           1           1
test_data_status-data-changed[main]       2.5314 (1.11)     2.5314 (1.11)     2.5314 (1.11)     0.0000 (1.0)      2.5314 (1.11)     0.0000 (1.0)           0;0  0.3950 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0326 (1.74)     4.0326 (1.74)     4.0326 (1.74)     0.0000 (1.0)      4.0326 (1.74)     0.0000 (1.0)           0;0  0.2480 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7621 (2.05)     4.7621 (2.05)     4.7621 (2.05)     0.0000 (1.0)      4.7621 (2.05)     0.0000 (1.0)           0;0  0.2100 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6528 (2.00)     4.6528 (2.00)     4.6528 (2.00)     0.0000 (1.0)      4.6528 (2.00)     0.0000 (1.0)           0;0  0.2149 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3210 (1.0)      2.3210 (1.0)      2.3210 (1.0)      0.0000 (1.0)      2.3210 (1.0)      0.0000 (1.0)           0;0  0.4309 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5411 (1.09)     2.5411 (1.09)     2.5411 (1.09)     0.0000 (1.0)      2.5411 (1.09)     0.0000 (1.0)           0;0  0.3935 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5806 (3.81)     18.5806 (3.81)     18.5806 (3.81)     0.0000 (1.0)      18.5806 (3.81)     0.0000 (1.0)           0;0  0.0538 (0.26)          1           1
test_data_status-data-new[3.10.0]     18.7877 (3.85)     18.7877 (3.85)     18.7877 (3.85)     0.0000 (1.0)      18.7877 (3.85)     0.0000 (1.0)           0;0  0.0532 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.9268 (3.88)     18.9268 (3.88)     18.9268 (3.88)     0.0000 (1.0)      18.9268 (3.88)     0.0000 (1.0)           0;0  0.0528 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8745 (1.0)       4.8745 (1.0)       4.8745 (1.0)      0.0000 (1.0)       4.8745 (1.0)      0.0000 (1.0)           0;0  0.2051 (1.0)           1           1
test_data_status-data-new[main]        5.2865 (1.08)      5.2865 (1.08)      5.2865 (1.08)     0.0000 (1.0)       5.2865 (1.08)     0.0000 (1.0)           0;0  0.1892 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0569 (1.77)     4.0569 (1.77)     4.0569 (1.77)     0.0000 (1.0)      4.0569 (1.77)     0.0000 (1.0)           0;0  0.2465 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.6781 (2.04)     4.6781 (2.04)     4.6781 (2.04)     0.0000 (1.0)      4.6781 (2.04)     0.0000 (1.0)           0;0  0.2138 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.5223 (1.98)     4.5223 (1.98)     4.5223 (1.98)     0.0000 (1.0)      4.5223 (1.98)     0.0000 (1.0)           0;0  0.2211 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.2891 (1.0)      2.2891 (1.0)      2.2891 (1.0)      0.0000 (1.0)      2.2891 (1.0)      0.0000 (1.0)           0;0  0.4369 (1.0)           1           1
test_data_status-data-noop[main]       2.5397 (1.11)     2.5397 (1.11)     2.5397 (1.11)     0.0000 (1.0)      2.5397 (1.11)     0.0000 (1.0)           0;0  0.3937 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.4294 (1.27)     7.4294 (1.27)     7.4294 (1.27)     0.0000 (1.0)      7.4294 (1.27)     0.0000 (1.0)           0;0  0.1346 (0.79)          1           1
test_data_status_all_flags-data-changed[3.10.0]     8.1307 (1.39)     8.1307 (1.39)     8.1307 (1.39)     0.0000 (1.0)      8.1307 (1.39)     0.0000 (1.0)           0;0  0.1230 (0.72)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.9999 (1.37)     7.9999 (1.37)     7.9999 (1.37)     0.0000 (1.0)      7.9999 (1.37)     0.0000 (1.0)           0;0  0.1250 (0.73)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.8446 (1.0)      5.8446 (1.0)      5.8446 (1.0)      0.0000 (1.0)      5.8446 (1.0)      0.0000 (1.0)           0;0  0.1711 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.3587 (1.09)     6.3587 (1.09)     6.3587 (1.09)     0.0000 (1.0)      6.3587 (1.09)     0.0000 (1.0)           0;0  0.1573 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.5453 (1.26)     7.5453 (1.26)     7.5453 (1.26)     0.0000 (1.0)      7.5453 (1.26)     0.0000 (1.0)           0;0  0.1325 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     8.1549 (1.36)     8.1549 (1.36)     8.1549 (1.36)     0.0000 (1.0)      8.1549 (1.36)     0.0000 (1.0)           0;0  0.1226 (0.74)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     8.0435 (1.34)     8.0435 (1.34)     8.0435 (1.34)     0.0000 (1.0)      8.0435 (1.34)     0.0000 (1.0)           0;0  0.1243 (0.75)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     6.0060 (1.0)      6.0060 (1.0)      6.0060 (1.0)      0.0000 (1.0)      6.0060 (1.0)      0.0000 (1.0)           0;0  0.1665 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.4440 (1.07)     6.4440 (1.07)     6.4440 (1.07)     0.0000 (1.0)      6.4440 (1.07)     0.0000 (1.0)           0;0  0.1552 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     22.6873 (2.74)     22.6873 (2.74)     22.6873 (2.74)     0.0000 (1.0)      22.6873 (2.74)     0.0000 (1.0)           0;0  0.0441 (0.36)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.8918 (2.77)     22.8918 (2.77)     22.8918 (2.77)     0.0000 (1.0)      22.8918 (2.77)     0.0000 (1.0)           0;0  0.0437 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.7522 (2.75)     22.7522 (2.75)     22.7522 (2.75)     0.0000 (1.0)      22.7522 (2.75)     0.0000 (1.0)           0;0  0.0440 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.2767 (1.0)       8.2767 (1.0)       8.2767 (1.0)      0.0000 (1.0)       8.2767 (1.0)      0.0000 (1.0)           0;0  0.1208 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.8182 (1.07)      8.8182 (1.07)      8.8182 (1.07)     0.0000 (1.0)       8.8182 (1.07)     0.0000 (1.0)           0;0  0.1134 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.7424 (1.33)     6.7424 (1.33)     6.7424 (1.33)     0.0000 (1.0)      6.7424 (1.33)     0.0000 (1.0)           0;0  0.1483 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.3877 (1.46)     7.3877 (1.46)     7.3877 (1.46)     0.0000 (1.0)      7.3877 (1.46)     0.0000 (1.0)           0;0  0.1354 (0.69)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.3757 (1.46)     7.3757 (1.46)     7.3757 (1.46)     0.0000 (1.0)      7.3757 (1.46)     0.0000 (1.0)           0;0  0.1356 (0.69)          1           1
test_data_status_all_flags-data-noop[3.60.1]     5.0631 (1.0)      5.0631 (1.0)      5.0631 (1.0)      0.0000 (1.0)      5.0631 (1.0)      0.0000 (1.0)           0;0  0.1975 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.6135 (1.11)     5.6135 (1.11)     5.6135 (1.11)     0.0000 (1.0)      5.6135 (1.11)     0.0000 (1.0)           0;0  0.1781 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.6894 (2.58)     18.6894 (2.58)     18.6894 (2.58)     0.0000 (1.0)      18.6894 (2.58)     0.0000 (1.0)           0;0  0.0535 (0.39)          1           1
test_diff-diff[3.10.0]     19.6120 (2.71)     19.6120 (2.71)     19.6120 (2.71)     0.0000 (1.0)      19.6120 (2.71)     0.0000 (1.0)           0;0  0.0510 (0.37)          1           1
test_diff-diff[3.53.2]     20.0577 (2.77)     20.0577 (2.77)     20.0577 (2.77)     0.0000 (1.0)      20.0577 (2.77)     0.0000 (1.0)           0;0  0.0499 (0.36)          1           1
test_diff-diff[3.60.1]      7.2436 (1.0)       7.2436 (1.0)       7.2436 (1.0)      0.0000 (1.0)       7.2436 (1.0)      0.0000 (1.0)           0;0  0.1381 (1.0)           1           1
test_diff-diff[main]        8.3888 (1.16)      8.3888 (1.16)      8.3888 (1.16)     0.0000 (1.0)       8.3888 (1.16)     0.0000 (1.0)           0;0  0.1192 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.4800 (1.71)     6.4800 (1.71)     6.4800 (1.71)     0.0000 (1.0)      6.4800 (1.71)     0.0000 (1.0)           0;0  0.1543 (0.59)          1           1
test_diff-diff-changed[3.10.0]     7.2085 (1.90)     7.2085 (1.90)     7.2085 (1.90)     0.0000 (1.0)      7.2085 (1.90)     0.0000 (1.0)           0;0  0.1387 (0.53)          1           1
test_diff-diff-changed[3.53.2]     6.0294 (1.59)     6.0294 (1.59)     6.0294 (1.59)     0.0000 (1.0)      6.0294 (1.59)     0.0000 (1.0)           0;0  0.1659 (0.63)          1           1
test_diff-diff-changed[3.60.1]     3.7950 (1.0)      3.7950 (1.0)      3.7950 (1.0)      0.0000 (1.0)      3.7950 (1.0)      0.0000 (1.0)           0;0  0.2635 (1.0)           1           1
test_diff-diff-changed[main]       4.6961 (1.24)     4.6961 (1.24)     4.6961 (1.24)     0.0000 (1.0)      4.6961 (1.24)     0.0000 (1.0)           0;0  0.2129 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5382 (1.46)     5.5382 (1.46)     5.5382 (1.46)     0.0000 (1.0)      5.5382 (1.46)     0.0000 (1.0)           0;0  0.1806 (0.68)          1           1
test_diff-diff-changed-noop[3.10.0]     6.2239 (1.65)     6.2239 (1.65)     6.2239 (1.65)     0.0000 (1.0)      6.2239 (1.65)     0.0000 (1.0)           0;0  0.1607 (0.61)          1           1
test_diff-diff-changed-noop[3.53.2]     6.0715 (1.61)     6.0715 (1.61)     6.0715 (1.61)     0.0000 (1.0)      6.0715 (1.61)     0.0000 (1.0)           0;0  0.1647 (0.62)          1           1
test_diff-diff-changed-noop[3.60.1]     3.7826 (1.0)      3.7826 (1.0)      3.7826 (1.0)      0.0000 (1.0)      3.7826 (1.0)      0.0000 (1.0)           0;0  0.2644 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.7857 (1.27)     4.7857 (1.27)     4.7857 (1.27)     0.0000 (1.0)      4.7857 (1.27)     0.0000 (1.0)           0;0  0.2090 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.4120 (1.15)     4.4120 (1.15)     4.4120 (1.15)     0.0000 (1.0)      4.4120 (1.15)     0.0000 (1.0)           0;0  0.2267 (0.87)          1           1
test_diff-diff-noop[3.10.0]     5.1775 (1.35)     5.1775 (1.35)     5.1775 (1.35)     0.0000 (1.0)      5.1775 (1.35)     0.0000 (1.0)           0;0  0.1931 (0.74)          1           1
test_diff-diff-noop[3.53.2]     6.1221 (1.59)     6.1221 (1.59)     6.1221 (1.59)     0.0000 (1.0)      6.1221 (1.59)     0.0000 (1.0)           0;0  0.1633 (0.63)          1           1
test_diff-diff-noop[3.60.1]     3.8479 (1.0)      3.8479 (1.0)      3.8479 (1.0)      0.0000 (1.0)      3.8479 (1.0)      0.0000 (1.0)           0;0  0.2599 (1.0)           1           1
test_diff-diff-noop[main]       4.6804 (1.22)     4.6804 (1.22)     4.6804 (1.22)     0.0000 (1.0)      4.6804 (1.22)     0.0000 (1.0)           0;0  0.2137 (0.82)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       962.3039 (1.0)        962.3039 (1.0)        962.3039 (1.0)      0.0000 (1.0)        962.3039 (1.0)      0.0000 (1.0)           0;0  1.0392 (1.0)           1           1
test_exp_show-exp[3.10.0]     5,516.3213 (5.73)     5,516.3213 (5.73)     5,516.3213 (5.73)     0.0000 (1.0)      5,516.3213 (5.73)     0.0000 (1.0)           0;0  0.1813 (0.17)          1           1
test_exp_show-exp[3.53.2]     3,678.6648 (3.82)     3,678.6648 (3.82)     3,678.6648 (3.82)     0.0000 (1.0)      3,678.6648 (3.82)     0.0000 (1.0)           0;0  0.2718 (0.26)          1           1
test_exp_show-exp[3.60.1]     3,559.6162 (3.70)     3,559.6162 (3.70)     3,559.6162 (3.70)     0.0000 (1.0)      3,559.6162 (3.70)     0.0000 (1.0)           0;0  0.2809 (0.27)          1           1
test_exp_show-exp[main]       6,224.7280 (6.47)     6,224.7280 (6.47)     6,224.7280 (6.47)     0.0000 (1.0)      6,224.7280 (6.47)     0.0000 (1.0)           0;0  0.1606 (0.15)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     65.4911 (2.79)     65.4911 (2.79)     65.4911 (2.79)     0.0000 (1.0)      65.4911 (2.79)     0.0000 (1.0)           0;0  0.0153 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.7494 (3.02)     70.7494 (3.02)     70.7494 (3.02)     0.0000 (1.0)      70.7494 (3.02)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_fetch-fetch[3.53.2]     34.1761 (1.46)     34.1761 (1.46)     34.1761 (1.46)     0.0000 (1.0)      34.1761 (1.46)     0.0000 (1.0)           0;0  0.0293 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.4317 (1.0)      23.4317 (1.0)      23.4317 (1.0)      0.0000 (1.0)      23.4317 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
test_fetch-fetch[main]       23.7909 (1.02)     23.7909 (1.02)     23.7909 (1.02)     0.0000 (1.0)      23.7909 (1.02)     0.0000 (1.0)           0;0  0.0420 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7933 (1.00)     2.7933 (1.00)     2.7933 (1.00)     0.0000 (1.0)      2.7933 (1.00)     0.0000 (1.0)           0;0  0.3580 (1.00)          1           1
test_gc-gc[3.10.0]     2.8571 (1.02)     2.8571 (1.02)     2.8571 (1.02)     0.0000 (1.0)      2.8571 (1.02)     0.0000 (1.0)           0;0  0.3500 (0.98)          1           1
test_gc-gc[3.53.2]     2.8274 (1.01)     2.8274 (1.01)     2.8274 (1.01)     0.0000 (1.0)      2.8274 (1.01)     0.0000 (1.0)           0;0  0.3537 (0.99)          1           1
test_gc-gc[3.60.1]     2.8002 (1.00)     2.8002 (1.00)     2.8002 (1.00)     0.0000 (1.0)      2.8002 (1.00)     0.0000 (1.0)           0;0  0.3571 (1.00)          1           1
test_gc-gc[main]       2.7887 (1.0)      2.7887 (1.0)      2.7887 (1.0)      0.0000 (1.0)      2.7887 (1.0)      0.0000 (1.0)           0;0  0.3586 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     139.2663 (2.69)     139.2663 (2.69)     139.2663 (2.69)     0.0000 (1.0)      139.2663 (2.69)     0.0000 (1.0)           0;0  0.0072 (0.37)          1           1
test_get-get[3.10.0]     172.1941 (3.33)     172.1941 (3.33)     172.1941 (3.33)     0.0000 (1.0)      172.1941 (3.33)     0.0000 (1.0)           0;0  0.0058 (0.30)          1           1
test_get-get[3.53.2]     149.5522 (2.89)     149.5522 (2.89)     149.5522 (2.89)     0.0000 (1.0)      149.5522 (2.89)     0.0000 (1.0)           0;0  0.0067 (0.35)          1           1
test_get-get[3.60.1]      51.7508 (1.0)       51.7508 (1.0)       51.7508 (1.0)      0.0000 (1.0)       51.7508 (1.0)      0.0000 (1.0)           0;0  0.0193 (1.0)           1           1
test_get-get[main]        51.8073 (1.00)      51.8073 (1.00)      51.8073 (1.00)     0.0000 (1.0)       51.8073 (1.00)     0.0000 (1.0)           0;0  0.0193 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.8345 (2.72)     44.8345 (2.72)     44.8345 (2.72)     0.0000 (1.0)      44.8345 (2.72)     0.0000 (1.0)           0;0  0.0223 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.0763 (2.92)     48.0763 (2.92)     48.0763 (2.92)     0.0000 (1.0)      48.0763 (2.92)     0.0000 (1.0)           0;0  0.0208 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.4843 (1.0)      16.4843 (1.0)      16.4843 (1.0)      0.0000 (1.0)      16.4843 (1.0)      0.0000 (1.0)           0;0  0.0607 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.6983 (1.01)     16.6983 (1.01)     16.6983 (1.01)     0.0000 (1.0)      16.6983 (1.01)     0.0000 (1.0)           0;0  0.0599 (0.99)          1           1
test_get_url-get-url[main]       16.7537 (1.02)     16.7537 (1.02)     16.7537 (1.02)     0.0000 (1.0)      16.7537 (1.02)     0.0000 (1.0)           0;0  0.0597 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.3256 (1.02)     133.6760 (1.01)     127.9038 (1.03)     1.8920 (1.19)     127.9228 (1.03)     2.8602 (1.77)         31;1  7.8184 (0.97)        100           1
test_help---help[3.10.0]     122.1985 (1.0)      134.3672 (1.01)     124.4357 (1.0)      1.5922 (1.0)      124.3163 (1.0)      1.6205 (1.0)          19;3  8.0363 (1.0)         100           1
test_help---help[3.53.2]     123.8771 (1.01)     132.4519 (1.0)      126.4123 (1.02)     1.6438 (1.03)     125.9415 (1.01)     1.7796 (1.10)         26;5  7.9106 (0.98)        100           1
test_help---help[3.60.1]     125.1402 (1.02)     174.4479 (1.32)     129.3706 (1.04)     7.1522 (4.49)     127.8706 (1.03)     2.1902 (1.35)          6;7  7.7297 (0.96)        100           1
test_help---help[main]       125.0501 (1.02)     150.4388 (1.14)     127.8704 (1.03)     3.0495 (1.92)     127.3559 (1.02)     2.8297 (1.75)          4;2  7.8204 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     225.5217 (2.95)     225.5217 (2.95)     225.5217 (2.95)     0.0000 (1.0)      225.5217 (2.95)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     257.2642 (3.37)     257.2642 (3.37)     257.2642 (3.37)     0.0000 (1.0)      257.2642 (3.37)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      76.3974 (1.0)       76.3974 (1.0)       76.3974 (1.0)      0.0000 (1.0)       76.3974 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
test_import-import[main]        77.6368 (1.02)      77.6368 (1.02)      77.6368 (1.02)     0.0000 (1.0)       77.6368 (1.02)     0.0000 (1.0)           0;0  0.0129 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     159.1770 (3.35)     159.1770 (3.35)     159.1770 (3.35)     0.0000 (1.0)      159.1770 (3.35)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     162.9605 (3.43)     162.9605 (3.43)     162.9605 (3.43)     0.0000 (1.0)      162.9605 (3.43)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.53.2]     120.4054 (2.54)     120.4054 (2.54)     120.4054 (2.54)     0.0000 (1.0)      120.4054 (2.54)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_import_url-import-url[3.60.1]      47.4766 (1.0)       47.4766 (1.0)       47.4766 (1.0)      0.0000 (1.0)       47.4766 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
test_import_url-import-url[main]        49.2802 (1.04)      49.2802 (1.04)      49.2802 (1.04)     0.0000 (1.0)       49.2802 (1.04)     0.0000 (1.0)           0;0  0.0203 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     390.6268 (1.00)     417.4234 (1.0)      398.9242 (1.0)       4.9686 (1.0)      398.4813 (1.0)       5.8856 (1.14)         24;5  2.5067 (1.0)         100           1
test_init-init[3.10.0]     400.3765 (1.03)     440.7699 (1.06)     414.1395 (1.04)      7.4499 (1.50)     412.9288 (1.04)     10.1642 (1.97)         27;2  2.4146 (0.96)        100           1
test_init-init[3.53.2]     391.1884 (1.00)     468.5992 (1.12)     408.9129 (1.03)     12.5468 (2.53)     406.0814 (1.02)     14.1324 (2.74)         25;5  2.4455 (0.98)        100           1
test_init-init[3.60.1]     389.8580 (1.0)      433.0701 (1.04)     407.0218 (1.02)     10.2817 (2.07)     404.6981 (1.02)     14.4496 (2.80)         31;0  2.4569 (0.98)        100           1
test_init-init[main]       418.5673 (1.07)     499.9728 (1.20)     429.8940 (1.08)     10.5593 (2.13)     427.9809 (1.07)      5.1658 (1.0)           9;9  2.3262 (0.93)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     605.0787 (1.03)     605.0787 (1.03)     605.0787 (1.03)     0.0000 (1.0)      605.0787 (1.03)     0.0000 (1.0)           0;0  1.6527 (0.97)          1           1
test_list-list[3.10.0]     697.2731 (1.19)     697.2731 (1.19)     697.2731 (1.19)     0.0000 (1.0)      697.2731 (1.19)     0.0000 (1.0)           0;0  1.4342 (0.84)          1           1
test_list-list[3.53.2]     624.3482 (1.07)     624.3482 (1.07)     624.3482 (1.07)     0.0000 (1.0)      624.3482 (1.07)     0.0000 (1.0)           0;0  1.6017 (0.94)          1           1
test_list-list[3.60.1]     587.5189 (1.00)     587.5189 (1.00)     587.5189 (1.00)     0.0000 (1.0)      587.5189 (1.00)     0.0000 (1.0)           0;0  1.7021 (1.00)          1           1
test_list-list[main]       586.0882 (1.0)      586.0882 (1.0)      586.0882 (1.0)      0.0000 (1.0)      586.0882 (1.0)      0.0000 (1.0)           0;0  1.7062 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     444.8687 (1.02)     444.8687 (1.02)     444.8687 (1.02)     0.0000 (1.0)      444.8687 (1.02)     0.0000 (1.0)           0;0  2.2479 (0.98)          1           1
test_list-list-dvc-only[3.10.0]     448.7084 (1.03)     448.7084 (1.03)     448.7084 (1.03)     0.0000 (1.0)      448.7084 (1.03)     0.0000 (1.0)           0;0  2.2286 (0.97)          1           1
test_list-list-dvc-only[3.53.2]     434.3480 (1.0)      434.3480 (1.0)      434.3480 (1.0)      0.0000 (1.0)      434.3480 (1.0)      0.0000 (1.0)           0;0  2.3023 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     437.4163 (1.01)     437.4163 (1.01)     437.4163 (1.01)     0.0000 (1.0)      437.4163 (1.01)     0.0000 (1.0)           0;0  2.2862 (0.99)          1           1
test_list-list-dvc-only[main]       449.8924 (1.04)     449.8924 (1.04)     449.8924 (1.04)     0.0000 (1.0)      449.8924 (1.04)     0.0000 (1.0)           0;0  2.2228 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8643 (1.0)      2.8643 (1.0)      2.8643 (1.0)      0.0000 (1.0)      2.8643 (1.0)      0.0000 (1.0)           0;0  0.3491 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.9723 (1.04)     2.9723 (1.04)     2.9723 (1.04)     0.0000 (1.0)      2.9723 (1.04)     0.0000 (1.0)           0;0  0.3364 (0.96)          1           1
test_list-list-recursive[3.53.2]     3.1772 (1.11)     3.1772 (1.11)     3.1772 (1.11)     0.0000 (1.0)      3.1772 (1.11)     0.0000 (1.0)           0;0  0.3147 (0.90)          1           1
test_list-list-recursive[3.60.1]     3.2220 (1.12)     3.2220 (1.12)     3.2220 (1.12)     0.0000 (1.0)      3.2220 (1.12)     0.0000 (1.0)           0;0  0.3104 (0.89)          1           1
test_list-list-recursive[main]       3.3165 (1.16)     3.3165 (1.16)     3.3165 (1.16)     0.0000 (1.0)      3.3165 (1.16)     0.0000 (1.0)           0;0  0.3015 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     448.8325 (1.03)     448.8325 (1.03)     448.8325 (1.03)     0.0000 (1.0)      448.8325 (1.03)     0.0000 (1.0)           0;0  2.2280 (0.97)          1           1
test_list-list-shallow[3.10.0]     438.0328 (1.01)     438.0328 (1.01)     438.0328 (1.01)     0.0000 (1.0)      438.0328 (1.01)     0.0000 (1.0)           0;0  2.2829 (0.99)          1           1
test_list-list-shallow[3.53.2]     434.5333 (1.0)      434.5333 (1.0)      434.5333 (1.0)      0.0000 (1.0)      434.5333 (1.0)      0.0000 (1.0)           0;0  2.3013 (1.0)           1           1
test_list-list-shallow[3.60.1]     471.7385 (1.09)     471.7385 (1.09)     471.7385 (1.09)     0.0000 (1.0)      471.7385 (1.09)     0.0000 (1.0)           0;0  2.1198 (0.92)          1           1
test_list-list-shallow[main]       452.5112 (1.04)     452.5112 (1.04)     452.5112 (1.04)     0.0000 (1.0)      452.5112 (1.04)     0.0000 (1.0)           0;0  2.2099 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.5193 (3.60)     72.5193 (3.60)     72.5193 (3.60)     0.0000 (1.0)      72.5193 (3.60)     0.0000 (1.0)           0;0  0.0138 (0.28)          1           1
test_partial_add-add[3.10.0]     72.2957 (3.59)     72.2957 (3.59)     72.2957 (3.59)     0.0000 (1.0)      72.2957 (3.59)     0.0000 (1.0)           0;0  0.0138 (0.28)          1           1
test_partial_add-add[3.53.2]     65.9459 (3.27)     65.9459 (3.27)     65.9459 (3.27)     0.0000 (1.0)      65.9459 (3.27)     0.0000 (1.0)           0;0  0.0152 (0.31)          1           1
test_partial_add-add[3.60.1]     20.1517 (1.0)      20.1517 (1.0)      20.1517 (1.0)      0.0000 (1.0)      20.1517 (1.0)      0.0000 (1.0)           0;0  0.0496 (1.0)           1           1
test_partial_add-add[main]       20.9283 (1.04)     20.9283 (1.04)     20.9283 (1.04)     0.0000 (1.0)      20.9283 (1.04)     0.0000 (1.0)           0;0  0.0478 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     60.5808 (7.68)     60.5808 (7.68)     60.5808 (7.68)     0.0000 (1.0)      60.5808 (7.68)     0.0000 (1.0)           0;0  0.0165 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     60.8602 (7.72)     60.8602 (7.72)     60.8602 (7.72)     0.0000 (1.0)      60.8602 (7.72)     0.0000 (1.0)           0;0  0.0164 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     56.1748 (7.13)     56.1748 (7.13)     56.1748 (7.13)     0.0000 (1.0)      56.1748 (7.13)     0.0000 (1.0)           0;0  0.0178 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.8839 (1.0)       7.8839 (1.0)       7.8839 (1.0)      0.0000 (1.0)       7.8839 (1.0)      0.0000 (1.0)           0;0  0.1268 (1.0)           1           1
test_partial_add-add-partial[main]        8.5578 (1.09)      8.5578 (1.09)      8.5578 (1.09)     0.0000 (1.0)       8.5578 (1.09)     0.0000 (1.0)           0;0  0.1169 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3300 (1.0)      4.3300 (1.0)      4.3300 (1.0)      0.0000 (1.0)      4.3300 (1.0)      0.0000 (1.0)           0;0  0.2309 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8360 (1.35)     5.8360 (1.35)     5.8360 (1.35)     0.0000 (1.0)      5.8360 (1.35)     0.0000 (1.0)           0;0  0.1714 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6914 (1.55)     6.6914 (1.55)     6.6914 (1.55)     0.0000 (1.0)      6.6914 (1.55)     0.0000 (1.0)           0;0  0.1494 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6006 (1.52)     6.6006 (1.52)     6.6006 (1.52)     0.0000 (1.0)      6.6006 (1.52)     0.0000 (1.0)           0;0  0.1515 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.7024 (1.55)     6.7024 (1.55)     6.7024 (1.55)     0.0000 (1.0)      6.7024 (1.55)     0.0000 (1.0)           0;0  0.1492 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3535 (1.0)      2.3535 (1.0)      2.3535 (1.0)      0.0000 (1.0)      2.3535 (1.0)      0.0000 (1.0)           0;0  0.4249 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8154 (1.62)     3.8154 (1.62)     3.8154 (1.62)     0.0000 (1.0)      3.8154 (1.62)     0.0000 (1.0)           0;0  0.2621 (0.62)          1           1
test_partial_add-gc-noop[3.53.2]     3.6936 (1.57)     3.6936 (1.57)     3.6936 (1.57)     0.0000 (1.0)      3.6936 (1.57)     0.0000 (1.0)           0;0  0.2707 (0.64)          1           1
test_partial_add-gc-noop[3.60.1]     3.6789 (1.56)     3.6789 (1.56)     3.6789 (1.56)     0.0000 (1.0)      3.6789 (1.56)     0.0000 (1.0)           0;0  0.2718 (0.64)          1           1
test_partial_add-gc-noop[main]       3.8122 (1.62)     3.8122 (1.62)     3.8122 (1.62)     0.0000 (1.0)      3.8122 (1.62)     0.0000 (1.0)           0;0  0.2623 (0.62)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     46.3305 (2.42)     46.3305 (2.42)     46.3305 (2.42)     0.0000 (1.0)      46.3305 (2.42)     0.0000 (1.0)           0;0  0.0216 (0.41)          1           1
test_partial_add-push[3.10.0]     41.4558 (2.17)     41.4558 (2.17)     41.4558 (2.17)     0.0000 (1.0)      41.4558 (2.17)     0.0000 (1.0)           0;0  0.0241 (0.46)          1           1
test_partial_add-push[3.53.2]     20.0358 (1.05)     20.0358 (1.05)     20.0358 (1.05)     0.0000 (1.0)      20.0358 (1.05)     0.0000 (1.0)           0;0  0.0499 (0.96)          1           1
test_partial_add-push[3.60.1]     19.1478 (1.0)      19.1478 (1.0)      19.1478 (1.0)      0.0000 (1.0)      19.1478 (1.0)      0.0000 (1.0)           0;0  0.0522 (1.0)           1           1
test_partial_add-push[main]       19.3393 (1.01)     19.3393 (1.01)     19.3393 (1.01)     0.0000 (1.0)      19.3393 (1.01)     0.0000 (1.0)           0;0  0.0517 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.6840 (1.13)     11.6840 (1.13)     11.6840 (1.13)     0.0000 (1.0)      11.6840 (1.13)     0.0000 (1.0)           0;0  0.0856 (0.89)          1           1
test_partial_add-push-partial[3.10.0]     11.2228 (1.08)     11.2228 (1.08)     11.2228 (1.08)     0.0000 (1.0)      11.2228 (1.08)     0.0000 (1.0)           0;0  0.0891 (0.93)          1           1
test_partial_add-push-partial[3.53.2]     10.7682 (1.04)     10.7682 (1.04)     10.7682 (1.04)     0.0000 (1.0)      10.7682 (1.04)     0.0000 (1.0)           0;0  0.0929 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     10.3857 (1.0)      10.3857 (1.0)      10.3857 (1.0)      0.0000 (1.0)      10.3857 (1.0)      0.0000 (1.0)           0;0  0.0963 (1.0)           1           1
test_partial_add-push-partial[main]       10.5860 (1.02)     10.5860 (1.02)     10.5860 (1.02)     0.0000 (1.0)      10.5860 (1.02)     0.0000 (1.0)           0;0  0.0945 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.3796 (3.63)     83.3796 (3.63)     83.3796 (3.63)     0.0000 (1.0)      83.3796 (3.63)     0.0000 (1.0)           0;0  0.0120 (0.28)          1           1
test_partial_remove-add[3.10.0]     83.2200 (3.62)     83.2200 (3.62)     83.2200 (3.62)     0.0000 (1.0)      83.2200 (3.62)     0.0000 (1.0)           0;0  0.0120 (0.28)          1           1
test_partial_remove-add[3.53.2]     74.3974 (3.24)     74.3974 (3.24)     74.3974 (3.24)     0.0000 (1.0)      74.3974 (3.24)     0.0000 (1.0)           0;0  0.0134 (0.31)          1           1
test_partial_remove-add[3.60.1]     22.9710 (1.0)      22.9710 (1.0)      22.9710 (1.0)      0.0000 (1.0)      22.9710 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_partial_remove-add[main]       23.9279 (1.04)     23.9279 (1.04)     23.9279 (1.04)     0.0000 (1.0)      23.9279 (1.04)     0.0000 (1.0)           0;0  0.0418 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.3846 (7.50)     8.3846 (7.50)     8.3846 (7.50)     0.0000 (1.0)      8.3846 (7.50)     0.0000 (1.0)           0;0  0.1193 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.5300 (7.63)     8.5300 (7.63)     8.5300 (7.63)     0.0000 (1.0)      8.5300 (7.63)     0.0000 (1.0)           0;0  0.1172 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.6929 (6.88)     7.6929 (6.88)     7.6929 (6.88)     0.0000 (1.0)      7.6929 (6.88)     0.0000 (1.0)           0;0  0.1300 (0.15)          1           1
test_partial_remove-add-update[3.60.1]     1.2415 (1.11)     1.2415 (1.11)     1.2415 (1.11)     0.0000 (1.0)      1.2415 (1.11)     0.0000 (1.0)           0;0  0.8055 (0.90)          1           1
test_partial_remove-add-update[main]       1.1177 (1.0)      1.1177 (1.0)      1.1177 (1.0)      0.0000 (1.0)      1.1177 (1.0)      0.0000 (1.0)           0;0  0.8947 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1838 (1.0)      3.1838 (1.0)      3.1838 (1.0)      0.0000 (1.0)      3.1838 (1.0)      0.0000 (1.0)           0;0  0.3141 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5220 (1.11)     3.5220 (1.11)     3.5220 (1.11)     0.0000 (1.0)      3.5220 (1.11)     0.0000 (1.0)           0;0  0.2839 (0.90)          1           1
test_partial_remove-gc[3.53.2]     3.6455 (1.15)     3.6455 (1.15)     3.6455 (1.15)     0.0000 (1.0)      3.6455 (1.15)     0.0000 (1.0)           0;0  0.2743 (0.87)          1           1
test_partial_remove-gc[3.60.1]     3.7385 (1.17)     3.7385 (1.17)     3.7385 (1.17)     0.0000 (1.0)      3.7385 (1.17)     0.0000 (1.0)           0;0  0.2675 (0.85)          1           1
test_partial_remove-gc[main]       3.6259 (1.14)     3.6259 (1.14)     3.6259 (1.14)     0.0000 (1.0)      3.6259 (1.14)     0.0000 (1.0)           0;0  0.2758 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7883 (1.04)     4.7883 (1.04)     4.7883 (1.04)     0.0000 (1.0)      4.7883 (1.04)     0.0000 (1.0)           0;0  0.2088 (0.96)          1           1
test_partial_remove-gc-cloud[3.10.0]     4.9302 (1.08)     4.9302 (1.08)     4.9302 (1.08)     0.0000 (1.0)      4.9302 (1.08)     0.0000 (1.0)           0;0  0.2028 (0.93)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8776 (1.06)     4.8776 (1.06)     4.8776 (1.06)     0.0000 (1.0)      4.8776 (1.06)     0.0000 (1.0)           0;0  0.2050 (0.94)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.7439 (1.04)     4.7439 (1.04)     4.7439 (1.04)     0.0000 (1.0)      4.7439 (1.04)     0.0000 (1.0)           0;0  0.2108 (0.97)          1           1
test_partial_remove-gc-cloud[main]       4.5822 (1.0)      4.5822 (1.0)      4.5822 (1.0)      0.0000 (1.0)      4.5822 (1.0)      0.0000 (1.0)           0;0  0.2182 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     54.0951 (2.45)     54.0951 (2.45)     54.0951 (2.45)     0.0000 (1.0)      54.0951 (2.45)     0.0000 (1.0)           0;0  0.0185 (0.41)          1           1
test_partial_remove-push[3.10.0]     47.3314 (2.14)     47.3314 (2.14)     47.3314 (2.14)     0.0000 (1.0)      47.3314 (2.14)     0.0000 (1.0)           0;0  0.0211 (0.47)          1           1
test_partial_remove-push[3.53.2]     22.8976 (1.04)     22.8976 (1.04)     22.8976 (1.04)     0.0000 (1.0)      22.8976 (1.04)     0.0000 (1.0)           0;0  0.0437 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.0945 (1.0)      22.0945 (1.0)      22.0945 (1.0)      0.0000 (1.0)      22.0945 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
test_partial_remove-push[main]       22.3434 (1.01)     22.3434 (1.01)     22.3434 (1.01)     0.0000 (1.0)      22.3434 (1.01)     0.0000 (1.0)           0;0  0.0448 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8359 (1.03)     1.8359 (1.03)     1.8359 (1.03)     0.0000 (1.0)      1.8359 (1.03)     0.0000 (1.0)           0;0  0.5447 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     1.7784 (1.0)      1.7784 (1.0)      1.7784 (1.0)      0.0000 (1.0)      1.7784 (1.0)      0.0000 (1.0)           0;0  0.5623 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.4368 (1.37)     2.4368 (1.37)     2.4368 (1.37)     0.0000 (1.0)      2.4368 (1.37)     0.0000 (1.0)           0;0  0.4104 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.4833 (1.40)     2.4833 (1.40)     2.4833 (1.40)     0.0000 (1.0)      2.4833 (1.40)     0.0000 (1.0)           0;0  0.4027 (0.72)          1           1
test_partial_remove-push-update[main]       2.4688 (1.39)     2.4688 (1.39)     2.4688 (1.39)     0.0000 (1.0)      2.4688 (1.39)     0.0000 (1.0)           0;0  0.4050 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     501.9103 (1.0)      516.2381 (1.0)      510.4562 (1.0)       5.4793 (1.53)     510.8110 (1.0)       7.0351 (1.31)          2;0  1.9590 (1.0)           5           3
test_plots-plots-diff[3.10.0]     909.7702 (1.81)     947.5355 (1.84)     926.5748 (1.82)     13.6520 (3.82)     925.2045 (1.81)     13.9414 (2.60)          2;0  1.0792 (0.55)          5           3
test_plots-plots-diff[3.53.2]     843.3067 (1.68)     852.1869 (1.65)     848.5488 (1.66)      3.5784 (1.0)      849.8533 (1.66)      5.3590 (1.0)           2;0  1.1785 (0.60)          5           3
test_plots-plots-diff[3.60.1]     830.6216 (1.65)     861.4681 (1.67)     843.2166 (1.65)     11.8063 (3.30)     841.7568 (1.65)     15.5679 (2.90)          2;0  1.1859 (0.61)          5           3
test_plots-plots-diff[main]       825.6573 (1.65)     834.6027 (1.62)     829.4808 (1.62)      3.8587 (1.08)     828.1653 (1.62)      6.6064 (1.23)          1;0  1.2056 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       525.0366 (1.0)        537.2818 (1.0)        529.7774 (1.0)       4.5952 (1.29)       528.5666 (1.0)       4.8980 (1.0)           2;0  1.8876 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,141.0500 (2.17)     1,149.5972 (2.14)     1,146.1216 (2.16)      3.5706 (1.0)      1,145.9609 (2.17)      5.7537 (1.17)          1;0  0.8725 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       923.6884 (1.76)       961.4654 (1.79)       935.4912 (1.77)     14.8556 (4.16)       930.2215 (1.76)     10.6990 (2.18)          1;1  1.0690 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       915.5694 (1.74)       932.5023 (1.74)       923.5342 (1.74)      6.2192 (1.74)       923.1130 (1.75)      7.6701 (1.57)          2;0  1.0828 (0.57)          5           3
test_plots-plots-diff-json[main]         910.9803 (1.74)       933.6475 (1.74)       921.5734 (1.74)      8.4085 (2.35)       919.1953 (1.74)     10.2608 (2.09)          2;0  1.0851 (0.57)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     428.1426 (1.0)      439.4219 (1.0)      433.8463 (1.0)       5.1041 (4.55)     432.7062 (1.0)       9.3998 (9.14)          2;0  2.3050 (1.0)           5           3
test_plots-plots-show[3.10.0]     742.3366 (1.73)     747.3480 (1.70)     744.6428 (1.72)      1.8911 (1.68)     744.8489 (1.72)      2.5267 (2.46)          2;0  1.3429 (0.58)          5           3
test_plots-plots-show[3.53.2]     725.9937 (1.70)     728.7844 (1.66)     726.8310 (1.68)      1.1226 (1.0)      726.5444 (1.68)      1.0284 (1.0)           1;1  1.3758 (0.60)          5           3
test_plots-plots-show[3.60.1]     721.3708 (1.68)     753.5179 (1.71)     736.5089 (1.70)     11.7075 (10.43)    735.1492 (1.70)     13.6309 (13.25)         2;0  1.3578 (0.59)          5           3
test_plots-plots-show[main]       707.0086 (1.65)     748.4281 (1.70)     728.1864 (1.68)     15.7810 (14.06)    731.2328 (1.69)     22.2811 (21.67)         2;0  1.3733 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     439.8338 (1.0)      450.5318 (1.0)      446.1737 (1.0)       3.9482 (1.0)      446.3414 (1.0)       3.9701 (1.0)           2;0  2.2413 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     865.3705 (1.97)     898.1253 (1.99)     885.5465 (1.98)     12.9799 (3.29)     891.6881 (2.00)     17.0524 (4.30)          1;0  1.1292 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     767.5625 (1.75)     784.1565 (1.74)     777.7433 (1.74)      7.1214 (1.80)     781.9078 (1.75)     10.9115 (2.75)          1;0  1.2858 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     749.7171 (1.70)     775.7222 (1.72)     759.9629 (1.70)      9.6128 (2.43)     757.7502 (1.70)      9.0880 (2.29)          2;0  1.3159 (0.59)          5           3
test_plots-plots-show-json[main]       753.9099 (1.71)     777.5494 (1.73)     765.2952 (1.72)      8.6044 (2.18)     766.1897 (1.72)      9.8777 (2.49)          2;0  1.3067 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     50.9932 (2.35)     50.9932 (2.35)     50.9932 (2.35)     0.0000 (1.0)      50.9932 (2.35)     0.0000 (1.0)           0;0  0.0196 (0.43)          1           1
test_push-push[3.10.0]     45.6508 (2.10)     45.6508 (2.10)     45.6508 (2.10)     0.0000 (1.0)      45.6508 (2.10)     0.0000 (1.0)           0;0  0.0219 (0.48)          1           1
test_push-push[3.53.2]     22.3714 (1.03)     22.3714 (1.03)     22.3714 (1.03)     0.0000 (1.0)      22.3714 (1.03)     0.0000 (1.0)           0;0  0.0447 (0.97)          1           1
test_push-push[3.60.1]     21.8703 (1.01)     21.8703 (1.01)     21.8703 (1.01)     0.0000 (1.0)      21.8703 (1.01)     0.0000 (1.0)           0;0  0.0457 (0.99)          1           1
test_push-push[main]       21.7158 (1.0)      21.7158 (1.0)      21.7158 (1.0)      0.0000 (1.0)      21.7158 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.4790 (2.76)     64.4790 (2.76)     64.4790 (2.76)     0.0000 (1.0)      64.4790 (2.76)     0.0000 (1.0)           0;0  0.0155 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.8447 (2.99)     69.8447 (2.99)     69.8447 (2.99)     0.0000 (1.0)      69.8447 (2.99)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.7884 (1.45)     33.7884 (1.45)     33.7884 (1.45)     0.0000 (1.0)      33.7884 (1.45)     0.0000 (1.0)           0;0  0.0296 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.5674 (1.01)     23.5674 (1.01)     23.5674 (1.01)     0.0000 (1.0)      23.5674 (1.01)     0.0000 (1.0)           0;0  0.0424 (0.99)          1           1
test_sharing-fetch[main]       23.3241 (1.0)      23.3241 (1.0)      23.3241 (1.0)      0.0000 (1.0)      23.3241 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2413 (1.0)      1.2413 (1.0)      1.2413 (1.0)      0.0000 (1.0)      1.2413 (1.0)      0.0000 (1.0)           0;0  0.8056 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6238 (2.92)     3.6238 (2.92)     3.6238 (2.92)     0.0000 (1.0)      3.6238 (2.92)     0.0000 (1.0)           0;0  0.2760 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.7933 (4.67)     5.7933 (4.67)     5.7933 (4.67)     0.0000 (1.0)      5.7933 (4.67)     0.0000 (1.0)           0;0  0.1726 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.8645 (4.72)     5.8645 (4.72)     5.8645 (4.72)     0.0000 (1.0)      5.8645 (4.72)     0.0000 (1.0)           0;0  0.1705 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8872 (4.74)     5.8872 (4.74)     5.8872 (4.74)     0.0000 (1.0)      5.8872 (4.74)     0.0000 (1.0)           0;0  0.1699 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.0285 (2.34)     52.0285 (2.34)     52.0285 (2.34)     0.0000 (1.0)      52.0285 (2.34)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_sharing-push[3.10.0]     45.8660 (2.06)     45.8660 (2.06)     45.8660 (2.06)     0.0000 (1.0)      45.8660 (2.06)     0.0000 (1.0)           0;0  0.0218 (0.48)          1           1
test_sharing-push[3.53.2]     22.7317 (1.02)     22.7317 (1.02)     22.7317 (1.02)     0.0000 (1.0)      22.7317 (1.02)     0.0000 (1.0)           0;0  0.0440 (0.98)          1           1
test_sharing-push[3.60.1]     22.2398 (1.0)      22.2398 (1.0)      22.2398 (1.0)      0.0000 (1.0)      22.2398 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
test_sharing-push[main]       22.7843 (1.02)     22.7843 (1.02)     22.7843 (1.02)     0.0000 (1.0)      22.7843 (1.02)     0.0000 (1.0)           0;0  0.0439 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1349 (1.03)     2.1349 (1.03)     2.1349 (1.03)     0.0000 (1.0)      2.1349 (1.03)     0.0000 (1.0)           0;0  0.4684 (0.97)          1           1
test_sharing-push-noop[3.10.0]     2.0802 (1.0)      2.0802 (1.0)      2.0802 (1.0)      0.0000 (1.0)      2.0802 (1.0)      0.0000 (1.0)           0;0  0.4807 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.1321 (2.95)     6.1321 (2.95)     6.1321 (2.95)     0.0000 (1.0)      6.1321 (2.95)     0.0000 (1.0)           0;0  0.1631 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0880 (2.93)     6.0880 (2.93)     6.0880 (2.93)     0.0000 (1.0)      6.0880 (2.93)     0.0000 (1.0)           0;0  0.1643 (0.34)          1           1
test_sharing-push-noop[main]       6.0244 (2.90)     6.0244 (2.90)     6.0244 (2.90)     0.0000 (1.0)      6.0244 (2.90)     0.0000 (1.0)           0;0  0.1660 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     359.6786 (1.03)     359.6786 (1.03)     359.6786 (1.03)     0.0000 (1.0)      359.6786 (1.03)     0.0000 (1.0)           0;0  0.0028 (0.97)          1           1
test_sharing_azure-fetch[main]       348.0113 (1.0)      348.0113 (1.0)      348.0113 (1.0)      0.0000 (1.0)      348.0113 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.5295 (1.0)      6.5295 (1.0)      6.5295 (1.0)      0.0000 (1.0)      6.5295 (1.0)      0.0000 (1.0)           0;0  0.1532 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7100 (1.03)     6.7100 (1.03)     6.7100 (1.03)     0.0000 (1.0)      6.7100 (1.03)     0.0000 (1.0)           0;0  0.1490 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     363.5129 (1.0)      363.5129 (1.0)      363.5129 (1.0)      0.0000 (1.0)      363.5129 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
test_sharing_azure-push[main]       369.9169 (1.02)     369.9169 (1.02)     369.9169 (1.02)     0.0000 (1.0)      369.9169 (1.02)     0.0000 (1.0)           0;0  0.0027 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.8116 (1.0)      7.8116 (1.0)      7.8116 (1.0)      0.0000 (1.0)      7.8116 (1.0)      0.0000 (1.0)           0;0  0.1280 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.9884 (1.02)     7.9884 (1.02)     7.9884 (1.02)     0.0000 (1.0)      7.9884 (1.02)     0.0000 (1.0)           0;0  0.1252 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     268.6618 (1.15)     268.6618 (1.15)     268.6618 (1.15)     0.0000 (1.0)      268.6618 (1.15)     0.0000 (1.0)           0;0  0.0037 (0.87)          1           1
test_sharing_gs-fetch[main]       233.3699 (1.0)      233.3699 (1.0)      233.3699 (1.0)      0.0000 (1.0)      233.3699 (1.0)      0.0000 (1.0)           0;0  0.0043 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     13.6191 (1.0)      13.6191 (1.0)      13.6191 (1.0)      0.0000 (1.0)      13.6191 (1.0)      0.0000 (1.0)           0;0  0.0734 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       14.2059 (1.04)     14.2059 (1.04)     14.2059 (1.04)     0.0000 (1.0)      14.2059 (1.04)     0.0000 (1.0)           0;0  0.0704 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     521.5756 (1.01)     521.5756 (1.01)     521.5756 (1.01)     0.0000 (1.0)      521.5756 (1.01)     0.0000 (1.0)           0;0  0.0019 (0.99)          1           1
test_sharing_gs-push[main]       518.0722 (1.0)      518.0722 (1.0)      518.0722 (1.0)      0.0000 (1.0)      518.0722 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.5198 (1.0)      6.5198 (1.0)      6.5198 (1.0)      0.0000 (1.0)      6.5198 (1.0)      0.0000 (1.0)           0;0  0.1534 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.7078 (1.03)     6.7078 (1.03)     6.7078 (1.03)     0.0000 (1.0)      6.7078 (1.03)     0.0000 (1.0)           0;0  0.1491 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     276.5327 (1.02)     276.5327 (1.02)     276.5327 (1.02)     0.0000 (1.0)      276.5327 (1.02)     0.0000 (1.0)           0;0  0.0036 (0.98)          1           1
test_sharing_s3-fetch[main]       270.6468 (1.0)      270.6468 (1.0)      270.6468 (1.0)      0.0000 (1.0)      270.6468 (1.0)      0.0000 (1.0)           0;0  0.0037 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2643 (1.0)      6.2643 (1.0)      6.2643 (1.0)      0.0000 (1.0)      6.2643 (1.0)      0.0000 (1.0)           0;0  0.1596 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.4783 (1.03)     6.4783 (1.03)     6.4783 (1.03)     0.0000 (1.0)      6.4783 (1.03)     0.0000 (1.0)           0;0  0.1544 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     308.3524 (1.00)     308.3524 (1.00)     308.3524 (1.00)     0.0000 (1.0)      308.3524 (1.00)     0.0000 (1.0)           0;0  0.0032 (1.00)          1           1
test_sharing_s3-push[main]       307.4130 (1.0)      307.4130 (1.0)      307.4130 (1.0)      0.0000 (1.0)      307.4130 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.3190 (1.0)      6.3190 (1.0)      6.3190 (1.0)      0.0000 (1.0)      6.3190 (1.0)      0.0000 (1.0)           0;0  0.1583 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.5552 (1.04)     6.5552 (1.04)     6.5552 (1.04)     0.0000 (1.0)      6.5552 (1.04)     0.0000 (1.0)           0;0  0.1526 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.1241 (3.76)     20.1241 (3.76)     20.1241 (3.76)     0.0000 (1.0)      20.1241 (3.76)     0.0000 (1.0)           0;0  0.0497 (0.27)          1           1
test_status-status[3.10.0]     20.4115 (3.81)     20.4115 (3.81)     20.4115 (3.81)     0.0000 (1.0)      20.4115 (3.81)     0.0000 (1.0)           0;0  0.0490 (0.26)          1           1
test_status-status[3.53.2]     18.4929 (3.45)     18.4929 (3.45)     18.4929 (3.45)     0.0000 (1.0)      18.4929 (3.45)     0.0000 (1.0)           0;0  0.0541 (0.29)          1           1
test_status-status[3.60.1]      5.3540 (1.0)       5.3540 (1.0)       5.3540 (1.0)      0.0000 (1.0)       5.3540 (1.0)      0.0000 (1.0)           0;0  0.1868 (1.0)           1           1
test_status-status[main]        5.6281 (1.05)      5.6281 (1.05)      5.6281 (1.05)     0.0000 (1.0)       5.6281 (1.05)     0.0000 (1.0)           0;0  0.1777 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9313 (1.77)     4.9313 (1.77)     4.9313 (1.77)     0.0000 (1.0)      4.9313 (1.77)     0.0000 (1.0)           0;0  0.2028 (0.56)          1           1
test_status-status-changed[3.10.0]     5.2171 (1.88)     5.2171 (1.88)     5.2171 (1.88)     0.0000 (1.0)      5.2171 (1.88)     0.0000 (1.0)           0;0  0.1917 (0.53)          1           1
test_status-status-changed[3.53.2]     5.2181 (1.88)     5.2181 (1.88)     5.2181 (1.88)     0.0000 (1.0)      5.2181 (1.88)     0.0000 (1.0)           0;0  0.1916 (0.53)          1           1
test_status-status-changed[3.60.1]     2.7809 (1.0)      2.7809 (1.0)      2.7809 (1.0)      0.0000 (1.0)      2.7809 (1.0)      0.0000 (1.0)           0;0  0.3596 (1.0)           1           1
test_status-status-changed[main]       3.0969 (1.11)     3.0969 (1.11)     3.0969 (1.11)     0.0000 (1.0)      3.0969 (1.11)     0.0000 (1.0)           0;0  0.3229 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9090 (1.80)     4.9090 (1.80)     4.9090 (1.80)     0.0000 (1.0)      4.9090 (1.80)     0.0000 (1.0)           0;0  0.2037 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     5.0152 (1.84)     5.0152 (1.84)     5.0152 (1.84)     0.0000 (1.0)      5.0152 (1.84)     0.0000 (1.0)           0;0  0.1994 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.9274 (1.81)     4.9274 (1.81)     4.9274 (1.81)     0.0000 (1.0)      4.9274 (1.81)     0.0000 (1.0)           0;0  0.2029 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.7215 (1.0)      2.7215 (1.0)      2.7215 (1.0)      0.0000 (1.0)      2.7215 (1.0)      0.0000 (1.0)           0;0  0.3674 (1.0)           1           1
test_status-status-changed-noop[main]       2.9504 (1.08)     2.9504 (1.08)     2.9504 (1.08)     0.0000 (1.0)      2.9504 (1.08)     0.0000 (1.0)           0;0  0.3389 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9060 (1.78)     4.9060 (1.78)     4.9060 (1.78)     0.0000 (1.0)      4.9060 (1.78)     0.0000 (1.0)           0;0  0.2038 (0.56)          1           1
test_status-status-noop[3.10.0]     5.1775 (1.88)     5.1775 (1.88)     5.1775 (1.88)     0.0000 (1.0)      5.1775 (1.88)     0.0000 (1.0)           0;0  0.1931 (0.53)          1           1
test_status-status-noop[3.53.2]     5.0254 (1.83)     5.0254 (1.83)     5.0254 (1.83)     0.0000 (1.0)      5.0254 (1.83)     0.0000 (1.0)           0;0  0.1990 (0.55)          1           1
test_status-status-noop[3.60.1]     2.7513 (1.0)      2.7513 (1.0)      2.7513 (1.0)      0.0000 (1.0)      2.7513 (1.0)      0.0000 (1.0)           0;0  0.3635 (1.0)           1           1
test_status-status-noop[main]       2.9489 (1.07)     2.9489 (1.07)     2.9489 (1.07)     0.0000 (1.0)      2.9489 (1.07)     0.0000 (1.0)           0;0  0.3391 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     156.0786 (3.34)     156.0786 (3.34)     156.0786 (3.34)     0.0000 (1.0)      156.0786 (3.34)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     159.4405 (3.41)     159.4405 (3.41)     159.4405 (3.41)     0.0000 (1.0)      159.4405 (3.41)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.53.2]     119.7728 (2.56)     119.7728 (2.56)     119.7728 (2.56)     0.0000 (1.0)      119.7728 (2.56)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_update-import-url[3.60.1]      46.7294 (1.0)       46.7294 (1.0)       46.7294 (1.0)      0.0000 (1.0)       46.7294 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_update-import-url[main]        48.9488 (1.05)      48.9488 (1.05)      48.9488 (1.05)     0.0000 (1.0)       48.9488 (1.05)     0.0000 (1.0)           0;0  0.0204 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     141.0718 (3.81)     141.0718 (3.81)     141.0718 (3.81)     0.0000 (1.0)      141.0718 (3.81)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.10.0]     143.9322 (3.88)     143.9322 (3.88)     143.9322 (3.88)     0.0000 (1.0)      143.9322 (3.88)     0.0000 (1.0)           0;0  0.0069 (0.26)          1           1
test_update-update[3.53.2]     111.9735 (3.02)     111.9735 (3.02)     111.9735 (3.02)     0.0000 (1.0)      111.9735 (3.02)     0.0000 (1.0)           0;0  0.0089 (0.33)          1           1
test_update-update[3.60.1]      37.0549 (1.0)       37.0549 (1.0)       37.0549 (1.0)      0.0000 (1.0)       37.0549 (1.0)      0.0000 (1.0)           0;0  0.0270 (1.0)           1           1
test_update-update[main]        37.7305 (1.02)      37.7305 (1.02)      37.7305 (1.02)     0.0000 (1.0)       37.7305 (1.02)     0.0000 (1.0)           0;0  0.0265 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1160 (1.98)     16.1160 (1.98)     16.1160 (1.98)     0.0000 (1.0)      16.1160 (1.98)     0.0000 (1.0)           0;0  0.0621 (0.50)          1           1
test_update-update-noop[3.10.0]     16.8883 (2.08)     16.8883 (2.08)     16.8883 (2.08)     0.0000 (1.0)      16.8883 (2.08)     0.0000 (1.0)           0;0  0.0592 (0.48)          1           1
test_update-update-noop[3.53.2]     16.1309 (1.99)     16.1309 (1.99)     16.1309 (1.99)     0.0000 (1.0)      16.1309 (1.99)     0.0000 (1.0)           0;0  0.0620 (0.50)          1           1
test_update-update-noop[3.60.1]      8.1264 (1.0)       8.1264 (1.0)       8.1264 (1.0)      0.0000 (1.0)       8.1264 (1.0)      0.0000 (1.0)           0;0  0.1231 (1.0)           1           1
test_update-update-noop[main]        8.8440 (1.09)      8.8440 (1.09)      8.8440 (1.09)     0.0000 (1.0)       8.8440 (1.09)     0.0000 (1.0)           0;0  0.1131 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean