Fri Oct 31 01:18:38 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     83.8911 (3.74)     83.8911 (3.74)     83.8911 (3.74)     0.0000 (1.0)      83.8911 (3.74)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_add_copy-add[3.10.0]     85.1698 (3.80)     85.1698 (3.80)     85.1698 (3.80)     0.0000 (1.0)      85.1698 (3.80)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_add_copy-add[3.53.2]     75.6884 (3.38)     75.6884 (3.38)     75.6884 (3.38)     0.0000 (1.0)      75.6884 (3.38)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_add_copy-add[3.60.1]     22.4154 (1.0)      22.4154 (1.0)      22.4154 (1.0)      0.0000 (1.0)      22.4154 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_add_copy-add[main]       23.7902 (1.06)     23.7902 (1.06)     23.7902 (1.06)     0.0000 (1.0)      23.7902 (1.06)     0.0000 (1.0)           0;0  0.0420 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.9252 (6.55)     27.9252 (6.55)     27.9252 (6.55)     0.0000 (1.0)      27.9252 (6.55)     0.0000 (1.0)           0;0  0.0358 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.5142 (6.69)     28.5142 (6.69)     28.5142 (6.69)     0.0000 (1.0)      28.5142 (6.69)     0.0000 (1.0)           0;0  0.0351 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     27.2828 (6.40)     27.2828 (6.40)     27.2828 (6.40)     0.0000 (1.0)      27.2828 (6.40)     0.0000 (1.0)           0;0  0.0367 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.2618 (1.0)       4.2618 (1.0)       4.2618 (1.0)      0.0000 (1.0)       4.2618 (1.0)      0.0000 (1.0)           0;0  0.2346 (1.0)           1           1
test_add_copy-add-noop[main]        4.4612 (1.05)      4.4612 (1.05)      4.4612 (1.05)     0.0000 (1.0)       4.4612 (1.05)     0.0000 (1.0)           0;0  0.2242 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.9753 (4.16)     64.9753 (4.16)     64.9753 (4.16)     0.0000 (1.0)      64.9753 (4.16)     0.0000 (1.0)           0;0  0.0154 (0.24)          1           1
test_add_hardlink-add[3.10.0]     65.5851 (4.20)     65.5851 (4.20)     65.5851 (4.20)     0.0000 (1.0)      65.5851 (4.20)     0.0000 (1.0)           0;0  0.0152 (0.24)          1           1
test_add_hardlink-add[3.53.2]     60.5086 (3.87)     60.5086 (3.87)     60.5086 (3.87)     0.0000 (1.0)      60.5086 (3.87)     0.0000 (1.0)           0;0  0.0165 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.6221 (1.0)      15.6221 (1.0)      15.6221 (1.0)      0.0000 (1.0)      15.6221 (1.0)      0.0000 (1.0)           0;0  0.0640 (1.0)           1           1
test_add_hardlink-add[main]       16.8915 (1.08)     16.8915 (1.08)     16.8915 (1.08)     0.0000 (1.0)      16.8915 (1.08)     0.0000 (1.0)           0;0  0.0592 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.7617 (7.99)     32.7617 (7.99)     32.7617 (7.99)     0.0000 (1.0)      32.7617 (7.99)     0.0000 (1.0)           0;0  0.0305 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.9012 (8.27)     33.9012 (8.27)     33.9012 (8.27)     0.0000 (1.0)      33.9012 (8.27)     0.0000 (1.0)           0;0  0.0295 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     31.4818 (7.68)     31.4818 (7.68)     31.4818 (7.68)     0.0000 (1.0)      31.4818 (7.68)     0.0000 (1.0)           0;0  0.0318 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.1009 (1.0)       4.1009 (1.0)       4.1009 (1.0)      0.0000 (1.0)       4.1009 (1.0)      0.0000 (1.0)           0;0  0.2438 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.3957 (1.07)      4.3957 (1.07)      4.3957 (1.07)     0.0000 (1.0)       4.3957 (1.07)     0.0000 (1.0)           0;0  0.2275 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.2768 (1.98)     69.2768 (1.98)     69.2768 (1.98)     0.0000 (1.0)      69.2768 (1.98)     0.0000 (1.0)           0;0  0.0144 (0.50)          1           1
test_add_symlink-add[3.10.0]     69.8961 (2.00)     69.8961 (2.00)     69.8961 (2.00)     0.0000 (1.0)      69.8961 (2.00)     0.0000 (1.0)           0;0  0.0143 (0.50)          1           1
test_add_symlink-add[3.53.2]     65.1695 (1.87)     65.1695 (1.87)     65.1695 (1.87)     0.0000 (1.0)      65.1695 (1.87)     0.0000 (1.0)           0;0  0.0153 (0.54)          1           1
test_add_symlink-add[3.60.1]     34.9420 (1.0)      34.9420 (1.0)      34.9420 (1.0)      0.0000 (1.0)      34.9420 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_add_symlink-add[main]       36.3677 (1.04)     36.3677 (1.04)     36.3677 (1.04)     0.0000 (1.0)      36.3677 (1.04)     0.0000 (1.0)           0;0  0.0275 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.3390 (8.10)     46.3390 (8.10)     46.3390 (8.10)     0.0000 (1.0)      46.3390 (8.10)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.0600 (8.22)     47.0600 (8.22)     47.0600 (8.22)     0.0000 (1.0)      47.0600 (8.22)     0.0000 (1.0)           0;0  0.0212 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     45.8249 (8.01)     45.8249 (8.01)     45.8249 (8.01)     0.0000 (1.0)      45.8249 (8.01)     0.0000 (1.0)           0;0  0.0218 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.7235 (1.0)       5.7235 (1.0)       5.7235 (1.0)      0.0000 (1.0)       5.7235 (1.0)      0.0000 (1.0)           0;0  0.1747 (1.0)           1           1
test_add_symlink-add-noop[main]        5.8096 (1.02)      5.8096 (1.02)      5.8096 (1.02)     0.0000 (1.0)       5.8096 (1.02)     0.0000 (1.0)           0;0  0.1721 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.2418 (1.90)     40.2418 (1.90)     40.2418 (1.90)     0.0000 (1.0)      40.2418 (1.90)     0.0000 (1.0)           0;0  0.0248 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     55.7759 (2.63)     55.7759 (2.63)     55.7759 (2.63)     0.0000 (1.0)      55.7759 (2.63)     0.0000 (1.0)           0;0  0.0179 (0.38)          1           1
test_checkout_copy-checkout[3.53.2]     28.6760 (1.35)     28.6760 (1.35)     28.6760 (1.35)     0.0000 (1.0)      28.6760 (1.35)     0.0000 (1.0)           0;0  0.0349 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     21.2290 (1.0)      21.2290 (1.0)      21.2290 (1.0)      0.0000 (1.0)      21.2290 (1.0)      0.0000 (1.0)           0;0  0.0471 (1.0)           1           1
test_checkout_copy-checkout[main]       21.9154 (1.03)     21.9154 (1.03)     21.9154 (1.03)     0.0000 (1.0)      21.9154 (1.03)     0.0000 (1.0)           0;0  0.0456 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5508 (1.63)     5.5508 (1.63)     5.5508 (1.63)     0.0000 (1.0)      5.5508 (1.63)     0.0000 (1.0)           0;0  0.1802 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8927 (1.73)     5.8927 (1.73)     5.8927 (1.73)     0.0000 (1.0)      5.8927 (1.73)     0.0000 (1.0)           0;0  0.1697 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7586 (1.69)     5.7586 (1.69)     5.7586 (1.69)     0.0000 (1.0)      5.7586 (1.69)     0.0000 (1.0)           0;0  0.1737 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.4028 (1.0)      3.4028 (1.0)      3.4028 (1.0)      0.0000 (1.0)      3.4028 (1.0)      0.0000 (1.0)           0;0  0.2939 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5163 (1.03)     3.5163 (1.03)     3.5163 (1.03)     0.0000 (1.0)      3.5163 (1.03)     0.0000 (1.0)           0;0  0.2844 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.0048 (1.97)     8.0048 (1.97)     8.0048 (1.97)     0.0000 (1.0)      8.0048 (1.97)     0.0000 (1.0)           0;0  0.1249 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6349 (1.63)     6.6349 (1.63)     6.6349 (1.63)     0.0000 (1.0)      6.6349 (1.63)     0.0000 (1.0)           0;0  0.1507 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4425 (1.58)     6.4425 (1.58)     6.4425 (1.58)     0.0000 (1.0)      6.4425 (1.58)     0.0000 (1.0)           0;0  0.1552 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0681 (1.0)      4.0681 (1.0)      4.0681 (1.0)      0.0000 (1.0)      4.0681 (1.0)      0.0000 (1.0)           0;0  0.2458 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4767 (1.10)     4.4767 (1.10)     4.4767 (1.10)     0.0000 (1.0)      4.4767 (1.10)     0.0000 (1.0)           0;0  0.2234 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     14.4751 (2.59)     14.4751 (2.59)     14.4751 (2.59)     0.0000 (1.0)      14.4751 (2.59)     0.0000 (1.0)           0;0  0.0691 (0.39)          1           1
test_checkout_hardlink-checkout[3.10.0]     11.4449 (2.05)     11.4449 (2.05)     11.4449 (2.05)     0.0000 (1.0)      11.4449 (2.05)     0.0000 (1.0)           0;0  0.0874 (0.49)          1           1
test_checkout_hardlink-checkout[3.53.2]      9.8486 (1.76)      9.8486 (1.76)      9.8486 (1.76)     0.0000 (1.0)       9.8486 (1.76)     0.0000 (1.0)           0;0  0.1015 (0.57)          1           1
test_checkout_hardlink-checkout[3.60.1]      5.5901 (1.0)       5.5901 (1.0)       5.5901 (1.0)      0.0000 (1.0)       5.5901 (1.0)      0.0000 (1.0)           0;0  0.1789 (1.0)           1           1
test_checkout_hardlink-checkout[main]        6.5951 (1.18)      6.5951 (1.18)      6.5951 (1.18)     0.0000 (1.0)       6.5951 (1.18)     0.0000 (1.0)           0;0  0.1516 (0.85)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     4.0175 (1.37)     4.0175 (1.37)     4.0175 (1.37)     0.0000 (1.0)      4.0175 (1.37)     0.0000 (1.0)           0;0  0.2489 (0.73)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     4.3399 (1.48)     4.3399 (1.48)     4.3399 (1.48)     0.0000 (1.0)      4.3399 (1.48)     0.0000 (1.0)           0;0  0.2304 (0.68)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     4.2705 (1.46)     4.2705 (1.46)     4.2705 (1.46)     0.0000 (1.0)      4.2705 (1.46)     0.0000 (1.0)           0;0  0.2342 (0.69)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     2.9340 (1.0)      2.9340 (1.0)      2.9340 (1.0)      0.0000 (1.0)      2.9340 (1.0)      0.0000 (1.0)           0;0  0.3408 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.1306 (1.07)     3.1306 (1.07)     3.1306 (1.07)     0.0000 (1.0)      3.1306 (1.07)     0.0000 (1.0)           0;0  0.3194 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     6.0059 (1.70)     6.0059 (1.70)     6.0059 (1.70)     0.0000 (1.0)      6.0059 (1.70)     0.0000 (1.0)           0;0  0.1665 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     4.9895 (1.41)     4.9895 (1.41)     4.9895 (1.41)     0.0000 (1.0)      4.9895 (1.41)     0.0000 (1.0)           0;0  0.2004 (0.71)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     4.8975 (1.39)     4.8975 (1.39)     4.8975 (1.39)     0.0000 (1.0)      4.8975 (1.39)     0.0000 (1.0)           0;0  0.2042 (0.72)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.5301 (1.0)      3.5301 (1.0)      3.5301 (1.0)      0.0000 (1.0)      3.5301 (1.0)      0.0000 (1.0)           0;0  0.2833 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.8397 (1.09)     3.8397 (1.09)     3.8397 (1.09)     0.0000 (1.0)      3.8397 (1.09)     0.0000 (1.0)           0;0  0.2604 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     23.9548 (2.33)     23.9548 (2.33)     23.9548 (2.33)     0.0000 (1.0)      23.9548 (2.33)     0.0000 (1.0)           0;0  0.0417 (0.43)          1           1
test_checkout_symlink-checkout[3.10.0]     18.8012 (1.83)     18.8012 (1.83)     18.8012 (1.83)     0.0000 (1.0)      18.8012 (1.83)     0.0000 (1.0)           0;0  0.0532 (0.55)          1           1
test_checkout_symlink-checkout[3.53.2]     17.3246 (1.69)     17.3246 (1.69)     17.3246 (1.69)     0.0000 (1.0)      17.3246 (1.69)     0.0000 (1.0)           0;0  0.0577 (0.59)          1           1
test_checkout_symlink-checkout[3.60.1]     10.2697 (1.0)      10.2697 (1.0)      10.2697 (1.0)      0.0000 (1.0)      10.2697 (1.0)      0.0000 (1.0)           0;0  0.0974 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.5325 (1.12)     11.5325 (1.12)     11.5325 (1.12)     0.0000 (1.0)      11.5325 (1.12)     0.0000 (1.0)           0;0  0.0867 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8190 (1.66)     6.8190 (1.66)     6.8190 (1.66)     0.0000 (1.0)      6.8190 (1.66)     0.0000 (1.0)           0;0  0.1466 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7234 (1.64)     6.7234 (1.64)     6.7234 (1.64)     0.0000 (1.0)      6.7234 (1.64)     0.0000 (1.0)           0;0  0.1487 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6637 (1.63)     6.6637 (1.63)     6.6637 (1.63)     0.0000 (1.0)      6.6637 (1.63)     0.0000 (1.0)           0;0  0.1501 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.0979 (1.0)      4.0979 (1.0)      4.0979 (1.0)      0.0000 (1.0)      4.0979 (1.0)      0.0000 (1.0)           0;0  0.2440 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5578 (1.11)     4.5578 (1.11)     4.5578 (1.11)     0.0000 (1.0)      4.5578 (1.11)     0.0000 (1.0)           0;0  0.2194 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.1016 (1.81)     10.1016 (1.81)     10.1016 (1.81)     0.0000 (1.0)      10.1016 (1.81)     0.0000 (1.0)           0;0  0.0990 (0.55)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4500 (1.51)      8.4500 (1.51)      8.4500 (1.51)     0.0000 (1.0)       8.4500 (1.51)     0.0000 (1.0)           0;0  0.1183 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.2821 (1.48)      8.2821 (1.48)      8.2821 (1.48)     0.0000 (1.0)       8.2821 (1.48)     0.0000 (1.0)           0;0  0.1207 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.5873 (1.0)       5.5873 (1.0)       5.5873 (1.0)      0.0000 (1.0)       5.5873 (1.0)      0.0000 (1.0)           0;0  0.1790 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.2252 (1.11)      6.2252 (1.11)      6.2252 (1.11)     0.0000 (1.0)       6.2252 (1.11)     0.0000 (1.0)           0;0  0.1606 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0001 (1.75)     4.0001 (1.75)     4.0001 (1.75)     0.0000 (1.0)      4.0001 (1.75)     0.0000 (1.0)           0;0  0.2500 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.6997 (2.06)     4.6997 (2.06)     4.6997 (2.06)     0.0000 (1.0)      4.6997 (2.06)     0.0000 (1.0)           0;0  0.2128 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.6345 (2.03)     4.6345 (2.03)     4.6345 (2.03)     0.0000 (1.0)      4.6345 (2.03)     0.0000 (1.0)           0;0  0.2158 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.2830 (1.0)      2.2830 (1.0)      2.2830 (1.0)      0.0000 (1.0)      2.2830 (1.0)      0.0000 (1.0)           0;0  0.4380 (1.0)           1           1
test_data_status-data-changed[main]       2.4605 (1.08)     2.4605 (1.08)     2.4605 (1.08)     0.0000 (1.0)      2.4605 (1.08)     0.0000 (1.0)           0;0  0.4064 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0095 (1.76)     4.0095 (1.76)     4.0095 (1.76)     0.0000 (1.0)      4.0095 (1.76)     0.0000 (1.0)           0;0  0.2494 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7351 (2.08)     4.7351 (2.08)     4.7351 (2.08)     0.0000 (1.0)      4.7351 (2.08)     0.0000 (1.0)           0;0  0.2112 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6616 (2.05)     4.6616 (2.05)     4.6616 (2.05)     0.0000 (1.0)      4.6616 (2.05)     0.0000 (1.0)           0;0  0.2145 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2794 (1.0)      2.2794 (1.0)      2.2794 (1.0)      0.0000 (1.0)      2.2794 (1.0)      0.0000 (1.0)           0;0  0.4387 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5524 (1.12)     2.5524 (1.12)     2.5524 (1.12)     0.0000 (1.0)      2.5524 (1.12)     0.0000 (1.0)           0;0  0.3918 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     17.9979 (3.80)     17.9979 (3.80)     17.9979 (3.80)     0.0000 (1.0)      17.9979 (3.80)     0.0000 (1.0)           0;0  0.0556 (0.26)          1           1
test_data_status-data-new[3.10.0]     18.6178 (3.93)     18.6178 (3.93)     18.6178 (3.93)     0.0000 (1.0)      18.6178 (3.93)     0.0000 (1.0)           0;0  0.0537 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.4588 (3.90)     18.4588 (3.90)     18.4588 (3.90)     0.0000 (1.0)      18.4588 (3.90)     0.0000 (1.0)           0;0  0.0542 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.7322 (1.0)       4.7322 (1.0)       4.7322 (1.0)      0.0000 (1.0)       4.7322 (1.0)      0.0000 (1.0)           0;0  0.2113 (1.0)           1           1
test_data_status-data-new[main]        4.9148 (1.04)      4.9148 (1.04)      4.9148 (1.04)     0.0000 (1.0)       4.9148 (1.04)     0.0000 (1.0)           0;0  0.2035 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0647 (1.79)     4.0647 (1.79)     4.0647 (1.79)     0.0000 (1.0)      4.0647 (1.79)     0.0000 (1.0)           0;0  0.2460 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.7396 (2.09)     4.7396 (2.09)     4.7396 (2.09)     0.0000 (1.0)      4.7396 (2.09)     0.0000 (1.0)           0;0  0.2110 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6499 (2.05)     4.6499 (2.05)     4.6499 (2.05)     0.0000 (1.0)      4.6499 (2.05)     0.0000 (1.0)           0;0  0.2151 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.2692 (1.0)      2.2692 (1.0)      2.2692 (1.0)      0.0000 (1.0)      2.2692 (1.0)      0.0000 (1.0)           0;0  0.4407 (1.0)           1           1
test_data_status-data-noop[main]       2.5321 (1.12)     2.5321 (1.12)     2.5321 (1.12)     0.0000 (1.0)      2.5321 (1.12)     0.0000 (1.0)           0;0  0.3949 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.9481 (1.30)     6.9481 (1.30)     6.9481 (1.30)     0.0000 (1.0)      6.9481 (1.30)     0.0000 (1.0)           0;0  0.1439 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.5203 (1.41)     7.5203 (1.41)     7.5203 (1.41)     0.0000 (1.0)      7.5203 (1.41)     0.0000 (1.0)           0;0  0.1330 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5918 (1.43)     7.5918 (1.43)     7.5918 (1.43)     0.0000 (1.0)      7.5918 (1.43)     0.0000 (1.0)           0;0  0.1317 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.3243 (1.0)      5.3243 (1.0)      5.3243 (1.0)      0.0000 (1.0)      5.3243 (1.0)      0.0000 (1.0)           0;0  0.1878 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.6578 (1.06)     5.6578 (1.06)     5.6578 (1.06)     0.0000 (1.0)      5.6578 (1.06)     0.0000 (1.0)           0;0  0.1767 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.8244 (1.29)     6.8244 (1.29)     6.8244 (1.29)     0.0000 (1.0)      6.8244 (1.29)     0.0000 (1.0)           0;0  0.1465 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6062 (1.43)     7.6062 (1.43)     7.6062 (1.43)     0.0000 (1.0)      7.6062 (1.43)     0.0000 (1.0)           0;0  0.1315 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6148 (1.44)     7.6148 (1.44)     7.6148 (1.44)     0.0000 (1.0)      7.6148 (1.44)     0.0000 (1.0)           0;0  0.1313 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.3034 (1.0)      5.3034 (1.0)      5.3034 (1.0)      0.0000 (1.0)      5.3034 (1.0)      0.0000 (1.0)           0;0  0.1886 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.5105 (1.04)     5.5105 (1.04)     5.5105 (1.04)     0.0000 (1.0)      5.5105 (1.04)     0.0000 (1.0)           0;0  0.1815 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.2303 (2.73)     21.2303 (2.73)     21.2303 (2.73)     0.0000 (1.0)      21.2303 (2.73)     0.0000 (1.0)           0;0  0.0471 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.9484 (2.82)     21.9484 (2.82)     21.9484 (2.82)     0.0000 (1.0)      21.9484 (2.82)     0.0000 (1.0)           0;0  0.0456 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.9214 (2.82)     21.9214 (2.82)     21.9214 (2.82)     0.0000 (1.0)      21.9214 (2.82)     0.0000 (1.0)           0;0  0.0456 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.7709 (1.0)       7.7709 (1.0)       7.7709 (1.0)      0.0000 (1.0)       7.7709 (1.0)      0.0000 (1.0)           0;0  0.1287 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2454 (1.06)      8.2454 (1.06)      8.2454 (1.06)     0.0000 (1.0)       8.2454 (1.06)     0.0000 (1.0)           0;0  0.1213 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.2839 (1.36)     6.2839 (1.36)     6.2839 (1.36)     0.0000 (1.0)      6.2839 (1.36)     0.0000 (1.0)           0;0  0.1591 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0173 (1.52)     7.0173 (1.52)     7.0173 (1.52)     0.0000 (1.0)      7.0173 (1.52)     0.0000 (1.0)           0;0  0.1425 (0.66)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.2000 (1.56)     7.2000 (1.56)     7.2000 (1.56)     0.0000 (1.0)      7.2000 (1.56)     0.0000 (1.0)           0;0  0.1389 (0.64)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.6052 (1.0)      4.6052 (1.0)      4.6052 (1.0)      0.0000 (1.0)      4.6052 (1.0)      0.0000 (1.0)           0;0  0.2171 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0754 (1.10)     5.0754 (1.10)     5.0754 (1.10)     0.0000 (1.0)      5.0754 (1.10)     0.0000 (1.0)           0;0  0.1970 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.5008 (2.59)     17.5008 (2.59)     17.5008 (2.59)     0.0000 (1.0)      17.5008 (2.59)     0.0000 (1.0)           0;0  0.0571 (0.39)          1           1
test_diff-diff[3.10.0]     18.4266 (2.72)     18.4266 (2.72)     18.4266 (2.72)     0.0000 (1.0)      18.4266 (2.72)     0.0000 (1.0)           0;0  0.0543 (0.37)          1           1
test_diff-diff[3.53.2]     18.7184 (2.77)     18.7184 (2.77)     18.7184 (2.77)     0.0000 (1.0)      18.7184 (2.77)     0.0000 (1.0)           0;0  0.0534 (0.36)          1           1
test_diff-diff[3.60.1]      6.7675 (1.0)       6.7675 (1.0)       6.7675 (1.0)      0.0000 (1.0)       6.7675 (1.0)      0.0000 (1.0)           0;0  0.1478 (1.0)           1           1
test_diff-diff[main]        7.9496 (1.17)      7.9496 (1.17)      7.9496 (1.17)     0.0000 (1.0)       7.9496 (1.17)     0.0000 (1.0)           0;0  0.1258 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.8939 (1.81)     5.8939 (1.81)     5.8939 (1.81)     0.0000 (1.0)      5.8939 (1.81)     0.0000 (1.0)           0;0  0.1697 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.6982 (2.06)     6.6982 (2.06)     6.6982 (2.06)     0.0000 (1.0)      6.6982 (2.06)     0.0000 (1.0)           0;0  0.1493 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.6922 (1.75)     5.6922 (1.75)     5.6922 (1.75)     0.0000 (1.0)      5.6922 (1.75)     0.0000 (1.0)           0;0  0.1757 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.2571 (1.0)      3.2571 (1.0)      3.2571 (1.0)      0.0000 (1.0)      3.2571 (1.0)      0.0000 (1.0)           0;0  0.3070 (1.0)           1           1
test_diff-diff-changed[main]       4.2009 (1.29)     4.2009 (1.29)     4.2009 (1.29)     0.0000 (1.0)      4.2009 (1.29)     0.0000 (1.0)           0;0  0.2380 (0.78)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2107 (1.59)     5.2107 (1.59)     5.2107 (1.59)     0.0000 (1.0)      5.2107 (1.59)     0.0000 (1.0)           0;0  0.1919 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8301 (1.78)     5.8301 (1.78)     5.8301 (1.78)     0.0000 (1.0)      5.8301 (1.78)     0.0000 (1.0)           0;0  0.1715 (0.56)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5525 (1.69)     5.5525 (1.69)     5.5525 (1.69)     0.0000 (1.0)      5.5525 (1.69)     0.0000 (1.0)           0;0  0.1801 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2772 (1.0)      3.2772 (1.0)      3.2772 (1.0)      0.0000 (1.0)      3.2772 (1.0)      0.0000 (1.0)           0;0  0.3051 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2942 (1.31)     4.2942 (1.31)     4.2942 (1.31)     0.0000 (1.0)      4.2942 (1.31)     0.0000 (1.0)           0;0  0.2329 (0.76)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1522 (1.27)     4.1522 (1.27)     4.1522 (1.27)     0.0000 (1.0)      4.1522 (1.27)     0.0000 (1.0)           0;0  0.2408 (0.79)          1           1
test_diff-diff-noop[3.10.0]     4.8786 (1.49)     4.8786 (1.49)     4.8786 (1.49)     0.0000 (1.0)      4.8786 (1.49)     0.0000 (1.0)           0;0  0.2050 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.7120 (1.75)     5.7120 (1.75)     5.7120 (1.75)     0.0000 (1.0)      5.7120 (1.75)     0.0000 (1.0)           0;0  0.1751 (0.57)          1           1
test_diff-diff-noop[3.60.1]     3.2705 (1.0)      3.2705 (1.0)      3.2705 (1.0)      0.0000 (1.0)      3.2705 (1.0)      0.0000 (1.0)           0;0  0.3058 (1.0)           1           1
test_diff-diff-noop[main]       4.2183 (1.29)     4.2183 (1.29)     4.2183 (1.29)     0.0000 (1.0)      4.2183 (1.29)     0.0000 (1.0)           0;0  0.2371 (0.78)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.3339 (1.0)       1.3339 (1.0)       1.3339 (1.0)      0.0000 (1.0)       1.3339 (1.0)      0.0000 (1.0)           0;0  0.7497 (1.0)           1           1
test_exp_show-exp[3.10.0]     12.0975 (9.07)     12.0975 (9.07)     12.0975 (9.07)     0.0000 (1.0)      12.0975 (9.07)     0.0000 (1.0)           0;0  0.0827 (0.11)          1           1
test_exp_show-exp[3.53.2]      6.9247 (5.19)      6.9247 (5.19)      6.9247 (5.19)     0.0000 (1.0)       6.9247 (5.19)     0.0000 (1.0)           0;0  0.1444 (0.19)          1           1
test_exp_show-exp[3.60.1]      8.9782 (6.73)      8.9782 (6.73)      8.9782 (6.73)     0.0000 (1.0)       8.9782 (6.73)     0.0000 (1.0)           0;0  0.1114 (0.15)          1           1
test_exp_show-exp[main]       12.6192 (9.46)     12.6192 (9.46)     12.6192 (9.46)     0.0000 (1.0)      12.6192 (9.46)     0.0000 (1.0)           0;0  0.0792 (0.11)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     61.9563 (2.62)     61.9563 (2.62)     61.9563 (2.62)     0.0000 (1.0)      61.9563 (2.62)     0.0000 (1.0)           0;0  0.0161 (0.38)          1           1
test_fetch-fetch[3.10.0]     67.9770 (2.88)     67.9770 (2.88)     67.9770 (2.88)     0.0000 (1.0)      67.9770 (2.88)     0.0000 (1.0)           0;0  0.0147 (0.35)          1           1
test_fetch-fetch[3.53.2]     34.5010 (1.46)     34.5010 (1.46)     34.5010 (1.46)     0.0000 (1.0)      34.5010 (1.46)     0.0000 (1.0)           0;0  0.0290 (0.68)          1           1
test_fetch-fetch[3.60.1]     23.7862 (1.01)     23.7862 (1.01)     23.7862 (1.01)     0.0000 (1.0)      23.7862 (1.01)     0.0000 (1.0)           0;0  0.0420 (0.99)          1           1
test_fetch-fetch[main]       23.6200 (1.0)      23.6200 (1.0)      23.6200 (1.0)      0.0000 (1.0)      23.6200 (1.0)      0.0000 (1.0)           0;0  0.0423 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.0401 (1.0)      2.0401 (1.0)      2.0401 (1.0)      0.0000 (1.0)      2.0401 (1.0)      0.0000 (1.0)           0;0  0.4902 (1.0)           1           1
test_gc-gc[3.10.0]     2.1865 (1.07)     2.1865 (1.07)     2.1865 (1.07)     0.0000 (1.0)      2.1865 (1.07)     0.0000 (1.0)           0;0  0.4573 (0.93)          1           1
test_gc-gc[3.53.2]     2.1009 (1.03)     2.1009 (1.03)     2.1009 (1.03)     0.0000 (1.0)      2.1009 (1.03)     0.0000 (1.0)           0;0  0.4760 (0.97)          1           1
test_gc-gc[3.60.1]     2.0620 (1.01)     2.0620 (1.01)     2.0620 (1.01)     0.0000 (1.0)      2.0620 (1.01)     0.0000 (1.0)           0;0  0.4850 (0.99)          1           1
test_gc-gc[main]       2.3007 (1.13)     2.3007 (1.13)     2.3007 (1.13)     0.0000 (1.0)      2.3007 (1.13)     0.0000 (1.0)           0;0  0.4347 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     131.7331 (2.77)     131.7331 (2.77)     131.7331 (2.77)     0.0000 (1.0)      131.7331 (2.77)     0.0000 (1.0)           0;0  0.0076 (0.36)          1           1
test_get-get[3.10.0]     160.0280 (3.36)     160.0280 (3.36)     160.0280 (3.36)     0.0000 (1.0)      160.0280 (3.36)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_get-get[3.53.2]     143.8207 (3.02)     143.8207 (3.02)     143.8207 (3.02)     0.0000 (1.0)      143.8207 (3.02)     0.0000 (1.0)           0;0  0.0070 (0.33)          1           1
test_get-get[3.60.1]      47.5827 (1.0)       47.5827 (1.0)       47.5827 (1.0)      0.0000 (1.0)       47.5827 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
test_get-get[main]        48.1286 (1.01)      48.1286 (1.01)      48.1286 (1.01)     0.0000 (1.0)       48.1286 (1.01)     0.0000 (1.0)           0;0  0.0208 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     41.0554 (2.48)     41.0554 (2.48)     41.0554 (2.48)     0.0000 (1.0)      41.0554 (2.48)     0.0000 (1.0)           0;0  0.0244 (0.40)          1           1
test_get_url-get-url[3.10.0]     43.7475 (2.64)     43.7475 (2.64)     43.7475 (2.64)     0.0000 (1.0)      43.7475 (2.64)     0.0000 (1.0)           0;0  0.0229 (0.38)          1           1
test_get_url-get-url[3.53.2]     16.6468 (1.00)     16.6468 (1.00)     16.6468 (1.00)     0.0000 (1.0)      16.6468 (1.00)     0.0000 (1.0)           0;0  0.0601 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.5821 (1.0)      16.5821 (1.0)      16.5821 (1.0)      0.0000 (1.0)      16.5821 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
test_get_url-get-url[main]       16.6810 (1.01)     16.6810 (1.01)     16.6810 (1.01)     0.0000 (1.0)      16.6810 (1.01)     0.0000 (1.0)           0;0  0.0599 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     147.4944 (1.06)     155.5643 (1.07)     150.1226 (1.06)     1.7064 (1.24)     149.7424 (1.06)     1.8469 (1.37)         25;5  6.6612 (0.94)        100           1
test_help---help[3.10.0]     142.8193 (1.03)     150.2882 (1.03)     145.9147 (1.03)     1.6878 (1.23)     145.5654 (1.03)     2.1665 (1.60)         32;1  6.8533 (0.97)        100           1
test_help---help[3.53.2]     146.6027 (1.05)     158.4206 (1.09)     149.1169 (1.05)     1.9806 (1.44)     148.5765 (1.05)     2.8797 (2.13)         29;1  6.7061 (0.95)        100           1
test_help---help[3.60.1]     147.1834 (1.06)     179.8529 (1.24)     151.2056 (1.07)     5.3934 (3.93)     149.2208 (1.06)     2.8057 (2.08)         9;10  6.6135 (0.94)        100           1
test_help---help[main]       139.1154 (1.0)      145.5398 (1.0)      141.4579 (1.0)      1.3727 (1.0)      141.1225 (1.0)      1.3506 (1.0)          29;8  7.0692 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     219.2364 (2.95)     219.2364 (2.95)     219.2364 (2.95)     0.0000 (1.0)      219.2364 (2.95)     0.0000 (1.0)           0;0  0.0046 (0.34)          1           1
test_import-import[3.10.0]     248.3512 (3.34)     248.3512 (3.34)     248.3512 (3.34)     0.0000 (1.0)      248.3512 (3.34)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      74.4126 (1.0)       74.4126 (1.0)       74.4126 (1.0)      0.0000 (1.0)       74.4126 (1.0)      0.0000 (1.0)           0;0  0.0134 (1.0)           1           1
test_import-import[main]        74.5460 (1.00)      74.5460 (1.00)      74.5460 (1.00)     0.0000 (1.0)       74.5460 (1.00)     0.0000 (1.0)           0;0  0.0134 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     153.8235 (3.28)     153.8235 (3.28)     153.8235 (3.28)     0.0000 (1.0)      153.8235 (3.28)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     158.4307 (3.38)     158.4307 (3.38)     158.4307 (3.38)     0.0000 (1.0)      158.4307 (3.38)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.53.2]     119.4691 (2.55)     119.4691 (2.55)     119.4691 (2.55)     0.0000 (1.0)      119.4691 (2.55)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_import_url-import-url[3.60.1]      46.8756 (1.0)       46.8756 (1.0)       46.8756 (1.0)      0.0000 (1.0)       46.8756 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_import_url-import-url[main]        48.3970 (1.03)      48.3970 (1.03)      48.3970 (1.03)     0.0000 (1.0)       48.3970 (1.03)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     431.7301 (1.03)     489.4782 (1.05)     450.2431 (1.03)     12.1990 (1.40)     449.3985 (1.03)     14.6076 (1.41)         31;3  2.2210 (0.98)        100           1
test_init-init[3.10.0]     436.5734 (1.04)     493.6848 (1.05)     455.2830 (1.04)     10.4114 (1.19)     455.3555 (1.04)     13.7994 (1.33)         29;1  2.1964 (0.96)        100           1
test_init-init[3.53.2]     421.7165 (1.01)     485.5298 (1.04)     439.0870 (1.00)     11.3754 (1.30)     436.7069 (1.0)      14.9309 (1.44)         30;1  2.2775 (1.00)        100           1
test_init-init[3.60.1]     417.9521 (1.0)      468.1305 (1.0)      439.0427 (1.0)       8.7241 (1.0)      438.8716 (1.00)     10.3605 (1.0)          29;2  2.2777 (1.0)         100           1
test_init-init[main]       448.4491 (1.07)     620.7743 (1.33)     473.0792 (1.08)     18.8099 (2.16)     470.4719 (1.08)     15.2012 (1.47)         12;4  2.1138 (0.93)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     673.4973 (1.09)     673.4973 (1.09)     673.4973 (1.09)     0.0000 (1.0)      673.4973 (1.09)     0.0000 (1.0)           0;0  1.4848 (0.92)          1           1
test_list-list[3.10.0]     787.0404 (1.27)     787.0404 (1.27)     787.0404 (1.27)     0.0000 (1.0)      787.0404 (1.27)     0.0000 (1.0)           0;0  1.2706 (0.79)          1           1
test_list-list[3.53.2]     698.0307 (1.13)     698.0307 (1.13)     698.0307 (1.13)     0.0000 (1.0)      698.0307 (1.13)     0.0000 (1.0)           0;0  1.4326 (0.89)          1           1
test_list-list[3.60.1]     618.5534 (1.0)      618.5534 (1.0)      618.5534 (1.0)      0.0000 (1.0)      618.5534 (1.0)      0.0000 (1.0)           0;0  1.6167 (1.0)           1           1
test_list-list[main]       627.5899 (1.01)     627.5899 (1.01)     627.5899 (1.01)     0.0000 (1.0)      627.5899 (1.01)     0.0000 (1.0)           0;0  1.5934 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     480.3299 (1.08)     480.3299 (1.08)     480.3299 (1.08)     0.0000 (1.0)      480.3299 (1.08)     0.0000 (1.0)           0;0  2.0819 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     475.8260 (1.07)     475.8260 (1.07)     475.8260 (1.07)     0.0000 (1.0)      475.8260 (1.07)     0.0000 (1.0)           0;0  2.1016 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     455.1948 (1.02)     455.1948 (1.02)     455.1948 (1.02)     0.0000 (1.0)      455.1948 (1.02)     0.0000 (1.0)           0;0  2.1969 (0.98)          1           1
test_list-list-dvc-only[3.60.1]     449.1100 (1.01)     449.1100 (1.01)     449.1100 (1.01)     0.0000 (1.0)      449.1100 (1.01)     0.0000 (1.0)           0;0  2.2266 (0.99)          1           1
test_list-list-dvc-only[main]       445.4755 (1.0)      445.4755 (1.0)      445.4755 (1.0)      0.0000 (1.0)      445.4755 (1.0)      0.0000 (1.0)           0;0  2.2448 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5396 (1.0)      2.5396 (1.0)      2.5396 (1.0)      0.0000 (1.0)      2.5396 (1.0)      0.0000 (1.0)           0;0  0.3938 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6482 (1.04)     2.6482 (1.04)     2.6482 (1.04)     0.0000 (1.0)      2.6482 (1.04)     0.0000 (1.0)           0;0  0.3776 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.7761 (1.09)     2.7761 (1.09)     2.7761 (1.09)     0.0000 (1.0)      2.7761 (1.09)     0.0000 (1.0)           0;0  0.3602 (0.91)          1           1
test_list-list-recursive[3.60.1]     2.7840 (1.10)     2.7840 (1.10)     2.7840 (1.10)     0.0000 (1.0)      2.7840 (1.10)     0.0000 (1.0)           0;0  0.3592 (0.91)          1           1
test_list-list-recursive[main]       2.7382 (1.08)     2.7382 (1.08)     2.7382 (1.08)     0.0000 (1.0)      2.7382 (1.08)     0.0000 (1.0)           0;0  0.3652 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     488.7953 (1.10)     488.7953 (1.10)     488.7953 (1.10)     0.0000 (1.0)      488.7953 (1.10)     0.0000 (1.0)           0;0  2.0458 (0.91)          1           1
test_list-list-shallow[3.10.0]     473.6732 (1.06)     473.6732 (1.06)     473.6732 (1.06)     0.0000 (1.0)      473.6732 (1.06)     0.0000 (1.0)           0;0  2.1112 (0.94)          1           1
test_list-list-shallow[3.53.2]     452.8214 (1.02)     452.8214 (1.02)     452.8214 (1.02)     0.0000 (1.0)      452.8214 (1.02)     0.0000 (1.0)           0;0  2.2084 (0.99)          1           1
test_list-list-shallow[3.60.1]     455.6704 (1.02)     455.6704 (1.02)     455.6704 (1.02)     0.0000 (1.0)      455.6704 (1.02)     0.0000 (1.0)           0;0  2.1946 (0.98)          1           1
test_list-list-shallow[main]       446.0817 (1.0)      446.0817 (1.0)      446.0817 (1.0)      0.0000 (1.0)      446.0817 (1.0)      0.0000 (1.0)           0;0  2.2417 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     70.8183 (3.72)     70.8183 (3.72)     70.8183 (3.72)     0.0000 (1.0)      70.8183 (3.72)     0.0000 (1.0)           0;0  0.0141 (0.27)          1           1
test_partial_add-add[3.10.0]     71.8780 (3.78)     71.8780 (3.78)     71.8780 (3.78)     0.0000 (1.0)      71.8780 (3.78)     0.0000 (1.0)           0;0  0.0139 (0.26)          1           1
test_partial_add-add[3.53.2]     65.1661 (3.43)     65.1661 (3.43)     65.1661 (3.43)     0.0000 (1.0)      65.1661 (3.43)     0.0000 (1.0)           0;0  0.0153 (0.29)          1           1
test_partial_add-add[3.60.1]     19.0264 (1.0)      19.0264 (1.0)      19.0264 (1.0)      0.0000 (1.0)      19.0264 (1.0)      0.0000 (1.0)           0;0  0.0526 (1.0)           1           1
test_partial_add-add[main]       19.9617 (1.05)     19.9617 (1.05)     19.9617 (1.05)     0.0000 (1.0)      19.9617 (1.05)     0.0000 (1.0)           0;0  0.0501 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.7389 (8.15)     59.7389 (8.15)     59.7389 (8.15)     0.0000 (1.0)      59.7389 (8.15)     0.0000 (1.0)           0;0  0.0167 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     60.1278 (8.21)     60.1278 (8.21)     60.1278 (8.21)     0.0000 (1.0)      60.1278 (8.21)     0.0000 (1.0)           0;0  0.0166 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     54.8333 (7.48)     54.8333 (7.48)     54.8333 (7.48)     0.0000 (1.0)      54.8333 (7.48)     0.0000 (1.0)           0;0  0.0182 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.3266 (1.0)       7.3266 (1.0)       7.3266 (1.0)      0.0000 (1.0)       7.3266 (1.0)      0.0000 (1.0)           0;0  0.1365 (1.0)           1           1
test_partial_add-add-partial[main]        7.4743 (1.02)      7.4743 (1.02)      7.4743 (1.02)     0.0000 (1.0)       7.4743 (1.02)     0.0000 (1.0)           0;0  0.1338 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6254 (1.0)      4.6254 (1.0)      4.6254 (1.0)      0.0000 (1.0)      4.6254 (1.0)      0.0000 (1.0)           0;0  0.2162 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1400 (1.33)     6.1400 (1.33)     6.1400 (1.33)     0.0000 (1.0)      6.1400 (1.33)     0.0000 (1.0)           0;0  0.1629 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9937 (1.51)     6.9937 (1.51)     6.9937 (1.51)     0.0000 (1.0)      6.9937 (1.51)     0.0000 (1.0)           0;0  0.1430 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.1085 (1.54)     7.1085 (1.54)     7.1085 (1.54)     0.0000 (1.0)      7.1085 (1.54)     0.0000 (1.0)           0;0  0.1407 (0.65)          1           1
test_partial_add-gc-cloud-noop[main]       7.0917 (1.53)     7.0917 (1.53)     7.0917 (1.53)     0.0000 (1.0)      7.0917 (1.53)     0.0000 (1.0)           0;0  0.1410 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5513 (1.0)      2.5513 (1.0)      2.5513 (1.0)      0.0000 (1.0)      2.5513 (1.0)      0.0000 (1.0)           0;0  0.3920 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9455 (1.55)     3.9455 (1.55)     3.9455 (1.55)     0.0000 (1.0)      3.9455 (1.55)     0.0000 (1.0)           0;0  0.2535 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.9215 (1.54)     3.9215 (1.54)     3.9215 (1.54)     0.0000 (1.0)      3.9215 (1.54)     0.0000 (1.0)           0;0  0.2550 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.9544 (1.55)     3.9544 (1.55)     3.9544 (1.55)     0.0000 (1.0)      3.9544 (1.55)     0.0000 (1.0)           0;0  0.2529 (0.65)          1           1
test_partial_add-gc-noop[main]       3.9847 (1.56)     3.9847 (1.56)     3.9847 (1.56)     0.0000 (1.0)      3.9847 (1.56)     0.0000 (1.0)           0;0  0.2510 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     40.4970 (2.16)     40.4970 (2.16)     40.4970 (2.16)     0.0000 (1.0)      40.4970 (2.16)     0.0000 (1.0)           0;0  0.0247 (0.46)          1           1
test_partial_add-push[3.10.0]     36.0260 (1.92)     36.0260 (1.92)     36.0260 (1.92)     0.0000 (1.0)      36.0260 (1.92)     0.0000 (1.0)           0;0  0.0278 (0.52)          1           1
test_partial_add-push[3.53.2]     19.5970 (1.05)     19.5970 (1.05)     19.5970 (1.05)     0.0000 (1.0)      19.5970 (1.05)     0.0000 (1.0)           0;0  0.0510 (0.96)          1           1
test_partial_add-push[3.60.1]     18.8490 (1.01)     18.8490 (1.01)     18.8490 (1.01)     0.0000 (1.0)      18.8490 (1.01)     0.0000 (1.0)           0;0  0.0531 (0.99)          1           1
test_partial_add-push[main]       18.7269 (1.0)      18.7269 (1.0)      18.7269 (1.0)      0.0000 (1.0)      18.7269 (1.0)      0.0000 (1.0)           0;0  0.0534 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.6548 (1.07)     10.6548 (1.07)     10.6548 (1.07)     0.0000 (1.0)      10.6548 (1.07)     0.0000 (1.0)           0;0  0.0939 (0.94)          1           1
test_partial_add-push-partial[3.10.0]      9.9735 (1.0)       9.9735 (1.0)       9.9735 (1.0)      0.0000 (1.0)       9.9735 (1.0)      0.0000 (1.0)           0;0  0.1003 (1.0)           1           1
test_partial_add-push-partial[3.53.2]     10.3334 (1.04)     10.3334 (1.04)     10.3334 (1.04)     0.0000 (1.0)      10.3334 (1.04)     0.0000 (1.0)           0;0  0.0968 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.0303 (1.01)     10.0303 (1.01)     10.0303 (1.01)     0.0000 (1.0)      10.0303 (1.01)     0.0000 (1.0)           0;0  0.0997 (0.99)          1           1
test_partial_add-push-partial[main]       10.0792 (1.01)     10.0792 (1.01)     10.0792 (1.01)     0.0000 (1.0)      10.0792 (1.01)     0.0000 (1.0)           0;0  0.0992 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     73.8564 (3.61)     73.8564 (3.61)     73.8564 (3.61)     0.0000 (1.0)      73.8564 (3.61)     0.0000 (1.0)           0;0  0.0135 (0.28)          1           1
test_partial_remove-add[3.10.0]     74.1816 (3.63)     74.1816 (3.63)     74.1816 (3.63)     0.0000 (1.0)      74.1816 (3.63)     0.0000 (1.0)           0;0  0.0135 (0.28)          1           1
test_partial_remove-add[3.53.2]     66.4970 (3.25)     66.4970 (3.25)     66.4970 (3.25)     0.0000 (1.0)      66.4970 (3.25)     0.0000 (1.0)           0;0  0.0150 (0.31)          1           1
test_partial_remove-add[3.60.1]     20.4484 (1.0)      20.4484 (1.0)      20.4484 (1.0)      0.0000 (1.0)      20.4484 (1.0)      0.0000 (1.0)           0;0  0.0489 (1.0)           1           1
test_partial_remove-add[main]       21.5533 (1.05)     21.5533 (1.05)     21.5533 (1.05)     0.0000 (1.0)      21.5533 (1.05)     0.0000 (1.0)           0;0  0.0464 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     7.6366 (7.31)     7.6366 (7.31)     7.6366 (7.31)     0.0000 (1.0)      7.6366 (7.31)     0.0000 (1.0)           0;0  0.1309 (0.14)          1           1
test_partial_remove-add-update[3.10.0]     7.6943 (7.37)     7.6943 (7.37)     7.6943 (7.37)     0.0000 (1.0)      7.6943 (7.37)     0.0000 (1.0)           0;0  0.1300 (0.14)          1           1
test_partial_remove-add-update[3.53.2]     6.7707 (6.48)     6.7707 (6.48)     6.7707 (6.48)     0.0000 (1.0)      6.7707 (6.48)     0.0000 (1.0)           0;0  0.1477 (0.15)          1           1
test_partial_remove-add-update[3.60.1]     1.0442 (1.0)      1.0442 (1.0)      1.0442 (1.0)      0.0000 (1.0)      1.0442 (1.0)      0.0000 (1.0)           0;0  0.9577 (1.0)           1           1
test_partial_remove-add-update[main]       1.0780 (1.03)     1.0780 (1.03)     1.0780 (1.03)     0.0000 (1.0)      1.0780 (1.03)     0.0000 (1.0)           0;0  0.9277 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3848 (1.0)      3.3848 (1.0)      3.3848 (1.0)      0.0000 (1.0)      3.3848 (1.0)      0.0000 (1.0)           0;0  0.2954 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6253 (1.07)     3.6253 (1.07)     3.6253 (1.07)     0.0000 (1.0)      3.6253 (1.07)     0.0000 (1.0)           0;0  0.2758 (0.93)          1           1
test_partial_remove-gc[3.53.2]     3.6614 (1.08)     3.6614 (1.08)     3.6614 (1.08)     0.0000 (1.0)      3.6614 (1.08)     0.0000 (1.0)           0;0  0.2731 (0.92)          1           1
test_partial_remove-gc[3.60.1]     3.8048 (1.12)     3.8048 (1.12)     3.8048 (1.12)     0.0000 (1.0)      3.8048 (1.12)     0.0000 (1.0)           0;0  0.2628 (0.89)          1           1
test_partial_remove-gc[main]       3.7518 (1.11)     3.7518 (1.11)     3.7518 (1.11)     0.0000 (1.0)      3.7518 (1.11)     0.0000 (1.0)           0;0  0.2665 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.6835 (1.0)      4.6835 (1.0)      4.6835 (1.0)      0.0000 (1.0)      4.6835 (1.0)      0.0000 (1.0)           0;0  0.2135 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.1416 (1.10)     5.1416 (1.10)     5.1416 (1.10)     0.0000 (1.0)      5.1416 (1.10)     0.0000 (1.0)           0;0  0.1945 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.7882 (1.02)     4.7882 (1.02)     4.7882 (1.02)     0.0000 (1.0)      4.7882 (1.02)     0.0000 (1.0)           0;0  0.2088 (0.98)          1           1
test_partial_remove-gc-cloud[3.60.1]     5.0691 (1.08)     5.0691 (1.08)     5.0691 (1.08)     0.0000 (1.0)      5.0691 (1.08)     0.0000 (1.0)           0;0  0.1973 (0.92)          1           1
test_partial_remove-gc-cloud[main]       4.8192 (1.03)     4.8192 (1.03)     4.8192 (1.03)     0.0000 (1.0)      4.8192 (1.03)     0.0000 (1.0)           0;0  0.2075 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     45.7136 (2.30)     45.7136 (2.30)     45.7136 (2.30)     0.0000 (1.0)      45.7136 (2.30)     0.0000 (1.0)           0;0  0.0219 (0.44)          1           1
test_partial_remove-push[3.10.0]     41.1536 (2.07)     41.1536 (2.07)     41.1536 (2.07)     0.0000 (1.0)      41.1536 (2.07)     0.0000 (1.0)           0;0  0.0243 (0.48)          1           1
test_partial_remove-push[3.53.2]     21.0522 (1.06)     21.0522 (1.06)     21.0522 (1.06)     0.0000 (1.0)      21.0522 (1.06)     0.0000 (1.0)           0;0  0.0475 (0.95)          1           1
test_partial_remove-push[3.60.1]     20.1506 (1.01)     20.1506 (1.01)     20.1506 (1.01)     0.0000 (1.0)      20.1506 (1.01)     0.0000 (1.0)           0;0  0.0496 (0.99)          1           1
test_partial_remove-push[main]       19.9057 (1.0)      19.9057 (1.0)      19.9057 (1.0)      0.0000 (1.0)      19.9057 (1.0)      0.0000 (1.0)           0;0  0.0502 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7800 (1.01)     1.7800 (1.01)     1.7800 (1.01)     0.0000 (1.0)      1.7800 (1.01)     0.0000 (1.0)           0;0  0.5618 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     1.7650 (1.0)      1.7650 (1.0)      1.7650 (1.0)      0.0000 (1.0)      1.7650 (1.0)      0.0000 (1.0)           0;0  0.5666 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.3940 (1.36)     2.3940 (1.36)     2.3940 (1.36)     0.0000 (1.0)      2.3940 (1.36)     0.0000 (1.0)           0;0  0.4177 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.6193 (1.48)     2.6193 (1.48)     2.6193 (1.48)     0.0000 (1.0)      2.6193 (1.48)     0.0000 (1.0)           0;0  0.3818 (0.67)          1           1
test_partial_remove-push-update[main]       2.4329 (1.38)     2.4329 (1.38)     2.4329 (1.38)     0.0000 (1.0)      2.4329 (1.38)     0.0000 (1.0)           0;0  0.4110 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     566.5925 (1.0)      570.6421 (1.0)      569.0488 (1.0)       1.6739 (1.0)      569.8988 (1.0)       2.4792 (1.0)           1;0  1.7573 (1.0)           5           3
test_plots-plots-diff[3.10.0]     969.7014 (1.71)     996.8097 (1.75)     982.6636 (1.73)     11.5107 (6.88)     987.0940 (1.73)     18.7050 (7.54)          2;0  1.0176 (0.58)          5           3
test_plots-plots-diff[3.53.2]     913.0333 (1.61)     923.7328 (1.62)     918.5864 (1.61)      3.8155 (2.28)     918.8389 (1.61)      3.6430 (1.47)          2;0  1.0886 (0.62)          5           3
test_plots-plots-diff[3.60.1]     908.4733 (1.60)     923.6340 (1.62)     918.6795 (1.61)      6.0333 (3.60)     920.4824 (1.62)      6.7316 (2.72)          1;0  1.0885 (0.62)          5           3
test_plots-plots-diff[main]       914.4289 (1.61)     928.0992 (1.63)     919.9601 (1.62)      5.6953 (3.40)     919.5279 (1.61)      9.2612 (3.74)          1;0  1.0870 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       582.6151 (1.0)        589.6085 (1.0)        585.4898 (1.0)      2.7877 (1.0)        585.7974 (1.0)       4.0129 (1.0)           2;0  1.7080 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,195.1182 (2.05)     1,207.5356 (2.05)     1,199.9109 (2.05)     4.6021 (1.65)     1,198.7348 (2.05)      4.0869 (1.02)          2;0  0.8334 (0.49)          5           3
test_plots-plots-diff-json[3.53.2]       986.5640 (1.69)     1,003.1139 (1.70)       994.1739 (1.70)     6.1678 (2.21)       994.1635 (1.70)      8.0292 (2.00)          2;0  1.0059 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       981.1438 (1.68)       990.3758 (1.68)       985.7312 (1.68)     3.3933 (1.22)       986.2317 (1.68)      4.1559 (1.04)          2;0  1.0145 (0.59)          5           3
test_plots-plots-diff-json[main]         980.8455 (1.68)       998.9455 (1.69)       990.6713 (1.69)     7.3059 (2.62)       988.8585 (1.69)     11.1953 (2.79)          2;0  1.0094 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     459.4727 (1.0)      463.3229 (1.0)      461.1907 (1.0)      1.8174 (1.0)      460.7214 (1.0)      3.4481 (1.0)           1;0  2.1683 (1.0)           5           3
test_plots-plots-show[3.10.0]     788.2836 (1.72)     803.0821 (1.73)     795.7958 (1.73)     5.7203 (3.15)     796.4296 (1.73)     8.5462 (2.48)          2;0  1.2566 (0.58)          5           3
test_plots-plots-show[3.53.2]     763.3166 (1.66)     776.1047 (1.68)     767.6574 (1.66)     5.0023 (2.75)     765.7253 (1.66)     5.2633 (1.53)          1;0  1.3027 (0.60)          5           3
test_plots-plots-show[3.60.1]     762.9883 (1.66)     770.7199 (1.66)     765.8780 (1.66)     3.1909 (1.76)     764.3581 (1.66)     4.6432 (1.35)          1;0  1.3057 (0.60)          5           3
test_plots-plots-show[main]       754.5423 (1.64)     768.0364 (1.66)     761.9101 (1.65)     4.8569 (2.67)     762.8342 (1.66)     4.7305 (1.37)          2;0  1.3125 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     472.9434 (1.0)      479.1677 (1.0)      475.9199 (1.0)      2.5108 (1.0)      475.3433 (1.0)       4.0276 (1.0)           2;0  2.1012 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     913.5590 (1.93)     936.1702 (1.95)     920.4609 (1.93)     9.2186 (3.67)     916.2283 (1.93)     10.0426 (2.49)          1;0  1.0864 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     820.1940 (1.73)     832.4773 (1.74)     824.6035 (1.73)     5.1525 (2.05)     821.8612 (1.73)      7.4403 (1.85)          1;0  1.2127 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     818.8177 (1.73)     827.0025 (1.73)     823.2211 (1.73)     3.2834 (1.31)     823.7234 (1.73)      5.2591 (1.31)          2;0  1.2147 (0.58)          5           3
test_plots-plots-show-json[main]       800.9008 (1.69)     817.3703 (1.71)     807.4132 (1.70)     7.2221 (2.88)     803.6181 (1.69)     11.8110 (2.93)          1;0  1.2385 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     46.8462 (2.18)     46.8462 (2.18)     46.8462 (2.18)     0.0000 (1.0)      46.8462 (2.18)     0.0000 (1.0)           0;0  0.0213 (0.46)          1           1
test_push-push[3.10.0]     42.0560 (1.95)     42.0560 (1.95)     42.0560 (1.95)     0.0000 (1.0)      42.0560 (1.95)     0.0000 (1.0)           0;0  0.0238 (0.51)          1           1
test_push-push[3.53.2]     22.3087 (1.04)     22.3087 (1.04)     22.3087 (1.04)     0.0000 (1.0)      22.3087 (1.04)     0.0000 (1.0)           0;0  0.0448 (0.97)          1           1
test_push-push[3.60.1]     21.6859 (1.01)     21.6859 (1.01)     21.6859 (1.01)     0.0000 (1.0)      21.6859 (1.01)     0.0000 (1.0)           0;0  0.0461 (0.99)          1           1
test_push-push[main]       21.5318 (1.0)      21.5318 (1.0)      21.5318 (1.0)      0.0000 (1.0)      21.5318 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     59.9917 (2.69)     59.9917 (2.69)     59.9917 (2.69)     0.0000 (1.0)      59.9917 (2.69)     0.0000 (1.0)           0;0  0.0167 (0.37)          1           1
test_sharing-fetch[3.10.0]     65.0915 (2.92)     65.0915 (2.92)     65.0915 (2.92)     0.0000 (1.0)      65.0915 (2.92)     0.0000 (1.0)           0;0  0.0154 (0.34)          1           1
test_sharing-fetch[3.53.2]     33.0478 (1.48)     33.0478 (1.48)     33.0478 (1.48)     0.0000 (1.0)      33.0478 (1.48)     0.0000 (1.0)           0;0  0.0303 (0.67)          1           1
test_sharing-fetch[3.60.1]     22.3368 (1.00)     22.3368 (1.00)     22.3368 (1.00)     0.0000 (1.0)      22.3368 (1.00)     0.0000 (1.0)           0;0  0.0448 (1.00)          1           1
test_sharing-fetch[main]       22.2606 (1.0)      22.2606 (1.0)      22.2606 (1.0)      0.0000 (1.0)      22.2606 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2519 (1.0)      1.2519 (1.0)      1.2519 (1.0)      0.0000 (1.0)      1.2519 (1.0)      0.0000 (1.0)           0;0  0.7988 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7052 (2.96)     3.7052 (2.96)     3.7052 (2.96)     0.0000 (1.0)      3.7052 (2.96)     0.0000 (1.0)           0;0  0.2699 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.8152 (4.65)     5.8152 (4.65)     5.8152 (4.65)     0.0000 (1.0)      5.8152 (4.65)     0.0000 (1.0)           0;0  0.1720 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9366 (4.74)     5.9366 (4.74)     5.9366 (4.74)     0.0000 (1.0)      5.9366 (4.74)     0.0000 (1.0)           0;0  0.1684 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9753 (4.77)     5.9753 (4.77)     5.9753 (4.77)     0.0000 (1.0)      5.9753 (4.77)     0.0000 (1.0)           0;0  0.1674 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     48.0184 (2.20)     48.0184 (2.20)     48.0184 (2.20)     0.0000 (1.0)      48.0184 (2.20)     0.0000 (1.0)           0;0  0.0208 (0.46)          1           1
test_sharing-push[3.10.0]     42.2920 (1.94)     42.2920 (1.94)     42.2920 (1.94)     0.0000 (1.0)      42.2920 (1.94)     0.0000 (1.0)           0;0  0.0236 (0.52)          1           1
test_sharing-push[3.53.2]     22.9778 (1.05)     22.9778 (1.05)     22.9778 (1.05)     0.0000 (1.0)      22.9778 (1.05)     0.0000 (1.0)           0;0  0.0435 (0.95)          1           1
test_sharing-push[3.60.1]     22.0693 (1.01)     22.0693 (1.01)     22.0693 (1.01)     0.0000 (1.0)      22.0693 (1.01)     0.0000 (1.0)           0;0  0.0453 (0.99)          1           1
test_sharing-push[main]       21.8528 (1.0)      21.8528 (1.0)      21.8528 (1.0)      0.0000 (1.0)      21.8528 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0545 (1.01)     2.0545 (1.01)     2.0545 (1.01)     0.0000 (1.0)      2.0545 (1.01)     0.0000 (1.0)           0;0  0.4867 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.0404 (1.0)      2.0404 (1.0)      2.0404 (1.0)      0.0000 (1.0)      2.0404 (1.0)      0.0000 (1.0)           0;0  0.4901 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9798 (2.93)     5.9798 (2.93)     5.9798 (2.93)     0.0000 (1.0)      5.9798 (2.93)     0.0000 (1.0)           0;0  0.1672 (0.34)          1           1
test_sharing-push-noop[3.60.1]     5.9249 (2.90)     5.9249 (2.90)     5.9249 (2.90)     0.0000 (1.0)      5.9249 (2.90)     0.0000 (1.0)           0;0  0.1688 (0.34)          1           1
test_sharing-push-noop[main]       6.2272 (3.05)     6.2272 (3.05)     6.2272 (3.05)     0.0000 (1.0)      6.2272 (3.05)     0.0000 (1.0)           0;0  0.1606 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     190.8191 (1.10)     190.8191 (1.10)     190.8191 (1.10)     0.0000 (1.0)      190.8191 (1.10)     0.0000 (1.0)           0;0  0.0052 (0.91)          1           1
test_sharing_azure-fetch[main]       172.8304 (1.0)      172.8304 (1.0)      172.8304 (1.0)      0.0000 (1.0)      172.8304 (1.0)      0.0000 (1.0)           0;0  0.0058 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.6347 (1.04)     6.6347 (1.04)     6.6347 (1.04)     0.0000 (1.0)      6.6347 (1.04)     0.0000 (1.0)           0;0  0.1507 (0.97)          1           1
test_sharing_azure-fetch-noop[main]       6.4087 (1.0)      6.4087 (1.0)      6.4087 (1.0)      0.0000 (1.0)      6.4087 (1.0)      0.0000 (1.0)           0;0  0.1560 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     175.9436 (1.02)     175.9436 (1.02)     175.9436 (1.02)     0.0000 (1.0)      175.9436 (1.02)     0.0000 (1.0)           0;0  0.0057 (0.99)          1           1
test_sharing_azure-push[main]       173.3318 (1.0)      173.3318 (1.0)      173.3318 (1.0)      0.0000 (1.0)      173.3318 (1.0)      0.0000 (1.0)           0;0  0.0058 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.1640 (1.04)     7.1640 (1.04)     7.1640 (1.04)     0.0000 (1.0)      7.1640 (1.04)     0.0000 (1.0)           0;0  0.1396 (0.96)          1           1
test_sharing_azure-push-noop[main]       6.8760 (1.0)      6.8760 (1.0)      6.8760 (1.0)      0.0000 (1.0)      6.8760 (1.0)      0.0000 (1.0)           0;0  0.1454 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     302.6904 (1.06)     302.6904 (1.06)     302.6904 (1.06)     0.0000 (1.0)      302.6904 (1.06)     0.0000 (1.0)           0;0  0.0033 (0.94)          1           1
test_sharing_gs-fetch[main]       284.4189 (1.0)      284.4189 (1.0)      284.4189 (1.0)      0.0000 (1.0)      284.4189 (1.0)      0.0000 (1.0)           0;0  0.0035 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     6.7185 (1.00)     6.7185 (1.00)     6.7185 (1.00)     0.0000 (1.0)      6.7185 (1.00)     0.0000 (1.0)           0;0  0.1488 (1.00)          1           1
test_sharing_gs-fetch-noop[main]       6.6852 (1.0)      6.6852 (1.0)      6.6852 (1.0)      0.0000 (1.0)      6.6852 (1.0)      0.0000 (1.0)           0;0  0.1496 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     717.8624 (1.0)      717.8624 (1.0)      717.8624 (1.0)      0.0000 (1.0)      717.8624 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
test_sharing_gs-push[main]       726.1676 (1.01)     726.1676 (1.01)     726.1676 (1.01)     0.0000 (1.0)      726.1676 (1.01)     0.0000 (1.0)           0;0  0.0014 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.6176 (1.0)      6.6176 (1.0)      6.6176 (1.0)      0.0000 (1.0)      6.6176 (1.0)      0.0000 (1.0)           0;0  0.1511 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.8804 (1.04)     6.8804 (1.04)     6.8804 (1.04)     0.0000 (1.0)      6.8804 (1.04)     0.0000 (1.0)           0;0  0.1453 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     690.9629 (1.01)     690.9629 (1.01)     690.9629 (1.01)     0.0000 (1.0)      690.9629 (1.01)     0.0000 (1.0)           0;0  0.0014 (0.99)          1           1
test_sharing_s3-fetch[main]       687.4428 (1.0)      687.4428 (1.0)      687.4428 (1.0)      0.0000 (1.0)      687.4428 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     5.4936 (1.0)      5.4936 (1.0)      5.4936 (1.0)      0.0000 (1.0)      5.4936 (1.0)      0.0000 (1.0)           0;0  0.1820 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       5.5376 (1.01)     5.5376 (1.01)     5.5376 (1.01)     0.0000 (1.0)      5.5376 (1.01)     0.0000 (1.0)           0;0  0.1806 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]       994.7175 (1.0)        994.7175 (1.0)        994.7175 (1.0)      0.0000 (1.0)        994.7175 (1.0)      0.0000 (1.0)           0;0  0.0010 (1.0)           1           1
test_sharing_s3-push[main]       1,024.2237 (1.03)     1,024.2237 (1.03)     1,024.2237 (1.03)     0.0000 (1.0)      1,024.2237 (1.03)     0.0000 (1.0)           0;0  0.0010 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.0911 (1.0)      6.0911 (1.0)      6.0911 (1.0)      0.0000 (1.0)      6.0911 (1.0)      0.0000 (1.0)           0;0  0.1642 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.0934 (1.00)     6.0934 (1.00)     6.0934 (1.00)     0.0000 (1.0)      6.0934 (1.00)     0.0000 (1.0)           0;0  0.1641 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.2738 (3.68)     19.2738 (3.68)     19.2738 (3.68)     0.0000 (1.0)      19.2738 (3.68)     0.0000 (1.0)           0;0  0.0519 (0.27)          1           1
test_status-status[3.10.0]     19.3804 (3.70)     19.3804 (3.70)     19.3804 (3.70)     0.0000 (1.0)      19.3804 (3.70)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_status-status[3.53.2]     17.4115 (3.33)     17.4115 (3.33)     17.4115 (3.33)     0.0000 (1.0)      17.4115 (3.33)     0.0000 (1.0)           0;0  0.0574 (0.30)          1           1
test_status-status[3.60.1]      5.2356 (1.0)       5.2356 (1.0)       5.2356 (1.0)      0.0000 (1.0)       5.2356 (1.0)      0.0000 (1.0)           0;0  0.1910 (1.0)           1           1
test_status-status[main]        5.3705 (1.03)      5.3705 (1.03)      5.3705 (1.03)     0.0000 (1.0)       5.3705 (1.03)     0.0000 (1.0)           0;0  0.1862 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9421 (1.78)     4.9421 (1.78)     4.9421 (1.78)     0.0000 (1.0)      4.9421 (1.78)     0.0000 (1.0)           0;0  0.2023 (0.56)          1           1
test_status-status-changed[3.10.0]     5.0099 (1.80)     5.0099 (1.80)     5.0099 (1.80)     0.0000 (1.0)      5.0099 (1.80)     0.0000 (1.0)           0;0  0.1996 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0446 (1.81)     5.0446 (1.81)     5.0446 (1.81)     0.0000 (1.0)      5.0446 (1.81)     0.0000 (1.0)           0;0  0.1982 (0.55)          1           1
test_status-status-changed[3.60.1]     2.7818 (1.0)      2.7818 (1.0)      2.7818 (1.0)      0.0000 (1.0)      2.7818 (1.0)      0.0000 (1.0)           0;0  0.3595 (1.0)           1           1
test_status-status-changed[main]       2.9974 (1.08)     2.9974 (1.08)     2.9974 (1.08)     0.0000 (1.0)      2.9974 (1.08)     0.0000 (1.0)           0;0  0.3336 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8094 (1.75)     4.8094 (1.75)     4.8094 (1.75)     0.0000 (1.0)      4.8094 (1.75)     0.0000 (1.0)           0;0  0.2079 (0.57)          1           1
test_status-status-changed-noop[3.10.0]     5.1535 (1.88)     5.1535 (1.88)     5.1535 (1.88)     0.0000 (1.0)      5.1535 (1.88)     0.0000 (1.0)           0;0  0.1940 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.8268 (1.76)     4.8268 (1.76)     4.8268 (1.76)     0.0000 (1.0)      4.8268 (1.76)     0.0000 (1.0)           0;0  0.2072 (0.57)          1           1
test_status-status-changed-noop[3.60.1]     2.7485 (1.0)      2.7485 (1.0)      2.7485 (1.0)      0.0000 (1.0)      2.7485 (1.0)      0.0000 (1.0)           0;0  0.3638 (1.0)           1           1
test_status-status-changed-noop[main]       2.7603 (1.00)     2.7603 (1.00)     2.7603 (1.00)     0.0000 (1.0)      2.7603 (1.00)     0.0000 (1.0)           0;0  0.3623 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8470 (1.81)     4.8470 (1.81)     4.8470 (1.81)     0.0000 (1.0)      4.8470 (1.81)     0.0000 (1.0)           0;0  0.2063 (0.55)          1           1
test_status-status-noop[3.10.0]     5.1150 (1.91)     5.1150 (1.91)     5.1150 (1.91)     0.0000 (1.0)      5.1150 (1.91)     0.0000 (1.0)           0;0  0.1955 (0.52)          1           1
test_status-status-noop[3.53.2]     4.8497 (1.81)     4.8497 (1.81)     4.8497 (1.81)     0.0000 (1.0)      4.8497 (1.81)     0.0000 (1.0)           0;0  0.2062 (0.55)          1           1
test_status-status-noop[3.60.1]     2.6781 (1.0)      2.6781 (1.0)      2.6781 (1.0)      0.0000 (1.0)      2.6781 (1.0)      0.0000 (1.0)           0;0  0.3734 (1.0)           1           1
test_status-status-noop[main]       2.7751 (1.04)     2.7751 (1.04)     2.7751 (1.04)     0.0000 (1.0)      2.7751 (1.04)     0.0000 (1.0)           0;0  0.3604 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     109.7127 (3.86)     109.7127 (3.86)     109.7127 (3.86)     0.0000 (1.0)      109.7127 (3.86)     0.0000 (1.0)           0;0  0.0091 (0.26)          1           1
test_update-import-url[3.10.0]     114.4000 (4.02)     114.4000 (4.02)     114.4000 (4.02)     0.0000 (1.0)      114.4000 (4.02)     0.0000 (1.0)           0;0  0.0087 (0.25)          1           1
test_update-import-url[3.53.2]      81.1325 (2.85)      81.1325 (2.85)      81.1325 (2.85)     0.0000 (1.0)       81.1325 (2.85)     0.0000 (1.0)           0;0  0.0123 (0.35)          1           1
test_update-import-url[3.60.1]      28.4285 (1.0)       28.4285 (1.0)       28.4285 (1.0)      0.0000 (1.0)       28.4285 (1.0)      0.0000 (1.0)           0;0  0.0352 (1.0)           1           1
test_update-import-url[main]        29.8451 (1.05)      29.8451 (1.05)      29.8451 (1.05)     0.0000 (1.0)       29.8451 (1.05)     0.0000 (1.0)           0;0  0.0335 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     101.1218 (4.22)     101.1218 (4.22)     101.1218 (4.22)     0.0000 (1.0)      101.1218 (4.22)     0.0000 (1.0)           0;0  0.0099 (0.24)          1           1
test_update-update[3.10.0]     104.1851 (4.35)     104.1851 (4.35)     104.1851 (4.35)     0.0000 (1.0)      104.1851 (4.35)     0.0000 (1.0)           0;0  0.0096 (0.23)          1           1
test_update-update[3.53.2]      73.6087 (3.07)      73.6087 (3.07)      73.6087 (3.07)     0.0000 (1.0)       73.6087 (3.07)     0.0000 (1.0)           0;0  0.0136 (0.33)          1           1
test_update-update[3.60.1]      23.9455 (1.0)       23.9455 (1.0)       23.9455 (1.0)      0.0000 (1.0)       23.9455 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
test_update-update[main]        24.9862 (1.04)      24.9862 (1.04)      24.9862 (1.04)     0.0000 (1.0)       24.9862 (1.04)     0.0000 (1.0)           0;0  0.0400 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     11.6197 (1.71)     11.6197 (1.71)     11.6197 (1.71)     0.0000 (1.0)      11.6197 (1.71)     0.0000 (1.0)           0;0  0.0861 (0.58)          1           1
test_update-update-noop[3.10.0]     12.2291 (1.80)     12.2291 (1.80)     12.2291 (1.80)     0.0000 (1.0)      12.2291 (1.80)     0.0000 (1.0)           0;0  0.0818 (0.55)          1           1
test_update-update-noop[3.53.2]     11.9373 (1.76)     11.9373 (1.76)     11.9373 (1.76)     0.0000 (1.0)      11.9373 (1.76)     0.0000 (1.0)           0;0  0.0838 (0.57)          1           1
test_update-update-noop[3.60.1]      6.7865 (1.0)       6.7865 (1.0)       6.7865 (1.0)      0.0000 (1.0)       6.7865 (1.0)      0.0000 (1.0)           0;0  0.1474 (1.0)           1           1
test_update-update-noop[main]        7.3822 (1.09)      7.3822 (1.09)      7.3822 (1.09)     0.0000 (1.0)       7.3822 (1.09)     0.0000 (1.0)           0;0  0.1355 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean