Thu Aug 21 01:05:56 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     82.2136 (3.61)     82.2136 (3.61)     82.2136 (3.61)     0.0000 (1.0)      82.2136 (3.61)     0.0000 (1.0)           0;0  0.0122 (0.28)          1           1
test_add_copy-add[3.10.0]     82.0751 (3.61)     82.0751 (3.61)     82.0751 (3.61)     0.0000 (1.0)      82.0751 (3.61)     0.0000 (1.0)           0;0  0.0122 (0.28)          1           1
test_add_copy-add[3.53.2]     73.8426 (3.25)     73.8426 (3.25)     73.8426 (3.25)     0.0000 (1.0)      73.8426 (3.25)     0.0000 (1.0)           0;0  0.0135 (0.31)          1           1
test_add_copy-add[3.60.1]     22.7490 (1.0)      22.7490 (1.0)      22.7490 (1.0)      0.0000 (1.0)      22.7490 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_add_copy-add[main]       23.5821 (1.04)     23.5821 (1.04)     23.5821 (1.04)     0.0000 (1.0)      23.5821 (1.04)     0.0000 (1.0)           0;0  0.0424 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.1977 (6.49)     28.1977 (6.49)     28.1977 (6.49)     0.0000 (1.0)      28.1977 (6.49)     0.0000 (1.0)           0;0  0.0355 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.3329 (6.52)     28.3329 (6.52)     28.3329 (6.52)     0.0000 (1.0)      28.3329 (6.52)     0.0000 (1.0)           0;0  0.0353 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     27.0256 (6.22)     27.0256 (6.22)     27.0256 (6.22)     0.0000 (1.0)      27.0256 (6.22)     0.0000 (1.0)           0;0  0.0370 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4415 (1.02)      4.4415 (1.02)      4.4415 (1.02)     0.0000 (1.0)       4.4415 (1.02)     0.0000 (1.0)           0;0  0.2251 (0.98)          1           1
test_add_copy-add-noop[main]        4.3471 (1.0)       4.3471 (1.0)       4.3471 (1.0)      0.0000 (1.0)       4.3471 (1.0)      0.0000 (1.0)           0;0  0.2300 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.2941 (4.15)     66.2941 (4.15)     66.2941 (4.15)     0.0000 (1.0)      66.2941 (4.15)     0.0000 (1.0)           0;0  0.0151 (0.24)          1           1
test_add_hardlink-add[3.10.0]     67.1893 (4.20)     67.1893 (4.20)     67.1893 (4.20)     0.0000 (1.0)      67.1893 (4.20)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.53.2]     61.9035 (3.87)     61.9035 (3.87)     61.9035 (3.87)     0.0000 (1.0)      61.9035 (3.87)     0.0000 (1.0)           0;0  0.0162 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.9887 (1.0)      15.9887 (1.0)      15.9887 (1.0)      0.0000 (1.0)      15.9887 (1.0)      0.0000 (1.0)           0;0  0.0625 (1.0)           1           1
test_add_hardlink-add[main]       16.9021 (1.06)     16.9021 (1.06)     16.9021 (1.06)     0.0000 (1.0)      16.9021 (1.06)     0.0000 (1.0)           0;0  0.0592 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.3590 (7.60)     34.3590 (7.60)     34.3590 (7.60)     0.0000 (1.0)      34.3590 (7.60)     0.0000 (1.0)           0;0  0.0291 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.0567 (7.75)     35.0567 (7.75)     35.0567 (7.75)     0.0000 (1.0)      35.0567 (7.75)     0.0000 (1.0)           0;0  0.0285 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     33.1654 (7.33)     33.1654 (7.33)     33.1654 (7.33)     0.0000 (1.0)      33.1654 (7.33)     0.0000 (1.0)           0;0  0.0302 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5220 (1.0)       4.5220 (1.0)       4.5220 (1.0)      0.0000 (1.0)       4.5220 (1.0)      0.0000 (1.0)           0;0  0.2211 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.5584 (1.01)      4.5584 (1.01)      4.5584 (1.01)     0.0000 (1.0)       4.5584 (1.01)     0.0000 (1.0)           0;0  0.2194 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     70.3047 (2.08)     70.3047 (2.08)     70.3047 (2.08)     0.0000 (1.0)      70.3047 (2.08)     0.0000 (1.0)           0;0  0.0142 (0.48)          1           1
test_add_symlink-add[3.10.0]     69.2695 (2.05)     69.2695 (2.05)     69.2695 (2.05)     0.0000 (1.0)      69.2695 (2.05)     0.0000 (1.0)           0;0  0.0144 (0.49)          1           1
test_add_symlink-add[3.53.2]     65.5504 (1.94)     65.5504 (1.94)     65.5504 (1.94)     0.0000 (1.0)      65.5504 (1.94)     0.0000 (1.0)           0;0  0.0153 (0.52)          1           1
test_add_symlink-add[3.60.1]     33.7935 (1.0)      33.7935 (1.0)      33.7935 (1.0)      0.0000 (1.0)      33.7935 (1.0)      0.0000 (1.0)           0;0  0.0296 (1.0)           1           1
test_add_symlink-add[main]       35.4424 (1.05)     35.4424 (1.05)     35.4424 (1.05)     0.0000 (1.0)      35.4424 (1.05)     0.0000 (1.0)           0;0  0.0282 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.1473 (8.47)     47.1473 (8.47)     47.1473 (8.47)     0.0000 (1.0)      47.1473 (8.47)     0.0000 (1.0)           0;0  0.0212 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     48.0053 (8.62)     48.0053 (8.62)     48.0053 (8.62)     0.0000 (1.0)      48.0053 (8.62)     0.0000 (1.0)           0;0  0.0208 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.9370 (8.43)     46.9370 (8.43)     46.9370 (8.43)     0.0000 (1.0)      46.9370 (8.43)     0.0000 (1.0)           0;0  0.0213 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5686 (1.0)       5.5686 (1.0)       5.5686 (1.0)      0.0000 (1.0)       5.5686 (1.0)      0.0000 (1.0)           0;0  0.1796 (1.0)           1           1
test_add_symlink-add-noop[main]        5.5781 (1.00)      5.5781 (1.00)      5.5781 (1.00)     0.0000 (1.0)       5.5781 (1.00)     0.0000 (1.0)           0;0  0.1793 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.8984 (2.00)     41.8984 (2.00)     41.8984 (2.00)     0.0000 (1.0)      41.8984 (2.00)     0.0000 (1.0)           0;0  0.0239 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     61.3650 (2.93)     61.3650 (2.93)     61.3650 (2.93)     0.0000 (1.0)      61.3650 (2.93)     0.0000 (1.0)           0;0  0.0163 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     28.6309 (1.37)     28.6309 (1.37)     28.6309 (1.37)     0.0000 (1.0)      28.6309 (1.37)     0.0000 (1.0)           0;0  0.0349 (0.73)          1           1
test_checkout_copy-checkout[3.60.1]     20.9408 (1.0)      20.9408 (1.0)      20.9408 (1.0)      0.0000 (1.0)      20.9408 (1.0)      0.0000 (1.0)           0;0  0.0478 (1.0)           1           1
test_checkout_copy-checkout[main]       21.9084 (1.05)     21.9084 (1.05)     21.9084 (1.05)     0.0000 (1.0)      21.9084 (1.05)     0.0000 (1.0)           0;0  0.0456 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6485 (1.67)     5.6485 (1.67)     5.6485 (1.67)     0.0000 (1.0)      5.6485 (1.67)     0.0000 (1.0)           0;0  0.1770 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8998 (1.74)     5.8998 (1.74)     5.8998 (1.74)     0.0000 (1.0)      5.8998 (1.74)     0.0000 (1.0)           0;0  0.1695 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7249 (1.69)     5.7249 (1.69)     5.7249 (1.69)     0.0000 (1.0)      5.7249 (1.69)     0.0000 (1.0)           0;0  0.1747 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3838 (1.0)      3.3838 (1.0)      3.3838 (1.0)      0.0000 (1.0)      3.3838 (1.0)      0.0000 (1.0)           0;0  0.2955 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5169 (1.04)     3.5169 (1.04)     3.5169 (1.04)     0.0000 (1.0)      3.5169 (1.04)     0.0000 (1.0)           0;0  0.2843 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.8062 (2.14)     8.8062 (2.14)     8.8062 (2.14)     0.0000 (1.0)      8.8062 (2.14)     0.0000 (1.0)           0;0  0.1136 (0.47)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8063 (1.65)     6.8063 (1.65)     6.8063 (1.65)     0.0000 (1.0)      6.8063 (1.65)     0.0000 (1.0)           0;0  0.1469 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4302 (1.56)     6.4302 (1.56)     6.4302 (1.56)     0.0000 (1.0)      6.4302 (1.56)     0.0000 (1.0)           0;0  0.1555 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.1513 (1.01)     4.1513 (1.01)     4.1513 (1.01)     0.0000 (1.0)      4.1513 (1.01)     0.0000 (1.0)           0;0  0.2409 (0.99)          1           1
test_checkout_copy-checkout-update[main]       4.1158 (1.0)      4.1158 (1.0)      4.1158 (1.0)      0.0000 (1.0)      4.1158 (1.0)      0.0000 (1.0)           0;0  0.2430 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.0732 (3.05)     22.0732 (3.05)     22.0732 (3.05)     0.0000 (1.0)      22.0732 (3.05)     0.0000 (1.0)           0;0  0.0453 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.8334 (2.19)     15.8334 (2.19)     15.8334 (2.19)     0.0000 (1.0)      15.8334 (2.19)     0.0000 (1.0)           0;0  0.0632 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.1056 (1.95)     14.1056 (1.95)     14.1056 (1.95)     0.0000 (1.0)      14.1056 (1.95)     0.0000 (1.0)           0;0  0.0709 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2309 (1.0)       7.2309 (1.0)       7.2309 (1.0)      0.0000 (1.0)       7.2309 (1.0)      0.0000 (1.0)           0;0  0.1383 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.7359 (1.07)      7.7359 (1.07)      7.7359 (1.07)     0.0000 (1.0)       7.7359 (1.07)     0.0000 (1.0)           0;0  0.1293 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4067 (1.67)     5.4067 (1.67)     5.4067 (1.67)     0.0000 (1.0)      5.4067 (1.67)     0.0000 (1.0)           0;0  0.1850 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5420 (1.71)     5.5420 (1.71)     5.5420 (1.71)     0.0000 (1.0)      5.5420 (1.71)     0.0000 (1.0)           0;0  0.1804 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3864 (1.66)     5.3864 (1.66)     5.3864 (1.66)     0.0000 (1.0)      5.3864 (1.66)     0.0000 (1.0)           0;0  0.1857 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2468 (1.0)      3.2468 (1.0)      3.2468 (1.0)      0.0000 (1.0)      3.2468 (1.0)      0.0000 (1.0)           0;0  0.3080 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.2851 (1.01)     3.2851 (1.01)     3.2851 (1.01)     0.0000 (1.0)      3.2851 (1.01)     0.0000 (1.0)           0;0  0.3044 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6752 (2.24)     8.6752 (2.24)     8.6752 (2.24)     0.0000 (1.0)      8.6752 (2.24)     0.0000 (1.0)           0;0  0.1153 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4356 (1.66)     6.4356 (1.66)     6.4356 (1.66)     0.0000 (1.0)      6.4356 (1.66)     0.0000 (1.0)           0;0  0.1554 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2235 (1.61)     6.2235 (1.61)     6.2235 (1.61)     0.0000 (1.0)      6.2235 (1.61)     0.0000 (1.0)           0;0  0.1607 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8774 (1.0)      3.8774 (1.0)      3.8774 (1.0)      0.0000 (1.0)      3.8774 (1.0)      0.0000 (1.0)           0;0  0.2579 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.9090 (1.01)     3.9090 (1.01)     3.9090 (1.01)     0.0000 (1.0)      3.9090 (1.01)     0.0000 (1.0)           0;0  0.2558 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.1747 (2.62)     27.1747 (2.62)     27.1747 (2.62)     0.0000 (1.0)      27.1747 (2.62)     0.0000 (1.0)           0;0  0.0368 (0.38)          1           1
test_checkout_symlink-checkout[3.10.0]     21.3264 (2.06)     21.3264 (2.06)     21.3264 (2.06)     0.0000 (1.0)      21.3264 (2.06)     0.0000 (1.0)           0;0  0.0469 (0.49)          1           1
test_checkout_symlink-checkout[3.53.2]     19.3753 (1.87)     19.3753 (1.87)     19.3753 (1.87)     0.0000 (1.0)      19.3753 (1.87)     0.0000 (1.0)           0;0  0.0516 (0.53)          1           1
test_checkout_symlink-checkout[3.60.1]     10.3571 (1.0)      10.3571 (1.0)      10.3571 (1.0)      0.0000 (1.0)      10.3571 (1.0)      0.0000 (1.0)           0;0  0.0966 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.3189 (1.09)     11.3189 (1.09)     11.3189 (1.09)     0.0000 (1.0)      11.3189 (1.09)     0.0000 (1.0)           0;0  0.0883 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6823 (1.56)     6.6823 (1.56)     6.6823 (1.56)     0.0000 (1.0)      6.6823 (1.56)     0.0000 (1.0)           0;0  0.1496 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7753 (1.59)     6.7753 (1.59)     6.7753 (1.59)     0.0000 (1.0)      6.7753 (1.59)     0.0000 (1.0)           0;0  0.1476 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.4790 (1.52)     6.4790 (1.52)     6.4790 (1.52)     0.0000 (1.0)      6.4790 (1.52)     0.0000 (1.0)           0;0  0.1543 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2738 (1.0)      4.2738 (1.0)      4.2738 (1.0)      0.0000 (1.0)      4.2738 (1.0)      0.0000 (1.0)           0;0  0.2340 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3098 (1.01)     4.3098 (1.01)     4.3098 (1.01)     0.0000 (1.0)      4.3098 (1.01)     0.0000 (1.0)           0;0  0.2320 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6545 (1.86)     10.6545 (1.86)     10.6545 (1.86)     0.0000 (1.0)      10.6545 (1.86)     0.0000 (1.0)           0;0  0.0939 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4950 (1.48)      8.4950 (1.48)      8.4950 (1.48)     0.0000 (1.0)       8.4950 (1.48)     0.0000 (1.0)           0;0  0.1177 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3402 (1.45)      8.3402 (1.45)      8.3402 (1.45)     0.0000 (1.0)       8.3402 (1.45)     0.0000 (1.0)           0;0  0.1199 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7360 (1.0)       5.7360 (1.0)       5.7360 (1.0)      0.0000 (1.0)       5.7360 (1.0)      0.0000 (1.0)           0;0  0.1743 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.8152 (1.01)      5.8152 (1.01)      5.8152 (1.01)     0.0000 (1.0)       5.8152 (1.01)     0.0000 (1.0)           0;0  0.1720 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0978 (1.68)     4.0978 (1.68)     4.0978 (1.68)     0.0000 (1.0)      4.0978 (1.68)     0.0000 (1.0)           0;0  0.2440 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.8280 (1.98)     4.8280 (1.98)     4.8280 (1.98)     0.0000 (1.0)      4.8280 (1.98)     0.0000 (1.0)           0;0  0.2071 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.6092 (1.89)     4.6092 (1.89)     4.6092 (1.89)     0.0000 (1.0)      4.6092 (1.89)     0.0000 (1.0)           0;0  0.2170 (0.53)          1           1
test_data_status-data-changed[3.60.1]     2.4450 (1.00)     2.4450 (1.00)     2.4450 (1.00)     0.0000 (1.0)      2.4450 (1.00)     0.0000 (1.0)           0;0  0.4090 (1.00)          1           1
test_data_status-data-changed[main]       2.4339 (1.0)      2.4339 (1.0)      2.4339 (1.0)      0.0000 (1.0)      2.4339 (1.0)      0.0000 (1.0)           0;0  0.4109 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2504 (1.74)     4.2504 (1.74)     4.2504 (1.74)     0.0000 (1.0)      4.2504 (1.74)     0.0000 (1.0)           0;0  0.2353 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8310 (1.98)     4.8310 (1.98)     4.8310 (1.98)     0.0000 (1.0)      4.8310 (1.98)     0.0000 (1.0)           0;0  0.2070 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7348 (1.94)     4.7348 (1.94)     4.7348 (1.94)     0.0000 (1.0)      4.7348 (1.94)     0.0000 (1.0)           0;0  0.2112 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4425 (1.0)      2.4425 (1.0)      2.4425 (1.0)      0.0000 (1.0)      2.4425 (1.0)      0.0000 (1.0)           0;0  0.4094 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5092 (1.03)     2.5092 (1.03)     2.5092 (1.03)     0.0000 (1.0)      2.5092 (1.03)     0.0000 (1.0)           0;0  0.3985 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.3889 (3.67)     18.3889 (3.67)     18.3889 (3.67)     0.0000 (1.0)      18.3889 (3.67)     0.0000 (1.0)           0;0  0.0544 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.3384 (3.86)     19.3384 (3.86)     19.3384 (3.86)     0.0000 (1.0)      19.3384 (3.86)     0.0000 (1.0)           0;0  0.0517 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.9325 (3.77)     18.9325 (3.77)     18.9325 (3.77)     0.0000 (1.0)      18.9325 (3.77)     0.0000 (1.0)           0;0  0.0528 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.0164 (1.0)       5.0164 (1.0)       5.0164 (1.0)      0.0000 (1.0)       5.0164 (1.0)      0.0000 (1.0)           0;0  0.1993 (1.0)           1           1
test_data_status-data-new[main]        5.2205 (1.04)      5.2205 (1.04)      5.2205 (1.04)     0.0000 (1.0)       5.2205 (1.04)     0.0000 (1.0)           0;0  0.1916 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1511 (1.71)     4.1511 (1.71)     4.1511 (1.71)     0.0000 (1.0)      4.1511 (1.71)     0.0000 (1.0)           0;0  0.2409 (0.59)          1           1
test_data_status-data-noop[3.10.0]     4.8407 (1.99)     4.8407 (1.99)     4.8407 (1.99)     0.0000 (1.0)      4.8407 (1.99)     0.0000 (1.0)           0;0  0.2066 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.7966 (1.97)     4.7966 (1.97)     4.7966 (1.97)     0.0000 (1.0)      4.7966 (1.97)     0.0000 (1.0)           0;0  0.2085 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.4309 (1.0)      2.4309 (1.0)      2.4309 (1.0)      0.0000 (1.0)      2.4309 (1.0)      0.0000 (1.0)           0;0  0.4114 (1.0)           1           1
test_data_status-data-noop[main]       2.5070 (1.03)     2.5070 (1.03)     2.5070 (1.03)     0.0000 (1.0)      2.5070 (1.03)     0.0000 (1.0)           0;0  0.3989 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.4065 (1.32)     7.4065 (1.32)     7.4065 (1.32)     0.0000 (1.0)      7.4065 (1.32)     0.0000 (1.0)           0;0  0.1350 (0.76)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.9950 (1.42)     7.9950 (1.42)     7.9950 (1.42)     0.0000 (1.0)      7.9950 (1.42)     0.0000 (1.0)           0;0  0.1251 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8811 (1.40)     7.8811 (1.40)     7.8811 (1.40)     0.0000 (1.0)      7.8811 (1.40)     0.0000 (1.0)           0;0  0.1269 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6804 (1.01)     5.6804 (1.01)     5.6804 (1.01)     0.0000 (1.0)      5.6804 (1.01)     0.0000 (1.0)           0;0  0.1760 (0.99)          1           1
test_data_status_all_flags-data-changed[main]       5.6203 (1.0)      5.6203 (1.0)      5.6203 (1.0)      0.0000 (1.0)      5.6203 (1.0)      0.0000 (1.0)           0;0  0.1779 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2905 (1.28)     7.2905 (1.28)     7.2905 (1.28)     0.0000 (1.0)      7.2905 (1.28)     0.0000 (1.0)           0;0  0.1372 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8205 (1.38)     7.8205 (1.38)     7.8205 (1.38)     0.0000 (1.0)      7.8205 (1.38)     0.0000 (1.0)           0;0  0.1279 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     8.1892 (1.44)     8.1892 (1.44)     8.1892 (1.44)     0.0000 (1.0)      8.1892 (1.44)     0.0000 (1.0)           0;0  0.1221 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6770 (1.0)      5.6770 (1.0)      5.6770 (1.0)      0.0000 (1.0)      5.6770 (1.0)      0.0000 (1.0)           0;0  0.1761 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.7709 (1.02)     5.7709 (1.02)     5.7709 (1.02)     0.0000 (1.0)      5.7709 (1.02)     0.0000 (1.0)           0;0  0.1733 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.0732 (2.61)     21.0732 (2.61)     21.0732 (2.61)     0.0000 (1.0)      21.0732 (2.61)     0.0000 (1.0)           0;0  0.0475 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0545 (2.74)     22.0545 (2.74)     22.0545 (2.74)     0.0000 (1.0)      22.0545 (2.74)     0.0000 (1.0)           0;0  0.0453 (0.37)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.9888 (2.73)     21.9888 (2.73)     21.9888 (2.73)     0.0000 (1.0)      21.9888 (2.73)     0.0000 (1.0)           0;0  0.0455 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0625 (1.0)       8.0625 (1.0)       8.0625 (1.0)      0.0000 (1.0)       8.0625 (1.0)      0.0000 (1.0)           0;0  0.1240 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3219 (1.03)      8.3219 (1.03)      8.3219 (1.03)     0.0000 (1.0)       8.3219 (1.03)     0.0000 (1.0)           0;0  0.1202 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5989 (1.36)     6.5989 (1.36)     6.5989 (1.36)     0.0000 (1.0)      6.5989 (1.36)     0.0000 (1.0)           0;0  0.1515 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2017 (1.48)     7.2017 (1.48)     7.2017 (1.48)     0.0000 (1.0)      7.2017 (1.48)     0.0000 (1.0)           0;0  0.1389 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1269 (1.46)     7.1269 (1.46)     7.1269 (1.46)     0.0000 (1.0)      7.1269 (1.46)     0.0000 (1.0)           0;0  0.1403 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8694 (1.0)      4.8694 (1.0)      4.8694 (1.0)      0.0000 (1.0)      4.8694 (1.0)      0.0000 (1.0)           0;0  0.2054 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0406 (1.04)     5.0406 (1.04)     5.0406 (1.04)     0.0000 (1.0)      5.0406 (1.04)     0.0000 (1.0)           0;0  0.1984 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0633 (2.69)     18.0633 (2.69)     18.0633 (2.69)     0.0000 (1.0)      18.0633 (2.69)     0.0000 (1.0)           0;0  0.0554 (0.37)          1           1
test_diff-diff[3.10.0]     18.9616 (2.82)     18.9616 (2.82)     18.9616 (2.82)     0.0000 (1.0)      18.9616 (2.82)     0.0000 (1.0)           0;0  0.0527 (0.35)          1           1
test_diff-diff[3.53.2]     18.9165 (2.82)     18.9165 (2.82)     18.9165 (2.82)     0.0000 (1.0)      18.9165 (2.82)     0.0000 (1.0)           0;0  0.0529 (0.36)          1           1
test_diff-diff[3.60.1]      6.7154 (1.0)       6.7154 (1.0)       6.7154 (1.0)      0.0000 (1.0)       6.7154 (1.0)      0.0000 (1.0)           0;0  0.1489 (1.0)           1           1
test_diff-diff[main]        7.3940 (1.10)      7.3940 (1.10)      7.3940 (1.10)     0.0000 (1.0)       7.3940 (1.10)     0.0000 (1.0)           0;0  0.1352 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1164 (1.83)     6.1164 (1.83)     6.1164 (1.83)     0.0000 (1.0)      6.1164 (1.83)     0.0000 (1.0)           0;0  0.1635 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.8070 (2.04)     6.8070 (2.04)     6.8070 (2.04)     0.0000 (1.0)      6.8070 (2.04)     0.0000 (1.0)           0;0  0.1469 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.6813 (1.70)     5.6813 (1.70)     5.6813 (1.70)     0.0000 (1.0)      5.6813 (1.70)     0.0000 (1.0)           0;0  0.1760 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.3413 (1.0)      3.3413 (1.0)      3.3413 (1.0)      0.0000 (1.0)      3.3413 (1.0)      0.0000 (1.0)           0;0  0.2993 (1.0)           1           1
test_diff-diff-changed[main]       3.9694 (1.19)     3.9694 (1.19)     3.9694 (1.19)     0.0000 (1.0)      3.9694 (1.19)     0.0000 (1.0)           0;0  0.2519 (0.84)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3015 (1.56)     5.3015 (1.56)     5.3015 (1.56)     0.0000 (1.0)      5.3015 (1.56)     0.0000 (1.0)           0;0  0.1886 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8033 (1.71)     5.8033 (1.71)     5.8033 (1.71)     0.0000 (1.0)      5.8033 (1.71)     0.0000 (1.0)           0;0  0.1723 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6117 (1.65)     5.6117 (1.65)     5.6117 (1.65)     0.0000 (1.0)      5.6117 (1.65)     0.0000 (1.0)           0;0  0.1782 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3960 (1.0)      3.3960 (1.0)      3.3960 (1.0)      0.0000 (1.0)      3.3960 (1.0)      0.0000 (1.0)           0;0  0.2945 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.9300 (1.16)     3.9300 (1.16)     3.9300 (1.16)     0.0000 (1.0)      3.9300 (1.16)     0.0000 (1.0)           0;0  0.2545 (0.86)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0921 (1.21)     4.0921 (1.21)     4.0921 (1.21)     0.0000 (1.0)      4.0921 (1.21)     0.0000 (1.0)           0;0  0.2444 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.7130 (1.40)     4.7130 (1.40)     4.7130 (1.40)     0.0000 (1.0)      4.7130 (1.40)     0.0000 (1.0)           0;0  0.2122 (0.72)          1           1
test_diff-diff-noop[3.53.2]     5.5998 (1.66)     5.5998 (1.66)     5.5998 (1.66)     0.0000 (1.0)      5.5998 (1.66)     0.0000 (1.0)           0;0  0.1786 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3699 (1.0)      3.3699 (1.0)      3.3699 (1.0)      0.0000 (1.0)      3.3699 (1.0)      0.0000 (1.0)           0;0  0.2967 (1.0)           1           1
test_diff-diff-noop[main]       4.2454 (1.26)     4.2454 (1.26)     4.2454 (1.26)     0.0000 (1.0)      4.2454 (1.26)     0.0000 (1.0)           0;0  0.2356 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        991.1567 (1.0)         991.1567 (1.0)         991.1567 (1.0)      0.0000 (1.0)         991.1567 (1.0)      0.0000 (1.0)           0;0  1.0089 (1.0)           1           1
test_exp_show-exp[3.10.0]     12,061.4862 (12.17)    12,061.4862 (12.17)    12,061.4862 (12.17)    0.0000 (1.0)      12,061.4862 (12.17)    0.0000 (1.0)           0;0  0.0829 (0.08)          1           1
test_exp_show-exp[3.53.2]      6,497.6422 (6.56)      6,497.6422 (6.56)      6,497.6422 (6.56)     0.0000 (1.0)       6,497.6422 (6.56)     0.0000 (1.0)           0;0  0.1539 (0.15)          1           1
test_exp_show-exp[3.60.1]      6,706.5125 (6.77)      6,706.5125 (6.77)      6,706.5125 (6.77)     0.0000 (1.0)       6,706.5125 (6.77)     0.0000 (1.0)           0;0  0.1491 (0.15)          1           1
test_exp_show-exp[main]        9,080.2281 (9.16)      9,080.2281 (9.16)      9,080.2281 (9.16)     0.0000 (1.0)       9,080.2281 (9.16)     0.0000 (1.0)           0;0  0.1101 (0.11)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     64.8819 (2.81)     64.8819 (2.81)     64.8819 (2.81)     0.0000 (1.0)      64.8819 (2.81)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.5441 (3.06)     70.5441 (3.06)     70.5441 (3.06)     0.0000 (1.0)      70.5441 (3.06)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.9657 (1.47)     33.9657 (1.47)     33.9657 (1.47)     0.0000 (1.0)      33.9657 (1.47)     0.0000 (1.0)           0;0  0.0294 (0.68)          1           1
test_fetch-fetch[3.60.1]     23.1547 (1.00)     23.1547 (1.00)     23.1547 (1.00)     0.0000 (1.0)      23.1547 (1.00)     0.0000 (1.0)           0;0  0.0432 (1.00)          1           1
test_fetch-fetch[main]       23.0671 (1.0)      23.0671 (1.0)      23.0671 (1.0)      0.0000 (1.0)      23.0671 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7917 (1.0)      2.7917 (1.0)      2.7917 (1.0)      0.0000 (1.0)      2.7917 (1.0)      0.0000 (1.0)           0;0  0.3582 (1.0)           1           1
test_gc-gc[3.10.0]     2.9120 (1.04)     2.9120 (1.04)     2.9120 (1.04)     0.0000 (1.0)      2.9120 (1.04)     0.0000 (1.0)           0;0  0.3434 (0.96)          1           1
test_gc-gc[3.53.2]     2.8347 (1.02)     2.8347 (1.02)     2.8347 (1.02)     0.0000 (1.0)      2.8347 (1.02)     0.0000 (1.0)           0;0  0.3528 (0.98)          1           1
test_gc-gc[3.60.1]     2.8340 (1.02)     2.8340 (1.02)     2.8340 (1.02)     0.0000 (1.0)      2.8340 (1.02)     0.0000 (1.0)           0;0  0.3529 (0.99)          1           1
test_gc-gc[main]       2.9818 (1.07)     2.9818 (1.07)     2.9818 (1.07)     0.0000 (1.0)      2.9818 (1.07)     0.0000 (1.0)           0;0  0.3354 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.2147 (2.69)     134.2147 (2.69)     134.2147 (2.69)     0.0000 (1.0)      134.2147 (2.69)     0.0000 (1.0)           0;0  0.0075 (0.37)          1           1
test_get-get[3.10.0]     163.6266 (3.28)     163.6266 (3.28)     163.6266 (3.28)     0.0000 (1.0)      163.6266 (3.28)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.2393 (2.87)     143.2393 (2.87)     143.2393 (2.87)     0.0000 (1.0)      143.2393 (2.87)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      49.8379 (1.0)       49.8379 (1.0)       49.8379 (1.0)      0.0000 (1.0)       49.8379 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
test_get-get[main]        49.9021 (1.00)      49.9021 (1.00)      49.9021 (1.00)     0.0000 (1.0)       49.9021 (1.00)     0.0000 (1.0)           0;0  0.0200 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.5684 (2.66)     44.5684 (2.66)     44.5684 (2.66)     0.0000 (1.0)      44.5684 (2.66)     0.0000 (1.0)           0;0  0.0224 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.6665 (2.85)     47.6665 (2.85)     47.6665 (2.85)     0.0000 (1.0)      47.6665 (2.85)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.7537 (1.0)      16.7537 (1.0)      16.7537 (1.0)      0.0000 (1.0)      16.7537 (1.0)      0.0000 (1.0)           0;0  0.0597 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.7740 (1.00)     16.7740 (1.00)     16.7740 (1.00)     0.0000 (1.0)      16.7740 (1.00)     0.0000 (1.0)           0;0  0.0596 (1.00)          1           1
test_get_url-get-url[main]       16.8510 (1.01)     16.8510 (1.01)     16.8510 (1.01)     0.0000 (1.0)      16.8510 (1.01)     0.0000 (1.0)           0;0  0.0593 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.5537 (1.01)     130.8122 (1.03)     126.3110 (1.01)     1.8458 (2.29)     125.7851 (1.01)     2.6004 (2.57)         31;0  7.9170 (0.99)        100           1
test_help---help[3.10.0]     122.5474 (1.0)      147.2857 (1.16)     126.7692 (1.02)     3.1601 (3.92)     126.7566 (1.02)     3.6352 (3.59)         26;1  7.8884 (0.98)        100           1
test_help---help[3.53.2]     123.2898 (1.01)     127.2096 (1.0)      124.6614 (1.0)      0.8059 (1.0)      124.4989 (1.0)      1.0130 (1.0)          27;3  8.0217 (1.0)         100           1
test_help---help[3.60.1]     124.2219 (1.01)     155.9905 (1.23)     126.8797 (1.02)     5.3771 (6.67)     125.5770 (1.01)     1.1832 (1.17)          4;7  7.8815 (0.98)        100           1
test_help---help[main]       124.0749 (1.01)     135.0894 (1.06)     126.0533 (1.01)     1.5817 (1.96)     125.7360 (1.01)     1.1994 (1.18)         11;6  7.9332 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     226.5999 (3.00)     226.5999 (3.00)     226.5999 (3.00)     0.0000 (1.0)      226.5999 (3.00)     0.0000 (1.0)           0;0  0.0044 (0.33)          1           1
test_import-import[3.10.0]     253.7614 (3.36)     253.7614 (3.36)     253.7614 (3.36)     0.0000 (1.0)      253.7614 (3.36)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      75.5969 (1.0)       75.5969 (1.0)       75.5969 (1.0)      0.0000 (1.0)       75.5969 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
test_import-import[main]        76.0024 (1.01)      76.0024 (1.01)      76.0024 (1.01)     0.0000 (1.0)       76.0024 (1.01)     0.0000 (1.0)           0;0  0.0132 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     160.2997 (3.32)     160.2997 (3.32)     160.2997 (3.32)     0.0000 (1.0)      160.2997 (3.32)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_import_url-import-url[3.10.0]     166.0364 (3.44)     166.0364 (3.44)     166.0364 (3.44)     0.0000 (1.0)      166.0364 (3.44)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.53.2]     122.0344 (2.53)     122.0344 (2.53)     122.0344 (2.53)     0.0000 (1.0)      122.0344 (2.53)     0.0000 (1.0)           0;0  0.0082 (0.40)          1           1
test_import_url-import-url[3.60.1]      48.2414 (1.0)       48.2414 (1.0)       48.2414 (1.0)      0.0000 (1.0)       48.2414 (1.0)      0.0000 (1.0)           0;0  0.0207 (1.0)           1           1
test_import_url-import-url[main]        49.0503 (1.02)      49.0503 (1.02)      49.0503 (1.02)     0.0000 (1.0)       49.0503 (1.02)     0.0000 (1.0)           0;0  0.0204 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     393.7403 (1.04)     429.0489 (1.03)     404.3811 (1.04)      6.0027 (1.09)     403.5211 (1.04)      6.4475 (1.61)         25;4  2.4729 (0.96)        100           1
test_init-init[3.10.0]     394.2987 (1.04)     433.9265 (1.05)     408.8987 (1.06)      7.9486 (1.44)     409.7975 (1.06)     14.1732 (3.54)         40;0  2.4456 (0.95)        100           1
test_init-init[3.53.2]     378.2428 (1.0)      415.0931 (1.0)      387.3059 (1.0)       5.5017 (1.0)      386.4367 (1.0)       4.0054 (1.0)          17;8  2.5819 (1.0)         100           1
test_init-init[3.60.1]     380.6193 (1.01)     416.8266 (1.00)     393.8764 (1.02)      7.5896 (1.38)     392.2708 (1.02)      8.1749 (2.04)         24;7  2.5389 (0.98)        100           1
test_init-init[main]       420.8208 (1.11)     505.4747 (1.22)     447.1231 (1.15)     15.5816 (2.83)     450.4585 (1.17)     22.1042 (5.52)         22;3  2.2365 (0.87)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     580.9085 (1.11)     580.9085 (1.11)     580.9085 (1.11)     0.0000 (1.0)      580.9085 (1.11)     0.0000 (1.0)           0;0  1.7214 (0.90)          1           1
test_list-list[3.10.0]     657.4167 (1.25)     657.4167 (1.25)     657.4167 (1.25)     0.0000 (1.0)      657.4167 (1.25)     0.0000 (1.0)           0;0  1.5211 (0.80)          1           1
test_list-list[3.53.2]     567.0764 (1.08)     567.0764 (1.08)     567.0764 (1.08)     0.0000 (1.0)      567.0764 (1.08)     0.0000 (1.0)           0;0  1.7634 (0.93)          1           1
test_list-list[3.60.1]     525.4204 (1.0)      525.4204 (1.0)      525.4204 (1.0)      0.0000 (1.0)      525.4204 (1.0)      0.0000 (1.0)           0;0  1.9032 (1.0)           1           1
test_list-list[main]       541.7411 (1.03)     541.7411 (1.03)     541.7411 (1.03)     0.0000 (1.0)      541.7411 (1.03)     0.0000 (1.0)           0;0  1.8459 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     415.0765 (1.07)     415.0765 (1.07)     415.0765 (1.07)     0.0000 (1.0)      415.0765 (1.07)     0.0000 (1.0)           0;0  2.4092 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     416.4973 (1.07)     416.4973 (1.07)     416.4973 (1.07)     0.0000 (1.0)      416.4973 (1.07)     0.0000 (1.0)           0;0  2.4010 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     395.0201 (1.02)     395.0201 (1.02)     395.0201 (1.02)     0.0000 (1.0)      395.0201 (1.02)     0.0000 (1.0)           0;0  2.5315 (0.98)          1           1
test_list-list-dvc-only[3.60.1]     388.7431 (1.0)      388.7431 (1.0)      388.7431 (1.0)      0.0000 (1.0)      388.7431 (1.0)      0.0000 (1.0)           0;0  2.5724 (1.0)           1           1
test_list-list-dvc-only[main]       396.5178 (1.02)     396.5178 (1.02)     396.5178 (1.02)     0.0000 (1.0)      396.5178 (1.02)     0.0000 (1.0)           0;0  2.5220 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7825 (1.04)     2.7825 (1.04)     2.7825 (1.04)     0.0000 (1.0)      2.7825 (1.04)     0.0000 (1.0)           0;0  0.3594 (0.96)          1           1
test_list-list-recursive[3.10.0]     2.7525 (1.03)     2.7525 (1.03)     2.7525 (1.03)     0.0000 (1.0)      2.7525 (1.03)     0.0000 (1.0)           0;0  0.3633 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.6803 (1.0)      2.6803 (1.0)      2.6803 (1.0)      0.0000 (1.0)      2.6803 (1.0)      0.0000 (1.0)           0;0  0.3731 (1.0)           1           1
test_list-list-recursive[3.60.1]     2.7379 (1.02)     2.7379 (1.02)     2.7379 (1.02)     0.0000 (1.0)      2.7379 (1.02)     0.0000 (1.0)           0;0  0.3652 (0.98)          1           1
test_list-list-recursive[main]       2.7983 (1.04)     2.7983 (1.04)     2.7983 (1.04)     0.0000 (1.0)      2.7983 (1.04)     0.0000 (1.0)           0;0  0.3574 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     427.8681 (1.11)     427.8681 (1.11)     427.8681 (1.11)     0.0000 (1.0)      427.8681 (1.11)     0.0000 (1.0)           0;0  2.3372 (0.90)          1           1
test_list-list-shallow[3.10.0]     419.2129 (1.08)     419.2129 (1.08)     419.2129 (1.08)     0.0000 (1.0)      419.2129 (1.08)     0.0000 (1.0)           0;0  2.3854 (0.92)          1           1
test_list-list-shallow[3.53.2]     389.2199 (1.01)     389.2199 (1.01)     389.2199 (1.01)     0.0000 (1.0)      389.2199 (1.01)     0.0000 (1.0)           0;0  2.5692 (0.99)          1           1
test_list-list-shallow[3.60.1]     386.8875 (1.0)      386.8875 (1.0)      386.8875 (1.0)      0.0000 (1.0)      386.8875 (1.0)      0.0000 (1.0)           0;0  2.5847 (1.0)           1           1
test_list-list-shallow[main]       393.3223 (1.02)     393.3223 (1.02)     393.3223 (1.02)     0.0000 (1.0)      393.3223 (1.02)     0.0000 (1.0)           0;0  2.5424 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.7647 (3.70)     72.7647 (3.70)     72.7647 (3.70)     0.0000 (1.0)      72.7647 (3.70)     0.0000 (1.0)           0;0  0.0137 (0.27)          1           1
test_partial_add-add[3.10.0]     75.0813 (3.82)     75.0813 (3.82)     75.0813 (3.82)     0.0000 (1.0)      75.0813 (3.82)     0.0000 (1.0)           0;0  0.0133 (0.26)          1           1
test_partial_add-add[3.53.2]     66.9239 (3.40)     66.9239 (3.40)     66.9239 (3.40)     0.0000 (1.0)      66.9239 (3.40)     0.0000 (1.0)           0;0  0.0149 (0.29)          1           1
test_partial_add-add[3.60.1]     19.6600 (1.0)      19.6600 (1.0)      19.6600 (1.0)      0.0000 (1.0)      19.6600 (1.0)      0.0000 (1.0)           0;0  0.0509 (1.0)           1           1
test_partial_add-add[main]       20.2401 (1.03)     20.2401 (1.03)     20.2401 (1.03)     0.0000 (1.0)      20.2401 (1.03)     0.0000 (1.0)           0;0  0.0494 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     61.0050 (7.93)     61.0050 (7.93)     61.0050 (7.93)     0.0000 (1.0)      61.0050 (7.93)     0.0000 (1.0)           0;0  0.0164 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     63.1205 (8.20)     63.1205 (8.20)     63.1205 (8.20)     0.0000 (1.0)      63.1205 (8.20)     0.0000 (1.0)           0;0  0.0158 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     56.9232 (7.40)     56.9232 (7.40)     56.9232 (7.40)     0.0000 (1.0)      56.9232 (7.40)     0.0000 (1.0)           0;0  0.0176 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      8.1015 (1.05)      8.1015 (1.05)      8.1015 (1.05)     0.0000 (1.0)       8.1015 (1.05)     0.0000 (1.0)           0;0  0.1234 (0.95)          1           1
test_partial_add-add-partial[main]        7.6963 (1.0)       7.6963 (1.0)       7.6963 (1.0)      0.0000 (1.0)       7.6963 (1.0)      0.0000 (1.0)           0;0  0.1299 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4149 (1.0)      4.4149 (1.0)      4.4149 (1.0)      0.0000 (1.0)      4.4149 (1.0)      0.0000 (1.0)           0;0  0.2265 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.7376 (1.30)     5.7376 (1.30)     5.7376 (1.30)     0.0000 (1.0)      5.7376 (1.30)     0.0000 (1.0)           0;0  0.1743 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6427 (1.50)     6.6427 (1.50)     6.6427 (1.50)     0.0000 (1.0)      6.6427 (1.50)     0.0000 (1.0)           0;0  0.1505 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5283 (1.48)     6.5283 (1.48)     6.5283 (1.48)     0.0000 (1.0)      6.5283 (1.48)     0.0000 (1.0)           0;0  0.1532 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       6.5363 (1.48)     6.5363 (1.48)     6.5363 (1.48)     0.0000 (1.0)      6.5363 (1.48)     0.0000 (1.0)           0;0  0.1530 (0.68)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3739 (1.0)      2.3739 (1.0)      2.3739 (1.0)      0.0000 (1.0)      2.3739 (1.0)      0.0000 (1.0)           0;0  0.4213 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6598 (1.54)     3.6598 (1.54)     3.6598 (1.54)     0.0000 (1.0)      3.6598 (1.54)     0.0000 (1.0)           0;0  0.2732 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.7500 (1.58)     3.7500 (1.58)     3.7500 (1.58)     0.0000 (1.0)      3.7500 (1.58)     0.0000 (1.0)           0;0  0.2667 (0.63)          1           1
test_partial_add-gc-noop[3.60.1]     3.7350 (1.57)     3.7350 (1.57)     3.7350 (1.57)     0.0000 (1.0)      3.7350 (1.57)     0.0000 (1.0)           0;0  0.2677 (0.64)          1           1
test_partial_add-gc-noop[main]       3.6414 (1.53)     3.6414 (1.53)     3.6414 (1.53)     0.0000 (1.0)      3.6414 (1.53)     0.0000 (1.0)           0;0  0.2746 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     43.6930 (2.32)     43.6930 (2.32)     43.6930 (2.32)     0.0000 (1.0)      43.6930 (2.32)     0.0000 (1.0)           0;0  0.0229 (0.43)          1           1
test_partial_add-push[3.10.0]     40.0702 (2.13)     40.0702 (2.13)     40.0702 (2.13)     0.0000 (1.0)      40.0702 (2.13)     0.0000 (1.0)           0;0  0.0250 (0.47)          1           1
test_partial_add-push[3.53.2]     19.7755 (1.05)     19.7755 (1.05)     19.7755 (1.05)     0.0000 (1.0)      19.7755 (1.05)     0.0000 (1.0)           0;0  0.0506 (0.95)          1           1
test_partial_add-push[3.60.1]     18.7929 (1.0)      18.7929 (1.0)      18.7929 (1.0)      0.0000 (1.0)      18.7929 (1.0)      0.0000 (1.0)           0;0  0.0532 (1.0)           1           1
test_partial_add-push[main]       18.9311 (1.01)     18.9311 (1.01)     18.9311 (1.01)     0.0000 (1.0)      18.9311 (1.01)     0.0000 (1.0)           0;0  0.0528 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.9981 (1.11)     10.9981 (1.11)     10.9981 (1.11)     0.0000 (1.0)      10.9981 (1.11)     0.0000 (1.0)           0;0  0.0909 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.6201 (1.07)     10.6201 (1.07)     10.6201 (1.07)     0.0000 (1.0)      10.6201 (1.07)     0.0000 (1.0)           0;0  0.0942 (0.93)          1           1
test_partial_add-push-partial[3.53.2]     10.6327 (1.07)     10.6327 (1.07)     10.6327 (1.07)     0.0000 (1.0)      10.6327 (1.07)     0.0000 (1.0)           0;0  0.0940 (0.93)          1           1
test_partial_add-push-partial[3.60.1]     10.3325 (1.04)     10.3325 (1.04)     10.3325 (1.04)     0.0000 (1.0)      10.3325 (1.04)     0.0000 (1.0)           0;0  0.0968 (0.96)          1           1
test_partial_add-push-partial[main]        9.9208 (1.0)       9.9208 (1.0)       9.9208 (1.0)      0.0000 (1.0)       9.9208 (1.0)      0.0000 (1.0)           0;0  0.1008 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.7451 (3.73)     83.7451 (3.73)     83.7451 (3.73)     0.0000 (1.0)      83.7451 (3.73)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.2641 (3.75)     84.2641 (3.75)     84.2641 (3.75)     0.0000 (1.0)      84.2641 (3.75)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.6596 (3.37)     75.6596 (3.37)     75.6596 (3.37)     0.0000 (1.0)      75.6596 (3.37)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.4431 (1.0)      22.4431 (1.0)      22.4431 (1.0)      0.0000 (1.0)      22.4431 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_partial_remove-add[main]       23.3990 (1.04)     23.3990 (1.04)     23.3990 (1.04)     0.0000 (1.0)      23.3990 (1.04)     0.0000 (1.0)           0;0  0.0427 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.4731 (8.40)     8.4731 (8.40)     8.4731 (8.40)     0.0000 (1.0)      8.4731 (8.40)     0.0000 (1.0)           0;0  0.1180 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.5604 (8.48)     8.5604 (8.48)     8.5604 (8.48)     0.0000 (1.0)      8.5604 (8.48)     0.0000 (1.0)           0;0  0.1168 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.7122 (7.64)     7.7122 (7.64)     7.7122 (7.64)     0.0000 (1.0)      7.7122 (7.64)     0.0000 (1.0)           0;0  0.1297 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.0216 (1.01)     1.0216 (1.01)     1.0216 (1.01)     0.0000 (1.0)      1.0216 (1.01)     0.0000 (1.0)           0;0  0.9788 (0.99)          1           1
test_partial_remove-add-update[main]       1.0092 (1.0)      1.0092 (1.0)      1.0092 (1.0)      0.0000 (1.0)      1.0092 (1.0)      0.0000 (1.0)           0;0  0.9909 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1453 (1.0)      3.1453 (1.0)      3.1453 (1.0)      0.0000 (1.0)      3.1453 (1.0)      0.0000 (1.0)           0;0  0.3179 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.4251 (1.09)     3.4251 (1.09)     3.4251 (1.09)     0.0000 (1.0)      3.4251 (1.09)     0.0000 (1.0)           0;0  0.2920 (0.92)          1           1
test_partial_remove-gc[3.53.2]     3.4407 (1.09)     3.4407 (1.09)     3.4407 (1.09)     0.0000 (1.0)      3.4407 (1.09)     0.0000 (1.0)           0;0  0.2906 (0.91)          1           1
test_partial_remove-gc[3.60.1]     3.6316 (1.15)     3.6316 (1.15)     3.6316 (1.15)     0.0000 (1.0)      3.6316 (1.15)     0.0000 (1.0)           0;0  0.2754 (0.87)          1           1
test_partial_remove-gc[main]       3.4976 (1.11)     3.4976 (1.11)     3.4976 (1.11)     0.0000 (1.0)      3.4976 (1.11)     0.0000 (1.0)           0;0  0.2859 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.5434 (1.01)     4.5434 (1.01)     4.5434 (1.01)     0.0000 (1.0)      4.5434 (1.01)     0.0000 (1.0)           0;0  0.2201 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     4.8977 (1.09)     4.8977 (1.09)     4.8977 (1.09)     0.0000 (1.0)      4.8977 (1.09)     0.0000 (1.0)           0;0  0.2042 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.7391 (1.06)     4.7391 (1.06)     4.7391 (1.06)     0.0000 (1.0)      4.7391 (1.06)     0.0000 (1.0)           0;0  0.2110 (0.95)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.6146 (1.03)     4.6146 (1.03)     4.6146 (1.03)     0.0000 (1.0)      4.6146 (1.03)     0.0000 (1.0)           0;0  0.2167 (0.97)          1           1
test_partial_remove-gc-cloud[main]       4.4862 (1.0)      4.4862 (1.0)      4.4862 (1.0)      0.0000 (1.0)      4.4862 (1.0)      0.0000 (1.0)           0;0  0.2229 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.3989 (2.42)     52.3989 (2.42)     52.3989 (2.42)     0.0000 (1.0)      52.3989 (2.42)     0.0000 (1.0)           0;0  0.0191 (0.41)          1           1
test_partial_remove-push[3.10.0]     45.8452 (2.11)     45.8452 (2.11)     45.8452 (2.11)     0.0000 (1.0)      45.8452 (2.11)     0.0000 (1.0)           0;0  0.0218 (0.47)          1           1
test_partial_remove-push[3.53.2]     22.3887 (1.03)     22.3887 (1.03)     22.3887 (1.03)     0.0000 (1.0)      22.3887 (1.03)     0.0000 (1.0)           0;0  0.0447 (0.97)          1           1
test_partial_remove-push[3.60.1]     21.8466 (1.01)     21.8466 (1.01)     21.8466 (1.01)     0.0000 (1.0)      21.8466 (1.01)     0.0000 (1.0)           0;0  0.0458 (0.99)          1           1
test_partial_remove-push[main]       21.6931 (1.0)      21.6931 (1.0)      21.6931 (1.0)      0.0000 (1.0)      21.6931 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7913 (1.0)      1.7913 (1.0)      1.7913 (1.0)      0.0000 (1.0)      1.7913 (1.0)      0.0000 (1.0)           0;0  0.5583 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.7978 (1.00)     1.7978 (1.00)     1.7978 (1.00)     0.0000 (1.0)      1.7978 (1.00)     0.0000 (1.0)           0;0  0.5562 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.4323 (1.36)     2.4323 (1.36)     2.4323 (1.36)     0.0000 (1.0)      2.4323 (1.36)     0.0000 (1.0)           0;0  0.4111 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.4428 (1.36)     2.4428 (1.36)     2.4428 (1.36)     0.0000 (1.0)      2.4428 (1.36)     0.0000 (1.0)           0;0  0.4094 (0.73)          1           1
test_partial_remove-push-update[main]       2.4453 (1.37)     2.4453 (1.37)     2.4453 (1.37)     0.0000 (1.0)      2.4453 (1.37)     0.0000 (1.0)           0;0  0.4090 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     483.5155 (1.0)      485.1782 (1.0)      484.3200 (1.0)      0.6113 (1.0)      484.2664 (1.0)       0.7647 (1.0)           2;0  2.0648 (1.0)           5           3
test_plots-plots-diff[3.10.0]     881.7683 (1.82)     897.1207 (1.85)     890.1677 (1.84)     5.4984 (8.99)     890.7487 (1.84)      5.0588 (6.62)          2;0  1.1234 (0.54)          5           3
test_plots-plots-diff[3.53.2]     807.6094 (1.67)     819.5535 (1.69)     814.4329 (1.68)     4.6804 (7.66)     815.6604 (1.68)      6.8429 (8.95)          2;0  1.2278 (0.59)          5           3
test_plots-plots-diff[3.60.1]     805.2168 (1.67)     826.0185 (1.70)     813.5188 (1.68)     7.9187 (12.95)    812.1416 (1.68)      9.9180 (12.97)         2;0  1.2292 (0.60)          5           3
test_plots-plots-diff[main]       826.0319 (1.71)     849.1525 (1.75)     835.6610 (1.73)     8.7201 (14.26)    834.9790 (1.72)     10.9656 (14.34)         2;0  1.1967 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       501.1788 (1.0)        503.3391 (1.0)        501.9206 (1.0)       0.8344 (1.65)       501.6293 (1.0)       0.8069 (1.97)          1;0  1.9923 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,113.4826 (2.22)     1,114.7730 (2.21)     1,113.8921 (2.22)      0.5061 (1.0)      1,113.7242 (2.22)      0.4105 (1.0)           1;1  0.8978 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       891.0284 (1.78)       917.9694 (1.82)       898.0142 (1.79)     11.3257 (22.38)      894.2735 (1.78)     10.0039 (24.37)         1;1  1.1136 (0.56)          5           3
test_plots-plots-diff-json[3.60.1]       882.1652 (1.76)       905.1845 (1.80)       891.2344 (1.78)     10.6624 (21.07)      884.6951 (1.76)     18.0214 (43.90)         1;0  1.1220 (0.56)          5           3
test_plots-plots-diff-json[main]         914.5907 (1.82)       952.1036 (1.89)       928.5128 (1.85)     15.1562 (29.94)      929.0081 (1.85)     20.8308 (50.75)         1;0  1.0770 (0.54)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     400.3713 (1.0)      405.4634 (1.0)      402.8447 (1.0)       1.9549 (1.37)     402.2708 (1.0)       2.7312 (1.33)          2;0  2.4823 (1.0)           5           3
test_plots-plots-show[3.10.0]     709.7748 (1.77)     713.2493 (1.76)     711.9990 (1.77)      1.4316 (1.0)      712.6004 (1.77)      2.0573 (1.0)           1;0  1.4045 (0.57)          5           3
test_plots-plots-show[3.53.2]     685.2972 (1.71)     699.8792 (1.73)     689.8519 (1.71)      5.7585 (4.02)     688.0062 (1.71)      4.8854 (2.37)          1;1  1.4496 (0.58)          5           3
test_plots-plots-show[3.60.1]     688.9632 (1.72)     706.3148 (1.74)     698.2034 (1.73)      6.1655 (4.31)     698.3550 (1.74)      4.9893 (2.43)          2;0  1.4322 (0.58)          5           3
test_plots-plots-show[main]       704.0497 (1.76)     750.9074 (1.85)     720.9947 (1.79)     19.0982 (13.34)    714.1079 (1.78)     27.1267 (13.19)         1;0  1.3870 (0.56)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     419.4929 (1.0)      428.8526 (1.0)      422.6777 (1.0)      3.9728 (1.0)      420.9477 (1.0)       5.8696 (1.14)          1;0  2.3659 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     843.8304 (2.01)     860.8078 (2.01)     847.5353 (2.01)     7.4354 (1.87)     844.1797 (2.01)      5.1301 (1.0)           1;1  1.1799 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     734.4463 (1.75)     751.1306 (1.75)     739.4538 (1.75)     6.9334 (1.75)     736.8256 (1.75)      8.3862 (1.63)          1;0  1.3523 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     734.3186 (1.75)     748.1935 (1.74)     741.3141 (1.75)     6.3127 (1.59)     744.5819 (1.77)     10.7781 (2.10)          3;0  1.3490 (0.57)          5           3
test_plots-plots-show-json[main]       764.3240 (1.82)     789.9970 (1.84)     774.1540 (1.83)     9.4974 (2.39)     772.2285 (1.83)      7.5368 (1.47)          2;1  1.2917 (0.55)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     50.6130 (2.34)     50.6130 (2.34)     50.6130 (2.34)     0.0000 (1.0)      50.6130 (2.34)     0.0000 (1.0)           0;0  0.0198 (0.43)          1           1
test_push-push[3.10.0]     45.2776 (2.09)     45.2776 (2.09)     45.2776 (2.09)     0.0000 (1.0)      45.2776 (2.09)     0.0000 (1.0)           0;0  0.0221 (0.48)          1           1
test_push-push[3.53.2]     22.0750 (1.02)     22.0750 (1.02)     22.0750 (1.02)     0.0000 (1.0)      22.0750 (1.02)     0.0000 (1.0)           0;0  0.0453 (0.98)          1           1
test_push-push[3.60.1]     21.6790 (1.00)     21.6790 (1.00)     21.6790 (1.00)     0.0000 (1.0)      21.6790 (1.00)     0.0000 (1.0)           0;0  0.0461 (1.00)          1           1
test_push-push[main]       21.6190 (1.0)      21.6190 (1.0)      21.6190 (1.0)      0.0000 (1.0)      21.6190 (1.0)      0.0000 (1.0)           0;0  0.0463 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     63.3057 (2.71)     63.3057 (2.71)     63.3057 (2.71)     0.0000 (1.0)      63.3057 (2.71)     0.0000 (1.0)           0;0  0.0158 (0.37)          1           1
test_sharing-fetch[3.10.0]     69.1399 (2.97)     69.1399 (2.97)     69.1399 (2.97)     0.0000 (1.0)      69.1399 (2.97)     0.0000 (1.0)           0;0  0.0145 (0.34)          1           1
test_sharing-fetch[3.53.2]     33.2009 (1.42)     33.2009 (1.42)     33.2009 (1.42)     0.0000 (1.0)      33.2009 (1.42)     0.0000 (1.0)           0;0  0.0301 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.3446 (1.00)     23.3446 (1.00)     23.3446 (1.00)     0.0000 (1.0)      23.3446 (1.00)     0.0000 (1.0)           0;0  0.0428 (1.00)          1           1
test_sharing-fetch[main]       23.3174 (1.0)      23.3174 (1.0)      23.3174 (1.0)      0.0000 (1.0)      23.3174 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2271 (1.0)      1.2271 (1.0)      1.2271 (1.0)      0.0000 (1.0)      1.2271 (1.0)      0.0000 (1.0)           0;0  0.8149 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5760 (2.91)     3.5760 (2.91)     3.5760 (2.91)     0.0000 (1.0)      3.5760 (2.91)     0.0000 (1.0)           0;0  0.2796 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6797 (4.63)     5.6797 (4.63)     5.6797 (4.63)     0.0000 (1.0)      5.6797 (4.63)     0.0000 (1.0)           0;0  0.1761 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8435 (4.76)     5.8435 (4.76)     5.8435 (4.76)     0.0000 (1.0)      5.8435 (4.76)     0.0000 (1.0)           0;0  0.1711 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7576 (4.69)     5.7576 (4.69)     5.7576 (4.69)     0.0000 (1.0)      5.7576 (4.69)     0.0000 (1.0)           0;0  0.1737 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.9470 (2.40)     51.9470 (2.40)     51.9470 (2.40)     0.0000 (1.0)      51.9470 (2.40)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_sharing-push[3.10.0]     46.1016 (2.13)     46.1016 (2.13)     46.1016 (2.13)     0.0000 (1.0)      46.1016 (2.13)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_sharing-push[3.53.2]     22.8556 (1.05)     22.8556 (1.05)     22.8556 (1.05)     0.0000 (1.0)      22.8556 (1.05)     0.0000 (1.0)           0;0  0.0438 (0.95)          1           1
test_sharing-push[3.60.1]     21.6687 (1.0)      21.6687 (1.0)      21.6687 (1.0)      0.0000 (1.0)      21.6687 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
test_sharing-push[main]       22.5328 (1.04)     22.5328 (1.04)     22.5328 (1.04)     0.0000 (1.0)      22.5328 (1.04)     0.0000 (1.0)           0;0  0.0444 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0766 (1.01)     2.0766 (1.01)     2.0766 (1.01)     0.0000 (1.0)      2.0766 (1.01)     0.0000 (1.0)           0;0  0.4816 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.0556 (1.0)      2.0556 (1.0)      2.0556 (1.0)      0.0000 (1.0)      2.0556 (1.0)      0.0000 (1.0)           0;0  0.4865 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9320 (2.89)     5.9320 (2.89)     5.9320 (2.89)     0.0000 (1.0)      5.9320 (2.89)     0.0000 (1.0)           0;0  0.1686 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.7972 (2.82)     5.7972 (2.82)     5.7972 (2.82)     0.0000 (1.0)      5.7972 (2.82)     0.0000 (1.0)           0;0  0.1725 (0.35)          1           1
test_sharing-push-noop[main]       5.8539 (2.85)     5.8539 (2.85)     5.8539 (2.85)     0.0000 (1.0)      5.8539 (2.85)     0.0000 (1.0)           0;0  0.1708 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     213.3005 (1.04)     213.3005 (1.04)     213.3005 (1.04)     0.0000 (1.0)      213.3005 (1.04)     0.0000 (1.0)           0;0  0.0047 (0.96)          1           1
test_sharing_azure-fetch[main]       205.0600 (1.0)      205.0600 (1.0)      205.0600 (1.0)      0.0000 (1.0)      205.0600 (1.0)      0.0000 (1.0)           0;0  0.0049 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4292 (1.0)      6.4292 (1.0)      6.4292 (1.0)      0.0000 (1.0)      6.4292 (1.0)      0.0000 (1.0)           0;0  0.1555 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5372 (1.02)     6.5372 (1.02)     6.5372 (1.02)     0.0000 (1.0)      6.5372 (1.02)     0.0000 (1.0)           0;0  0.1530 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     214.7144 (1.0)      214.7144 (1.0)      214.7144 (1.0)      0.0000 (1.0)      214.7144 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
test_sharing_azure-push[main]       225.3033 (1.05)     225.3033 (1.05)     225.3033 (1.05)     0.0000 (1.0)      225.3033 (1.05)     0.0000 (1.0)           0;0  0.0044 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.0196 (1.0)      7.0196 (1.0)      7.0196 (1.0)      0.0000 (1.0)      7.0196 (1.0)      0.0000 (1.0)           0;0  0.1425 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.0545 (1.00)     7.0545 (1.00)     7.0545 (1.00)     0.0000 (1.0)      7.0545 (1.00)     0.0000 (1.0)           0;0  0.1418 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     362.1086 (1.0)      362.1086 (1.0)      362.1086 (1.0)      0.0000 (1.0)      362.1086 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
test_sharing_gs-fetch[main]       392.8682 (1.08)     392.8682 (1.08)     392.8682 (1.08)     0.0000 (1.0)      392.8682 (1.08)     0.0000 (1.0)           0;0  0.0025 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     21.6348 (1.0)      21.6348 (1.0)      21.6348 (1.0)      0.0000 (1.0)      21.6348 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       21.6778 (1.00)     21.6778 (1.00)     21.6778 (1.00)     0.0000 (1.0)      21.6778 (1.00)     0.0000 (1.0)           0;0  0.0461 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     930.8268 (1.0)      930.8268 (1.0)      930.8268 (1.0)      0.0000 (1.0)      930.8268 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
test_sharing_gs-push[main]       944.7220 (1.01)     944.7220 (1.01)     944.7220 (1.01)     0.0000 (1.0)      944.7220 (1.01)     0.0000 (1.0)           0;0  0.0011 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8131 (1.0)      6.8131 (1.0)      6.8131 (1.0)      0.0000 (1.0)      6.8131 (1.0)      0.0000 (1.0)           0;0  0.1468 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.9667 (1.02)     6.9667 (1.02)     6.9667 (1.02)     0.0000 (1.0)      6.9667 (1.02)     0.0000 (1.0)           0;0  0.1435 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     287.4435 (1.04)     287.4435 (1.04)     287.4435 (1.04)     0.0000 (1.0)      287.4435 (1.04)     0.0000 (1.0)           0;0  0.0035 (0.96)          1           1
test_sharing_s3-fetch[main]       277.3809 (1.0)      277.3809 (1.0)      277.3809 (1.0)      0.0000 (1.0)      277.3809 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.7119 (1.0)      6.7119 (1.0)      6.7119 (1.0)      0.0000 (1.0)      6.7119 (1.0)      0.0000 (1.0)           0;0  0.1490 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.8450 (1.02)     6.8450 (1.02)     6.8450 (1.02)     0.0000 (1.0)      6.8450 (1.02)     0.0000 (1.0)           0;0  0.1461 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     324.1815 (1.01)     324.1815 (1.01)     324.1815 (1.01)     0.0000 (1.0)      324.1815 (1.01)     0.0000 (1.0)           0;0  0.0031 (0.99)          1           1
test_sharing_s3-push[main]       321.4710 (1.0)      321.4710 (1.0)      321.4710 (1.0)      0.0000 (1.0)      321.4710 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9567 (1.0)      6.9567 (1.0)      6.9567 (1.0)      0.0000 (1.0)      6.9567 (1.0)      0.0000 (1.0)           0;0  0.1437 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.1966 (1.03)     7.1966 (1.03)     7.1966 (1.03)     0.0000 (1.0)      7.1966 (1.03)     0.0000 (1.0)           0;0  0.1390 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.0414 (3.68)     19.0414 (3.68)     19.0414 (3.68)     0.0000 (1.0)      19.0414 (3.68)     0.0000 (1.0)           0;0  0.0525 (0.27)          1           1
test_status-status[3.10.0]     19.5414 (3.78)     19.5414 (3.78)     19.5414 (3.78)     0.0000 (1.0)      19.5414 (3.78)     0.0000 (1.0)           0;0  0.0512 (0.26)          1           1
test_status-status[3.53.2]     17.7264 (3.43)     17.7264 (3.43)     17.7264 (3.43)     0.0000 (1.0)      17.7264 (3.43)     0.0000 (1.0)           0;0  0.0564 (0.29)          1           1
test_status-status[3.60.1]      5.1673 (1.0)       5.1673 (1.0)       5.1673 (1.0)      0.0000 (1.0)       5.1673 (1.0)      0.0000 (1.0)           0;0  0.1935 (1.0)           1           1
test_status-status[main]        5.3545 (1.04)      5.3545 (1.04)      5.3545 (1.04)     0.0000 (1.0)       5.3545 (1.04)     0.0000 (1.0)           0;0  0.1868 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7477 (1.78)     4.7477 (1.78)     4.7477 (1.78)     0.0000 (1.0)      4.7477 (1.78)     0.0000 (1.0)           0;0  0.2106 (0.56)          1           1
test_status-status-changed[3.10.0]     4.9109 (1.84)     4.9109 (1.84)     4.9109 (1.84)     0.0000 (1.0)      4.9109 (1.84)     0.0000 (1.0)           0;0  0.2036 (0.54)          1           1
test_status-status-changed[3.53.2]     4.9140 (1.84)     4.9140 (1.84)     4.9140 (1.84)     0.0000 (1.0)      4.9140 (1.84)     0.0000 (1.0)           0;0  0.2035 (0.54)          1           1
test_status-status-changed[3.60.1]     2.6665 (1.0)      2.6665 (1.0)      2.6665 (1.0)      0.0000 (1.0)      2.6665 (1.0)      0.0000 (1.0)           0;0  0.3750 (1.0)           1           1
test_status-status-changed[main]       2.7053 (1.01)     2.7053 (1.01)     2.7053 (1.01)     0.0000 (1.0)      2.7053 (1.01)     0.0000 (1.0)           0;0  0.3696 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7285 (1.83)     4.7285 (1.83)     4.7285 (1.83)     0.0000 (1.0)      4.7285 (1.83)     0.0000 (1.0)           0;0  0.2115 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     5.0114 (1.94)     5.0114 (1.94)     5.0114 (1.94)     0.0000 (1.0)      5.0114 (1.94)     0.0000 (1.0)           0;0  0.1995 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.8779 (1.89)     4.8779 (1.89)     4.8779 (1.89)     0.0000 (1.0)      4.8779 (1.89)     0.0000 (1.0)           0;0  0.2050 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.5814 (1.0)      2.5814 (1.0)      2.5814 (1.0)      0.0000 (1.0)      2.5814 (1.0)      0.0000 (1.0)           0;0  0.3874 (1.0)           1           1
test_status-status-changed-noop[main]       2.5943 (1.00)     2.5943 (1.00)     2.5943 (1.00)     0.0000 (1.0)      2.5943 (1.00)     0.0000 (1.0)           0;0  0.3855 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7649 (1.86)     4.7649 (1.86)     4.7649 (1.86)     0.0000 (1.0)      4.7649 (1.86)     0.0000 (1.0)           0;0  0.2099 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9712 (1.94)     4.9712 (1.94)     4.9712 (1.94)     0.0000 (1.0)      4.9712 (1.94)     0.0000 (1.0)           0;0  0.2012 (0.51)          1           1
test_status-status-noop[3.53.2]     4.7029 (1.84)     4.7029 (1.84)     4.7029 (1.84)     0.0000 (1.0)      4.7029 (1.84)     0.0000 (1.0)           0;0  0.2126 (0.54)          1           1
test_status-status-noop[3.60.1]     2.5750 (1.01)     2.5750 (1.01)     2.5750 (1.01)     0.0000 (1.0)      2.5750 (1.01)     0.0000 (1.0)           0;0  0.3884 (0.99)          1           1
test_status-status-noop[main]       2.5589 (1.0)      2.5589 (1.0)      2.5589 (1.0)      0.0000 (1.0)      2.5589 (1.0)      0.0000 (1.0)           0;0  0.3908 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     161.5955 (3.44)     161.5955 (3.44)     161.5955 (3.44)     0.0000 (1.0)      161.5955 (3.44)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.10.0]     165.3416 (3.52)     165.3416 (3.52)     165.3416 (3.52)     0.0000 (1.0)      165.3416 (3.52)     0.0000 (1.0)           0;0  0.0060 (0.28)          1           1
test_update-import-url[3.53.2]     118.3367 (2.52)     118.3367 (2.52)     118.3367 (2.52)     0.0000 (1.0)      118.3367 (2.52)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_update-import-url[3.60.1]      47.0094 (1.0)       47.0094 (1.0)       47.0094 (1.0)      0.0000 (1.0)       47.0094 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_update-import-url[main]        47.6797 (1.01)      47.6797 (1.01)      47.6797 (1.01)     0.0000 (1.0)       47.6797 (1.01)     0.0000 (1.0)           0;0  0.0210 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     141.1532 (3.93)     141.1532 (3.93)     141.1532 (3.93)     0.0000 (1.0)      141.1532 (3.93)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.10.0]     148.9657 (4.15)     148.9657 (4.15)     148.9657 (4.15)     0.0000 (1.0)      148.9657 (4.15)     0.0000 (1.0)           0;0  0.0067 (0.24)          1           1
test_update-update[3.53.2]     110.0935 (3.06)     110.0935 (3.06)     110.0935 (3.06)     0.0000 (1.0)      110.0935 (3.06)     0.0000 (1.0)           0;0  0.0091 (0.33)          1           1
test_update-update[3.60.1]      35.9384 (1.0)       35.9384 (1.0)       35.9384 (1.0)      0.0000 (1.0)       35.9384 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
test_update-update[main]        36.2128 (1.01)      36.2128 (1.01)      36.2128 (1.01)     0.0000 (1.0)       36.2128 (1.01)     0.0000 (1.0)           0;0  0.0276 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1047 (2.06)     16.1047 (2.06)     16.1047 (2.06)     0.0000 (1.0)      16.1047 (2.06)     0.0000 (1.0)           0;0  0.0621 (0.49)          1           1
test_update-update-noop[3.10.0]     17.6546 (2.25)     17.6546 (2.25)     17.6546 (2.25)     0.0000 (1.0)      17.6546 (2.25)     0.0000 (1.0)           0;0  0.0566 (0.44)          1           1
test_update-update-noop[3.53.2]     16.2700 (2.08)     16.2700 (2.08)     16.2700 (2.08)     0.0000 (1.0)      16.2700 (2.08)     0.0000 (1.0)           0;0  0.0615 (0.48)          1           1
test_update-update-noop[3.60.1]      7.8327 (1.0)       7.8327 (1.0)       7.8327 (1.0)      0.0000 (1.0)       7.8327 (1.0)      0.0000 (1.0)           0;0  0.1277 (1.0)           1           1
test_update-update-noop[main]        7.8528 (1.00)      7.8528 (1.00)      7.8528 (1.00)     0.0000 (1.0)       7.8528 (1.00)     0.0000 (1.0)           0;0  0.1273 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean