Tue Sep  2 00:54:55 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     83.5326 (3.71)     83.5326 (3.71)     83.5326 (3.71)     0.0000 (1.0)      83.5326 (3.71)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_add_copy-add[3.10.0]     85.5611 (3.80)     85.5611 (3.80)     85.5611 (3.80)     0.0000 (1.0)      85.5611 (3.80)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_add_copy-add[3.53.2]     76.2345 (3.38)     76.2345 (3.38)     76.2345 (3.38)     0.0000 (1.0)      76.2345 (3.38)     0.0000 (1.0)           0;0  0.0131 (0.30)          1           1
test_add_copy-add[3.60.1]     22.5279 (1.0)      22.5279 (1.0)      22.5279 (1.0)      0.0000 (1.0)      22.5279 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_add_copy-add[main]       23.6203 (1.05)     23.6203 (1.05)     23.6203 (1.05)     0.0000 (1.0)      23.6203 (1.05)     0.0000 (1.0)           0;0  0.0423 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.1194 (6.52)     29.1194 (6.52)     29.1194 (6.52)     0.0000 (1.0)      29.1194 (6.52)     0.0000 (1.0)           0;0  0.0343 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.2261 (6.55)     29.2261 (6.55)     29.2261 (6.55)     0.0000 (1.0)      29.2261 (6.55)     0.0000 (1.0)           0;0  0.0342 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.1143 (6.30)     28.1143 (6.30)     28.1143 (6.30)     0.0000 (1.0)      28.1143 (6.30)     0.0000 (1.0)           0;0  0.0356 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4639 (1.0)       4.4639 (1.0)       4.4639 (1.0)      0.0000 (1.0)       4.4639 (1.0)      0.0000 (1.0)           0;0  0.2240 (1.0)           1           1
test_add_copy-add-noop[main]        4.6197 (1.03)      4.6197 (1.03)      4.6197 (1.03)     0.0000 (1.0)       4.6197 (1.03)     0.0000 (1.0)           0;0  0.2165 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.6277 (4.24)     66.6277 (4.24)     66.6277 (4.24)     0.0000 (1.0)      66.6277 (4.24)     0.0000 (1.0)           0;0  0.0150 (0.24)          1           1
test_add_hardlink-add[3.10.0]     68.1574 (4.33)     68.1574 (4.33)     68.1574 (4.33)     0.0000 (1.0)      68.1574 (4.33)     0.0000 (1.0)           0;0  0.0147 (0.23)          1           1
test_add_hardlink-add[3.53.2]     61.3699 (3.90)     61.3699 (3.90)     61.3699 (3.90)     0.0000 (1.0)      61.3699 (3.90)     0.0000 (1.0)           0;0  0.0163 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.7226 (1.0)      15.7226 (1.0)      15.7226 (1.0)      0.0000 (1.0)      15.7226 (1.0)      0.0000 (1.0)           0;0  0.0636 (1.0)           1           1
test_add_hardlink-add[main]       17.1475 (1.09)     17.1475 (1.09)     17.1475 (1.09)     0.0000 (1.0)      17.1475 (1.09)     0.0000 (1.0)           0;0  0.0583 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.1642 (7.86)     34.1642 (7.86)     34.1642 (7.86)     0.0000 (1.0)      34.1642 (7.86)     0.0000 (1.0)           0;0  0.0293 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.2710 (8.11)     35.2710 (8.11)     35.2710 (8.11)     0.0000 (1.0)      35.2710 (8.11)     0.0000 (1.0)           0;0  0.0284 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     32.8492 (7.56)     32.8492 (7.56)     32.8492 (7.56)     0.0000 (1.0)      32.8492 (7.56)     0.0000 (1.0)           0;0  0.0304 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3464 (1.0)       4.3464 (1.0)       4.3464 (1.0)      0.0000 (1.0)       4.3464 (1.0)      0.0000 (1.0)           0;0  0.2301 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.7141 (1.08)      4.7141 (1.08)      4.7141 (1.08)     0.0000 (1.0)       4.7141 (1.08)     0.0000 (1.0)           0;0  0.2121 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     73.9013 (2.08)     73.9013 (2.08)     73.9013 (2.08)     0.0000 (1.0)      73.9013 (2.08)     0.0000 (1.0)           0;0  0.0135 (0.48)          1           1
test_add_symlink-add[3.10.0]     74.6418 (2.10)     74.6418 (2.10)     74.6418 (2.10)     0.0000 (1.0)      74.6418 (2.10)     0.0000 (1.0)           0;0  0.0134 (0.48)          1           1
test_add_symlink-add[3.53.2]     69.8355 (1.97)     69.8355 (1.97)     69.8355 (1.97)     0.0000 (1.0)      69.8355 (1.97)     0.0000 (1.0)           0;0  0.0143 (0.51)          1           1
test_add_symlink-add[3.60.1]     35.5065 (1.0)      35.5065 (1.0)      35.5065 (1.0)      0.0000 (1.0)      35.5065 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_add_symlink-add[main]       36.7662 (1.04)     36.7662 (1.04)     36.7662 (1.04)     0.0000 (1.0)      36.7662 (1.04)     0.0000 (1.0)           0;0  0.0272 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.4783 (8.07)     48.4783 (8.07)     48.4783 (8.07)     0.0000 (1.0)      48.4783 (8.07)     0.0000 (1.0)           0;0  0.0206 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.4508 (8.23)     49.4508 (8.23)     49.4508 (8.23)     0.0000 (1.0)      49.4508 (8.23)     0.0000 (1.0)           0;0  0.0202 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.4935 (8.07)     48.4935 (8.07)     48.4935 (8.07)     0.0000 (1.0)      48.4935 (8.07)     0.0000 (1.0)           0;0  0.0206 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      6.0094 (1.0)       6.0094 (1.0)       6.0094 (1.0)      0.0000 (1.0)       6.0094 (1.0)      0.0000 (1.0)           0;0  0.1664 (1.0)           1           1
test_add_symlink-add-noop[main]        6.5474 (1.09)      6.5474 (1.09)      6.5474 (1.09)     0.0000 (1.0)       6.5474 (1.09)     0.0000 (1.0)           0;0  0.1527 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.3407 (1.98)     41.3407 (1.98)     41.3407 (1.98)     0.0000 (1.0)      41.3407 (1.98)     0.0000 (1.0)           0;0  0.0242 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     60.2299 (2.88)     60.2299 (2.88)     60.2299 (2.88)     0.0000 (1.0)      60.2299 (2.88)     0.0000 (1.0)           0;0  0.0166 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     27.9340 (1.34)     27.9340 (1.34)     27.9340 (1.34)     0.0000 (1.0)      27.9340 (1.34)     0.0000 (1.0)           0;0  0.0358 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.9085 (1.0)      20.9085 (1.0)      20.9085 (1.0)      0.0000 (1.0)      20.9085 (1.0)      0.0000 (1.0)           0;0  0.0478 (1.0)           1           1
test_checkout_copy-checkout[main]       21.6493 (1.04)     21.6493 (1.04)     21.6493 (1.04)     0.0000 (1.0)      21.6493 (1.04)     0.0000 (1.0)           0;0  0.0462 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4490 (1.64)     5.4490 (1.64)     5.4490 (1.64)     0.0000 (1.0)      5.4490 (1.64)     0.0000 (1.0)           0;0  0.1835 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7820 (1.74)     5.7820 (1.74)     5.7820 (1.74)     0.0000 (1.0)      5.7820 (1.74)     0.0000 (1.0)           0;0  0.1730 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6542 (1.70)     5.6542 (1.70)     5.6542 (1.70)     0.0000 (1.0)      5.6542 (1.70)     0.0000 (1.0)           0;0  0.1769 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3181 (1.0)      3.3181 (1.0)      3.3181 (1.0)      0.0000 (1.0)      3.3181 (1.0)      0.0000 (1.0)           0;0  0.3014 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6146 (1.09)     3.6146 (1.09)     3.6146 (1.09)     0.0000 (1.0)      3.6146 (1.09)     0.0000 (1.0)           0;0  0.2767 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6989 (2.18)     8.6989 (2.18)     8.6989 (2.18)     0.0000 (1.0)      8.6989 (2.18)     0.0000 (1.0)           0;0  0.1150 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4889 (1.63)     6.4889 (1.63)     6.4889 (1.63)     0.0000 (1.0)      6.4889 (1.63)     0.0000 (1.0)           0;0  0.1541 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2258 (1.56)     6.2258 (1.56)     6.2258 (1.56)     0.0000 (1.0)      6.2258 (1.56)     0.0000 (1.0)           0;0  0.1606 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9847 (1.0)      3.9847 (1.0)      3.9847 (1.0)      0.0000 (1.0)      3.9847 (1.0)      0.0000 (1.0)           0;0  0.2510 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5085 (1.13)     4.5085 (1.13)     4.5085 (1.13)     0.0000 (1.0)      4.5085 (1.13)     0.0000 (1.0)           0;0  0.2218 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.1354 (3.02)     22.1354 (3.02)     22.1354 (3.02)     0.0000 (1.0)      22.1354 (3.02)     0.0000 (1.0)           0;0  0.0452 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.0299 (2.19)     16.0299 (2.19)     16.0299 (2.19)     0.0000 (1.0)      16.0299 (2.19)     0.0000 (1.0)           0;0  0.0624 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.2865 (1.95)     14.2865 (1.95)     14.2865 (1.95)     0.0000 (1.0)      14.2865 (1.95)     0.0000 (1.0)           0;0  0.0700 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3211 (1.0)       7.3211 (1.0)       7.3211 (1.0)      0.0000 (1.0)       7.3211 (1.0)      0.0000 (1.0)           0;0  0.1366 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.0086 (1.09)      8.0086 (1.09)      8.0086 (1.09)     0.0000 (1.0)       8.0086 (1.09)     0.0000 (1.0)           0;0  0.1249 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4309 (1.63)     5.4309 (1.63)     5.4309 (1.63)     0.0000 (1.0)      5.4309 (1.63)     0.0000 (1.0)           0;0  0.1841 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5900 (1.68)     5.5900 (1.68)     5.5900 (1.68)     0.0000 (1.0)      5.5900 (1.68)     0.0000 (1.0)           0;0  0.1789 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4225 (1.63)     5.4225 (1.63)     5.4225 (1.63)     0.0000 (1.0)      5.4225 (1.63)     0.0000 (1.0)           0;0  0.1844 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3255 (1.0)      3.3255 (1.0)      3.3255 (1.0)      0.0000 (1.0)      3.3255 (1.0)      0.0000 (1.0)           0;0  0.3007 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5067 (1.05)     3.5067 (1.05)     3.5067 (1.05)     0.0000 (1.0)      3.5067 (1.05)     0.0000 (1.0)           0;0  0.2852 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6884 (2.22)     8.6884 (2.22)     8.6884 (2.22)     0.0000 (1.0)      8.6884 (2.22)     0.0000 (1.0)           0;0  0.1151 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4143 (1.64)     6.4143 (1.64)     6.4143 (1.64)     0.0000 (1.0)      6.4143 (1.64)     0.0000 (1.0)           0;0  0.1559 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2600 (1.60)     6.2600 (1.60)     6.2600 (1.60)     0.0000 (1.0)      6.2600 (1.60)     0.0000 (1.0)           0;0  0.1597 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9161 (1.0)      3.9161 (1.0)      3.9161 (1.0)      0.0000 (1.0)      3.9161 (1.0)      0.0000 (1.0)           0;0  0.2554 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4026 (1.12)     4.4026 (1.12)     4.4026 (1.12)     0.0000 (1.0)      4.4026 (1.12)     0.0000 (1.0)           0;0  0.2271 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.0770 (2.56)     25.0770 (2.56)     25.0770 (2.56)     0.0000 (1.0)      25.0770 (2.56)     0.0000 (1.0)           0;0  0.0399 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     19.3088 (1.97)     19.3088 (1.97)     19.3088 (1.97)     0.0000 (1.0)      19.3088 (1.97)     0.0000 (1.0)           0;0  0.0518 (0.51)          1           1
test_checkout_symlink-checkout[3.53.2]     17.3397 (1.77)     17.3397 (1.77)     17.3397 (1.77)     0.0000 (1.0)      17.3397 (1.77)     0.0000 (1.0)           0;0  0.0577 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]      9.7812 (1.0)       9.7812 (1.0)       9.7812 (1.0)      0.0000 (1.0)       9.7812 (1.0)      0.0000 (1.0)           0;0  0.1022 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.8040 (1.10)     10.8040 (1.10)     10.8040 (1.10)     0.0000 (1.0)      10.8040 (1.10)     0.0000 (1.0)           0;0  0.0926 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.5722 (1.56)     6.5722 (1.56)     6.5722 (1.56)     0.0000 (1.0)      6.5722 (1.56)     0.0000 (1.0)           0;0  0.1522 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.6681 (1.58)     6.6681 (1.58)     6.6681 (1.58)     0.0000 (1.0)      6.6681 (1.58)     0.0000 (1.0)           0;0  0.1500 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6209 (1.57)     6.6209 (1.57)     6.6209 (1.57)     0.0000 (1.0)      6.6209 (1.57)     0.0000 (1.0)           0;0  0.1510 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2258 (1.0)      4.2258 (1.0)      4.2258 (1.0)      0.0000 (1.0)      4.2258 (1.0)      0.0000 (1.0)           0;0  0.2366 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5124 (1.07)     4.5124 (1.07)     4.5124 (1.07)     0.0000 (1.0)      4.5124 (1.07)     0.0000 (1.0)           0;0  0.2216 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.7455 (1.88)     10.7455 (1.88)     10.7455 (1.88)     0.0000 (1.0)      10.7455 (1.88)     0.0000 (1.0)           0;0  0.0931 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4402 (1.48)      8.4402 (1.48)      8.4402 (1.48)     0.0000 (1.0)       8.4402 (1.48)     0.0000 (1.0)           0;0  0.1185 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.2882 (1.45)      8.2882 (1.45)      8.2882 (1.45)     0.0000 (1.0)       8.2882 (1.45)     0.0000 (1.0)           0;0  0.1207 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7092 (1.0)       5.7092 (1.0)       5.7092 (1.0)      0.0000 (1.0)       5.7092 (1.0)      0.0000 (1.0)           0;0  0.1752 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.3084 (1.10)      6.3084 (1.10)      6.3084 (1.10)     0.0000 (1.0)       6.3084 (1.10)     0.0000 (1.0)           0;0  0.1585 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0466 (1.69)     4.0466 (1.69)     4.0466 (1.69)     0.0000 (1.0)      4.0466 (1.69)     0.0000 (1.0)           0;0  0.2471 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.6734 (1.95)     4.6734 (1.95)     4.6734 (1.95)     0.0000 (1.0)      4.6734 (1.95)     0.0000 (1.0)           0;0  0.2140 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.5602 (1.90)     4.5602 (1.90)     4.5602 (1.90)     0.0000 (1.0)      4.5602 (1.90)     0.0000 (1.0)           0;0  0.2193 (0.53)          1           1
test_data_status-data-changed[3.60.1]     2.3950 (1.0)      2.3950 (1.0)      2.3950 (1.0)      0.0000 (1.0)      2.3950 (1.0)      0.0000 (1.0)           0;0  0.4175 (1.0)           1           1
test_data_status-data-changed[main]       2.7296 (1.14)     2.7296 (1.14)     2.7296 (1.14)     0.0000 (1.0)      2.7296 (1.14)     0.0000 (1.0)           0;0  0.3664 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2696 (1.80)     4.2696 (1.80)     4.2696 (1.80)     0.0000 (1.0)      4.2696 (1.80)     0.0000 (1.0)           0;0  0.2342 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8360 (2.04)     4.8360 (2.04)     4.8360 (2.04)     0.0000 (1.0)      4.8360 (2.04)     0.0000 (1.0)           0;0  0.2068 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7013 (1.98)     4.7013 (1.98)     4.7013 (1.98)     0.0000 (1.0)      4.7013 (1.98)     0.0000 (1.0)           0;0  0.2127 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3733 (1.0)      2.3733 (1.0)      2.3733 (1.0)      0.0000 (1.0)      2.3733 (1.0)      0.0000 (1.0)           0;0  0.4213 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.7313 (1.15)     2.7313 (1.15)     2.7313 (1.15)     0.0000 (1.0)      2.7313 (1.15)     0.0000 (1.0)           0;0  0.3661 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2609 (3.66)     18.2609 (3.66)     18.2609 (3.66)     0.0000 (1.0)      18.2609 (3.66)     0.0000 (1.0)           0;0  0.0548 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.1123 (3.83)     19.1123 (3.83)     19.1123 (3.83)     0.0000 (1.0)      19.1123 (3.83)     0.0000 (1.0)           0;0  0.0523 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.7986 (3.77)     18.7986 (3.77)     18.7986 (3.77)     0.0000 (1.0)      18.7986 (3.77)     0.0000 (1.0)           0;0  0.0532 (0.27)          1           1
test_data_status-data-new[3.60.1]      4.9915 (1.0)       4.9915 (1.0)       4.9915 (1.0)      0.0000 (1.0)       4.9915 (1.0)      0.0000 (1.0)           0;0  0.2003 (1.0)           1           1
test_data_status-data-new[main]        5.3774 (1.08)      5.3774 (1.08)      5.3774 (1.08)     0.0000 (1.0)       5.3774 (1.08)     0.0000 (1.0)           0;0  0.1860 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.3995 (1.86)     4.3995 (1.86)     4.3995 (1.86)     0.0000 (1.0)      4.3995 (1.86)     0.0000 (1.0)           0;0  0.2273 (0.54)          1           1
test_data_status-data-noop[3.10.0]     4.8015 (2.03)     4.8015 (2.03)     4.8015 (2.03)     0.0000 (1.0)      4.8015 (2.03)     0.0000 (1.0)           0;0  0.2083 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.8907 (2.06)     4.8907 (2.06)     4.8907 (2.06)     0.0000 (1.0)      4.8907 (2.06)     0.0000 (1.0)           0;0  0.2045 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3710 (1.0)      2.3710 (1.0)      2.3710 (1.0)      0.0000 (1.0)      2.3710 (1.0)      0.0000 (1.0)           0;0  0.4218 (1.0)           1           1
test_data_status-data-noop[main]       2.7278 (1.15)     2.7278 (1.15)     2.7278 (1.15)     0.0000 (1.0)      2.7278 (1.15)     0.0000 (1.0)           0;0  0.3666 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2715 (1.33)     7.2715 (1.33)     7.2715 (1.33)     0.0000 (1.0)      7.2715 (1.33)     0.0000 (1.0)           0;0  0.1375 (0.75)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6544 (1.40)     7.6544 (1.40)     7.6544 (1.40)     0.0000 (1.0)      7.6544 (1.40)     0.0000 (1.0)           0;0  0.1306 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7172 (1.41)     7.7172 (1.41)     7.7172 (1.41)     0.0000 (1.0)      7.7172 (1.41)     0.0000 (1.0)           0;0  0.1296 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4576 (1.0)      5.4576 (1.0)      5.4576 (1.0)      0.0000 (1.0)      5.4576 (1.0)      0.0000 (1.0)           0;0  0.1832 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.8031 (1.06)     5.8031 (1.06)     5.8031 (1.06)     0.0000 (1.0)      5.8031 (1.06)     0.0000 (1.0)           0;0  0.1723 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2049 (1.30)     7.2049 (1.30)     7.2049 (1.30)     0.0000 (1.0)      7.2049 (1.30)     0.0000 (1.0)           0;0  0.1388 (0.77)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6977 (1.39)     7.6977 (1.39)     7.6977 (1.39)     0.0000 (1.0)      7.6977 (1.39)     0.0000 (1.0)           0;0  0.1299 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6371 (1.38)     7.6371 (1.38)     7.6371 (1.38)     0.0000 (1.0)      7.6371 (1.38)     0.0000 (1.0)           0;0  0.1309 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5451 (1.0)      5.5451 (1.0)      5.5451 (1.0)      0.0000 (1.0)      5.5451 (1.0)      0.0000 (1.0)           0;0  0.1803 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8997 (1.06)     5.8997 (1.06)     5.8997 (1.06)     0.0000 (1.0)      5.8997 (1.06)     0.0000 (1.0)           0;0  0.1695 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.1083 (2.72)     21.1083 (2.72)     21.1083 (2.72)     0.0000 (1.0)      21.1083 (2.72)     0.0000 (1.0)           0;0  0.0474 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0292 (2.83)     22.0292 (2.83)     22.0292 (2.83)     0.0000 (1.0)      22.0292 (2.83)     0.0000 (1.0)           0;0  0.0454 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.7129 (2.79)     21.7129 (2.79)     21.7129 (2.79)     0.0000 (1.0)      21.7129 (2.79)     0.0000 (1.0)           0;0  0.0461 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.7747 (1.0)       7.7747 (1.0)       7.7747 (1.0)      0.0000 (1.0)       7.7747 (1.0)      0.0000 (1.0)           0;0  0.1286 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3575 (1.07)      8.3575 (1.07)      8.3575 (1.07)     0.0000 (1.0)       8.3575 (1.07)     0.0000 (1.0)           0;0  0.1197 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5491 (1.39)     6.5491 (1.39)     6.5491 (1.39)     0.0000 (1.0)      6.5491 (1.39)     0.0000 (1.0)           0;0  0.1527 (0.72)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0502 (1.50)     7.0502 (1.50)     7.0502 (1.50)     0.0000 (1.0)      7.0502 (1.50)     0.0000 (1.0)           0;0  0.1418 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9229 (1.47)     6.9229 (1.47)     6.9229 (1.47)     0.0000 (1.0)      6.9229 (1.47)     0.0000 (1.0)           0;0  0.1444 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7119 (1.0)      4.7119 (1.0)      4.7119 (1.0)      0.0000 (1.0)      4.7119 (1.0)      0.0000 (1.0)           0;0  0.2122 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2088 (1.11)     5.2088 (1.11)     5.2088 (1.11)     0.0000 (1.0)      5.2088 (1.11)     0.0000 (1.0)           0;0  0.1920 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0524 (2.54)     18.0524 (2.54)     18.0524 (2.54)     0.0000 (1.0)      18.0524 (2.54)     0.0000 (1.0)           0;0  0.0554 (0.39)          1           1
test_diff-diff[3.10.0]     19.1548 (2.69)     19.1548 (2.69)     19.1548 (2.69)     0.0000 (1.0)      19.1548 (2.69)     0.0000 (1.0)           0;0  0.0522 (0.37)          1           1
test_diff-diff[3.53.2]     19.2609 (2.71)     19.2609 (2.71)     19.2609 (2.71)     0.0000 (1.0)      19.2609 (2.71)     0.0000 (1.0)           0;0  0.0519 (0.37)          1           1
test_diff-diff[3.60.1]      7.1201 (1.0)       7.1201 (1.0)       7.1201 (1.0)      0.0000 (1.0)       7.1201 (1.0)      0.0000 (1.0)           0;0  0.1404 (1.0)           1           1
test_diff-diff[main]        8.1047 (1.14)      8.1047 (1.14)      8.1047 (1.14)     0.0000 (1.0)       8.1047 (1.14)     0.0000 (1.0)           0;0  0.1234 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1388 (1.78)     6.1388 (1.78)     6.1388 (1.78)     0.0000 (1.0)      6.1388 (1.78)     0.0000 (1.0)           0;0  0.1629 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.6898 (1.94)     6.6898 (1.94)     6.6898 (1.94)     0.0000 (1.0)      6.6898 (1.94)     0.0000 (1.0)           0;0  0.1495 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.6363 (1.63)     5.6363 (1.63)     5.6363 (1.63)     0.0000 (1.0)      5.6363 (1.63)     0.0000 (1.0)           0;0  0.1774 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4521 (1.0)      3.4521 (1.0)      3.4521 (1.0)      0.0000 (1.0)      3.4521 (1.0)      0.0000 (1.0)           0;0  0.2897 (1.0)           1           1
test_diff-diff-changed[main]       4.2591 (1.23)     4.2591 (1.23)     4.2591 (1.23)     0.0000 (1.0)      4.2591 (1.23)     0.0000 (1.0)           0;0  0.2348 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3291 (1.57)     5.3291 (1.57)     5.3291 (1.57)     0.0000 (1.0)      5.3291 (1.57)     0.0000 (1.0)           0;0  0.1876 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9061 (1.74)     5.9061 (1.74)     5.9061 (1.74)     0.0000 (1.0)      5.9061 (1.74)     0.0000 (1.0)           0;0  0.1693 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6703 (1.67)     5.6703 (1.67)     5.6703 (1.67)     0.0000 (1.0)      5.6703 (1.67)     0.0000 (1.0)           0;0  0.1764 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3924 (1.0)      3.3924 (1.0)      3.3924 (1.0)      0.0000 (1.0)      3.3924 (1.0)      0.0000 (1.0)           0;0  0.2948 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2963 (1.27)     4.2963 (1.27)     4.2963 (1.27)     0.0000 (1.0)      4.2963 (1.27)     0.0000 (1.0)           0;0  0.2328 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1393 (1.21)     4.1393 (1.21)     4.1393 (1.21)     0.0000 (1.0)      4.1393 (1.21)     0.0000 (1.0)           0;0  0.2416 (0.83)          1           1
test_diff-diff-noop[3.10.0]     4.8162 (1.41)     4.8162 (1.41)     4.8162 (1.41)     0.0000 (1.0)      4.8162 (1.41)     0.0000 (1.0)           0;0  0.2076 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.7232 (1.67)     5.7232 (1.67)     5.7232 (1.67)     0.0000 (1.0)      5.7232 (1.67)     0.0000 (1.0)           0;0  0.1747 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.4202 (1.0)      3.4202 (1.0)      3.4202 (1.0)      0.0000 (1.0)      3.4202 (1.0)      0.0000 (1.0)           0;0  0.2924 (1.0)           1           1
test_diff-diff-noop[main]       4.3774 (1.28)     4.3774 (1.28)     4.3774 (1.28)     0.0000 (1.0)      4.3774 (1.28)     0.0000 (1.0)           0;0  0.2284 (0.78)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       965.7489 (1.0)        965.7489 (1.0)        965.7489 (1.0)      0.0000 (1.0)        965.7489 (1.0)      0.0000 (1.0)           0;0  1.0355 (1.0)           1           1
test_exp_show-exp[3.10.0]     5,655.9685 (5.86)     5,655.9685 (5.86)     5,655.9685 (5.86)     0.0000 (1.0)      5,655.9685 (5.86)     0.0000 (1.0)           0;0  0.1768 (0.17)          1           1
test_exp_show-exp[3.53.2]     3,256.5828 (3.37)     3,256.5828 (3.37)     3,256.5828 (3.37)     0.0000 (1.0)      3,256.5828 (3.37)     0.0000 (1.0)           0;0  0.3071 (0.30)          1           1
test_exp_show-exp[3.60.1]     4,513.5244 (4.67)     4,513.5244 (4.67)     4,513.5244 (4.67)     0.0000 (1.0)      4,513.5244 (4.67)     0.0000 (1.0)           0;0  0.2216 (0.21)          1           1
test_exp_show-exp[main]       7,026.0564 (7.28)     7,026.0564 (7.28)     7,026.0564 (7.28)     0.0000 (1.0)      7,026.0564 (7.28)     0.0000 (1.0)           0;0  0.1423 (0.14)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     65.2783 (2.82)     65.2783 (2.82)     65.2783 (2.82)     0.0000 (1.0)      65.2783 (2.82)     0.0000 (1.0)           0;0  0.0153 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.6633 (3.05)     70.6633 (3.05)     70.6633 (3.05)     0.0000 (1.0)      70.6633 (3.05)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.4955 (1.45)     33.4955 (1.45)     33.4955 (1.45)     0.0000 (1.0)      33.4955 (1.45)     0.0000 (1.0)           0;0  0.0299 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.1749 (1.0)      23.1749 (1.0)      23.1749 (1.0)      0.0000 (1.0)      23.1749 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
test_fetch-fetch[main]       23.1945 (1.00)     23.1945 (1.00)     23.1945 (1.00)     0.0000 (1.0)      23.1945 (1.00)     0.0000 (1.0)           0;0  0.0431 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8016 (1.0)      2.8016 (1.0)      2.8016 (1.0)      0.0000 (1.0)      2.8016 (1.0)      0.0000 (1.0)           0;0  0.3569 (1.0)           1           1
test_gc-gc[3.10.0]     2.9583 (1.06)     2.9583 (1.06)     2.9583 (1.06)     0.0000 (1.0)      2.9583 (1.06)     0.0000 (1.0)           0;0  0.3380 (0.95)          1           1
test_gc-gc[3.53.2]     2.8639 (1.02)     2.8639 (1.02)     2.8639 (1.02)     0.0000 (1.0)      2.8639 (1.02)     0.0000 (1.0)           0;0  0.3492 (0.98)          1           1
test_gc-gc[3.60.1]     2.8431 (1.01)     2.8431 (1.01)     2.8431 (1.01)     0.0000 (1.0)      2.8431 (1.01)     0.0000 (1.0)           0;0  0.3517 (0.99)          1           1
test_gc-gc[main]       3.1290 (1.12)     3.1290 (1.12)     3.1290 (1.12)     0.0000 (1.0)      3.1290 (1.12)     0.0000 (1.0)           0;0  0.3196 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     136.5179 (2.74)     136.5179 (2.74)     136.5179 (2.74)     0.0000 (1.0)      136.5179 (2.74)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     165.8458 (3.32)     165.8458 (3.32)     165.8458 (3.32)     0.0000 (1.0)      165.8458 (3.32)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     157.7137 (3.16)     157.7137 (3.16)     157.7137 (3.16)     0.0000 (1.0)      157.7137 (3.16)     0.0000 (1.0)           0;0  0.0063 (0.32)          1           1
test_get-get[3.60.1]      49.9150 (1.0)       49.9150 (1.0)       49.9150 (1.0)      0.0000 (1.0)       49.9150 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
test_get-get[main]        50.0934 (1.00)      50.0934 (1.00)      50.0934 (1.00)     0.0000 (1.0)       50.0934 (1.00)     0.0000 (1.0)           0;0  0.0200 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.7060 (2.68)     44.7060 (2.68)     44.7060 (2.68)     0.0000 (1.0)      44.7060 (2.68)     0.0000 (1.0)           0;0  0.0224 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.7015 (2.86)     47.7015 (2.86)     47.7015 (2.86)     0.0000 (1.0)      47.7015 (2.86)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.7290 (1.00)     16.7290 (1.00)     16.7290 (1.00)     0.0000 (1.0)      16.7290 (1.00)     0.0000 (1.0)           0;0  0.0598 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.8784 (1.01)     16.8784 (1.01)     16.8784 (1.01)     0.0000 (1.0)      16.8784 (1.01)     0.0000 (1.0)           0;0  0.0592 (0.99)          1           1
test_get_url-get-url[main]       16.6619 (1.0)      16.6619 (1.0)      16.6619 (1.0)      0.0000 (1.0)      16.6619 (1.0)      0.0000 (1.0)           0;0  0.0600 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.2936 (1.01)     129.9867 (1.03)     125.2560 (1.01)     1.0830 (1.14)     125.0006 (1.01)     1.2949 (1.28)         27;2  7.9836 (0.99)        100           1
test_help---help[3.10.0]     121.6544 (1.0)      126.0899 (1.0)      123.5754 (1.0)      0.9469 (1.0)      123.3867 (1.0)      1.2331 (1.22)         34;2  8.0922 (1.0)         100           1
test_help---help[3.53.2]     123.3583 (1.01)     131.2236 (1.04)     125.4768 (1.02)     1.3521 (1.43)     125.1880 (1.01)     1.5472 (1.53)         19;3  7.9696 (0.98)        100           1
test_help---help[3.60.1]     124.7201 (1.03)     135.9101 (1.08)     126.3613 (1.02)     1.2866 (1.36)     126.1908 (1.02)     1.0120 (1.0)          11;4  7.9138 (0.98)        100           1
test_help---help[main]       125.0923 (1.03)     158.2604 (1.26)     127.6316 (1.03)     4.9019 (5.18)     126.3833 (1.02)     1.3022 (1.29)         4;10  7.8351 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     222.5059 (2.94)     222.5059 (2.94)     222.5059 (2.94)     0.0000 (1.0)      222.5059 (2.94)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     251.7392 (3.33)     251.7392 (3.33)     251.7392 (3.33)     0.0000 (1.0)      251.7392 (3.33)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      75.6258 (1.0)       75.6258 (1.0)       75.6258 (1.0)      0.0000 (1.0)       75.6258 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
test_import-import[main]        76.7234 (1.01)      76.7234 (1.01)      76.7234 (1.01)     0.0000 (1.0)       76.7234 (1.01)     0.0000 (1.0)           0;0  0.0130 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     154.0104 (3.35)     154.0104 (3.35)     154.0104 (3.35)     0.0000 (1.0)      154.0104 (3.35)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     157.2122 (3.42)     157.2122 (3.42)     157.2122 (3.42)     0.0000 (1.0)      157.2122 (3.42)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.5681 (2.56)     117.5681 (2.56)     117.5681 (2.56)     0.0000 (1.0)      117.5681 (2.56)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_import_url-import-url[3.60.1]      46.0047 (1.0)       46.0047 (1.0)       46.0047 (1.0)      0.0000 (1.0)       46.0047 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_import_url-import-url[main]        47.2982 (1.03)      47.2982 (1.03)      47.2982 (1.03)     0.0000 (1.0)       47.2982 (1.03)     0.0000 (1.0)           0;0  0.0211 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     376.8729 (1.00)     426.0979 (1.03)     386.3972 (1.01)      6.1230 (1.36)     384.8200 (1.01)     3.6900 (1.08)          9;8  2.5880 (0.99)        100           1
test_init-init[3.10.0]     391.4538 (1.04)     420.8445 (1.01)     397.9515 (1.04)      4.8835 (1.08)     396.7643 (1.04)     4.5728 (1.34)         17;5  2.5129 (0.96)        100           1
test_init-init[3.53.2]     376.3418 (1.0)      415.2433 (1.0)      382.8282 (1.0)       4.5095 (1.0)      382.1583 (1.0)      3.4149 (1.0)          11;6  2.6121 (1.0)         100           1
test_init-init[3.60.1]     377.1503 (1.00)     421.6229 (1.02)     387.6708 (1.01)      7.9976 (1.77)     385.6701 (1.01)     5.6590 (1.66)        13;11  2.5795 (0.99)        100           1
test_init-init[main]       413.1902 (1.10)     489.0662 (1.18)     420.8687 (1.10)     12.7403 (2.83)     417.6776 (1.09)     4.4085 (1.29)          8;9  2.3760 (0.91)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     565.4694 (1.06)     565.4694 (1.06)     565.4694 (1.06)     0.0000 (1.0)      565.4694 (1.06)     0.0000 (1.0)           0;0  1.7684 (0.94)          1           1
test_list-list[3.10.0]     652.2627 (1.22)     652.2627 (1.22)     652.2627 (1.22)     0.0000 (1.0)      652.2627 (1.22)     0.0000 (1.0)           0;0  1.5331 (0.82)          1           1
test_list-list[3.53.2]     555.4848 (1.04)     555.4848 (1.04)     555.4848 (1.04)     0.0000 (1.0)      555.4848 (1.04)     0.0000 (1.0)           0;0  1.8002 (0.96)          1           1
test_list-list[3.60.1]     541.0809 (1.01)     541.0809 (1.01)     541.0809 (1.01)     0.0000 (1.0)      541.0809 (1.01)     0.0000 (1.0)           0;0  1.8482 (0.99)          1           1
test_list-list[main]       533.4607 (1.0)      533.4607 (1.0)      533.4607 (1.0)      0.0000 (1.0)      533.4607 (1.0)      0.0000 (1.0)           0;0  1.8746 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     415.8190 (1.06)     415.8190 (1.06)     415.8190 (1.06)     0.0000 (1.0)      415.8190 (1.06)     0.0000 (1.0)           0;0  2.4049 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     415.2759 (1.06)     415.2759 (1.06)     415.2759 (1.06)     0.0000 (1.0)      415.2759 (1.06)     0.0000 (1.0)           0;0  2.4080 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     394.6722 (1.01)     394.6722 (1.01)     394.6722 (1.01)     0.0000 (1.0)      394.6722 (1.01)     0.0000 (1.0)           0;0  2.5337 (0.99)          1           1
test_list-list-dvc-only[3.60.1]     392.2310 (1.0)      392.2310 (1.0)      392.2310 (1.0)      0.0000 (1.0)      392.2310 (1.0)      0.0000 (1.0)           0;0  2.5495 (1.0)           1           1
test_list-list-dvc-only[main]       418.4921 (1.07)     418.4921 (1.07)     418.4921 (1.07)     0.0000 (1.0)      418.4921 (1.07)     0.0000 (1.0)           0;0  2.3895 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6769 (1.0)      2.6769 (1.0)      2.6769 (1.0)      0.0000 (1.0)      2.6769 (1.0)      0.0000 (1.0)           0;0  0.3736 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6856 (1.00)     2.6856 (1.00)     2.6856 (1.00)     0.0000 (1.0)      2.6856 (1.00)     0.0000 (1.0)           0;0  0.3724 (1.00)          1           1
test_list-list-recursive[3.53.2]     2.8940 (1.08)     2.8940 (1.08)     2.8940 (1.08)     0.0000 (1.0)      2.8940 (1.08)     0.0000 (1.0)           0;0  0.3455 (0.92)          1           1
test_list-list-recursive[3.60.1]     2.8855 (1.08)     2.8855 (1.08)     2.8855 (1.08)     0.0000 (1.0)      2.8855 (1.08)     0.0000 (1.0)           0;0  0.3466 (0.93)          1           1
test_list-list-recursive[main]       2.8282 (1.06)     2.8282 (1.06)     2.8282 (1.06)     0.0000 (1.0)      2.8282 (1.06)     0.0000 (1.0)           0;0  0.3536 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     414.1581 (1.04)     414.1581 (1.04)     414.1581 (1.04)     0.0000 (1.0)      414.1581 (1.04)     0.0000 (1.0)           0;0  2.4145 (0.96)          1           1
test_list-list-shallow[3.10.0]     417.5227 (1.05)     417.5227 (1.05)     417.5227 (1.05)     0.0000 (1.0)      417.5227 (1.05)     0.0000 (1.0)           0;0  2.3951 (0.95)          1           1
test_list-list-shallow[3.53.2]     407.7987 (1.02)     407.7987 (1.02)     407.7987 (1.02)     0.0000 (1.0)      407.7987 (1.02)     0.0000 (1.0)           0;0  2.4522 (0.98)          1           1
test_list-list-shallow[3.60.1]     401.7073 (1.01)     401.7073 (1.01)     401.7073 (1.01)     0.0000 (1.0)      401.7073 (1.01)     0.0000 (1.0)           0;0  2.4894 (0.99)          1           1
test_list-list-shallow[main]       398.2958 (1.0)      398.2958 (1.0)      398.2958 (1.0)      0.0000 (1.0)      398.2958 (1.0)      0.0000 (1.0)           0;0  2.5107 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.7195 (3.77)     72.7195 (3.77)     72.7195 (3.77)     0.0000 (1.0)      72.7195 (3.77)     0.0000 (1.0)           0;0  0.0138 (0.27)          1           1
test_partial_add-add[3.10.0]     72.6665 (3.76)     72.6665 (3.76)     72.6665 (3.76)     0.0000 (1.0)      72.6665 (3.76)     0.0000 (1.0)           0;0  0.0138 (0.27)          1           1
test_partial_add-add[3.53.2]     65.3358 (3.38)     65.3358 (3.38)     65.3358 (3.38)     0.0000 (1.0)      65.3358 (3.38)     0.0000 (1.0)           0;0  0.0153 (0.30)          1           1
test_partial_add-add[3.60.1]     19.3099 (1.0)      19.3099 (1.0)      19.3099 (1.0)      0.0000 (1.0)      19.3099 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
test_partial_add-add[main]       20.3878 (1.06)     20.3878 (1.06)     20.3878 (1.06)     0.0000 (1.0)      20.3878 (1.06)     0.0000 (1.0)           0;0  0.0490 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     61.3891 (7.88)     61.3891 (7.88)     61.3891 (7.88)     0.0000 (1.0)      61.3891 (7.88)     0.0000 (1.0)           0;0  0.0163 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     61.7312 (7.92)     61.7312 (7.92)     61.7312 (7.92)     0.0000 (1.0)      61.7312 (7.92)     0.0000 (1.0)           0;0  0.0162 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     55.5830 (7.13)     55.5830 (7.13)     55.5830 (7.13)     0.0000 (1.0)      55.5830 (7.13)     0.0000 (1.0)           0;0  0.0180 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.7935 (1.0)       7.7935 (1.0)       7.7935 (1.0)      0.0000 (1.0)       7.7935 (1.0)      0.0000 (1.0)           0;0  0.1283 (1.0)           1           1
test_partial_add-add-partial[main]        8.0227 (1.03)      8.0227 (1.03)      8.0227 (1.03)     0.0000 (1.0)       8.0227 (1.03)     0.0000 (1.0)           0;0  0.1246 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3548 (1.0)      4.3548 (1.0)      4.3548 (1.0)      0.0000 (1.0)      4.3548 (1.0)      0.0000 (1.0)           0;0  0.2296 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.7156 (1.31)     5.7156 (1.31)     5.7156 (1.31)     0.0000 (1.0)      5.7156 (1.31)     0.0000 (1.0)           0;0  0.1750 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.4830 (1.49)     6.4830 (1.49)     6.4830 (1.49)     0.0000 (1.0)      6.4830 (1.49)     0.0000 (1.0)           0;0  0.1543 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5213 (1.50)     6.5213 (1.50)     6.5213 (1.50)     0.0000 (1.0)      6.5213 (1.50)     0.0000 (1.0)           0;0  0.1533 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.5314 (1.50)     6.5314 (1.50)     6.5314 (1.50)     0.0000 (1.0)      6.5314 (1.50)     0.0000 (1.0)           0;0  0.1531 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3662 (1.0)      2.3662 (1.0)      2.3662 (1.0)      0.0000 (1.0)      2.3662 (1.0)      0.0000 (1.0)           0;0  0.4226 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6676 (1.55)     3.6676 (1.55)     3.6676 (1.55)     0.0000 (1.0)      3.6676 (1.55)     0.0000 (1.0)           0;0  0.2727 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.7088 (1.57)     3.7088 (1.57)     3.7088 (1.57)     0.0000 (1.0)      3.7088 (1.57)     0.0000 (1.0)           0;0  0.2696 (0.64)          1           1
test_partial_add-gc-noop[3.60.1]     3.6458 (1.54)     3.6458 (1.54)     3.6458 (1.54)     0.0000 (1.0)      3.6458 (1.54)     0.0000 (1.0)           0;0  0.2743 (0.65)          1           1
test_partial_add-gc-noop[main]       3.7000 (1.56)     3.7000 (1.56)     3.7000 (1.56)     0.0000 (1.0)      3.7000 (1.56)     0.0000 (1.0)           0;0  0.2703 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.4283 (2.41)     44.4283 (2.41)     44.4283 (2.41)     0.0000 (1.0)      44.4283 (2.41)     0.0000 (1.0)           0;0  0.0225 (0.42)          1           1
test_partial_add-push[3.10.0]     38.7913 (2.10)     38.7913 (2.10)     38.7913 (2.10)     0.0000 (1.0)      38.7913 (2.10)     0.0000 (1.0)           0;0  0.0258 (0.48)          1           1
test_partial_add-push[3.53.2]     19.1752 (1.04)     19.1752 (1.04)     19.1752 (1.04)     0.0000 (1.0)      19.1752 (1.04)     0.0000 (1.0)           0;0  0.0522 (0.96)          1           1
test_partial_add-push[3.60.1]     18.4461 (1.0)      18.4461 (1.0)      18.4461 (1.0)      0.0000 (1.0)      18.4461 (1.0)      0.0000 (1.0)           0;0  0.0542 (1.0)           1           1
test_partial_add-push[main]       18.8203 (1.02)     18.8203 (1.02)     18.8203 (1.02)     0.0000 (1.0)      18.8203 (1.02)     0.0000 (1.0)           0;0  0.0531 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.2543 (1.12)     11.2543 (1.12)     11.2543 (1.12)     0.0000 (1.0)      11.2543 (1.12)     0.0000 (1.0)           0;0  0.0889 (0.89)          1           1
test_partial_add-push-partial[3.10.0]     10.6138 (1.06)     10.6138 (1.06)     10.6138 (1.06)     0.0000 (1.0)      10.6138 (1.06)     0.0000 (1.0)           0;0  0.0942 (0.94)          1           1
test_partial_add-push-partial[3.53.2]     10.3174 (1.03)     10.3174 (1.03)     10.3174 (1.03)     0.0000 (1.0)      10.3174 (1.03)     0.0000 (1.0)           0;0  0.0969 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.0045 (1.0)      10.0045 (1.0)      10.0045 (1.0)      0.0000 (1.0)      10.0045 (1.0)      0.0000 (1.0)           0;0  0.1000 (1.0)           1           1
test_partial_add-push-partial[main]       10.0288 (1.00)     10.0288 (1.00)     10.0288 (1.00)     0.0000 (1.0)      10.0288 (1.00)     0.0000 (1.0)           0;0  0.0997 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.3320 (3.73)     83.3320 (3.73)     83.3320 (3.73)     0.0000 (1.0)      83.3320 (3.73)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_partial_remove-add[3.10.0]     85.1107 (3.81)     85.1107 (3.81)     85.1107 (3.81)     0.0000 (1.0)      85.1107 (3.81)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_partial_remove-add[3.53.2]     75.4091 (3.37)     75.4091 (3.37)     75.4091 (3.37)     0.0000 (1.0)      75.4091 (3.37)     0.0000 (1.0)           0;0  0.0133 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.3596 (1.0)      22.3596 (1.0)      22.3596 (1.0)      0.0000 (1.0)      22.3596 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
test_partial_remove-add[main]       23.3393 (1.04)     23.3393 (1.04)     23.3393 (1.04)     0.0000 (1.0)      23.3393 (1.04)     0.0000 (1.0)           0;0  0.0428 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.5253 (8.41)     8.5253 (8.41)     8.5253 (8.41)     0.0000 (1.0)      8.5253 (8.41)     0.0000 (1.0)           0;0  0.1173 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.5978 (8.48)     8.5978 (8.48)     8.5978 (8.48)     0.0000 (1.0)      8.5978 (8.48)     0.0000 (1.0)           0;0  0.1163 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.6800 (7.57)     7.6800 (7.57)     7.6800 (7.57)     0.0000 (1.0)      7.6800 (7.57)     0.0000 (1.0)           0;0  0.1302 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.0141 (1.0)      1.0141 (1.0)      1.0141 (1.0)      0.0000 (1.0)      1.0141 (1.0)      0.0000 (1.0)           0;0  0.9861 (1.0)           1           1
test_partial_remove-add-update[main]       1.0309 (1.02)     1.0309 (1.02)     1.0309 (1.02)     0.0000 (1.0)      1.0309 (1.02)     0.0000 (1.0)           0;0  0.9700 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1033 (1.0)      3.1033 (1.0)      3.1033 (1.0)      0.0000 (1.0)      3.1033 (1.0)      0.0000 (1.0)           0;0  0.3222 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5815 (1.15)     3.5815 (1.15)     3.5815 (1.15)     0.0000 (1.0)      3.5815 (1.15)     0.0000 (1.0)           0;0  0.2792 (0.87)          1           1
test_partial_remove-gc[3.53.2]     3.5994 (1.16)     3.5994 (1.16)     3.5994 (1.16)     0.0000 (1.0)      3.5994 (1.16)     0.0000 (1.0)           0;0  0.2778 (0.86)          1           1
test_partial_remove-gc[3.60.1]     3.4872 (1.12)     3.4872 (1.12)     3.4872 (1.12)     0.0000 (1.0)      3.4872 (1.12)     0.0000 (1.0)           0;0  0.2868 (0.89)          1           1
test_partial_remove-gc[main]       3.5397 (1.14)     3.5397 (1.14)     3.5397 (1.14)     0.0000 (1.0)      3.5397 (1.14)     0.0000 (1.0)           0;0  0.2825 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.6871 (1.04)     4.6871 (1.04)     4.6871 (1.04)     0.0000 (1.0)      4.6871 (1.04)     0.0000 (1.0)           0;0  0.2134 (0.96)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1115 (1.14)     5.1115 (1.14)     5.1115 (1.14)     0.0000 (1.0)      5.1115 (1.14)     0.0000 (1.0)           0;0  0.1956 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.7996 (1.07)     4.7996 (1.07)     4.7996 (1.07)     0.0000 (1.0)      4.7996 (1.07)     0.0000 (1.0)           0;0  0.2083 (0.94)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.6075 (1.02)     4.6075 (1.02)     4.6075 (1.02)     0.0000 (1.0)      4.6075 (1.02)     0.0000 (1.0)           0;0  0.2170 (0.98)          1           1
test_partial_remove-gc-cloud[main]       4.5033 (1.0)      4.5033 (1.0)      4.5033 (1.0)      0.0000 (1.0)      4.5033 (1.0)      0.0000 (1.0)           0;0  0.2221 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.2614 (2.36)     51.2614 (2.36)     51.2614 (2.36)     0.0000 (1.0)      51.2614 (2.36)     0.0000 (1.0)           0;0  0.0195 (0.42)          1           1
test_partial_remove-push[3.10.0]     45.7932 (2.11)     45.7932 (2.11)     45.7932 (2.11)     0.0000 (1.0)      45.7932 (2.11)     0.0000 (1.0)           0;0  0.0218 (0.47)          1           1
test_partial_remove-push[3.53.2]     22.9044 (1.05)     22.9044 (1.05)     22.9044 (1.05)     0.0000 (1.0)      22.9044 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.95)          1           1
test_partial_remove-push[3.60.1]     21.7118 (1.0)      21.7118 (1.0)      21.7118 (1.0)      0.0000 (1.0)      21.7118 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
test_partial_remove-push[main]       22.2144 (1.02)     22.2144 (1.02)     22.2144 (1.02)     0.0000 (1.0)      22.2144 (1.02)     0.0000 (1.0)           0;0  0.0450 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7562 (1.0)      1.7562 (1.0)      1.7562 (1.0)      0.0000 (1.0)      1.7562 (1.0)      0.0000 (1.0)           0;0  0.5694 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8132 (1.03)     1.8132 (1.03)     1.8132 (1.03)     0.0000 (1.0)      1.8132 (1.03)     0.0000 (1.0)           0;0  0.5515 (0.97)          1           1
test_partial_remove-push-update[3.53.2]     2.4668 (1.40)     2.4668 (1.40)     2.4668 (1.40)     0.0000 (1.0)      2.4668 (1.40)     0.0000 (1.0)           0;0  0.4054 (0.71)          1           1
test_partial_remove-push-update[3.60.1]     2.6987 (1.54)     2.6987 (1.54)     2.6987 (1.54)     0.0000 (1.0)      2.6987 (1.54)     0.0000 (1.0)           0;0  0.3705 (0.65)          1           1
test_partial_remove-push-update[main]       2.5555 (1.46)     2.5555 (1.46)     2.5555 (1.46)     0.0000 (1.0)      2.5555 (1.46)     0.0000 (1.0)           0;0  0.3913 (0.69)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     487.4376 (1.0)      490.2019 (1.0)      489.0177 (1.0)      1.0975 (1.0)      489.1859 (1.0)      1.6776 (1.0)           2;0  2.0449 (1.0)           5           3
test_plots-plots-diff[3.10.0]     879.6348 (1.80)     888.3929 (1.81)     884.1191 (1.81)     3.7003 (3.37)     884.8906 (1.81)     6.3845 (3.81)          2;0  1.1311 (0.55)          5           3
test_plots-plots-diff[3.53.2]     801.7899 (1.64)     804.7551 (1.64)     803.0370 (1.64)     1.2677 (1.16)     803.0561 (1.64)     2.1647 (1.29)          1;0  1.2453 (0.61)          5           3
test_plots-plots-diff[3.60.1]     802.9131 (1.65)     809.6206 (1.65)     806.4984 (1.65)     2.8002 (2.55)     806.1600 (1.65)     4.7374 (2.82)          2;0  1.2399 (0.61)          5           3
test_plots-plots-diff[main]       806.2589 (1.65)     812.0506 (1.66)     808.5640 (1.65)     2.1701 (1.98)     808.3798 (1.65)     2.4181 (1.44)          2;0  1.2368 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       503.3310 (1.0)        508.0390 (1.0)        505.5063 (1.0)      1.6953 (1.04)       505.3257 (1.0)      1.7595 (1.0)           2;0  1.9782 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,112.4477 (2.21)     1,116.4696 (2.20)     1,115.1644 (2.21)     1.6315 (1.0)      1,115.6007 (2.21)     2.0103 (1.14)          1;0  0.8967 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       876.5539 (1.74)       890.8424 (1.75)       882.9223 (1.75)     5.9525 (3.65)       880.4641 (1.74)     9.5711 (5.44)          2;0  1.1326 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       884.0366 (1.76)       892.4378 (1.76)       886.3085 (1.75)     3.4729 (2.13)       884.7524 (1.75)     2.8067 (1.60)          1;1  1.1283 (0.57)          5           3
test_plots-plots-diff-json[main]         882.3092 (1.75)       891.9553 (1.76)       886.7546 (1.75)     3.8624 (2.37)       887.8417 (1.76)     5.7633 (3.28)          2;0  1.1277 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     407.0515 (1.0)      409.8583 (1.0)      408.4609 (1.0)      1.1368 (1.0)      408.1121 (1.0)       1.7853 (1.00)          2;0  2.4482 (1.0)           5           3
test_plots-plots-show[3.10.0]     710.7879 (1.75)     715.4197 (1.75)     713.2612 (1.75)     1.8519 (1.63)     713.8954 (1.75)      2.8313 (1.59)          2;0  1.4020 (0.57)          5           3
test_plots-plots-show[3.53.2]     687.5646 (1.69)     708.1339 (1.73)     695.2844 (1.70)     8.2156 (7.23)     695.5583 (1.70)     11.0101 (6.17)          1;0  1.4383 (0.59)          5           3
test_plots-plots-show[3.60.1]     689.9438 (1.69)     694.7826 (1.70)     692.1698 (1.69)     1.7449 (1.53)     691.8515 (1.70)      1.7836 (1.0)           2;0  1.4447 (0.59)          5           3
test_plots-plots-show[main]       689.7141 (1.69)     693.1278 (1.69)     691.0949 (1.69)     1.3280 (1.17)     690.9974 (1.69)      1.8323 (1.03)          2;0  1.4470 (0.59)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     420.8761 (1.0)      422.3689 (1.0)      421.6560 (1.0)      0.5882 (1.0)      421.6852 (1.0)      0.9201 (1.0)           2;0  2.3716 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     841.7603 (2.00)     848.7700 (2.01)     843.8136 (2.00)     2.8672 (4.87)     843.2450 (2.00)     2.8410 (3.09)          1;0  1.1851 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     732.5406 (1.74)     738.8839 (1.75)     735.3572 (1.74)     2.7306 (4.64)     734.3982 (1.74)     4.6786 (5.08)          2;0  1.3599 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     732.1442 (1.74)     737.9533 (1.75)     736.1748 (1.75)     2.5326 (4.31)     737.7885 (1.75)     3.4197 (3.72)          1;0  1.3584 (0.57)          5           3
test_plots-plots-show-json[main]       736.5612 (1.75)     742.6595 (1.76)     739.7507 (1.75)     2.8962 (4.92)     740.5754 (1.76)     5.5060 (5.98)          3;0  1.3518 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.8861 (2.37)     51.8861 (2.37)     51.8861 (2.37)     0.0000 (1.0)      51.8861 (2.37)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_push-push[3.10.0]     46.0744 (2.11)     46.0744 (2.11)     46.0744 (2.11)     0.0000 (1.0)      46.0744 (2.11)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_push-push[3.53.2]     23.0389 (1.05)     23.0389 (1.05)     23.0389 (1.05)     0.0000 (1.0)      23.0389 (1.05)     0.0000 (1.0)           0;0  0.0434 (0.95)          1           1
test_push-push[3.60.1]     21.8587 (1.0)      21.8587 (1.0)      21.8587 (1.0)      0.0000 (1.0)      21.8587 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
test_push-push[main]       22.2762 (1.02)     22.2762 (1.02)     22.2762 (1.02)     0.0000 (1.0)      22.2762 (1.02)     0.0000 (1.0)           0;0  0.0449 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.2980 (2.76)     64.2980 (2.76)     64.2980 (2.76)     0.0000 (1.0)      64.2980 (2.76)     0.0000 (1.0)           0;0  0.0156 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.0154 (3.00)     70.0154 (3.00)     70.0154 (3.00)     0.0000 (1.0)      70.0154 (3.00)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     34.0589 (1.46)     34.0589 (1.46)     34.0589 (1.46)     0.0000 (1.0)      34.0589 (1.46)     0.0000 (1.0)           0;0  0.0294 (0.68)          1           1
test_sharing-fetch[3.60.1]     23.3169 (1.0)      23.3169 (1.0)      23.3169 (1.0)      0.0000 (1.0)      23.3169 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_sharing-fetch[main]       23.5388 (1.01)     23.5388 (1.01)     23.5388 (1.01)     0.0000 (1.0)      23.5388 (1.01)     0.0000 (1.0)           0;0  0.0425 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2757 (1.0)      1.2757 (1.0)      1.2757 (1.0)      0.0000 (1.0)      1.2757 (1.0)      0.0000 (1.0)           0;0  0.7839 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6199 (2.84)     3.6199 (2.84)     3.6199 (2.84)     0.0000 (1.0)      3.6199 (2.84)     0.0000 (1.0)           0;0  0.2763 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.7598 (4.51)     5.7598 (4.51)     5.7598 (4.51)     0.0000 (1.0)      5.7598 (4.51)     0.0000 (1.0)           0;0  0.1736 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.7121 (4.48)     5.7121 (4.48)     5.7121 (4.48)     0.0000 (1.0)      5.7121 (4.48)     0.0000 (1.0)           0;0  0.1751 (0.22)          1           1
test_sharing-fetch-noop[main]       5.9816 (4.69)     5.9816 (4.69)     5.9816 (4.69)     0.0000 (1.0)      5.9816 (4.69)     0.0000 (1.0)           0;0  0.1672 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.0331 (2.36)     52.0331 (2.36)     52.0331 (2.36)     0.0000 (1.0)      52.0331 (2.36)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_sharing-push[3.10.0]     46.2460 (2.09)     46.2460 (2.09)     46.2460 (2.09)     0.0000 (1.0)      46.2460 (2.09)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_sharing-push[3.53.2]     22.7883 (1.03)     22.7883 (1.03)     22.7883 (1.03)     0.0000 (1.0)      22.7883 (1.03)     0.0000 (1.0)           0;0  0.0439 (0.97)          1           1
test_sharing-push[3.60.1]     22.0936 (1.0)      22.0936 (1.0)      22.0936 (1.0)      0.0000 (1.0)      22.0936 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
test_sharing-push[main]       22.3159 (1.01)     22.3159 (1.01)     22.3159 (1.01)     0.0000 (1.0)      22.3159 (1.01)     0.0000 (1.0)           0;0  0.0448 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0895 (1.02)     2.0895 (1.02)     2.0895 (1.02)     0.0000 (1.0)      2.0895 (1.02)     0.0000 (1.0)           0;0  0.4786 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.0583 (1.0)      2.0583 (1.0)      2.0583 (1.0)      0.0000 (1.0)      2.0583 (1.0)      0.0000 (1.0)           0;0  0.4858 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0783 (2.95)     6.0783 (2.95)     6.0783 (2.95)     0.0000 (1.0)      6.0783 (2.95)     0.0000 (1.0)           0;0  0.1645 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0948 (2.96)     6.0948 (2.96)     6.0948 (2.96)     0.0000 (1.0)      6.0948 (2.96)     0.0000 (1.0)           0;0  0.1641 (0.34)          1           1
test_sharing-push-noop[main]       6.0590 (2.94)     6.0590 (2.94)     6.0590 (2.94)     0.0000 (1.0)      6.0590 (2.94)     0.0000 (1.0)           0;0  0.1650 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     341.7244 (1.03)     341.7244 (1.03)     341.7244 (1.03)     0.0000 (1.0)      341.7244 (1.03)     0.0000 (1.0)           0;0  0.0029 (0.97)          1           1
test_sharing_azure-fetch[main]       331.9965 (1.0)      331.9965 (1.0)      331.9965 (1.0)      0.0000 (1.0)      331.9965 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3717 (1.0)      6.3717 (1.0)      6.3717 (1.0)      0.0000 (1.0)      6.3717 (1.0)      0.0000 (1.0)           0;0  0.1569 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5102 (1.02)     6.5102 (1.02)     6.5102 (1.02)     0.0000 (1.0)      6.5102 (1.02)     0.0000 (1.0)           0;0  0.1536 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     339.9881 (1.0)      339.9881 (1.0)      339.9881 (1.0)      0.0000 (1.0)      339.9881 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
test_sharing_azure-push[main]       341.1795 (1.00)     341.1795 (1.00)     341.1795 (1.00)     0.0000 (1.0)      341.1795 (1.00)     0.0000 (1.0)           0;0  0.0029 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.5707 (1.0)      7.5707 (1.0)      7.5707 (1.0)      0.0000 (1.0)      7.5707 (1.0)      0.0000 (1.0)           0;0  0.1321 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.5960 (1.00)     7.5960 (1.00)     7.5960 (1.00)     0.0000 (1.0)      7.5960 (1.00)     0.0000 (1.0)           0;0  0.1316 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     367.5557 (1.05)     367.5557 (1.05)     367.5557 (1.05)     0.0000 (1.0)      367.5557 (1.05)     0.0000 (1.0)           0;0  0.0027 (0.95)          1           1
test_sharing_gs-fetch[main]       348.4191 (1.0)      348.4191 (1.0)      348.4191 (1.0)      0.0000 (1.0)      348.4191 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     19.5288 (1.13)     19.5288 (1.13)     19.5288 (1.13)     0.0000 (1.0)      19.5288 (1.13)     0.0000 (1.0)           0;0  0.0512 (0.89)          1           1
test_sharing_gs-fetch-noop[main]       17.3071 (1.0)      17.3071 (1.0)      17.3071 (1.0)      0.0000 (1.0)      17.3071 (1.0)      0.0000 (1.0)           0;0  0.0578 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     621.2120 (1.02)     621.2120 (1.02)     621.2120 (1.02)     0.0000 (1.0)      621.2120 (1.02)     0.0000 (1.0)           0;0  0.0016 (0.98)          1           1
test_sharing_gs-push[main]       607.1740 (1.0)      607.1740 (1.0)      607.1740 (1.0)      0.0000 (1.0)      607.1740 (1.0)      0.0000 (1.0)           0;0  0.0016 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.0260 (1.0)      7.0260 (1.0)      7.0260 (1.0)      0.0000 (1.0)      7.0260 (1.0)      0.0000 (1.0)           0;0  0.1423 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.0316 (1.00)     7.0316 (1.00)     7.0316 (1.00)     0.0000 (1.0)      7.0316 (1.00)     0.0000 (1.0)           0;0  0.1422 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     231.6641 (1.05)     231.6641 (1.05)     231.6641 (1.05)     0.0000 (1.0)      231.6641 (1.05)     0.0000 (1.0)           0;0  0.0043 (0.95)          1           1
test_sharing_s3-fetch[main]       220.2007 (1.0)      220.2007 (1.0)      220.2007 (1.0)      0.0000 (1.0)      220.2007 (1.0)      0.0000 (1.0)           0;0  0.0045 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.0379 (1.0)      6.0379 (1.0)      6.0379 (1.0)      0.0000 (1.0)      6.0379 (1.0)      0.0000 (1.0)           0;0  0.1656 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.2126 (1.03)     6.2126 (1.03)     6.2126 (1.03)     0.0000 (1.0)      6.2126 (1.03)     0.0000 (1.0)           0;0  0.1610 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     255.8880 (1.0)      255.8880 (1.0)      255.8880 (1.0)      0.0000 (1.0)      255.8880 (1.0)      0.0000 (1.0)           0;0  0.0039 (1.0)           1           1
test_sharing_s3-push[main]       256.2469 (1.00)     256.2469 (1.00)     256.2469 (1.00)     0.0000 (1.0)      256.2469 (1.00)     0.0000 (1.0)           0;0  0.0039 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.3580 (1.0)      6.3580 (1.0)      6.3580 (1.0)      0.0000 (1.0)      6.3580 (1.0)      0.0000 (1.0)           0;0  0.1573 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.3781 (1.00)     6.3781 (1.00)     6.3781 (1.00)     0.0000 (1.0)      6.3781 (1.00)     0.0000 (1.0)           0;0  0.1568 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.2717 (3.75)     19.2717 (3.75)     19.2717 (3.75)     0.0000 (1.0)      19.2717 (3.75)     0.0000 (1.0)           0;0  0.0519 (0.27)          1           1
test_status-status[3.10.0]     19.3786 (3.77)     19.3786 (3.77)     19.3786 (3.77)     0.0000 (1.0)      19.3786 (3.77)     0.0000 (1.0)           0;0  0.0516 (0.26)          1           1
test_status-status[3.53.2]     17.6367 (3.44)     17.6367 (3.44)     17.6367 (3.44)     0.0000 (1.0)      17.6367 (3.44)     0.0000 (1.0)           0;0  0.0567 (0.29)          1           1
test_status-status[3.60.1]      5.1338 (1.0)       5.1338 (1.0)       5.1338 (1.0)      0.0000 (1.0)       5.1338 (1.0)      0.0000 (1.0)           0;0  0.1948 (1.0)           1           1
test_status-status[main]        5.6514 (1.10)      5.6514 (1.10)      5.6514 (1.10)     0.0000 (1.0)       5.6514 (1.10)     0.0000 (1.0)           0;0  0.1769 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6283 (1.76)     4.6283 (1.76)     4.6283 (1.76)     0.0000 (1.0)      4.6283 (1.76)     0.0000 (1.0)           0;0  0.2161 (0.57)          1           1
test_status-status-changed[3.10.0]     4.9793 (1.89)     4.9793 (1.89)     4.9793 (1.89)     0.0000 (1.0)      4.9793 (1.89)     0.0000 (1.0)           0;0  0.2008 (0.53)          1           1
test_status-status-changed[3.53.2]     4.8746 (1.85)     4.8746 (1.85)     4.8746 (1.85)     0.0000 (1.0)      4.8746 (1.85)     0.0000 (1.0)           0;0  0.2051 (0.54)          1           1
test_status-status-changed[3.60.1]     2.6302 (1.0)      2.6302 (1.0)      2.6302 (1.0)      0.0000 (1.0)      2.6302 (1.0)      0.0000 (1.0)           0;0  0.3802 (1.0)           1           1
test_status-status-changed[main]       2.8745 (1.09)     2.8745 (1.09)     2.8745 (1.09)     0.0000 (1.0)      2.8745 (1.09)     0.0000 (1.0)           0;0  0.3479 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7172 (1.84)     4.7172 (1.84)     4.7172 (1.84)     0.0000 (1.0)      4.7172 (1.84)     0.0000 (1.0)           0;0  0.2120 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.9842 (1.94)     4.9842 (1.94)     4.9842 (1.94)     0.0000 (1.0)      4.9842 (1.94)     0.0000 (1.0)           0;0  0.2006 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.7955 (1.87)     4.7955 (1.87)     4.7955 (1.87)     0.0000 (1.0)      4.7955 (1.87)     0.0000 (1.0)           0;0  0.2085 (0.54)          1           1
test_status-status-changed-noop[3.60.1]     2.5698 (1.0)      2.5698 (1.0)      2.5698 (1.0)      0.0000 (1.0)      2.5698 (1.0)      0.0000 (1.0)           0;0  0.3891 (1.0)           1           1
test_status-status-changed-noop[main]       2.7778 (1.08)     2.7778 (1.08)     2.7778 (1.08)     0.0000 (1.0)      2.7778 (1.08)     0.0000 (1.0)           0;0  0.3600 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7185 (1.84)     4.7185 (1.84)     4.7185 (1.84)     0.0000 (1.0)      4.7185 (1.84)     0.0000 (1.0)           0;0  0.2119 (0.54)          1           1
test_status-status-noop[3.10.0]     4.8621 (1.90)     4.8621 (1.90)     4.8621 (1.90)     0.0000 (1.0)      4.8621 (1.90)     0.0000 (1.0)           0;0  0.2057 (0.53)          1           1
test_status-status-noop[3.53.2]     4.7495 (1.86)     4.7495 (1.86)     4.7495 (1.86)     0.0000 (1.0)      4.7495 (1.86)     0.0000 (1.0)           0;0  0.2105 (0.54)          1           1
test_status-status-noop[3.60.1]     2.5595 (1.0)      2.5595 (1.0)      2.5595 (1.0)      0.0000 (1.0)      2.5595 (1.0)      0.0000 (1.0)           0;0  0.3907 (1.0)           1           1
test_status-status-noop[main]       2.7777 (1.09)     2.7777 (1.09)     2.7777 (1.09)     0.0000 (1.0)      2.7777 (1.09)     0.0000 (1.0)           0;0  0.3600 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     154.0619 (3.33)     154.0619 (3.33)     154.0619 (3.33)     0.0000 (1.0)      154.0619 (3.33)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.10.0]     159.4665 (3.45)     159.4665 (3.45)     159.4665 (3.45)     0.0000 (1.0)      159.4665 (3.45)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.53.2]     119.1516 (2.58)     119.1516 (2.58)     119.1516 (2.58)     0.0000 (1.0)      119.1516 (2.58)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_update-import-url[3.60.1]      46.2678 (1.0)       46.2678 (1.0)       46.2678 (1.0)      0.0000 (1.0)       46.2678 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        47.8144 (1.03)      47.8144 (1.03)      47.8144 (1.03)     0.0000 (1.0)       47.8144 (1.03)     0.0000 (1.0)           0;0  0.0209 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     138.7852 (3.88)     138.7852 (3.88)     138.7852 (3.88)     0.0000 (1.0)      138.7852 (3.88)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     142.9422 (4.00)     142.9422 (4.00)     142.9422 (4.00)     0.0000 (1.0)      142.9422 (4.00)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     110.0680 (3.08)     110.0680 (3.08)     110.0680 (3.08)     0.0000 (1.0)      110.0680 (3.08)     0.0000 (1.0)           0;0  0.0091 (0.32)          1           1
test_update-update[3.60.1]      35.7691 (1.0)       35.7691 (1.0)       35.7691 (1.0)      0.0000 (1.0)       35.7691 (1.0)      0.0000 (1.0)           0;0  0.0280 (1.0)           1           1
test_update-update[main]        36.9136 (1.03)      36.9136 (1.03)      36.9136 (1.03)     0.0000 (1.0)       36.9136 (1.03)     0.0000 (1.0)           0;0  0.0271 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.8522 (2.02)     15.8522 (2.02)     15.8522 (2.02)     0.0000 (1.0)      15.8522 (2.02)     0.0000 (1.0)           0;0  0.0631 (0.50)          1           1
test_update-update-noop[3.10.0]     16.4172 (2.09)     16.4172 (2.09)     16.4172 (2.09)     0.0000 (1.0)      16.4172 (2.09)     0.0000 (1.0)           0;0  0.0609 (0.48)          1           1
test_update-update-noop[3.53.2]     16.1761 (2.06)     16.1761 (2.06)     16.1761 (2.06)     0.0000 (1.0)      16.1761 (2.06)     0.0000 (1.0)           0;0  0.0618 (0.49)          1           1
test_update-update-noop[3.60.1]      7.8524 (1.0)       7.8524 (1.0)       7.8524 (1.0)      0.0000 (1.0)       7.8524 (1.0)      0.0000 (1.0)           0;0  0.1273 (1.0)           1           1
test_update-update-noop[main]        8.6786 (1.11)      8.6786 (1.11)      8.6786 (1.11)     0.0000 (1.0)       8.6786 (1.11)     0.0000 (1.0)           0;0  0.1152 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean