Wed Oct  8 01:03:34 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     86.1211 (3.61)     86.1211 (3.61)     86.1211 (3.61)     0.0000 (1.0)      86.1211 (3.61)     0.0000 (1.0)           0;0  0.0116 (0.28)          1           1
test_add_copy-add[3.10.0]     85.9989 (3.60)     85.9989 (3.60)     85.9989 (3.60)     0.0000 (1.0)      85.9989 (3.60)     0.0000 (1.0)           0;0  0.0116 (0.28)          1           1
test_add_copy-add[3.53.2]     76.9427 (3.22)     76.9427 (3.22)     76.9427 (3.22)     0.0000 (1.0)      76.9427 (3.22)     0.0000 (1.0)           0;0  0.0130 (0.31)          1           1
test_add_copy-add[3.60.1]     23.8685 (1.0)      23.8685 (1.0)      23.8685 (1.0)      0.0000 (1.0)      23.8685 (1.0)      0.0000 (1.0)           0;0  0.0419 (1.0)           1           1
test_add_copy-add[main]       24.4213 (1.02)     24.4213 (1.02)     24.4213 (1.02)     0.0000 (1.0)      24.4213 (1.02)     0.0000 (1.0)           0;0  0.0409 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.6364 (5.68)     28.6364 (5.68)     28.6364 (5.68)     0.0000 (1.0)      28.6364 (5.68)     0.0000 (1.0)           0;0  0.0349 (0.18)          1           1
test_add_copy-add-noop[3.10.0]     28.9051 (5.73)     28.9051 (5.73)     28.9051 (5.73)     0.0000 (1.0)      28.9051 (5.73)     0.0000 (1.0)           0;0  0.0346 (0.17)          1           1
test_add_copy-add-noop[3.53.2]     27.5764 (5.47)     27.5764 (5.47)     27.5764 (5.47)     0.0000 (1.0)      27.5764 (5.47)     0.0000 (1.0)           0;0  0.0363 (0.18)          1           1
test_add_copy-add-noop[3.60.1]      5.0441 (1.0)       5.0441 (1.0)       5.0441 (1.0)      0.0000 (1.0)       5.0441 (1.0)      0.0000 (1.0)           0;0  0.1983 (1.0)           1           1
test_add_copy-add-noop[main]        5.2387 (1.04)      5.2387 (1.04)      5.2387 (1.04)     0.0000 (1.0)       5.2387 (1.04)     0.0000 (1.0)           0;0  0.1909 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.9999 (4.18)     64.9999 (4.18)     64.9999 (4.18)     0.0000 (1.0)      64.9999 (4.18)     0.0000 (1.0)           0;0  0.0154 (0.24)          1           1
test_add_hardlink-add[3.10.0]     65.7218 (4.23)     65.7218 (4.23)     65.7218 (4.23)     0.0000 (1.0)      65.7218 (4.23)     0.0000 (1.0)           0;0  0.0152 (0.24)          1           1
test_add_hardlink-add[3.53.2]     60.5947 (3.90)     60.5947 (3.90)     60.5947 (3.90)     0.0000 (1.0)      60.5947 (3.90)     0.0000 (1.0)           0;0  0.0165 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.5517 (1.0)      15.5517 (1.0)      15.5517 (1.0)      0.0000 (1.0)      15.5517 (1.0)      0.0000 (1.0)           0;0  0.0643 (1.0)           1           1
test_add_hardlink-add[main]       16.9432 (1.09)     16.9432 (1.09)     16.9432 (1.09)     0.0000 (1.0)      16.9432 (1.09)     0.0000 (1.0)           0;0  0.0590 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.4787 (7.53)     32.4787 (7.53)     32.4787 (7.53)     0.0000 (1.0)      32.4787 (7.53)     0.0000 (1.0)           0;0  0.0308 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.0486 (7.66)     33.0486 (7.66)     33.0486 (7.66)     0.0000 (1.0)      33.0486 (7.66)     0.0000 (1.0)           0;0  0.0303 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.0858 (7.21)     31.0858 (7.21)     31.0858 (7.21)     0.0000 (1.0)      31.0858 (7.21)     0.0000 (1.0)           0;0  0.0322 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3120 (1.0)       4.3120 (1.0)       4.3120 (1.0)      0.0000 (1.0)       4.3120 (1.0)      0.0000 (1.0)           0;0  0.2319 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.6559 (1.08)      4.6559 (1.08)      4.6559 (1.08)     0.0000 (1.0)       4.6559 (1.08)     0.0000 (1.0)           0;0  0.2148 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     68.9922 (1.96)     68.9922 (1.96)     68.9922 (1.96)     0.0000 (1.0)      68.9922 (1.96)     0.0000 (1.0)           0;0  0.0145 (0.51)          1           1
test_add_symlink-add[3.10.0]     69.6096 (1.98)     69.6096 (1.98)     69.6096 (1.98)     0.0000 (1.0)      69.6096 (1.98)     0.0000 (1.0)           0;0  0.0144 (0.50)          1           1
test_add_symlink-add[3.53.2]     64.6368 (1.84)     64.6368 (1.84)     64.6368 (1.84)     0.0000 (1.0)      64.6368 (1.84)     0.0000 (1.0)           0;0  0.0155 (0.54)          1           1
test_add_symlink-add[3.60.1]     35.1483 (1.0)      35.1483 (1.0)      35.1483 (1.0)      0.0000 (1.0)      35.1483 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
test_add_symlink-add[main]       36.0840 (1.03)     36.0840 (1.03)     36.0840 (1.03)     0.0000 (1.0)      36.0840 (1.03)     0.0000 (1.0)           0;0  0.0277 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.9318 (7.80)     45.9318 (7.80)     45.9318 (7.80)     0.0000 (1.0)      45.9318 (7.80)     0.0000 (1.0)           0;0  0.0218 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     46.2840 (7.86)     46.2840 (7.86)     46.2840 (7.86)     0.0000 (1.0)      46.2840 (7.86)     0.0000 (1.0)           0;0  0.0216 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     45.4184 (7.71)     45.4184 (7.71)     45.4184 (7.71)     0.0000 (1.0)      45.4184 (7.71)     0.0000 (1.0)           0;0  0.0220 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.8919 (1.0)       5.8919 (1.0)       5.8919 (1.0)      0.0000 (1.0)       5.8919 (1.0)      0.0000 (1.0)           0;0  0.1697 (1.0)           1           1
test_add_symlink-add-noop[main]        6.3285 (1.07)      6.3285 (1.07)      6.3285 (1.07)     0.0000 (1.0)       6.3285 (1.07)     0.0000 (1.0)           0;0  0.1580 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.1150 (1.95)     41.1150 (1.95)     41.1150 (1.95)     0.0000 (1.0)      41.1150 (1.95)     0.0000 (1.0)           0;0  0.0243 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     60.4858 (2.87)     60.4858 (2.87)     60.4858 (2.87)     0.0000 (1.0)      60.4858 (2.87)     0.0000 (1.0)           0;0  0.0165 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     28.1654 (1.34)     28.1654 (1.34)     28.1654 (1.34)     0.0000 (1.0)      28.1654 (1.34)     0.0000 (1.0)           0;0  0.0355 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     21.0470 (1.0)      21.0470 (1.0)      21.0470 (1.0)      0.0000 (1.0)      21.0470 (1.0)      0.0000 (1.0)           0;0  0.0475 (1.0)           1           1
test_checkout_copy-checkout[main]       21.7295 (1.03)     21.7295 (1.03)     21.7295 (1.03)     0.0000 (1.0)      21.7295 (1.03)     0.0000 (1.0)           0;0  0.0460 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5256 (1.62)     5.5256 (1.62)     5.5256 (1.62)     0.0000 (1.0)      5.5256 (1.62)     0.0000 (1.0)           0;0  0.1810 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9067 (1.74)     5.9067 (1.74)     5.9067 (1.74)     0.0000 (1.0)      5.9067 (1.74)     0.0000 (1.0)           0;0  0.1693 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6747 (1.67)     5.6747 (1.67)     5.6747 (1.67)     0.0000 (1.0)      5.6747 (1.67)     0.0000 (1.0)           0;0  0.1762 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.4022 (1.0)      3.4022 (1.0)      3.4022 (1.0)      0.0000 (1.0)      3.4022 (1.0)      0.0000 (1.0)           0;0  0.2939 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.7572 (1.10)     3.7572 (1.10)     3.7572 (1.10)     0.0000 (1.0)      3.7572 (1.10)     0.0000 (1.0)           0;0  0.2662 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9332 (1.92)     7.9332 (1.92)     7.9332 (1.92)     0.0000 (1.0)      7.9332 (1.92)     0.0000 (1.0)           0;0  0.1261 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5082 (1.58)     6.5082 (1.58)     6.5082 (1.58)     0.0000 (1.0)      6.5082 (1.58)     0.0000 (1.0)           0;0  0.1537 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4012 (1.55)     6.4012 (1.55)     6.4012 (1.55)     0.0000 (1.0)      6.4012 (1.55)     0.0000 (1.0)           0;0  0.1562 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.1274 (1.0)      4.1274 (1.0)      4.1274 (1.0)      0.0000 (1.0)      4.1274 (1.0)      0.0000 (1.0)           0;0  0.2423 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5971 (1.11)     4.5971 (1.11)     4.5971 (1.11)     0.0000 (1.0)      4.5971 (1.11)     0.0000 (1.0)           0;0  0.2175 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.3232 (2.98)     21.3232 (2.98)     21.3232 (2.98)     0.0000 (1.0)      21.3232 (2.98)     0.0000 (1.0)           0;0  0.0469 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7522 (2.20)     15.7522 (2.20)     15.7522 (2.20)     0.0000 (1.0)      15.7522 (2.20)     0.0000 (1.0)           0;0  0.0635 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.6089 (2.04)     14.6089 (2.04)     14.6089 (2.04)     0.0000 (1.0)      14.6089 (2.04)     0.0000 (1.0)           0;0  0.0685 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.1464 (1.0)       7.1464 (1.0)       7.1464 (1.0)      0.0000 (1.0)       7.1464 (1.0)      0.0000 (1.0)           0;0  0.1399 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.0557 (1.13)      8.0557 (1.13)      8.0557 (1.13)     0.0000 (1.0)       8.0557 (1.13)     0.0000 (1.0)           0;0  0.1241 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4014 (1.66)     5.4014 (1.66)     5.4014 (1.66)     0.0000 (1.0)      5.4014 (1.66)     0.0000 (1.0)           0;0  0.1851 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6521 (1.74)     5.6521 (1.74)     5.6521 (1.74)     0.0000 (1.0)      5.6521 (1.74)     0.0000 (1.0)           0;0  0.1769 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3876 (1.66)     5.3876 (1.66)     5.3876 (1.66)     0.0000 (1.0)      5.3876 (1.66)     0.0000 (1.0)           0;0  0.1856 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2512 (1.0)      3.2512 (1.0)      3.2512 (1.0)      0.0000 (1.0)      3.2512 (1.0)      0.0000 (1.0)           0;0  0.3076 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6322 (1.12)     3.6322 (1.12)     3.6322 (1.12)     0.0000 (1.0)      3.6322 (1.12)     0.0000 (1.0)           0;0  0.2753 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.7428 (2.01)     7.7428 (2.01)     7.7428 (2.01)     0.0000 (1.0)      7.7428 (2.01)     0.0000 (1.0)           0;0  0.1292 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3215 (1.64)     6.3215 (1.64)     6.3215 (1.64)     0.0000 (1.0)      6.3215 (1.64)     0.0000 (1.0)           0;0  0.1582 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1259 (1.59)     6.1259 (1.59)     6.1259 (1.59)     0.0000 (1.0)      6.1259 (1.59)     0.0000 (1.0)           0;0  0.1632 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8504 (1.0)      3.8504 (1.0)      3.8504 (1.0)      0.0000 (1.0)      3.8504 (1.0)      0.0000 (1.0)           0;0  0.2597 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3807 (1.14)     4.3807 (1.14)     4.3807 (1.14)     0.0000 (1.0)      4.3807 (1.14)     0.0000 (1.0)           0;0  0.2283 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.2584 (2.45)     24.2584 (2.45)     24.2584 (2.45)     0.0000 (1.0)      24.2584 (2.45)     0.0000 (1.0)           0;0  0.0412 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     18.8232 (1.90)     18.8232 (1.90)     18.8232 (1.90)     0.0000 (1.0)      18.8232 (1.90)     0.0000 (1.0)           0;0  0.0531 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.3597 (1.75)     17.3597 (1.75)     17.3597 (1.75)     0.0000 (1.0)      17.3597 (1.75)     0.0000 (1.0)           0;0  0.0576 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]      9.8992 (1.0)       9.8992 (1.0)       9.8992 (1.0)      0.0000 (1.0)       9.8992 (1.0)      0.0000 (1.0)           0;0  0.1010 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.1294 (1.12)     11.1294 (1.12)     11.1294 (1.12)     0.0000 (1.0)      11.1294 (1.12)     0.0000 (1.0)           0;0  0.0899 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7036 (1.60)     6.7036 (1.60)     6.7036 (1.60)     0.0000 (1.0)      6.7036 (1.60)     0.0000 (1.0)           0;0  0.1492 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.6683 (1.59)     6.6683 (1.59)     6.6683 (1.59)     0.0000 (1.0)      6.6683 (1.59)     0.0000 (1.0)           0;0  0.1500 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6066 (1.57)     6.6066 (1.57)     6.6066 (1.57)     0.0000 (1.0)      6.6066 (1.57)     0.0000 (1.0)           0;0  0.1514 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2016 (1.0)      4.2016 (1.0)      4.2016 (1.0)      0.0000 (1.0)      4.2016 (1.0)      0.0000 (1.0)           0;0  0.2380 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5277 (1.08)     4.5277 (1.08)     4.5277 (1.08)     0.0000 (1.0)      4.5277 (1.08)     0.0000 (1.0)           0;0  0.2209 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.7052 (1.70)     9.7052 (1.70)     9.7052 (1.70)     0.0000 (1.0)      9.7052 (1.70)     0.0000 (1.0)           0;0  0.1030 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.4860 (1.49)     8.4860 (1.49)     8.4860 (1.49)     0.0000 (1.0)      8.4860 (1.49)     0.0000 (1.0)           0;0  0.1178 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.2605 (1.45)     8.2605 (1.45)     8.2605 (1.45)     0.0000 (1.0)      8.2605 (1.45)     0.0000 (1.0)           0;0  0.1211 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.7102 (1.0)      5.7102 (1.0)      5.7102 (1.0)      0.0000 (1.0)      5.7102 (1.0)      0.0000 (1.0)           0;0  0.1751 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.2535 (1.10)     6.2535 (1.10)     6.2535 (1.10)     0.0000 (1.0)      6.2535 (1.10)     0.0000 (1.0)           0;0  0.1599 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9503 (1.70)     3.9503 (1.70)     3.9503 (1.70)     0.0000 (1.0)      3.9503 (1.70)     0.0000 (1.0)           0;0  0.2531 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.7541 (2.05)     4.7541 (2.05)     4.7541 (2.05)     0.0000 (1.0)      4.7541 (2.05)     0.0000 (1.0)           0;0  0.2103 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.6352 (2.00)     4.6352 (2.00)     4.6352 (2.00)     0.0000 (1.0)      4.6352 (2.00)     0.0000 (1.0)           0;0  0.2157 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3218 (1.0)      2.3218 (1.0)      2.3218 (1.0)      0.0000 (1.0)      2.3218 (1.0)      0.0000 (1.0)           0;0  0.4307 (1.0)           1           1
test_data_status-data-changed[main]       2.6123 (1.13)     2.6123 (1.13)     2.6123 (1.13)     0.0000 (1.0)      2.6123 (1.13)     0.0000 (1.0)           0;0  0.3828 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1667 (1.78)     4.1667 (1.78)     4.1667 (1.78)     0.0000 (1.0)      4.1667 (1.78)     0.0000 (1.0)           0;0  0.2400 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7925 (2.05)     4.7925 (2.05)     4.7925 (2.05)     0.0000 (1.0)      4.7925 (2.05)     0.0000 (1.0)           0;0  0.2087 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7064 (2.01)     4.7064 (2.01)     4.7064 (2.01)     0.0000 (1.0)      4.7064 (2.01)     0.0000 (1.0)           0;0  0.2125 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3360 (1.0)      2.3360 (1.0)      2.3360 (1.0)      0.0000 (1.0)      2.3360 (1.0)      0.0000 (1.0)           0;0  0.4281 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6796 (1.15)     2.6796 (1.15)     2.6796 (1.15)     0.0000 (1.0)      2.6796 (1.15)     0.0000 (1.0)           0;0  0.3732 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2486 (3.71)     18.2486 (3.71)     18.2486 (3.71)     0.0000 (1.0)      18.2486 (3.71)     0.0000 (1.0)           0;0  0.0548 (0.27)          1           1
test_data_status-data-new[3.10.0]     18.6249 (3.78)     18.6249 (3.78)     18.6249 (3.78)     0.0000 (1.0)      18.6249 (3.78)     0.0000 (1.0)           0;0  0.0537 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.5175 (3.76)     18.5175 (3.76)     18.5175 (3.76)     0.0000 (1.0)      18.5175 (3.76)     0.0000 (1.0)           0;0  0.0540 (0.27)          1           1
test_data_status-data-new[3.60.1]      4.9251 (1.0)       4.9251 (1.0)       4.9251 (1.0)      0.0000 (1.0)       4.9251 (1.0)      0.0000 (1.0)           0;0  0.2030 (1.0)           1           1
test_data_status-data-new[main]        5.1789 (1.05)      5.1789 (1.05)      5.1789 (1.05)     0.0000 (1.0)       5.1789 (1.05)     0.0000 (1.0)           0;0  0.1931 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9931 (1.71)     3.9931 (1.71)     3.9931 (1.71)     0.0000 (1.0)      3.9931 (1.71)     0.0000 (1.0)           0;0  0.2504 (0.59)          1           1
test_data_status-data-noop[3.10.0]     4.7996 (2.05)     4.7996 (2.05)     4.7996 (2.05)     0.0000 (1.0)      4.7996 (2.05)     0.0000 (1.0)           0;0  0.2083 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.5013 (1.92)     4.5013 (1.92)     4.5013 (1.92)     0.0000 (1.0)      4.5013 (1.92)     0.0000 (1.0)           0;0  0.2222 (0.52)          1           1
test_data_status-data-noop[3.60.1]     2.3405 (1.0)      2.3405 (1.0)      2.3405 (1.0)      0.0000 (1.0)      2.3405 (1.0)      0.0000 (1.0)           0;0  0.4273 (1.0)           1           1
test_data_status-data-noop[main]       2.5965 (1.11)     2.5965 (1.11)     2.5965 (1.11)     0.0000 (1.0)      2.5965 (1.11)     0.0000 (1.0)           0;0  0.3851 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2413 (1.30)     7.2413 (1.30)     7.2413 (1.30)     0.0000 (1.0)      7.2413 (1.30)     0.0000 (1.0)           0;0  0.1381 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8982 (1.42)     7.8982 (1.42)     7.8982 (1.42)     0.0000 (1.0)      7.8982 (1.42)     0.0000 (1.0)           0;0  0.1266 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8958 (1.41)     7.8958 (1.41)     7.8958 (1.41)     0.0000 (1.0)      7.8958 (1.41)     0.0000 (1.0)           0;0  0.1266 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5808 (1.0)      5.5808 (1.0)      5.5808 (1.0)      0.0000 (1.0)      5.5808 (1.0)      0.0000 (1.0)           0;0  0.1792 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.8885 (1.06)     5.8885 (1.06)     5.8885 (1.06)     0.0000 (1.0)      5.8885 (1.06)     0.0000 (1.0)           0;0  0.1698 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2426 (1.29)     7.2426 (1.29)     7.2426 (1.29)     0.0000 (1.0)      7.2426 (1.29)     0.0000 (1.0)           0;0  0.1381 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8236 (1.39)     7.8236 (1.39)     7.8236 (1.39)     0.0000 (1.0)      7.8236 (1.39)     0.0000 (1.0)           0;0  0.1278 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7332 (1.38)     7.7332 (1.38)     7.7332 (1.38)     0.0000 (1.0)      7.7332 (1.38)     0.0000 (1.0)           0;0  0.1293 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6241 (1.0)      5.6241 (1.0)      5.6241 (1.0)      0.0000 (1.0)      5.6241 (1.0)      0.0000 (1.0)           0;0  0.1778 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.9199 (1.05)     5.9199 (1.05)     5.9199 (1.05)     0.0000 (1.0)      5.9199 (1.05)     0.0000 (1.0)           0;0  0.1689 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.7343 (2.71)     21.7343 (2.71)     21.7343 (2.71)     0.0000 (1.0)      21.7343 (2.71)     0.0000 (1.0)           0;0  0.0460 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.4971 (2.80)     22.4971 (2.80)     22.4971 (2.80)     0.0000 (1.0)      22.4971 (2.80)     0.0000 (1.0)           0;0  0.0445 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.3324 (2.78)     22.3324 (2.78)     22.3324 (2.78)     0.0000 (1.0)      22.3324 (2.78)     0.0000 (1.0)           0;0  0.0448 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0315 (1.0)       8.0315 (1.0)       8.0315 (1.0)      0.0000 (1.0)       8.0315 (1.0)      0.0000 (1.0)           0;0  0.1245 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4120 (1.05)      8.4120 (1.05)      8.4120 (1.05)     0.0000 (1.0)       8.4120 (1.05)     0.0000 (1.0)           0;0  0.1189 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.6027 (1.36)     6.6027 (1.36)     6.6027 (1.36)     0.0000 (1.0)      6.6027 (1.36)     0.0000 (1.0)           0;0  0.1515 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0978 (1.46)     7.0978 (1.46)     7.0978 (1.46)     0.0000 (1.0)      7.0978 (1.46)     0.0000 (1.0)           0;0  0.1409 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1107 (1.47)     7.1107 (1.47)     7.1107 (1.47)     0.0000 (1.0)      7.1107 (1.47)     0.0000 (1.0)           0;0  0.1406 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8500 (1.0)      4.8500 (1.0)      4.8500 (1.0)      0.0000 (1.0)      4.8500 (1.0)      0.0000 (1.0)           0;0  0.2062 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2468 (1.08)     5.2468 (1.08)     5.2468 (1.08)     0.0000 (1.0)      5.2468 (1.08)     0.0000 (1.0)           0;0  0.1906 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.1802 (2.68)     18.1802 (2.68)     18.1802 (2.68)     0.0000 (1.0)      18.1802 (2.68)     0.0000 (1.0)           0;0  0.0550 (0.37)          1           1
test_diff-diff[3.10.0]     18.6309 (2.75)     18.6309 (2.75)     18.6309 (2.75)     0.0000 (1.0)      18.6309 (2.75)     0.0000 (1.0)           0;0  0.0537 (0.36)          1           1
test_diff-diff[3.53.2]     18.8984 (2.79)     18.8984 (2.79)     18.8984 (2.79)     0.0000 (1.0)      18.8984 (2.79)     0.0000 (1.0)           0;0  0.0529 (0.36)          1           1
test_diff-diff[3.60.1]      6.7815 (1.0)       6.7815 (1.0)       6.7815 (1.0)      0.0000 (1.0)       6.7815 (1.0)      0.0000 (1.0)           0;0  0.1475 (1.0)           1           1
test_diff-diff[main]        7.5700 (1.12)      7.5700 (1.12)      7.5700 (1.12)     0.0000 (1.0)       7.5700 (1.12)     0.0000 (1.0)           0;0  0.1321 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0529 (1.82)     6.0529 (1.82)     6.0529 (1.82)     0.0000 (1.0)      6.0529 (1.82)     0.0000 (1.0)           0;0  0.1652 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.5369 (1.96)     6.5369 (1.96)     6.5369 (1.96)     0.0000 (1.0)      6.5369 (1.96)     0.0000 (1.0)           0;0  0.1530 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.5399 (1.66)     5.5399 (1.66)     5.5399 (1.66)     0.0000 (1.0)      5.5399 (1.66)     0.0000 (1.0)           0;0  0.1805 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3344 (1.0)      3.3344 (1.0)      3.3344 (1.0)      0.0000 (1.0)      3.3344 (1.0)      0.0000 (1.0)           0;0  0.2999 (1.0)           1           1
test_diff-diff-changed[main]       4.6393 (1.39)     4.6393 (1.39)     4.6393 (1.39)     0.0000 (1.0)      4.6393 (1.39)     0.0000 (1.0)           0;0  0.2156 (0.72)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0119 (1.51)     5.0119 (1.51)     5.0119 (1.51)     0.0000 (1.0)      5.0119 (1.51)     0.0000 (1.0)           0;0  0.1995 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7550 (1.73)     5.7550 (1.73)     5.7550 (1.73)     0.0000 (1.0)      5.7550 (1.73)     0.0000 (1.0)           0;0  0.1738 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5390 (1.66)     5.5390 (1.66)     5.5390 (1.66)     0.0000 (1.0)      5.5390 (1.66)     0.0000 (1.0)           0;0  0.1805 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3299 (1.0)      3.3299 (1.0)      3.3299 (1.0)      0.0000 (1.0)      3.3299 (1.0)      0.0000 (1.0)           0;0  0.3003 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.6389 (1.39)     4.6389 (1.39)     4.6389 (1.39)     0.0000 (1.0)      4.6389 (1.39)     0.0000 (1.0)           0;0  0.2156 (0.72)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0453 (1.22)     4.0453 (1.22)     4.0453 (1.22)     0.0000 (1.0)      4.0453 (1.22)     0.0000 (1.0)           0;0  0.2472 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.8105 (1.46)     4.8105 (1.46)     4.8105 (1.46)     0.0000 (1.0)      4.8105 (1.46)     0.0000 (1.0)           0;0  0.2079 (0.69)          1           1
test_diff-diff-noop[3.53.2]     5.5371 (1.68)     5.5371 (1.68)     5.5371 (1.68)     0.0000 (1.0)      5.5371 (1.68)     0.0000 (1.0)           0;0  0.1806 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3030 (1.0)      3.3030 (1.0)      3.3030 (1.0)      0.0000 (1.0)      3.3030 (1.0)      0.0000 (1.0)           0;0  0.3028 (1.0)           1           1
test_diff-diff-noop[main]       4.2623 (1.29)     4.2623 (1.29)     4.2623 (1.29)     0.0000 (1.0)      4.2623 (1.29)     0.0000 (1.0)           0;0  0.2346 (0.77)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       992.7948 (1.0)        992.7948 (1.0)        992.7948 (1.0)      0.0000 (1.0)        992.7948 (1.0)      0.0000 (1.0)           0;0  1.0073 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,560.6323 (4.59)     4,560.6323 (4.59)     4,560.6323 (4.59)     0.0000 (1.0)      4,560.6323 (4.59)     0.0000 (1.0)           0;0  0.2193 (0.22)          1           1
test_exp_show-exp[3.53.2]     2,652.2532 (2.67)     2,652.2532 (2.67)     2,652.2532 (2.67)     0.0000 (1.0)      2,652.2532 (2.67)     0.0000 (1.0)           0;0  0.3770 (0.37)          1           1
test_exp_show-exp[3.60.1]     3,050.5084 (3.07)     3,050.5084 (3.07)     3,050.5084 (3.07)     0.0000 (1.0)      3,050.5084 (3.07)     0.0000 (1.0)           0;0  0.3278 (0.33)          1           1
test_exp_show-exp[main]       6,144.8190 (6.19)     6,144.8190 (6.19)     6,144.8190 (6.19)     0.0000 (1.0)      6,144.8190 (6.19)     0.0000 (1.0)           0;0  0.1627 (0.16)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     65.9000 (2.84)     65.9000 (2.84)     65.9000 (2.84)     0.0000 (1.0)      65.9000 (2.84)     0.0000 (1.0)           0;0  0.0152 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.8363 (3.10)     71.8363 (3.10)     71.8363 (3.10)     0.0000 (1.0)      71.8363 (3.10)     0.0000 (1.0)           0;0  0.0139 (0.32)          1           1
test_fetch-fetch[3.53.2]     32.3784 (1.40)     32.3784 (1.40)     32.3784 (1.40)     0.0000 (1.0)      32.3784 (1.40)     0.0000 (1.0)           0;0  0.0309 (0.72)          1           1
test_fetch-fetch[3.60.1]     23.2511 (1.00)     23.2511 (1.00)     23.2511 (1.00)     0.0000 (1.0)      23.2511 (1.00)     0.0000 (1.0)           0;0  0.0430 (1.00)          1           1
test_fetch-fetch[main]       23.2029 (1.0)      23.2029 (1.0)      23.2029 (1.0)      0.0000 (1.0)      23.2029 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7828 (1.00)     2.7828 (1.00)     2.7828 (1.00)     0.0000 (1.0)      2.7828 (1.00)     0.0000 (1.0)           0;0  0.3594 (1.00)          1           1
test_gc-gc[3.10.0]     2.9439 (1.06)     2.9439 (1.06)     2.9439 (1.06)     0.0000 (1.0)      2.9439 (1.06)     0.0000 (1.0)           0;0  0.3397 (0.94)          1           1
test_gc-gc[3.53.2]     2.8413 (1.02)     2.8413 (1.02)     2.8413 (1.02)     0.0000 (1.0)      2.8413 (1.02)     0.0000 (1.0)           0;0  0.3520 (0.98)          1           1
test_gc-gc[3.60.1]     2.8484 (1.02)     2.8484 (1.02)     2.8484 (1.02)     0.0000 (1.0)      2.8484 (1.02)     0.0000 (1.0)           0;0  0.3511 (0.98)          1           1
test_gc-gc[main]       2.7819 (1.0)      2.7819 (1.0)      2.7819 (1.0)      0.0000 (1.0)      2.7819 (1.0)      0.0000 (1.0)           0;0  0.3595 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     135.0599 (2.71)     135.0599 (2.71)     135.0599 (2.71)     0.0000 (1.0)      135.0599 (2.71)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     165.0919 (3.31)     165.0919 (3.31)     165.0919 (3.31)     0.0000 (1.0)      165.0919 (3.31)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     145.1153 (2.91)     145.1153 (2.91)     145.1153 (2.91)     0.0000 (1.0)      145.1153 (2.91)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[3.60.1]      49.8798 (1.0)       49.8798 (1.0)       49.8798 (1.0)      0.0000 (1.0)       49.8798 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
test_get-get[main]        50.2069 (1.01)      50.2069 (1.01)      50.2069 (1.01)     0.0000 (1.0)       50.2069 (1.01)     0.0000 (1.0)           0;0  0.0199 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.7707 (2.75)     45.7707 (2.75)     45.7707 (2.75)     0.0000 (1.0)      45.7707 (2.75)     0.0000 (1.0)           0;0  0.0218 (0.36)          1           1
test_get_url-get-url[3.10.0]     48.9907 (2.94)     48.9907 (2.94)     48.9907 (2.94)     0.0000 (1.0)      48.9907 (2.94)     0.0000 (1.0)           0;0  0.0204 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.6719 (1.0)      16.6719 (1.0)      16.6719 (1.0)      0.0000 (1.0)      16.6719 (1.0)      0.0000 (1.0)           0;0  0.0600 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.7510 (1.00)     16.7510 (1.00)     16.7510 (1.00)     0.0000 (1.0)      16.7510 (1.00)     0.0000 (1.0)           0;0  0.0597 (1.00)          1           1
test_get_url-get-url[main]       16.8290 (1.01)     16.8290 (1.01)     16.8290 (1.01)     0.0000 (1.0)      16.8290 (1.01)     0.0000 (1.0)           0;0  0.0594 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.2910 (1.10)     146.5936 (1.0)      131.5664 (1.02)      2.4867 (1.0)      131.2535 (1.04)      2.4077 (1.0)          14;3  7.6007 (0.98)        100           1
test_help---help[3.10.0]     123.7616 (1.07)     150.4140 (1.03)     129.2283 (1.00)      4.8382 (1.95)     127.7575 (1.01)      4.1851 (1.74)         10;8  7.7382 (1.00)        100           1
test_help---help[3.53.2]     130.8724 (1.13)     151.3182 (1.03)     141.3292 (1.10)      4.4132 (1.77)     141.1848 (1.12)      4.9361 (2.05)         30;2  7.0757 (0.91)        100           1
test_help---help[3.60.1]     132.2318 (1.14)     154.5976 (1.05)     138.9179 (1.08)      5.0174 (2.02)     137.9707 (1.09)      5.8439 (2.43)         34;4  7.1985 (0.93)        100           1
test_help---help[main]       116.1181 (1.0)      173.4503 (1.18)     128.8433 (1.0)      10.3424 (4.16)     126.3779 (1.0)      10.3925 (4.32)         20;5  7.7614 (1.0)         100           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     224.0178 (2.84)     224.0178 (2.84)     224.0178 (2.84)     0.0000 (1.0)      224.0178 (2.84)     0.0000 (1.0)           0;0  0.0045 (0.35)          1           1
test_import-import[3.10.0]     259.3370 (3.29)     259.3370 (3.29)     259.3370 (3.29)     0.0000 (1.0)      259.3370 (3.29)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      79.7987 (1.01)      79.7987 (1.01)      79.7987 (1.01)     0.0000 (1.0)       79.7987 (1.01)     0.0000 (1.0)           0;0  0.0125 (0.99)          1           1
test_import-import[main]        78.9385 (1.0)       78.9385 (1.0)       78.9385 (1.0)      0.0000 (1.0)       78.9385 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     153.8878 (3.32)     153.8878 (3.32)     153.8878 (3.32)     0.0000 (1.0)      153.8878 (3.32)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     157.3092 (3.39)     157.3092 (3.39)     157.3092 (3.39)     0.0000 (1.0)      157.3092 (3.39)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_import_url-import-url[3.53.2]     115.2133 (2.48)     115.2133 (2.48)     115.2133 (2.48)     0.0000 (1.0)      115.2133 (2.48)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.3660 (1.0)       46.3660 (1.0)       46.3660 (1.0)      0.0000 (1.0)       46.3660 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_import_url-import-url[main]        48.1615 (1.04)      48.1615 (1.04)      48.1615 (1.04)     0.0000 (1.0)       48.1615 (1.04)     0.0000 (1.0)           0;0  0.0208 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     386.4946 (1.01)     406.5218 (1.0)      395.3705 (1.01)      3.6209 (1.0)      395.1238 (1.01)     4.6651 (1.03)         37;1  2.5293 (0.99)        100           1
test_init-init[3.10.0]     396.9890 (1.04)     434.3721 (1.07)     405.1631 (1.03)      5.0982 (1.41)     404.4977 (1.03)     5.4748 (1.21)         21;3  2.4681 (0.97)        100           1
test_init-init[3.53.2]     382.5676 (1.0)      416.3800 (1.02)     391.9683 (1.0)       4.4804 (1.24)     391.8406 (1.0)      4.8767 (1.07)         25;2  2.5512 (1.0)         100           1
test_init-init[3.60.1]     385.9431 (1.01)     418.3616 (1.03)     393.5473 (1.00)      4.7360 (1.31)     392.7215 (1.00)     4.5420 (1.0)          22;5  2.5410 (1.00)        100           1
test_init-init[main]       416.6913 (1.09)     604.1198 (1.49)     427.8780 (1.09)     21.1130 (5.83)     424.0814 (1.08)     6.0835 (1.34)          3;4  2.3371 (0.92)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     597.8273 (1.10)     597.8273 (1.10)     597.8273 (1.10)     0.0000 (1.0)      597.8273 (1.10)     0.0000 (1.0)           0;0  1.6727 (0.91)          1           1
test_list-list[3.10.0]     677.0977 (1.25)     677.0977 (1.25)     677.0977 (1.25)     0.0000 (1.0)      677.0977 (1.25)     0.0000 (1.0)           0;0  1.4769 (0.80)          1           1
test_list-list[3.53.2]     592.7495 (1.09)     592.7495 (1.09)     592.7495 (1.09)     0.0000 (1.0)      592.7495 (1.09)     0.0000 (1.0)           0;0  1.6871 (0.91)          1           1
test_list-list[3.60.1]     553.9101 (1.02)     553.9101 (1.02)     553.9101 (1.02)     0.0000 (1.0)      553.9101 (1.02)     0.0000 (1.0)           0;0  1.8053 (0.98)          1           1
test_list-list[main]       541.4506 (1.0)      541.4506 (1.0)      541.4506 (1.0)      0.0000 (1.0)      541.4506 (1.0)      0.0000 (1.0)           0;0  1.8469 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     442.0734 (1.09)     442.0734 (1.09)     442.0734 (1.09)     0.0000 (1.0)      442.0734 (1.09)     0.0000 (1.0)           0;0  2.2621 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     439.9403 (1.09)     439.9403 (1.09)     439.9403 (1.09)     0.0000 (1.0)      439.9403 (1.09)     0.0000 (1.0)           0;0  2.2730 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     417.3117 (1.03)     417.3117 (1.03)     417.3117 (1.03)     0.0000 (1.0)      417.3117 (1.03)     0.0000 (1.0)           0;0  2.3963 (0.97)          1           1
test_list-list-dvc-only[3.60.1]     416.5602 (1.03)     416.5602 (1.03)     416.5602 (1.03)     0.0000 (1.0)      416.5602 (1.03)     0.0000 (1.0)           0;0  2.4006 (0.97)          1           1
test_list-list-dvc-only[main]       404.5986 (1.0)      404.5986 (1.0)      404.5986 (1.0)      0.0000 (1.0)      404.5986 (1.0)      0.0000 (1.0)           0;0  2.4716 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8411 (1.00)     2.8411 (1.00)     2.8411 (1.00)     0.0000 (1.0)      2.8411 (1.00)     0.0000 (1.0)           0;0  0.3520 (1.00)          1           1
test_list-list-recursive[3.10.0]     2.8325 (1.0)      2.8325 (1.0)      2.8325 (1.0)      0.0000 (1.0)      2.8325 (1.0)      0.0000 (1.0)           0;0  0.3530 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.8414 (1.00)     2.8414 (1.00)     2.8414 (1.00)     0.0000 (1.0)      2.8414 (1.00)     0.0000 (1.0)           0;0  0.3519 (1.00)          1           1
test_list-list-recursive[3.60.1]     3.0016 (1.06)     3.0016 (1.06)     3.0016 (1.06)     0.0000 (1.0)      3.0016 (1.06)     0.0000 (1.0)           0;0  0.3332 (0.94)          1           1
test_list-list-recursive[main]       3.0052 (1.06)     3.0052 (1.06)     3.0052 (1.06)     0.0000 (1.0)      3.0052 (1.06)     0.0000 (1.0)           0;0  0.3328 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     443.5407 (1.09)     443.5407 (1.09)     443.5407 (1.09)     0.0000 (1.0)      443.5407 (1.09)     0.0000 (1.0)           0;0  2.2546 (0.92)          1           1
test_list-list-shallow[3.10.0]     451.4770 (1.11)     451.4770 (1.11)     451.4770 (1.11)     0.0000 (1.0)      451.4770 (1.11)     0.0000 (1.0)           0;0  2.2150 (0.90)          1           1
test_list-list-shallow[3.53.2]     407.7812 (1.0)      407.7812 (1.0)      407.7812 (1.0)      0.0000 (1.0)      407.7812 (1.0)      0.0000 (1.0)           0;0  2.4523 (1.0)           1           1
test_list-list-shallow[3.60.1]     420.5453 (1.03)     420.5453 (1.03)     420.5453 (1.03)     0.0000 (1.0)      420.5453 (1.03)     0.0000 (1.0)           0;0  2.3779 (0.97)          1           1
test_list-list-shallow[main]       407.8134 (1.00)     407.8134 (1.00)     407.8134 (1.00)     0.0000 (1.0)      407.8134 (1.00)     0.0000 (1.0)           0;0  2.4521 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     69.2262 (3.60)     69.2262 (3.60)     69.2262 (3.60)     0.0000 (1.0)      69.2262 (3.60)     0.0000 (1.0)           0;0  0.0144 (0.28)          1           1
test_partial_add-add[3.10.0]     68.4857 (3.56)     68.4857 (3.56)     68.4857 (3.56)     0.0000 (1.0)      68.4857 (3.56)     0.0000 (1.0)           0;0  0.0146 (0.28)          1           1
test_partial_add-add[3.53.2]     61.4777 (3.19)     61.4777 (3.19)     61.4777 (3.19)     0.0000 (1.0)      61.4777 (3.19)     0.0000 (1.0)           0;0  0.0163 (0.31)          1           1
test_partial_add-add[3.60.1]     19.2474 (1.0)      19.2474 (1.0)      19.2474 (1.0)      0.0000 (1.0)      19.2474 (1.0)      0.0000 (1.0)           0;0  0.0520 (1.0)           1           1
test_partial_add-add[main]       20.4450 (1.06)     20.4450 (1.06)     20.4450 (1.06)     0.0000 (1.0)      20.4450 (1.06)     0.0000 (1.0)           0;0  0.0489 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     58.1420 (7.61)     58.1420 (7.61)     58.1420 (7.61)     0.0000 (1.0)      58.1420 (7.61)     0.0000 (1.0)           0;0  0.0172 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     57.9315 (7.58)     57.9315 (7.58)     57.9315 (7.58)     0.0000 (1.0)      57.9315 (7.58)     0.0000 (1.0)           0;0  0.0173 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     51.9725 (6.80)     51.9725 (6.80)     51.9725 (6.80)     0.0000 (1.0)      51.9725 (6.80)     0.0000 (1.0)           0;0  0.0192 (0.15)          1           1
test_partial_add-add-partial[3.60.1]      7.6430 (1.0)       7.6430 (1.0)       7.6430 (1.0)      0.0000 (1.0)       7.6430 (1.0)      0.0000 (1.0)           0;0  0.1308 (1.0)           1           1
test_partial_add-add-partial[main]        7.9299 (1.04)      7.9299 (1.04)      7.9299 (1.04)     0.0000 (1.0)       7.9299 (1.04)     0.0000 (1.0)           0;0  0.1261 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.2844 (1.0)      4.2844 (1.0)      4.2844 (1.0)      0.0000 (1.0)      4.2844 (1.0)      0.0000 (1.0)           0;0  0.2334 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8114 (1.36)     5.8114 (1.36)     5.8114 (1.36)     0.0000 (1.0)      5.8114 (1.36)     0.0000 (1.0)           0;0  0.1721 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.5343 (1.53)     6.5343 (1.53)     6.5343 (1.53)     0.0000 (1.0)      6.5343 (1.53)     0.0000 (1.0)           0;0  0.1530 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5191 (1.52)     6.5191 (1.52)     6.5191 (1.52)     0.0000 (1.0)      6.5191 (1.52)     0.0000 (1.0)           0;0  0.1534 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.5557 (1.53)     6.5557 (1.53)     6.5557 (1.53)     0.0000 (1.0)      6.5557 (1.53)     0.0000 (1.0)           0;0  0.1525 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4041 (1.0)      2.4041 (1.0)      2.4041 (1.0)      0.0000 (1.0)      2.4041 (1.0)      0.0000 (1.0)           0;0  0.4160 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6018 (1.50)     3.6018 (1.50)     3.6018 (1.50)     0.0000 (1.0)      3.6018 (1.50)     0.0000 (1.0)           0;0  0.2776 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.6342 (1.51)     3.6342 (1.51)     3.6342 (1.51)     0.0000 (1.0)      3.6342 (1.51)     0.0000 (1.0)           0;0  0.2752 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.6668 (1.53)     3.6668 (1.53)     3.6668 (1.53)     0.0000 (1.0)      3.6668 (1.53)     0.0000 (1.0)           0;0  0.2727 (0.66)          1           1
test_partial_add-gc-noop[main]       3.6552 (1.52)     3.6552 (1.52)     3.6552 (1.52)     0.0000 (1.0)      3.6552 (1.52)     0.0000 (1.0)           0;0  0.2736 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.3424 (2.41)     45.3424 (2.41)     45.3424 (2.41)     0.0000 (1.0)      45.3424 (2.41)     0.0000 (1.0)           0;0  0.0221 (0.42)          1           1
test_partial_add-push[3.10.0]     40.3901 (2.15)     40.3901 (2.15)     40.3901 (2.15)     0.0000 (1.0)      40.3901 (2.15)     0.0000 (1.0)           0;0  0.0248 (0.47)          1           1
test_partial_add-push[3.53.2]     19.1500 (1.02)     19.1500 (1.02)     19.1500 (1.02)     0.0000 (1.0)      19.1500 (1.02)     0.0000 (1.0)           0;0  0.0522 (0.98)          1           1
test_partial_add-push[3.60.1]     18.8238 (1.0)      18.8238 (1.0)      18.8238 (1.0)      0.0000 (1.0)      18.8238 (1.0)      0.0000 (1.0)           0;0  0.0531 (1.0)           1           1
test_partial_add-push[main]       18.8812 (1.00)     18.8812 (1.00)     18.8812 (1.00)     0.0000 (1.0)      18.8812 (1.00)     0.0000 (1.0)           0;0  0.0530 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.4091 (1.14)     11.4091 (1.14)     11.4091 (1.14)     0.0000 (1.0)      11.4091 (1.14)     0.0000 (1.0)           0;0  0.0876 (0.88)          1           1
test_partial_add-push-partial[3.10.0]     10.4958 (1.05)     10.4958 (1.05)     10.4958 (1.05)     0.0000 (1.0)      10.4958 (1.05)     0.0000 (1.0)           0;0  0.0953 (0.95)          1           1
test_partial_add-push-partial[3.53.2]     10.1521 (1.02)     10.1521 (1.02)     10.1521 (1.02)     0.0000 (1.0)      10.1521 (1.02)     0.0000 (1.0)           0;0  0.0985 (0.98)          1           1
test_partial_add-push-partial[3.60.1]      9.9976 (1.00)      9.9976 (1.00)      9.9976 (1.00)     0.0000 (1.0)       9.9976 (1.00)     0.0000 (1.0)           0;0  0.1000 (1.00)          1           1
test_partial_add-push-partial[main]        9.9928 (1.0)       9.9928 (1.0)       9.9928 (1.0)      0.0000 (1.0)       9.9928 (1.0)      0.0000 (1.0)           0;0  0.1001 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.6192 (3.65)     85.6192 (3.65)     85.6192 (3.65)     0.0000 (1.0)      85.6192 (3.65)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     87.7013 (3.74)     87.7013 (3.74)     87.7013 (3.74)     0.0000 (1.0)      87.7013 (3.74)     0.0000 (1.0)           0;0  0.0114 (0.27)          1           1
test_partial_remove-add[3.53.2]     77.8405 (3.32)     77.8405 (3.32)     77.8405 (3.32)     0.0000 (1.0)      77.8405 (3.32)     0.0000 (1.0)           0;0  0.0128 (0.30)          1           1
test_partial_remove-add[3.60.1]     23.4301 (1.0)      23.4301 (1.0)      23.4301 (1.0)      0.0000 (1.0)      23.4301 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
test_partial_remove-add[main]       24.7633 (1.06)     24.7633 (1.06)     24.7633 (1.06)     0.0000 (1.0)      24.7633 (1.06)     0.0000 (1.0)           0;0  0.0404 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.3886 (7.65)     8.3886 (7.65)     8.3886 (7.65)     0.0000 (1.0)      8.3886 (7.65)     0.0000 (1.0)           0;0  0.1192 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.8206 (8.05)     8.8206 (8.05)     8.8206 (8.05)     0.0000 (1.0)      8.8206 (8.05)     0.0000 (1.0)           0;0  0.1134 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.7511 (7.07)     7.7511 (7.07)     7.7511 (7.07)     0.0000 (1.0)      7.7511 (7.07)     0.0000 (1.0)           0;0  0.1290 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0962 (1.0)      1.0962 (1.0)      1.0962 (1.0)      0.0000 (1.0)      1.0962 (1.0)      0.0000 (1.0)           0;0  0.9122 (1.0)           1           1
test_partial_remove-add-update[main]       1.1447 (1.04)     1.1447 (1.04)     1.1447 (1.04)     0.0000 (1.0)      1.1447 (1.04)     0.0000 (1.0)           0;0  0.8736 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3794 (1.0)      3.3794 (1.0)      3.3794 (1.0)      0.0000 (1.0)      3.3794 (1.0)      0.0000 (1.0)           0;0  0.2959 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.8751 (1.15)     3.8751 (1.15)     3.8751 (1.15)     0.0000 (1.0)      3.8751 (1.15)     0.0000 (1.0)           0;0  0.2581 (0.87)          1           1
test_partial_remove-gc[3.53.2]     3.5776 (1.06)     3.5776 (1.06)     3.5776 (1.06)     0.0000 (1.0)      3.5776 (1.06)     0.0000 (1.0)           0;0  0.2795 (0.94)          1           1
test_partial_remove-gc[3.60.1]     3.6988 (1.09)     3.6988 (1.09)     3.6988 (1.09)     0.0000 (1.0)      3.6988 (1.09)     0.0000 (1.0)           0;0  0.2704 (0.91)          1           1
test_partial_remove-gc[main]       3.6691 (1.09)     3.6691 (1.09)     3.6691 (1.09)     0.0000 (1.0)      3.6691 (1.09)     0.0000 (1.0)           0;0  0.2725 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.0283 (1.03)     5.0283 (1.03)     5.0283 (1.03)     0.0000 (1.0)      5.0283 (1.03)     0.0000 (1.0)           0;0  0.1989 (0.97)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.5040 (1.13)     5.5040 (1.13)     5.5040 (1.13)     0.0000 (1.0)      5.5040 (1.13)     0.0000 (1.0)           0;0  0.1817 (0.89)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0925 (1.05)     5.0925 (1.05)     5.0925 (1.05)     0.0000 (1.0)      5.0925 (1.05)     0.0000 (1.0)           0;0  0.1964 (0.96)          1           1
test_partial_remove-gc-cloud[3.60.1]     5.0835 (1.04)     5.0835 (1.04)     5.0835 (1.04)     0.0000 (1.0)      5.0835 (1.04)     0.0000 (1.0)           0;0  0.1967 (0.96)          1           1
test_partial_remove-gc-cloud[main]       4.8731 (1.0)      4.8731 (1.0)      4.8731 (1.0)      0.0000 (1.0)      4.8731 (1.0)      0.0000 (1.0)           0;0  0.2052 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.4087 (2.36)     53.4087 (2.36)     53.4087 (2.36)     0.0000 (1.0)      53.4087 (2.36)     0.0000 (1.0)           0;0  0.0187 (0.42)          1           1
test_partial_remove-push[3.10.0]     47.8440 (2.12)     47.8440 (2.12)     47.8440 (2.12)     0.0000 (1.0)      47.8440 (2.12)     0.0000 (1.0)           0;0  0.0209 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.2669 (1.03)     23.2669 (1.03)     23.2669 (1.03)     0.0000 (1.0)      23.2669 (1.03)     0.0000 (1.0)           0;0  0.0430 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.6484 (1.00)     22.6484 (1.00)     22.6484 (1.00)     0.0000 (1.0)      22.6484 (1.00)     0.0000 (1.0)           0;0  0.0442 (1.00)          1           1
test_partial_remove-push[main]       22.6048 (1.0)      22.6048 (1.0)      22.6048 (1.0)      0.0000 (1.0)      22.6048 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8679 (1.0)      1.8679 (1.0)      1.8679 (1.0)      0.0000 (1.0)      1.8679 (1.0)      0.0000 (1.0)           0;0  0.5354 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8695 (1.00)     1.8695 (1.00)     1.8695 (1.00)     0.0000 (1.0)      1.8695 (1.00)     0.0000 (1.0)           0;0  0.5349 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.5094 (1.34)     2.5094 (1.34)     2.5094 (1.34)     0.0000 (1.0)      2.5094 (1.34)     0.0000 (1.0)           0;0  0.3985 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.7005 (1.45)     2.7005 (1.45)     2.7005 (1.45)     0.0000 (1.0)      2.7005 (1.45)     0.0000 (1.0)           0;0  0.3703 (0.69)          1           1
test_partial_remove-push-update[main]       2.6946 (1.44)     2.6946 (1.44)     2.6946 (1.44)     0.0000 (1.0)      2.6946 (1.44)     0.0000 (1.0)           0;0  0.3711 (0.69)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]       566.0291 (1.0)        574.8738 (1.0)        570.5582 (1.0)       4.2417 (1.0)        572.1368 (1.0)       7.9629 (1.13)          3;0  1.7527 (1.0)           5           3
test_plots-plots-diff[3.10.0]     1,001.2914 (1.77)     1,046.9829 (1.82)     1,019.6685 (1.79)     20.6089 (4.86)     1,006.8621 (1.76)     33.7631 (4.79)          1;0  0.9807 (0.56)          5           3
test_plots-plots-diff[3.53.2]       924.7679 (1.63)       937.6162 (1.63)       932.5189 (1.63)      5.1102 (1.20)       934.8124 (1.63)      7.0464 (1.0)           1;0  1.0724 (0.61)          5           3
test_plots-plots-diff[3.60.1]       909.4616 (1.61)       955.3433 (1.66)       935.8662 (1.64)     19.8800 (4.69)       935.8794 (1.64)     34.7177 (4.93)          1;0  1.0685 (0.61)          5           3
test_plots-plots-diff[main]         865.6662 (1.53)       911.3369 (1.59)       887.4079 (1.56)     17.4665 (4.12)       883.2354 (1.54)     24.6496 (3.50)          2;0  1.1269 (0.64)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       588.3841 (1.0)        600.7324 (1.0)        594.9344 (1.0)       5.4377 (1.0)        593.9420 (1.0)       9.7316 (1.34)          2;0  1.6809 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,242.1687 (2.11)     1,263.8601 (2.10)     1,253.2146 (2.11)      7.7234 (1.42)     1,252.9912 (2.11)      7.2676 (1.0)           2;0  0.7979 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]       991.1475 (1.68)     1,025.7467 (1.71)     1,007.8227 (1.69)     15.2164 (2.80)     1,000.8341 (1.69)     25.8019 (3.55)          2;0  0.9922 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       989.0588 (1.68)     1,007.7273 (1.68)       999.1849 (1.68)      7.2946 (1.34)       997.8256 (1.68)     10.5877 (1.46)          2;0  1.0008 (0.60)          5           3
test_plots-plots-diff-json[main]       1,008.1098 (1.71)     1,032.0015 (1.72)     1,021.2875 (1.72)      9.4680 (1.74)     1,021.1957 (1.72)     14.6455 (2.02)          2;0  0.9792 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     475.9407 (1.0)      490.4792 (1.0)      481.3129 (1.0)       5.5762 (1.41)     479.4824 (1.0)       6.2790 (2.07)          1;0  2.0777 (1.0)           5           3
test_plots-plots-show[3.10.0]     823.8492 (1.73)     849.8267 (1.73)     842.1482 (1.75)     10.7903 (2.72)     847.7519 (1.77)     12.0993 (3.99)          1;0  1.1874 (0.57)          5           3
test_plots-plots-show[3.53.2]     778.4510 (1.64)     808.0649 (1.65)     792.3691 (1.65)     11.1116 (2.80)     791.3852 (1.65)     15.0900 (4.97)          2;0  1.2620 (0.61)          5           3
test_plots-plots-show[3.60.1]     798.1374 (1.68)     810.8207 (1.65)     804.6418 (1.67)      5.3575 (1.35)     805.1785 (1.68)      9.3567 (3.08)          2;0  1.2428 (0.60)          5           3
test_plots-plots-show[main]       769.1941 (1.62)     779.9816 (1.59)     773.4084 (1.61)      3.9670 (1.0)      772.4875 (1.61)      3.0345 (1.0)           2;1  1.2930 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     496.2460 (1.0)      526.2620 (1.0)      508.1294 (1.0)      11.2280 (3.03)     506.5187 (1.0)      12.3543 (2.15)          2;0  1.9680 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     954.1771 (1.92)     989.3816 (1.88)     976.3319 (1.92)     14.4588 (3.90)     975.2757 (1.93)     20.5340 (3.58)          1;0  1.0242 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     805.2803 (1.62)     842.9240 (1.60)     816.6074 (1.61)     15.2902 (4.12)     809.2891 (1.60)     15.3462 (2.68)          1;0  1.2246 (0.62)          5           3
test_plots-plots-show-json[3.60.1]     860.9215 (1.73)     870.2972 (1.65)     865.1813 (1.70)      3.7085 (1.0)      865.2873 (1.71)      5.7348 (1.0)           2;0  1.1558 (0.59)          5           3
test_plots-plots-show-json[main]       803.8427 (1.62)     826.4085 (1.57)     814.9492 (1.60)      8.7888 (2.37)     815.7548 (1.61)     13.3618 (2.33)          2;0  1.2271 (0.62)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     54.0295 (2.49)     54.0295 (2.49)     54.0295 (2.49)     0.0000 (1.0)      54.0295 (2.49)     0.0000 (1.0)           0;0  0.0185 (0.40)          1           1
test_push-push[3.10.0]     47.7778 (2.20)     47.7778 (2.20)     47.7778 (2.20)     0.0000 (1.0)      47.7778 (2.20)     0.0000 (1.0)           0;0  0.0209 (0.45)          1           1
test_push-push[3.53.2]     22.6694 (1.05)     22.6694 (1.05)     22.6694 (1.05)     0.0000 (1.0)      22.6694 (1.05)     0.0000 (1.0)           0;0  0.0441 (0.96)          1           1
test_push-push[3.60.1]     21.8644 (1.01)     21.8644 (1.01)     21.8644 (1.01)     0.0000 (1.0)      21.8644 (1.01)     0.0000 (1.0)           0;0  0.0457 (0.99)          1           1
test_push-push[main]       21.6772 (1.0)      21.6772 (1.0)      21.6772 (1.0)      0.0000 (1.0)      21.6772 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.6138 (2.77)     64.6138 (2.77)     64.6138 (2.77)     0.0000 (1.0)      64.6138 (2.77)     0.0000 (1.0)           0;0  0.0155 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.5594 (2.98)     69.5594 (2.98)     69.5594 (2.98)     0.0000 (1.0)      69.5594 (2.98)     0.0000 (1.0)           0;0  0.0144 (0.34)          1           1
test_sharing-fetch[3.53.2]     34.0170 (1.46)     34.0170 (1.46)     34.0170 (1.46)     0.0000 (1.0)      34.0170 (1.46)     0.0000 (1.0)           0;0  0.0294 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.5091 (1.01)     23.5091 (1.01)     23.5091 (1.01)     0.0000 (1.0)      23.5091 (1.01)     0.0000 (1.0)           0;0  0.0425 (0.99)          1           1
test_sharing-fetch[main]       23.3362 (1.0)      23.3362 (1.0)      23.3362 (1.0)      0.0000 (1.0)      23.3362 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2585 (1.0)      1.2585 (1.0)      1.2585 (1.0)      0.0000 (1.0)      1.2585 (1.0)      0.0000 (1.0)           0;0  0.7946 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5607 (2.83)     3.5607 (2.83)     3.5607 (2.83)     0.0000 (1.0)      3.5607 (2.83)     0.0000 (1.0)           0;0  0.2808 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.6997 (4.53)     5.6997 (4.53)     5.6997 (4.53)     0.0000 (1.0)      5.6997 (4.53)     0.0000 (1.0)           0;0  0.1754 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8697 (4.66)     5.8697 (4.66)     5.8697 (4.66)     0.0000 (1.0)      5.8697 (4.66)     0.0000 (1.0)           0;0  0.1704 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8982 (4.69)     5.8982 (4.69)     5.8982 (4.69)     0.0000 (1.0)      5.8982 (4.69)     0.0000 (1.0)           0;0  0.1695 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.3896 (2.35)     52.3896 (2.35)     52.3896 (2.35)     0.0000 (1.0)      52.3896 (2.35)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_sharing-push[3.10.0]     46.9960 (2.11)     46.9960 (2.11)     46.9960 (2.11)     0.0000 (1.0)      46.9960 (2.11)     0.0000 (1.0)           0;0  0.0213 (0.47)          1           1
test_sharing-push[3.53.2]     23.2453 (1.04)     23.2453 (1.04)     23.2453 (1.04)     0.0000 (1.0)      23.2453 (1.04)     0.0000 (1.0)           0;0  0.0430 (0.96)          1           1
test_sharing-push[3.60.1]     22.6370 (1.01)     22.6370 (1.01)     22.6370 (1.01)     0.0000 (1.0)      22.6370 (1.01)     0.0000 (1.0)           0;0  0.0442 (0.99)          1           1
test_sharing-push[main]       22.3205 (1.0)      22.3205 (1.0)      22.3205 (1.0)      0.0000 (1.0)      22.3205 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0972 (1.00)     2.0972 (1.00)     2.0972 (1.00)     0.0000 (1.0)      2.0972 (1.00)     0.0000 (1.0)           0;0  0.4768 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.0875 (1.0)      2.0875 (1.0)      2.0875 (1.0)      0.0000 (1.0)      2.0875 (1.0)      0.0000 (1.0)           0;0  0.4790 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9854 (2.87)     5.9854 (2.87)     5.9854 (2.87)     0.0000 (1.0)      5.9854 (2.87)     0.0000 (1.0)           0;0  0.1671 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.0840 (2.91)     6.0840 (2.91)     6.0840 (2.91)     0.0000 (1.0)      6.0840 (2.91)     0.0000 (1.0)           0;0  0.1644 (0.34)          1           1
test_sharing-push-noop[main]       5.9587 (2.85)     5.9587 (2.85)     5.9587 (2.85)     0.0000 (1.0)      5.9587 (2.85)     0.0000 (1.0)           0;0  0.1678 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     349.0043 (1.04)     349.0043 (1.04)     349.0043 (1.04)     0.0000 (1.0)      349.0043 (1.04)     0.0000 (1.0)           0;0  0.0029 (0.97)          1           1
test_sharing_azure-fetch[main]       337.1673 (1.0)      337.1673 (1.0)      337.1673 (1.0)      0.0000 (1.0)      337.1673 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4140 (1.0)      6.4140 (1.0)      6.4140 (1.0)      0.0000 (1.0)      6.4140 (1.0)      0.0000 (1.0)           0;0  0.1559 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5592 (1.02)     6.5592 (1.02)     6.5592 (1.02)     0.0000 (1.0)      6.5592 (1.02)     0.0000 (1.0)           0;0  0.1525 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     346.1088 (1.00)     346.1088 (1.00)     346.1088 (1.00)     0.0000 (1.0)      346.1088 (1.00)     0.0000 (1.0)           0;0  0.0029 (1.00)          1           1
test_sharing_azure-push[main]       345.5239 (1.0)      345.5239 (1.0)      345.5239 (1.0)      0.0000 (1.0)      345.5239 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.4387 (1.0)      7.4387 (1.0)      7.4387 (1.0)      0.0000 (1.0)      7.4387 (1.0)      0.0000 (1.0)           0;0  0.1344 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.5511 (1.02)     7.5511 (1.02)     7.5511 (1.02)     0.0000 (1.0)      7.5511 (1.02)     0.0000 (1.0)           0;0  0.1324 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     379.2835 (1.02)     379.2835 (1.02)     379.2835 (1.02)     0.0000 (1.0)      379.2835 (1.02)     0.0000 (1.0)           0;0  0.0026 (0.98)          1           1
test_sharing_gs-fetch[main]       372.0831 (1.0)      372.0831 (1.0)      372.0831 (1.0)      0.0000 (1.0)      372.0831 (1.0)      0.0000 (1.0)           0;0  0.0027 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     22.5748 (1.05)     22.5748 (1.05)     22.5748 (1.05)     0.0000 (1.0)      22.5748 (1.05)     0.0000 (1.0)           0;0  0.0443 (0.96)          1           1
test_sharing_gs-fetch-noop[main]       21.5737 (1.0)      21.5737 (1.0)      21.5737 (1.0)      0.0000 (1.0)      21.5737 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     860.7978 (1.0)      860.7978 (1.0)      860.7978 (1.0)      0.0000 (1.0)      860.7978 (1.0)      0.0000 (1.0)           0;0  0.0012 (1.0)           1           1
test_sharing_gs-push[main]       894.7274 (1.04)     894.7274 (1.04)     894.7274 (1.04)     0.0000 (1.0)      894.7274 (1.04)     0.0000 (1.0)           0;0  0.0011 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8696 (1.0)      6.8696 (1.0)      6.8696 (1.0)      0.0000 (1.0)      6.8696 (1.0)      0.0000 (1.0)           0;0  0.1456 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.1997 (1.05)     7.1997 (1.05)     7.1997 (1.05)     0.0000 (1.0)      7.1997 (1.05)     0.0000 (1.0)           0;0  0.1389 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     398.8461 (1.01)     398.8461 (1.01)     398.8461 (1.01)     0.0000 (1.0)      398.8461 (1.01)     0.0000 (1.0)           0;0  0.0025 (0.99)          1           1
test_sharing_s3-fetch[main]       396.7880 (1.0)      396.7880 (1.0)      396.7880 (1.0)      0.0000 (1.0)      396.7880 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2361 (1.0)      6.2361 (1.0)      6.2361 (1.0)      0.0000 (1.0)      6.2361 (1.0)      0.0000 (1.0)           0;0  0.1604 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3032 (1.01)     6.3032 (1.01)     6.3032 (1.01)     0.0000 (1.0)      6.3032 (1.01)     0.0000 (1.0)           0;0  0.1587 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     490.5560 (1.0)      490.5560 (1.0)      490.5560 (1.0)      0.0000 (1.0)      490.5560 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
test_sharing_s3-push[main]       499.6962 (1.02)     499.6962 (1.02)     499.6962 (1.02)     0.0000 (1.0)      499.6962 (1.02)     0.0000 (1.0)           0;0  0.0020 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.4734 (1.0)      6.4734 (1.0)      6.4734 (1.0)      0.0000 (1.0)      6.4734 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.6743 (1.03)     6.6743 (1.03)     6.6743 (1.03)     0.0000 (1.0)      6.6743 (1.03)     0.0000 (1.0)           0;0  0.1498 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.4235 (3.74)     19.4235 (3.74)     19.4235 (3.74)     0.0000 (1.0)      19.4235 (3.74)     0.0000 (1.0)           0;0  0.0515 (0.27)          1           1
test_status-status[3.10.0]     19.4858 (3.75)     19.4858 (3.75)     19.4858 (3.75)     0.0000 (1.0)      19.4858 (3.75)     0.0000 (1.0)           0;0  0.0513 (0.27)          1           1
test_status-status[3.53.2]     17.8261 (3.43)     17.8261 (3.43)     17.8261 (3.43)     0.0000 (1.0)      17.8261 (3.43)     0.0000 (1.0)           0;0  0.0561 (0.29)          1           1
test_status-status[3.60.1]      5.1963 (1.0)       5.1963 (1.0)       5.1963 (1.0)      0.0000 (1.0)       5.1963 (1.0)      0.0000 (1.0)           0;0  0.1924 (1.0)           1           1
test_status-status[main]        5.3364 (1.03)      5.3364 (1.03)      5.3364 (1.03)     0.0000 (1.0)       5.3364 (1.03)     0.0000 (1.0)           0;0  0.1874 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7725 (1.78)     4.7725 (1.78)     4.7725 (1.78)     0.0000 (1.0)      4.7725 (1.78)     0.0000 (1.0)           0;0  0.2095 (0.56)          1           1
test_status-status-changed[3.10.0]     4.9795 (1.86)     4.9795 (1.86)     4.9795 (1.86)     0.0000 (1.0)      4.9795 (1.86)     0.0000 (1.0)           0;0  0.2008 (0.54)          1           1
test_status-status-changed[3.53.2]     4.8499 (1.81)     4.8499 (1.81)     4.8499 (1.81)     0.0000 (1.0)      4.8499 (1.81)     0.0000 (1.0)           0;0  0.2062 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6840 (1.0)      2.6840 (1.0)      2.6840 (1.0)      0.0000 (1.0)      2.6840 (1.0)      0.0000 (1.0)           0;0  0.3726 (1.0)           1           1
test_status-status-changed[main]       2.9844 (1.11)     2.9844 (1.11)     2.9844 (1.11)     0.0000 (1.0)      2.9844 (1.11)     0.0000 (1.0)           0;0  0.3351 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7539 (1.81)     4.7539 (1.81)     4.7539 (1.81)     0.0000 (1.0)      4.7539 (1.81)     0.0000 (1.0)           0;0  0.2104 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.9178 (1.88)     4.9178 (1.88)     4.9178 (1.88)     0.0000 (1.0)      4.9178 (1.88)     0.0000 (1.0)           0;0  0.2033 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.8070 (1.83)     4.8070 (1.83)     4.8070 (1.83)     0.0000 (1.0)      4.8070 (1.83)     0.0000 (1.0)           0;0  0.2080 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.6200 (1.0)      2.6200 (1.0)      2.6200 (1.0)      0.0000 (1.0)      2.6200 (1.0)      0.0000 (1.0)           0;0  0.3817 (1.0)           1           1
test_status-status-changed-noop[main]       2.8388 (1.08)     2.8388 (1.08)     2.8388 (1.08)     0.0000 (1.0)      2.8388 (1.08)     0.0000 (1.0)           0;0  0.3523 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8667 (1.86)     4.8667 (1.86)     4.8667 (1.86)     0.0000 (1.0)      4.8667 (1.86)     0.0000 (1.0)           0;0  0.2055 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9929 (1.91)     4.9929 (1.91)     4.9929 (1.91)     0.0000 (1.0)      4.9929 (1.91)     0.0000 (1.0)           0;0  0.2003 (0.52)          1           1
test_status-status-noop[3.53.2]     4.8815 (1.86)     4.8815 (1.86)     4.8815 (1.86)     0.0000 (1.0)      4.8815 (1.86)     0.0000 (1.0)           0;0  0.2049 (0.54)          1           1
test_status-status-noop[3.60.1]     2.6194 (1.0)      2.6194 (1.0)      2.6194 (1.0)      0.0000 (1.0)      2.6194 (1.0)      0.0000 (1.0)           0;0  0.3818 (1.0)           1           1
test_status-status-noop[main]       2.8301 (1.08)     2.8301 (1.08)     2.8301 (1.08)     0.0000 (1.0)      2.8301 (1.08)     0.0000 (1.0)           0;0  0.3533 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     152.6382 (3.30)     152.6382 (3.30)     152.6382 (3.30)     0.0000 (1.0)      152.6382 (3.30)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_update-import-url[3.10.0]     156.2359 (3.38)     156.2359 (3.38)     156.2359 (3.38)     0.0000 (1.0)      156.2359 (3.38)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.53.2]     114.3784 (2.48)     114.3784 (2.48)     114.3784 (2.48)     0.0000 (1.0)      114.3784 (2.48)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_update-import-url[3.60.1]      46.1843 (1.0)       46.1843 (1.0)       46.1843 (1.0)      0.0000 (1.0)       46.1843 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_update-import-url[main]        47.4360 (1.03)      47.4360 (1.03)      47.4360 (1.03)     0.0000 (1.0)       47.4360 (1.03)     0.0000 (1.0)           0;0  0.0211 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     137.3547 (3.88)     137.3547 (3.88)     137.3547 (3.88)     0.0000 (1.0)      137.3547 (3.88)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     141.6066 (4.00)     141.6066 (4.00)     141.6066 (4.00)     0.0000 (1.0)      141.6066 (4.00)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.53.2]     106.3523 (3.00)     106.3523 (3.00)     106.3523 (3.00)     0.0000 (1.0)      106.3523 (3.00)     0.0000 (1.0)           0;0  0.0094 (0.33)          1           1
test_update-update[3.60.1]      35.4000 (1.0)       35.4000 (1.0)       35.4000 (1.0)      0.0000 (1.0)       35.4000 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.4557 (1.03)      36.4557 (1.03)      36.4557 (1.03)     0.0000 (1.0)       36.4557 (1.03)     0.0000 (1.0)           0;0  0.0274 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.7322 (2.06)     15.7322 (2.06)     15.7322 (2.06)     0.0000 (1.0)      15.7322 (2.06)     0.0000 (1.0)           0;0  0.0636 (0.49)          1           1
test_update-update-noop[3.10.0]     16.7612 (2.20)     16.7612 (2.20)     16.7612 (2.20)     0.0000 (1.0)      16.7612 (2.20)     0.0000 (1.0)           0;0  0.0597 (0.46)          1           1
test_update-update-noop[3.53.2]     16.0529 (2.10)     16.0529 (2.10)     16.0529 (2.10)     0.0000 (1.0)      16.0529 (2.10)     0.0000 (1.0)           0;0  0.0623 (0.48)          1           1
test_update-update-noop[3.60.1]      7.6358 (1.0)       7.6358 (1.0)       7.6358 (1.0)      0.0000 (1.0)       7.6358 (1.0)      0.0000 (1.0)           0;0  0.1310 (1.0)           1           1
test_update-update-noop[main]        8.3976 (1.10)      8.3976 (1.10)      8.3976 (1.10)     0.0000 (1.0)       8.3976 (1.10)     0.0000 (1.0)           0;0  0.1191 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean