Sat Oct  4 00:45:49 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.7337 (3.74)     85.7337 (3.74)     85.7337 (3.74)     0.0000 (1.0)      85.7337 (3.74)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_add_copy-add[3.10.0]     87.7518 (3.83)     87.7518 (3.83)     87.7518 (3.83)     0.0000 (1.0)      87.7518 (3.83)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_add_copy-add[3.53.2]     77.7987 (3.40)     77.7987 (3.40)     77.7987 (3.40)     0.0000 (1.0)      77.7987 (3.40)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_add_copy-add[3.60.1]     22.8961 (1.0)      22.8961 (1.0)      22.8961 (1.0)      0.0000 (1.0)      22.8961 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
test_add_copy-add[main]       23.5902 (1.03)     23.5902 (1.03)     23.5902 (1.03)     0.0000 (1.0)      23.5902 (1.03)     0.0000 (1.0)           0;0  0.0424 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.6119 (6.35)     29.6119 (6.35)     29.6119 (6.35)     0.0000 (1.0)      29.6119 (6.35)     0.0000 (1.0)           0;0  0.0338 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     30.1796 (6.47)     30.1796 (6.47)     30.1796 (6.47)     0.0000 (1.0)      30.1796 (6.47)     0.0000 (1.0)           0;0  0.0331 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.7049 (6.16)     28.7049 (6.16)     28.7049 (6.16)     0.0000 (1.0)      28.7049 (6.16)     0.0000 (1.0)           0;0  0.0348 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.6633 (1.0)       4.6633 (1.0)       4.6633 (1.0)      0.0000 (1.0)       4.6633 (1.0)      0.0000 (1.0)           0;0  0.2144 (1.0)           1           1
test_add_copy-add-noop[main]        4.8290 (1.04)      4.8290 (1.04)      4.8290 (1.04)     0.0000 (1.0)       4.8290 (1.04)     0.0000 (1.0)           0;0  0.2071 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     47.1440 (3.99)     47.1440 (3.99)     47.1440 (3.99)     0.0000 (1.0)      47.1440 (3.99)     0.0000 (1.0)           0;0  0.0212 (0.25)          1           1
test_add_hardlink-add[3.10.0]     47.7716 (4.04)     47.7716 (4.04)     47.7716 (4.04)     0.0000 (1.0)      47.7716 (4.04)     0.0000 (1.0)           0;0  0.0209 (0.25)          1           1
test_add_hardlink-add[3.53.2]     43.6152 (3.69)     43.6152 (3.69)     43.6152 (3.69)     0.0000 (1.0)      43.6152 (3.69)     0.0000 (1.0)           0;0  0.0229 (0.27)          1           1
test_add_hardlink-add[3.60.1]     11.8125 (1.0)      11.8125 (1.0)      11.8125 (1.0)      0.0000 (1.0)      11.8125 (1.0)      0.0000 (1.0)           0;0  0.0847 (1.0)           1           1
test_add_hardlink-add[main]       13.0732 (1.11)     13.0732 (1.11)     13.0732 (1.11)     0.0000 (1.0)      13.0732 (1.11)     0.0000 (1.0)           0;0  0.0765 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     25.0589 (6.19)     25.0589 (6.19)     25.0589 (6.19)     0.0000 (1.0)      25.0589 (6.19)     0.0000 (1.0)           0;0  0.0399 (0.16)          1           1
test_add_hardlink-add-noop[3.10.0]     25.0882 (6.20)     25.0882 (6.20)     25.0882 (6.20)     0.0000 (1.0)      25.0882 (6.20)     0.0000 (1.0)           0;0  0.0399 (0.16)          1           1
test_add_hardlink-add-noop[3.53.2]     24.0655 (5.95)     24.0655 (5.95)     24.0655 (5.95)     0.0000 (1.0)      24.0655 (5.95)     0.0000 (1.0)           0;0  0.0416 (0.17)          1           1
test_add_hardlink-add-noop[3.60.1]      4.0471 (1.0)       4.0471 (1.0)       4.0471 (1.0)      0.0000 (1.0)       4.0471 (1.0)      0.0000 (1.0)           0;0  0.2471 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4920 (1.11)      4.4920 (1.11)      4.4920 (1.11)     0.0000 (1.0)       4.4920 (1.11)     0.0000 (1.0)           0;0  0.2226 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     78.4116 (2.03)     78.4116 (2.03)     78.4116 (2.03)     0.0000 (1.0)      78.4116 (2.03)     0.0000 (1.0)           0;0  0.0128 (0.49)          1           1
test_add_symlink-add[3.10.0]     78.9738 (2.05)     78.9738 (2.05)     78.9738 (2.05)     0.0000 (1.0)      78.9738 (2.05)     0.0000 (1.0)           0;0  0.0127 (0.49)          1           1
test_add_symlink-add[3.53.2]     73.2746 (1.90)     73.2746 (1.90)     73.2746 (1.90)     0.0000 (1.0)      73.2746 (1.90)     0.0000 (1.0)           0;0  0.0136 (0.53)          1           1
test_add_symlink-add[3.60.1]     38.5351 (1.0)      38.5351 (1.0)      38.5351 (1.0)      0.0000 (1.0)      38.5351 (1.0)      0.0000 (1.0)           0;0  0.0260 (1.0)           1           1
test_add_symlink-add[main]       40.0001 (1.04)     40.0001 (1.04)     40.0001 (1.04)     0.0000 (1.0)      40.0001 (1.04)     0.0000 (1.0)           0;0  0.0250 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     52.6420 (7.91)     52.6420 (7.91)     52.6420 (7.91)     0.0000 (1.0)      52.6420 (7.91)     0.0000 (1.0)           0;0  0.0190 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     51.8592 (7.79)     51.8592 (7.79)     51.8592 (7.79)     0.0000 (1.0)      51.8592 (7.79)     0.0000 (1.0)           0;0  0.0193 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     50.5355 (7.59)     50.5355 (7.59)     50.5355 (7.59)     0.0000 (1.0)      50.5355 (7.59)     0.0000 (1.0)           0;0  0.0198 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      6.6564 (1.0)       6.6564 (1.0)       6.6564 (1.0)      0.0000 (1.0)       6.6564 (1.0)      0.0000 (1.0)           0;0  0.1502 (1.0)           1           1
test_add_symlink-add-noop[main]        7.1354 (1.07)      7.1354 (1.07)      7.1354 (1.07)     0.0000 (1.0)       7.1354 (1.07)     0.0000 (1.0)           0;0  0.1401 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.9928 (1.99)     40.9928 (1.99)     40.9928 (1.99)     0.0000 (1.0)      40.9928 (1.99)     0.0000 (1.0)           0;0  0.0244 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     59.8831 (2.90)     59.8831 (2.90)     59.8831 (2.90)     0.0000 (1.0)      59.8831 (2.90)     0.0000 (1.0)           0;0  0.0167 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     28.2182 (1.37)     28.2182 (1.37)     28.2182 (1.37)     0.0000 (1.0)      28.2182 (1.37)     0.0000 (1.0)           0;0  0.0354 (0.73)          1           1
test_checkout_copy-checkout[3.60.1]     20.6285 (1.0)      20.6285 (1.0)      20.6285 (1.0)      0.0000 (1.0)      20.6285 (1.0)      0.0000 (1.0)           0;0  0.0485 (1.0)           1           1
test_checkout_copy-checkout[main]       21.7723 (1.06)     21.7723 (1.06)     21.7723 (1.06)     0.0000 (1.0)      21.7723 (1.06)     0.0000 (1.0)           0;0  0.0459 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4394 (1.66)     5.4394 (1.66)     5.4394 (1.66)     0.0000 (1.0)      5.4394 (1.66)     0.0000 (1.0)           0;0  0.1838 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6661 (1.73)     5.6661 (1.73)     5.6661 (1.73)     0.0000 (1.0)      5.6661 (1.73)     0.0000 (1.0)           0;0  0.1765 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4498 (1.66)     5.4498 (1.66)     5.4498 (1.66)     0.0000 (1.0)      5.4498 (1.66)     0.0000 (1.0)           0;0  0.1835 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2749 (1.0)      3.2749 (1.0)      3.2749 (1.0)      0.0000 (1.0)      3.2749 (1.0)      0.0000 (1.0)           0;0  0.3054 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5822 (1.09)     3.5822 (1.09)     3.5822 (1.09)     0.0000 (1.0)      3.5822 (1.09)     0.0000 (1.0)           0;0  0.2792 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6253 (2.17)     8.6253 (2.17)     8.6253 (2.17)     0.0000 (1.0)      8.6253 (2.17)     0.0000 (1.0)           0;0  0.1159 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.2732 (1.58)     6.2732 (1.58)     6.2732 (1.58)     0.0000 (1.0)      6.2732 (1.58)     0.0000 (1.0)           0;0  0.1594 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2487 (1.57)     6.2487 (1.57)     6.2487 (1.57)     0.0000 (1.0)      6.2487 (1.57)     0.0000 (1.0)           0;0  0.1600 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9786 (1.0)      3.9786 (1.0)      3.9786 (1.0)      0.0000 (1.0)      3.9786 (1.0)      0.0000 (1.0)           0;0  0.2513 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4542 (1.12)     4.4542 (1.12)     4.4542 (1.12)     0.0000 (1.0)      4.4542 (1.12)     0.0000 (1.0)           0;0  0.2245 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.3697 (3.10)     22.3697 (3.10)     22.3697 (3.10)     0.0000 (1.0)      22.3697 (3.10)     0.0000 (1.0)           0;0  0.0447 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.3928 (2.27)     16.3928 (2.27)     16.3928 (2.27)     0.0000 (1.0)      16.3928 (2.27)     0.0000 (1.0)           0;0  0.0610 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.6414 (2.03)     14.6414 (2.03)     14.6414 (2.03)     0.0000 (1.0)      14.6414 (2.03)     0.0000 (1.0)           0;0  0.0683 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2121 (1.0)       7.2121 (1.0)       7.2121 (1.0)      0.0000 (1.0)       7.2121 (1.0)      0.0000 (1.0)           0;0  0.1387 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2741 (1.15)      8.2741 (1.15)      8.2741 (1.15)     0.0000 (1.0)       8.2741 (1.15)     0.0000 (1.0)           0;0  0.1209 (0.87)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5544 (1.66)     5.5544 (1.66)     5.5544 (1.66)     0.0000 (1.0)      5.5544 (1.66)     0.0000 (1.0)           0;0  0.1800 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7118 (1.71)     5.7118 (1.71)     5.7118 (1.71)     0.0000 (1.0)      5.7118 (1.71)     0.0000 (1.0)           0;0  0.1751 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5511 (1.66)     5.5511 (1.66)     5.5511 (1.66)     0.0000 (1.0)      5.5511 (1.66)     0.0000 (1.0)           0;0  0.1801 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3482 (1.0)      3.3482 (1.0)      3.3482 (1.0)      0.0000 (1.0)      3.3482 (1.0)      0.0000 (1.0)           0;0  0.2987 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6367 (1.09)     3.6367 (1.09)     3.6367 (1.09)     0.0000 (1.0)      3.6367 (1.09)     0.0000 (1.0)           0;0  0.2750 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8458 (2.21)     8.8458 (2.21)     8.8458 (2.21)     0.0000 (1.0)      8.8458 (2.21)     0.0000 (1.0)           0;0  0.1130 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4131 (1.60)     6.4131 (1.60)     6.4131 (1.60)     0.0000 (1.0)      6.4131 (1.60)     0.0000 (1.0)           0;0  0.1559 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3050 (1.58)     6.3050 (1.58)     6.3050 (1.58)     0.0000 (1.0)      6.3050 (1.58)     0.0000 (1.0)           0;0  0.1586 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9968 (1.0)      3.9968 (1.0)      3.9968 (1.0)      0.0000 (1.0)      3.9968 (1.0)      0.0000 (1.0)           0;0  0.2502 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.5558 (1.14)     4.5558 (1.14)     4.5558 (1.14)     0.0000 (1.0)      4.5558 (1.14)     0.0000 (1.0)           0;0  0.2195 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.5669 (2.51)     25.5669 (2.51)     25.5669 (2.51)     0.0000 (1.0)      25.5669 (2.51)     0.0000 (1.0)           0;0  0.0391 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     19.2573 (1.89)     19.2573 (1.89)     19.2573 (1.89)     0.0000 (1.0)      19.2573 (1.89)     0.0000 (1.0)           0;0  0.0519 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.8332 (1.75)     17.8332 (1.75)     17.8332 (1.75)     0.0000 (1.0)      17.8332 (1.75)     0.0000 (1.0)           0;0  0.0561 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1838 (1.0)      10.1838 (1.0)      10.1838 (1.0)      0.0000 (1.0)      10.1838 (1.0)      0.0000 (1.0)           0;0  0.0982 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.0001 (1.08)     11.0001 (1.08)     11.0001 (1.08)     0.0000 (1.0)      11.0001 (1.08)     0.0000 (1.0)           0;0  0.0909 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7327 (1.54)     6.7327 (1.54)     6.7327 (1.54)     0.0000 (1.0)      6.7327 (1.54)     0.0000 (1.0)           0;0  0.1485 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9525 (1.59)     6.9525 (1.59)     6.9525 (1.59)     0.0000 (1.0)      6.9525 (1.59)     0.0000 (1.0)           0;0  0.1438 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.8013 (1.56)     6.8013 (1.56)     6.8013 (1.56)     0.0000 (1.0)      6.8013 (1.56)     0.0000 (1.0)           0;0  0.1470 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3733 (1.0)      4.3733 (1.0)      4.3733 (1.0)      0.0000 (1.0)      4.3733 (1.0)      0.0000 (1.0)           0;0  0.2287 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.7362 (1.08)     4.7362 (1.08)     4.7362 (1.08)     0.0000 (1.0)      4.7362 (1.08)     0.0000 (1.0)           0;0  0.2111 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.1311 (1.88)     11.1311 (1.88)     11.1311 (1.88)     0.0000 (1.0)      11.1311 (1.88)     0.0000 (1.0)           0;0  0.0898 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7015 (1.47)      8.7015 (1.47)      8.7015 (1.47)     0.0000 (1.0)       8.7015 (1.47)     0.0000 (1.0)           0;0  0.1149 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.6978 (1.47)      8.6978 (1.47)      8.6978 (1.47)     0.0000 (1.0)       8.6978 (1.47)     0.0000 (1.0)           0;0  0.1150 (0.68)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9324 (1.0)       5.9324 (1.0)       5.9324 (1.0)      0.0000 (1.0)       5.9324 (1.0)      0.0000 (1.0)           0;0  0.1686 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.4833 (1.09)      6.4833 (1.09)      6.4833 (1.09)     0.0000 (1.0)       6.4833 (1.09)     0.0000 (1.0)           0;0  0.1542 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0244 (1.75)     4.0244 (1.75)     4.0244 (1.75)     0.0000 (1.0)      4.0244 (1.75)     0.0000 (1.0)           0;0  0.2485 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.6918 (2.04)     4.6918 (2.04)     4.6918 (2.04)     0.0000 (1.0)      4.6918 (2.04)     0.0000 (1.0)           0;0  0.2131 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.4594 (1.94)     4.4594 (1.94)     4.4594 (1.94)     0.0000 (1.0)      4.4594 (1.94)     0.0000 (1.0)           0;0  0.2242 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.3021 (1.0)      2.3021 (1.0)      2.3021 (1.0)      0.0000 (1.0)      2.3021 (1.0)      0.0000 (1.0)           0;0  0.4344 (1.0)           1           1
test_data_status-data-changed[main]       2.5629 (1.11)     2.5629 (1.11)     2.5629 (1.11)     0.0000 (1.0)      2.5629 (1.11)     0.0000 (1.0)           0;0  0.3902 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0652 (1.76)     4.0652 (1.76)     4.0652 (1.76)     0.0000 (1.0)      4.0652 (1.76)     0.0000 (1.0)           0;0  0.2460 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7664 (2.06)     4.7664 (2.06)     4.7664 (2.06)     0.0000 (1.0)      4.7664 (2.06)     0.0000 (1.0)           0;0  0.2098 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6242 (2.00)     4.6242 (2.00)     4.6242 (2.00)     0.0000 (1.0)      4.6242 (2.00)     0.0000 (1.0)           0;0  0.2163 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3083 (1.0)      2.3083 (1.0)      2.3083 (1.0)      0.0000 (1.0)      2.3083 (1.0)      0.0000 (1.0)           0;0  0.4332 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5953 (1.12)     2.5953 (1.12)     2.5953 (1.12)     0.0000 (1.0)      2.5953 (1.12)     0.0000 (1.0)           0;0  0.3853 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5947 (3.80)     18.5947 (3.80)     18.5947 (3.80)     0.0000 (1.0)      18.5947 (3.80)     0.0000 (1.0)           0;0  0.0538 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.2752 (3.94)     19.2752 (3.94)     19.2752 (3.94)     0.0000 (1.0)      19.2752 (3.94)     0.0000 (1.0)           0;0  0.0519 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.9806 (3.88)     18.9806 (3.88)     18.9806 (3.88)     0.0000 (1.0)      18.9806 (3.88)     0.0000 (1.0)           0;0  0.0527 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8926 (1.0)       4.8926 (1.0)       4.8926 (1.0)      0.0000 (1.0)       4.8926 (1.0)      0.0000 (1.0)           0;0  0.2044 (1.0)           1           1
test_data_status-data-new[main]        5.0892 (1.04)      5.0892 (1.04)      5.0892 (1.04)     0.0000 (1.0)       5.0892 (1.04)     0.0000 (1.0)           0;0  0.1965 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9932 (1.74)     3.9932 (1.74)     3.9932 (1.74)     0.0000 (1.0)      3.9932 (1.74)     0.0000 (1.0)           0;0  0.2504 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.6167 (2.01)     4.6167 (2.01)     4.6167 (2.01)     0.0000 (1.0)      4.6167 (2.01)     0.0000 (1.0)           0;0  0.2166 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.5620 (1.99)     4.5620 (1.99)     4.5620 (1.99)     0.0000 (1.0)      4.5620 (1.99)     0.0000 (1.0)           0;0  0.2192 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.2972 (1.0)      2.2972 (1.0)      2.2972 (1.0)      0.0000 (1.0)      2.2972 (1.0)      0.0000 (1.0)           0;0  0.4353 (1.0)           1           1
test_data_status-data-noop[main]       2.5981 (1.13)     2.5981 (1.13)     2.5981 (1.13)     0.0000 (1.0)      2.5981 (1.13)     0.0000 (1.0)           0;0  0.3849 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.4197 (1.30)     7.4197 (1.30)     7.4197 (1.30)     0.0000 (1.0)      7.4197 (1.30)     0.0000 (1.0)           0;0  0.1348 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.9743 (1.40)     7.9743 (1.40)     7.9743 (1.40)     0.0000 (1.0)      7.9743 (1.40)     0.0000 (1.0)           0;0  0.1254 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8064 (1.37)     7.8064 (1.37)     7.8064 (1.37)     0.0000 (1.0)      7.8064 (1.37)     0.0000 (1.0)           0;0  0.1281 (0.73)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6973 (1.0)      5.6973 (1.0)      5.6973 (1.0)      0.0000 (1.0)      5.6973 (1.0)      0.0000 (1.0)           0;0  0.1755 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.0496 (1.06)     6.0496 (1.06)     6.0496 (1.06)     0.0000 (1.0)      6.0496 (1.06)     0.0000 (1.0)           0;0  0.1653 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.3395 (1.27)     7.3395 (1.27)     7.3395 (1.27)     0.0000 (1.0)      7.3395 (1.27)     0.0000 (1.0)           0;0  0.1362 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9242 (1.37)     7.9242 (1.37)     7.9242 (1.37)     0.0000 (1.0)      7.9242 (1.37)     0.0000 (1.0)           0;0  0.1262 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8512 (1.35)     7.8512 (1.35)     7.8512 (1.35)     0.0000 (1.0)      7.8512 (1.35)     0.0000 (1.0)           0;0  0.1274 (0.74)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7976 (1.0)      5.7976 (1.0)      5.7976 (1.0)      0.0000 (1.0)      5.7976 (1.0)      0.0000 (1.0)           0;0  0.1725 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.0922 (1.05)     6.0922 (1.05)     6.0922 (1.05)     0.0000 (1.0)      6.0922 (1.05)     0.0000 (1.0)           0;0  0.1641 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.8862 (2.70)     21.8862 (2.70)     21.8862 (2.70)     0.0000 (1.0)      21.8862 (2.70)     0.0000 (1.0)           0;0  0.0457 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.6669 (2.80)     22.6669 (2.80)     22.6669 (2.80)     0.0000 (1.0)      22.6669 (2.80)     0.0000 (1.0)           0;0  0.0441 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.5697 (2.79)     22.5697 (2.79)     22.5697 (2.79)     0.0000 (1.0)      22.5697 (2.79)     0.0000 (1.0)           0;0  0.0443 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0971 (1.0)       8.0971 (1.0)       8.0971 (1.0)      0.0000 (1.0)       8.0971 (1.0)      0.0000 (1.0)           0;0  0.1235 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6395 (1.07)      8.6395 (1.07)      8.6395 (1.07)     0.0000 (1.0)       8.6395 (1.07)     0.0000 (1.0)           0;0  0.1157 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.7190 (1.36)     6.7190 (1.36)     6.7190 (1.36)     0.0000 (1.0)      6.7190 (1.36)     0.0000 (1.0)           0;0  0.1488 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2149 (1.46)     7.2149 (1.46)     7.2149 (1.46)     0.0000 (1.0)      7.2149 (1.46)     0.0000 (1.0)           0;0  0.1386 (0.69)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0594 (1.43)     7.0594 (1.43)     7.0594 (1.43)     0.0000 (1.0)      7.0594 (1.43)     0.0000 (1.0)           0;0  0.1417 (0.70)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.9475 (1.0)      4.9475 (1.0)      4.9475 (1.0)      0.0000 (1.0)      4.9475 (1.0)      0.0000 (1.0)           0;0  0.2021 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.3369 (1.08)     5.3369 (1.08)     5.3369 (1.08)     0.0000 (1.0)      5.3369 (1.08)     0.0000 (1.0)           0;0  0.1874 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.9341 (2.61)     17.9341 (2.61)     17.9341 (2.61)     0.0000 (1.0)      17.9341 (2.61)     0.0000 (1.0)           0;0  0.0558 (0.38)          1           1
test_diff-diff[3.10.0]     19.0408 (2.77)     19.0408 (2.77)     19.0408 (2.77)     0.0000 (1.0)      19.0408 (2.77)     0.0000 (1.0)           0;0  0.0525 (0.36)          1           1
test_diff-diff[3.53.2]     19.0835 (2.78)     19.0835 (2.78)     19.0835 (2.78)     0.0000 (1.0)      19.0835 (2.78)     0.0000 (1.0)           0;0  0.0524 (0.36)          1           1
test_diff-diff[3.60.1]      6.8626 (1.0)       6.8626 (1.0)       6.8626 (1.0)      0.0000 (1.0)       6.8626 (1.0)      0.0000 (1.0)           0;0  0.1457 (1.0)           1           1
test_diff-diff[main]        7.8056 (1.14)      7.8056 (1.14)      7.8056 (1.14)     0.0000 (1.0)       7.8056 (1.14)     0.0000 (1.0)           0;0  0.1281 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9963 (1.78)     5.9963 (1.78)     5.9963 (1.78)     0.0000 (1.0)      5.9963 (1.78)     0.0000 (1.0)           0;0  0.1668 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.7348 (2.00)     6.7348 (2.00)     6.7348 (2.00)     0.0000 (1.0)      6.7348 (2.00)     0.0000 (1.0)           0;0  0.1485 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.5863 (1.66)     5.5863 (1.66)     5.5863 (1.66)     0.0000 (1.0)      5.5863 (1.66)     0.0000 (1.0)           0;0  0.1790 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3638 (1.0)      3.3638 (1.0)      3.3638 (1.0)      0.0000 (1.0)      3.3638 (1.0)      0.0000 (1.0)           0;0  0.2973 (1.0)           1           1
test_diff-diff-changed[main]       4.2060 (1.25)     4.2060 (1.25)     4.2060 (1.25)     0.0000 (1.0)      4.2060 (1.25)     0.0000 (1.0)           0;0  0.2378 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1890 (1.54)     5.1890 (1.54)     5.1890 (1.54)     0.0000 (1.0)      5.1890 (1.54)     0.0000 (1.0)           0;0  0.1927 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7520 (1.71)     5.7520 (1.71)     5.7520 (1.71)     0.0000 (1.0)      5.7520 (1.71)     0.0000 (1.0)           0;0  0.1739 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5705 (1.66)     5.5705 (1.66)     5.5705 (1.66)     0.0000 (1.0)      5.5705 (1.66)     0.0000 (1.0)           0;0  0.1795 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3627 (1.0)      3.3627 (1.0)      3.3627 (1.0)      0.0000 (1.0)      3.3627 (1.0)      0.0000 (1.0)           0;0  0.2974 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2664 (1.27)     4.2664 (1.27)     4.2664 (1.27)     0.0000 (1.0)      4.2664 (1.27)     0.0000 (1.0)           0;0  0.2344 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0477 (1.21)     4.0477 (1.21)     4.0477 (1.21)     0.0000 (1.0)      4.0477 (1.21)     0.0000 (1.0)           0;0  0.2471 (0.83)          1           1
test_diff-diff-noop[3.10.0]     4.7394 (1.41)     4.7394 (1.41)     4.7394 (1.41)     0.0000 (1.0)      4.7394 (1.41)     0.0000 (1.0)           0;0  0.2110 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.6492 (1.68)     5.6492 (1.68)     5.6492 (1.68)     0.0000 (1.0)      5.6492 (1.68)     0.0000 (1.0)           0;0  0.1770 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.3556 (1.0)      3.3556 (1.0)      3.3556 (1.0)      0.0000 (1.0)      3.3556 (1.0)      0.0000 (1.0)           0;0  0.2980 (1.0)           1           1
test_diff-diff-noop[main]       4.2328 (1.26)     4.2328 (1.26)     4.2328 (1.26)     0.0000 (1.0)      4.2328 (1.26)     0.0000 (1.0)           0;0  0.2363 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       960.7744 (1.0)        960.7744 (1.0)        960.7744 (1.0)      0.0000 (1.0)        960.7744 (1.0)      0.0000 (1.0)           0;0  1.0408 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,336.4979 (4.51)     4,336.4979 (4.51)     4,336.4979 (4.51)     0.0000 (1.0)      4,336.4979 (4.51)     0.0000 (1.0)           0;0  0.2306 (0.22)          1           1
test_exp_show-exp[3.53.2]     2,629.0478 (2.74)     2,629.0478 (2.74)     2,629.0478 (2.74)     0.0000 (1.0)      2,629.0478 (2.74)     0.0000 (1.0)           0;0  0.3804 (0.37)          1           1
test_exp_show-exp[3.60.1]     2,778.4640 (2.89)     2,778.4640 (2.89)     2,778.4640 (2.89)     0.0000 (1.0)      2,778.4640 (2.89)     0.0000 (1.0)           0;0  0.3599 (0.35)          1           1
test_exp_show-exp[main]       5,990.3954 (6.23)     5,990.3954 (6.23)     5,990.3954 (6.23)     0.0000 (1.0)      5,990.3954 (6.23)     0.0000 (1.0)           0;0  0.1669 (0.16)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     65.9821 (2.84)     65.9821 (2.84)     65.9821 (2.84)     0.0000 (1.0)      65.9821 (2.84)     0.0000 (1.0)           0;0  0.0152 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.2600 (3.07)     71.2600 (3.07)     71.2600 (3.07)     0.0000 (1.0)      71.2600 (3.07)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.2100 (1.43)     33.2100 (1.43)     33.2100 (1.43)     0.0000 (1.0)      33.2100 (1.43)     0.0000 (1.0)           0;0  0.0301 (0.70)          1           1
test_fetch-fetch[3.60.1]     23.2475 (1.0)      23.2475 (1.0)      23.2475 (1.0)      0.0000 (1.0)      23.2475 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
test_fetch-fetch[main]       23.3366 (1.00)     23.3366 (1.00)     23.3366 (1.00)     0.0000 (1.0)      23.3366 (1.00)     0.0000 (1.0)           0;0  0.0429 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8066 (1.0)      2.8066 (1.0)      2.8066 (1.0)      0.0000 (1.0)      2.8066 (1.0)      0.0000 (1.0)           0;0  0.3563 (1.0)           1           1
test_gc-gc[3.10.0]     2.9069 (1.04)     2.9069 (1.04)     2.9069 (1.04)     0.0000 (1.0)      2.9069 (1.04)     0.0000 (1.0)           0;0  0.3440 (0.97)          1           1
test_gc-gc[3.53.2]     2.8335 (1.01)     2.8335 (1.01)     2.8335 (1.01)     0.0000 (1.0)      2.8335 (1.01)     0.0000 (1.0)           0;0  0.3529 (0.99)          1           1
test_gc-gc[3.60.1]     2.8575 (1.02)     2.8575 (1.02)     2.8575 (1.02)     0.0000 (1.0)      2.8575 (1.02)     0.0000 (1.0)           0;0  0.3500 (0.98)          1           1
test_gc-gc[main]       2.9649 (1.06)     2.9649 (1.06)     2.9649 (1.06)     0.0000 (1.0)      2.9649 (1.06)     0.0000 (1.0)           0;0  0.3373 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.3006 (2.77)     137.3006 (2.77)     137.3006 (2.77)     0.0000 (1.0)      137.3006 (2.77)     0.0000 (1.0)           0;0  0.0073 (0.36)          1           1
test_get-get[3.10.0]     162.8124 (3.28)     162.8124 (3.28)     162.8124 (3.28)     0.0000 (1.0)      162.8124 (3.28)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     144.7298 (2.92)     144.7298 (2.92)     144.7298 (2.92)     0.0000 (1.0)      144.7298 (2.92)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[3.60.1]      49.6297 (1.0)       49.6297 (1.0)       49.6297 (1.0)      0.0000 (1.0)       49.6297 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
test_get-get[main]        49.8939 (1.01)      49.8939 (1.01)      49.8939 (1.01)     0.0000 (1.0)       49.8939 (1.01)     0.0000 (1.0)           0;0  0.0200 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.6464 (2.68)     44.6464 (2.68)     44.6464 (2.68)     0.0000 (1.0)      44.6464 (2.68)     0.0000 (1.0)           0;0  0.0224 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.5553 (2.85)     47.5553 (2.85)     47.5553 (2.85)     0.0000 (1.0)      47.5553 (2.85)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.6791 (1.0)      16.6791 (1.0)      16.6791 (1.0)      0.0000 (1.0)      16.6791 (1.0)      0.0000 (1.0)           0;0  0.0600 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.7635 (1.01)     16.7635 (1.01)     16.7635 (1.01)     0.0000 (1.0)      16.7635 (1.01)     0.0000 (1.0)           0;0  0.0597 (0.99)          1           1
test_get_url-get-url[main]       16.9446 (1.02)     16.9446 (1.02)     16.9446 (1.02)     0.0000 (1.0)      16.9446 (1.02)     0.0000 (1.0)           0;0  0.0590 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     126.1283 (1.01)     152.2387 (1.14)     130.0849 (1.01)     3.0202 (2.06)     129.7220 (1.01)     2.9195 (1.94)         13;3  7.6873 (0.99)        100           1
test_help---help[3.10.0]     125.2032 (1.00)     141.5873 (1.06)     129.1309 (1.00)     2.3893 (1.63)     128.6824 (1.0)      2.3596 (1.57)         16;6  7.7441 (1.00)        100           1
test_help---help[3.53.2]     125.1909 (1.0)      134.0690 (1.0)      128.9293 (1.0)      1.4694 (1.0)      128.7986 (1.00)     1.5013 (1.0)          27;5  7.7562 (1.0)         100           1
test_help---help[3.60.1]     128.1099 (1.02)     139.6032 (1.04)     131.5338 (1.02)     2.2377 (1.52)     131.2810 (1.02)     3.0377 (2.02)         29;2  7.6026 (0.98)        100           1
test_help---help[main]       127.2909 (1.02)     158.7686 (1.18)     131.0791 (1.02)     4.5126 (3.07)     130.0447 (1.01)     2.4836 (1.65)          7;7  7.6290 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     220.5197 (2.94)     220.5197 (2.94)     220.5197 (2.94)     0.0000 (1.0)      220.5197 (2.94)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     251.3253 (3.35)     251.3253 (3.35)     251.3253 (3.35)     0.0000 (1.0)      251.3253 (3.35)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      74.9616 (1.0)       74.9616 (1.0)       74.9616 (1.0)      0.0000 (1.0)       74.9616 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        76.8679 (1.03)      76.8679 (1.03)      76.8679 (1.03)     0.0000 (1.0)       76.8679 (1.03)     0.0000 (1.0)           0;0  0.0130 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     156.3223 (3.34)     156.3223 (3.34)     156.3223 (3.34)     0.0000 (1.0)      156.3223 (3.34)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     158.9440 (3.40)     158.9440 (3.40)     158.9440 (3.40)     0.0000 (1.0)      158.9440 (3.40)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.6875 (2.52)     117.6875 (2.52)     117.6875 (2.52)     0.0000 (1.0)      117.6875 (2.52)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.7722 (1.0)       46.7722 (1.0)       46.7722 (1.0)      0.0000 (1.0)       46.7722 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_import_url-import-url[main]        48.3169 (1.03)      48.3169 (1.03)      48.3169 (1.03)     0.0000 (1.0)       48.3169 (1.03)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     400.4402 (1.01)     448.6457 (1.00)     413.4700 (1.0)       9.7282 (1.0)      410.5334 (1.0)       7.1298 (1.0)         15;12  2.4186 (1.0)         100           1
test_init-init[3.10.0]     411.7114 (1.04)     470.6919 (1.05)     433.4453 (1.05)     16.1670 (1.66)     425.9030 (1.04)     25.8659 (3.63)         27;0  2.3071 (0.95)        100           1
test_init-init[3.53.2]     396.6457 (1.0)      452.8700 (1.01)     416.5672 (1.01)     10.2855 (1.06)     417.5367 (1.02)     13.8144 (1.94)         32;1  2.4006 (0.99)        100           1
test_init-init[3.60.1]     399.9343 (1.01)     448.3855 (1.0)      416.1021 (1.01)     10.7358 (1.10)     413.3115 (1.01)     15.9624 (2.24)         35;1  2.4033 (0.99)        100           1
test_init-init[main]       434.6583 (1.10)     705.9503 (1.57)     453.9841 (1.10)     29.3881 (3.02)     446.8786 (1.09)     14.1296 (1.98)          4;4  2.2027 (0.91)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     580.0844 (1.11)     580.0844 (1.11)     580.0844 (1.11)     0.0000 (1.0)      580.0844 (1.11)     0.0000 (1.0)           0;0  1.7239 (0.90)          1           1
test_list-list[3.10.0]     662.2322 (1.27)     662.2322 (1.27)     662.2322 (1.27)     0.0000 (1.0)      662.2322 (1.27)     0.0000 (1.0)           0;0  1.5100 (0.79)          1           1
test_list-list[3.53.2]     590.7915 (1.13)     590.7915 (1.13)     590.7915 (1.13)     0.0000 (1.0)      590.7915 (1.13)     0.0000 (1.0)           0;0  1.6926 (0.89)          1           1
test_list-list[3.60.1]     523.4906 (1.0)      523.4906 (1.0)      523.4906 (1.0)      0.0000 (1.0)      523.4906 (1.0)      0.0000 (1.0)           0;0  1.9103 (1.0)           1           1
test_list-list[main]       535.5363 (1.02)     535.5363 (1.02)     535.5363 (1.02)     0.0000 (1.0)      535.5363 (1.02)     0.0000 (1.0)           0;0  1.8673 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     425.3842 (1.08)     425.3842 (1.08)     425.3842 (1.08)     0.0000 (1.0)      425.3842 (1.08)     0.0000 (1.0)           0;0  2.3508 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     411.7889 (1.04)     411.7889 (1.04)     411.7889 (1.04)     0.0000 (1.0)      411.7889 (1.04)     0.0000 (1.0)           0;0  2.4284 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     425.0051 (1.08)     425.0051 (1.08)     425.0051 (1.08)     0.0000 (1.0)      425.0051 (1.08)     0.0000 (1.0)           0;0  2.3529 (0.93)          1           1
test_list-list-dvc-only[3.60.1]     394.8818 (1.00)     394.8818 (1.00)     394.8818 (1.00)     0.0000 (1.0)      394.8818 (1.00)     0.0000 (1.0)           0;0  2.5324 (1.00)          1           1
test_list-list-dvc-only[main]       394.0715 (1.0)      394.0715 (1.0)      394.0715 (1.0)      0.0000 (1.0)      394.0715 (1.0)      0.0000 (1.0)           0;0  2.5376 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6847 (1.01)     2.6847 (1.01)     2.6847 (1.01)     0.0000 (1.0)      2.6847 (1.01)     0.0000 (1.0)           0;0  0.3725 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.6554 (1.0)      2.6554 (1.0)      2.6554 (1.0)      0.0000 (1.0)      2.6554 (1.0)      0.0000 (1.0)           0;0  0.3766 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.6845 (1.01)     2.6845 (1.01)     2.6845 (1.01)     0.0000 (1.0)      2.6845 (1.01)     0.0000 (1.0)           0;0  0.3725 (0.99)          1           1
test_list-list-recursive[3.60.1]     2.7705 (1.04)     2.7705 (1.04)     2.7705 (1.04)     0.0000 (1.0)      2.7705 (1.04)     0.0000 (1.0)           0;0  0.3609 (0.96)          1           1
test_list-list-recursive[main]       2.7602 (1.04)     2.7602 (1.04)     2.7602 (1.04)     0.0000 (1.0)      2.7602 (1.04)     0.0000 (1.0)           0;0  0.3623 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     426.9040 (1.09)     426.9040 (1.09)     426.9040 (1.09)     0.0000 (1.0)      426.9040 (1.09)     0.0000 (1.0)           0;0  2.3424 (0.92)          1           1
test_list-list-shallow[3.10.0]     413.5776 (1.05)     413.5776 (1.05)     413.5776 (1.05)     0.0000 (1.0)      413.5776 (1.05)     0.0000 (1.0)           0;0  2.4179 (0.95)          1           1
test_list-list-shallow[3.53.2]     393.2707 (1.0)      393.2707 (1.0)      393.2707 (1.0)      0.0000 (1.0)      393.2707 (1.0)      0.0000 (1.0)           0;0  2.5428 (1.0)           1           1
test_list-list-shallow[3.60.1]     403.8050 (1.03)     403.8050 (1.03)     403.8050 (1.03)     0.0000 (1.0)      403.8050 (1.03)     0.0000 (1.0)           0;0  2.4764 (0.97)          1           1
test_list-list-shallow[main]       393.4165 (1.00)     393.4165 (1.00)     393.4165 (1.00)     0.0000 (1.0)      393.4165 (1.00)     0.0000 (1.0)           0;0  2.5418 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     73.0920 (3.81)     73.0920 (3.81)     73.0920 (3.81)     0.0000 (1.0)      73.0920 (3.81)     0.0000 (1.0)           0;0  0.0137 (0.26)          1           1
test_partial_add-add[3.10.0]     73.4048 (3.83)     73.4048 (3.83)     73.4048 (3.83)     0.0000 (1.0)      73.4048 (3.83)     0.0000 (1.0)           0;0  0.0136 (0.26)          1           1
test_partial_add-add[3.53.2]     64.7004 (3.37)     64.7004 (3.37)     64.7004 (3.37)     0.0000 (1.0)      64.7004 (3.37)     0.0000 (1.0)           0;0  0.0155 (0.30)          1           1
test_partial_add-add[3.60.1]     19.1839 (1.0)      19.1839 (1.0)      19.1839 (1.0)      0.0000 (1.0)      19.1839 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
test_partial_add-add[main]       20.3150 (1.06)     20.3150 (1.06)     20.3150 (1.06)     0.0000 (1.0)      20.3150 (1.06)     0.0000 (1.0)           0;0  0.0492 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     61.0415 (7.99)     61.0415 (7.99)     61.0415 (7.99)     0.0000 (1.0)      61.0415 (7.99)     0.0000 (1.0)           0;0  0.0164 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     61.8921 (8.10)     61.8921 (8.10)     61.8921 (8.10)     0.0000 (1.0)      61.8921 (8.10)     0.0000 (1.0)           0;0  0.0162 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     55.5755 (7.28)     55.5755 (7.28)     55.5755 (7.28)     0.0000 (1.0)      55.5755 (7.28)     0.0000 (1.0)           0;0  0.0180 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.6369 (1.0)       7.6369 (1.0)       7.6369 (1.0)      0.0000 (1.0)       7.6369 (1.0)      0.0000 (1.0)           0;0  0.1309 (1.0)           1           1
test_partial_add-add-partial[main]        8.0821 (1.06)      8.0821 (1.06)      8.0821 (1.06)     0.0000 (1.0)       8.0821 (1.06)     0.0000 (1.0)           0;0  0.1237 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3064 (1.0)      4.3064 (1.0)      4.3064 (1.0)      0.0000 (1.0)      4.3064 (1.0)      0.0000 (1.0)           0;0  0.2322 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.6779 (1.32)     5.6779 (1.32)     5.6779 (1.32)     0.0000 (1.0)      5.6779 (1.32)     0.0000 (1.0)           0;0  0.1761 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.4732 (1.50)     6.4732 (1.50)     6.4732 (1.50)     0.0000 (1.0)      6.4732 (1.50)     0.0000 (1.0)           0;0  0.1545 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.4926 (1.51)     6.4926 (1.51)     6.4926 (1.51)     0.0000 (1.0)      6.4926 (1.51)     0.0000 (1.0)           0;0  0.1540 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.5556 (1.52)     6.5556 (1.52)     6.5556 (1.52)     0.0000 (1.0)      6.5556 (1.52)     0.0000 (1.0)           0;0  0.1525 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3584 (1.0)      2.3584 (1.0)      2.3584 (1.0)      0.0000 (1.0)      2.3584 (1.0)      0.0000 (1.0)           0;0  0.4240 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.5565 (1.51)     3.5565 (1.51)     3.5565 (1.51)     0.0000 (1.0)      3.5565 (1.51)     0.0000 (1.0)           0;0  0.2812 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.5654 (1.51)     3.5654 (1.51)     3.5654 (1.51)     0.0000 (1.0)      3.5654 (1.51)     0.0000 (1.0)           0;0  0.2805 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.6126 (1.53)     3.6126 (1.53)     3.6126 (1.53)     0.0000 (1.0)      3.6126 (1.53)     0.0000 (1.0)           0;0  0.2768 (0.65)          1           1
test_partial_add-gc-noop[main]       3.6562 (1.55)     3.6562 (1.55)     3.6562 (1.55)     0.0000 (1.0)      3.6562 (1.55)     0.0000 (1.0)           0;0  0.2735 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     43.9286 (2.35)     43.9286 (2.35)     43.9286 (2.35)     0.0000 (1.0)      43.9286 (2.35)     0.0000 (1.0)           0;0  0.0228 (0.43)          1           1
test_partial_add-push[3.10.0]     38.9094 (2.08)     38.9094 (2.08)     38.9094 (2.08)     0.0000 (1.0)      38.9094 (2.08)     0.0000 (1.0)           0;0  0.0257 (0.48)          1           1
test_partial_add-push[3.53.2]     19.2740 (1.03)     19.2740 (1.03)     19.2740 (1.03)     0.0000 (1.0)      19.2740 (1.03)     0.0000 (1.0)           0;0  0.0519 (0.97)          1           1
test_partial_add-push[3.60.1]     18.6876 (1.0)      18.6876 (1.0)      18.6876 (1.0)      0.0000 (1.0)      18.6876 (1.0)      0.0000 (1.0)           0;0  0.0535 (1.0)           1           1
test_partial_add-push[main]       18.6932 (1.00)     18.6932 (1.00)     18.6932 (1.00)     0.0000 (1.0)      18.6932 (1.00)     0.0000 (1.0)           0;0  0.0535 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.3296 (1.14)     11.3296 (1.14)     11.3296 (1.14)     0.0000 (1.0)      11.3296 (1.14)     0.0000 (1.0)           0;0  0.0883 (0.87)          1           1
test_partial_add-push-partial[3.10.0]     10.4672 (1.06)     10.4672 (1.06)     10.4672 (1.06)     0.0000 (1.0)      10.4672 (1.06)     0.0000 (1.0)           0;0  0.0955 (0.95)          1           1
test_partial_add-push-partial[3.53.2]     10.1851 (1.03)     10.1851 (1.03)     10.1851 (1.03)     0.0000 (1.0)      10.1851 (1.03)     0.0000 (1.0)           0;0  0.0982 (0.97)          1           1
test_partial_add-push-partial[3.60.1]      9.9074 (1.0)       9.9074 (1.0)       9.9074 (1.0)      0.0000 (1.0)       9.9074 (1.0)      0.0000 (1.0)           0;0  0.1009 (1.0)           1           1
test_partial_add-push-partial[main]        9.9778 (1.01)      9.9778 (1.01)      9.9778 (1.01)     0.0000 (1.0)       9.9778 (1.01)     0.0000 (1.0)           0;0  0.1002 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     82.9311 (3.64)     82.9311 (3.64)     82.9311 (3.64)     0.0000 (1.0)      82.9311 (3.64)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.2726 (3.70)     84.2726 (3.70)     84.2726 (3.70)     0.0000 (1.0)      84.2726 (3.70)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.53.2]     76.0374 (3.34)     76.0374 (3.34)     76.0374 (3.34)     0.0000 (1.0)      76.0374 (3.34)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.7654 (1.0)      22.7654 (1.0)      22.7654 (1.0)      0.0000 (1.0)      22.7654 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
test_partial_remove-add[main]       23.9114 (1.05)     23.9114 (1.05)     23.9114 (1.05)     0.0000 (1.0)      23.9114 (1.05)     0.0000 (1.0)           0;0  0.0418 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.7509 (8.31)     8.7509 (8.31)     8.7509 (8.31)     0.0000 (1.0)      8.7509 (8.31)     0.0000 (1.0)           0;0  0.1143 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.4320 (8.00)     8.4320 (8.00)     8.4320 (8.00)     0.0000 (1.0)      8.4320 (8.00)     0.0000 (1.0)           0;0  0.1186 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.8538 (7.45)     7.8538 (7.45)     7.8538 (7.45)     0.0000 (1.0)      7.8538 (7.45)     0.0000 (1.0)           0;0  0.1273 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.0656 (1.01)     1.0656 (1.01)     1.0656 (1.01)     0.0000 (1.0)      1.0656 (1.01)     0.0000 (1.0)           0;0  0.9384 (0.99)          1           1
test_partial_remove-add-update[main]       1.0535 (1.0)      1.0535 (1.0)      1.0535 (1.0)      0.0000 (1.0)      1.0535 (1.0)      0.0000 (1.0)           0;0  0.9492 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2861 (1.0)      3.2861 (1.0)      3.2861 (1.0)      0.0000 (1.0)      3.2861 (1.0)      0.0000 (1.0)           0;0  0.3043 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6149 (1.10)     3.6149 (1.10)     3.6149 (1.10)     0.0000 (1.0)      3.6149 (1.10)     0.0000 (1.0)           0;0  0.2766 (0.91)          1           1
test_partial_remove-gc[3.53.2]     3.7344 (1.14)     3.7344 (1.14)     3.7344 (1.14)     0.0000 (1.0)      3.7344 (1.14)     0.0000 (1.0)           0;0  0.2678 (0.88)          1           1
test_partial_remove-gc[3.60.1]     3.9715 (1.21)     3.9715 (1.21)     3.9715 (1.21)     0.0000 (1.0)      3.9715 (1.21)     0.0000 (1.0)           0;0  0.2518 (0.83)          1           1
test_partial_remove-gc[main]       3.5498 (1.08)     3.5498 (1.08)     3.5498 (1.08)     0.0000 (1.0)      3.5498 (1.08)     0.0000 (1.0)           0;0  0.2817 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7713 (1.03)     4.7713 (1.03)     4.7713 (1.03)     0.0000 (1.0)      4.7713 (1.03)     0.0000 (1.0)           0;0  0.2096 (0.97)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.0759 (1.10)     5.0759 (1.10)     5.0759 (1.10)     0.0000 (1.0)      5.0759 (1.10)     0.0000 (1.0)           0;0  0.1970 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8071 (1.04)     4.8071 (1.04)     4.8071 (1.04)     0.0000 (1.0)      4.8071 (1.04)     0.0000 (1.0)           0;0  0.2080 (0.96)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.7903 (1.04)     4.7903 (1.04)     4.7903 (1.04)     0.0000 (1.0)      4.7903 (1.04)     0.0000 (1.0)           0;0  0.2088 (0.96)          1           1
test_partial_remove-gc-cloud[main]       4.6151 (1.0)      4.6151 (1.0)      4.6151 (1.0)      0.0000 (1.0)      4.6151 (1.0)      0.0000 (1.0)           0;0  0.2167 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.4523 (2.44)     53.4523 (2.44)     53.4523 (2.44)     0.0000 (1.0)      53.4523 (2.44)     0.0000 (1.0)           0;0  0.0187 (0.41)          1           1
test_partial_remove-push[3.10.0]     47.6421 (2.18)     47.6421 (2.18)     47.6421 (2.18)     0.0000 (1.0)      47.6421 (2.18)     0.0000 (1.0)           0;0  0.0210 (0.46)          1           1
test_partial_remove-push[3.53.2]     22.8604 (1.05)     22.8604 (1.05)     22.8604 (1.05)     0.0000 (1.0)      22.8604 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.3954 (1.02)     22.3954 (1.02)     22.3954 (1.02)     0.0000 (1.0)      22.3954 (1.02)     0.0000 (1.0)           0;0  0.0447 (0.98)          1           1
test_partial_remove-push[main]       21.8722 (1.0)      21.8722 (1.0)      21.8722 (1.0)      0.0000 (1.0)      21.8722 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8921 (1.03)     1.8921 (1.03)     1.8921 (1.03)     0.0000 (1.0)      1.8921 (1.03)     0.0000 (1.0)           0;0  0.5285 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     1.8433 (1.0)      1.8433 (1.0)      1.8433 (1.0)      0.0000 (1.0)      1.8433 (1.0)      0.0000 (1.0)           0;0  0.5425 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5328 (1.37)     2.5328 (1.37)     2.5328 (1.37)     0.0000 (1.0)      2.5328 (1.37)     0.0000 (1.0)           0;0  0.3948 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.4917 (1.35)     2.4917 (1.35)     2.4917 (1.35)     0.0000 (1.0)      2.4917 (1.35)     0.0000 (1.0)           0;0  0.4013 (0.74)          1           1
test_partial_remove-push-update[main]       2.6152 (1.42)     2.6152 (1.42)     2.6152 (1.42)     0.0000 (1.0)      2.6152 (1.42)     0.0000 (1.0)           0;0  0.3824 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     485.3755 (1.0)      495.8344 (1.0)      488.4775 (1.0)       4.2123 (2.39)     487.4771 (1.0)       3.6374 (1.36)          1;1  2.0472 (1.0)           5           3
test_plots-plots-diff[3.10.0]     906.1664 (1.87)     952.3777 (1.92)     927.7148 (1.90)     19.8736 (11.29)    919.6547 (1.89)     33.5484 (12.51)         2;0  1.0779 (0.53)          5           3
test_plots-plots-diff[3.53.2]     821.2874 (1.69)     828.2426 (1.67)     825.0913 (1.69)      3.3239 (1.89)     825.9813 (1.69)      6.3587 (2.37)          1;0  1.2120 (0.59)          5           3
test_plots-plots-diff[3.60.1]     795.8106 (1.64)     801.1093 (1.62)     797.7988 (1.63)      2.1605 (1.23)     797.1018 (1.64)      3.1852 (1.19)          1;0  1.2534 (0.61)          5           3
test_plots-plots-diff[main]       800.2171 (1.65)     804.3712 (1.62)     801.7063 (1.64)      1.7599 (1.0)      800.9429 (1.64)      2.6822 (1.0)           1;0  1.2473 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       497.8179 (1.0)        512.6574 (1.0)        503.6514 (1.0)       6.1201 (3.33)       500.7684 (1.0)       9.1524 (3.26)          1;0  1.9855 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,172.8620 (2.36)     1,180.1022 (2.30)     1,175.4939 (2.33)      2.9919 (1.63)     1,173.8343 (2.34)      4.1433 (1.48)          1;0  0.8507 (0.43)          5           3
test_plots-plots-diff-json[3.53.2]       900.8069 (1.81)       905.3560 (1.77)       902.8780 (1.79)      1.8384 (1.0)        903.3549 (1.80)      2.8048 (1.0)           2;0  1.1076 (0.56)          5           3
test_plots-plots-diff-json[3.60.1]       875.5285 (1.76)       932.5519 (1.82)       889.6042 (1.77)     24.1017 (13.11)      880.0318 (1.76)     16.1111 (5.74)          1;1  1.1241 (0.57)          5           3
test_plots-plots-diff-json[main]         864.7575 (1.74)       880.8313 (1.72)       873.1476 (1.73)      7.3379 (3.99)       874.8246 (1.75)     13.6619 (4.87)          2;0  1.1453 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     423.1731 (1.0)      442.1270 (1.0)      437.0354 (1.0)      7.8504 (3.38)     440.2146 (1.0)       6.4782 (2.15)          1;1  2.2881 (1.0)           5           3
test_plots-plots-show[3.10.0]     727.6970 (1.72)     733.1664 (1.66)     730.7462 (1.67)     2.3239 (1.0)      729.9886 (1.66)      3.7183 (1.23)          2;0  1.3685 (0.60)          5           3
test_plots-plots-show[3.53.2]     683.1277 (1.61)     702.7353 (1.59)     693.7540 (1.59)     7.3839 (3.18)     694.6400 (1.58)     10.0363 (3.32)          2;0  1.4414 (0.63)          5           3
test_plots-plots-show[3.60.1]     667.7410 (1.58)     681.8051 (1.54)     675.5096 (1.55)     5.5351 (2.38)     677.6182 (1.54)      8.0055 (2.65)          2;0  1.4804 (0.65)          5           3
test_plots-plots-show[main]       684.2018 (1.62)     691.6825 (1.56)     687.3959 (1.57)     2.7471 (1.18)     687.1860 (1.56)      3.0200 (1.0)           2;0  1.4548 (0.64)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     440.0700 (1.0)      455.4423 (1.0)      447.6765 (1.0)       6.3499 (2.20)     449.1567 (1.0)      10.5161 (2.58)          2;0  2.2338 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     857.2776 (1.95)     864.5015 (1.90)     860.0825 (1.92)      2.8914 (1.0)      860.1812 (1.92)      4.0734 (1.0)           1;0  1.1627 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     734.6166 (1.67)     762.6998 (1.67)     750.1723 (1.68)     10.0597 (3.48)     750.8436 (1.67)      8.7450 (2.15)          2;0  1.3330 (0.60)          5           3
test_plots-plots-show-json[3.60.1]     724.8473 (1.65)     732.1655 (1.61)     728.3433 (1.63)      2.9531 (1.02)     727.3280 (1.62)      4.5921 (1.13)          2;0  1.3730 (0.61)          5           3
test_plots-plots-show-json[main]       728.6233 (1.66)     738.3882 (1.62)     734.1368 (1.64)      4.0415 (1.40)     734.0124 (1.63)      6.6684 (1.64)          2;0  1.3621 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.7384 (2.38)     51.7384 (2.38)     51.7384 (2.38)     0.0000 (1.0)      51.7384 (2.38)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_push-push[3.10.0]     45.5354 (2.09)     45.5354 (2.09)     45.5354 (2.09)     0.0000 (1.0)      45.5354 (2.09)     0.0000 (1.0)           0;0  0.0220 (0.48)          1           1
test_push-push[3.53.2]     22.4056 (1.03)     22.4056 (1.03)     22.4056 (1.03)     0.0000 (1.0)      22.4056 (1.03)     0.0000 (1.0)           0;0  0.0446 (0.97)          1           1
test_push-push[3.60.1]     21.9013 (1.01)     21.9013 (1.01)     21.9013 (1.01)     0.0000 (1.0)      21.9013 (1.01)     0.0000 (1.0)           0;0  0.0457 (0.99)          1           1
test_push-push[main]       21.7361 (1.0)      21.7361 (1.0)      21.7361 (1.0)      0.0000 (1.0)      21.7361 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.5995 (2.85)     65.5995 (2.85)     65.5995 (2.85)     0.0000 (1.0)      65.5995 (2.85)     0.0000 (1.0)           0;0  0.0152 (0.35)          1           1
test_sharing-fetch[3.10.0]     69.8893 (3.03)     69.8893 (3.03)     69.8893 (3.03)     0.0000 (1.0)      69.8893 (3.03)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     32.6757 (1.42)     32.6757 (1.42)     32.6757 (1.42)     0.0000 (1.0)      32.6757 (1.42)     0.0000 (1.0)           0;0  0.0306 (0.71)          1           1
test_sharing-fetch[3.60.1]     23.0405 (1.0)      23.0405 (1.0)      23.0405 (1.0)      0.0000 (1.0)      23.0405 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
test_sharing-fetch[main]       23.1731 (1.01)     23.1731 (1.01)     23.1731 (1.01)     0.0000 (1.0)      23.1731 (1.01)     0.0000 (1.0)           0;0  0.0432 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2558 (1.0)      1.2558 (1.0)      1.2558 (1.0)      0.0000 (1.0)      1.2558 (1.0)      0.0000 (1.0)           0;0  0.7963 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6026 (2.87)     3.6026 (2.87)     3.6026 (2.87)     0.0000 (1.0)      3.6026 (2.87)     0.0000 (1.0)           0;0  0.2776 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.6921 (4.53)     5.6921 (4.53)     5.6921 (4.53)     0.0000 (1.0)      5.6921 (4.53)     0.0000 (1.0)           0;0  0.1757 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.7160 (4.55)     5.7160 (4.55)     5.7160 (4.55)     0.0000 (1.0)      5.7160 (4.55)     0.0000 (1.0)           0;0  0.1749 (0.22)          1           1
test_sharing-fetch-noop[main]       5.8696 (4.67)     5.8696 (4.67)     5.8696 (4.67)     0.0000 (1.0)      5.8696 (4.67)     0.0000 (1.0)           0;0  0.1704 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.2282 (2.48)     53.2282 (2.48)     53.2282 (2.48)     0.0000 (1.0)      53.2282 (2.48)     0.0000 (1.0)           0;0  0.0188 (0.40)          1           1
test_sharing-push[3.10.0]     48.2594 (2.25)     48.2594 (2.25)     48.2594 (2.25)     0.0000 (1.0)      48.2594 (2.25)     0.0000 (1.0)           0;0  0.0207 (0.44)          1           1
test_sharing-push[3.53.2]     22.6405 (1.06)     22.6405 (1.06)     22.6405 (1.06)     0.0000 (1.0)      22.6405 (1.06)     0.0000 (1.0)           0;0  0.0442 (0.95)          1           1
test_sharing-push[3.60.1]     21.4464 (1.0)      21.4464 (1.0)      21.4464 (1.0)      0.0000 (1.0)      21.4464 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
test_sharing-push[main]       22.7409 (1.06)     22.7409 (1.06)     22.7409 (1.06)     0.0000 (1.0)      22.7409 (1.06)     0.0000 (1.0)           0;0  0.0440 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1651 (1.04)     2.1651 (1.04)     2.1651 (1.04)     0.0000 (1.0)      2.1651 (1.04)     0.0000 (1.0)           0;0  0.4619 (0.97)          1           1
test_sharing-push-noop[3.10.0]     2.0908 (1.0)      2.0908 (1.0)      2.0908 (1.0)      0.0000 (1.0)      2.0908 (1.0)      0.0000 (1.0)           0;0  0.4783 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.8679 (2.81)     5.8679 (2.81)     5.8679 (2.81)     0.0000 (1.0)      5.8679 (2.81)     0.0000 (1.0)           0;0  0.1704 (0.36)          1           1
test_sharing-push-noop[3.60.1]     5.9735 (2.86)     5.9735 (2.86)     5.9735 (2.86)     0.0000 (1.0)      5.9735 (2.86)     0.0000 (1.0)           0;0  0.1674 (0.35)          1           1
test_sharing-push-noop[main]       5.8538 (2.80)     5.8538 (2.80)     5.8538 (2.80)     0.0000 (1.0)      5.8538 (2.80)     0.0000 (1.0)           0;0  0.1708 (0.36)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     215.8972 (1.04)     215.8972 (1.04)     215.8972 (1.04)     0.0000 (1.0)      215.8972 (1.04)     0.0000 (1.0)           0;0  0.0046 (0.96)          1           1
test_sharing_azure-fetch[main]       207.5122 (1.0)      207.5122 (1.0)      207.5122 (1.0)      0.0000 (1.0)      207.5122 (1.0)      0.0000 (1.0)           0;0  0.0048 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.2832 (1.0)      6.2832 (1.0)      6.2832 (1.0)      0.0000 (1.0)      6.2832 (1.0)      0.0000 (1.0)           0;0  0.1592 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6346 (1.06)     6.6346 (1.06)     6.6346 (1.06)     0.0000 (1.0)      6.6346 (1.06)     0.0000 (1.0)           0;0  0.1507 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     224.1025 (1.0)      224.1025 (1.0)      224.1025 (1.0)      0.0000 (1.0)      224.1025 (1.0)      0.0000 (1.0)           0;0  0.0045 (1.0)           1           1
test_sharing_azure-push[main]       226.6649 (1.01)     226.6649 (1.01)     226.6649 (1.01)     0.0000 (1.0)      226.6649 (1.01)     0.0000 (1.0)           0;0  0.0044 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.0869 (1.0)      7.0869 (1.0)      7.0869 (1.0)      0.0000 (1.0)      7.0869 (1.0)      0.0000 (1.0)           0;0  0.1411 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.4163 (1.05)     7.4163 (1.05)     7.4163 (1.05)     0.0000 (1.0)      7.4163 (1.05)     0.0000 (1.0)           0;0  0.1348 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     240.1318 (1.06)     240.1318 (1.06)     240.1318 (1.06)     0.0000 (1.0)      240.1318 (1.06)     0.0000 (1.0)           0;0  0.0042 (0.95)          1           1
test_sharing_gs-fetch[main]       227.1538 (1.0)      227.1538 (1.0)      227.1538 (1.0)      0.0000 (1.0)      227.1538 (1.0)      0.0000 (1.0)           0;0  0.0044 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     14.0428 (1.01)     14.0428 (1.01)     14.0428 (1.01)     0.0000 (1.0)      14.0428 (1.01)     0.0000 (1.0)           0;0  0.0712 (0.99)          1           1
test_sharing_gs-fetch-noop[main]       13.9210 (1.0)      13.9210 (1.0)      13.9210 (1.0)      0.0000 (1.0)      13.9210 (1.0)      0.0000 (1.0)           0;0  0.0718 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     533.0238 (1.01)     533.0238 (1.01)     533.0238 (1.01)     0.0000 (1.0)      533.0238 (1.01)     0.0000 (1.0)           0;0  0.0019 (0.99)          1           1
test_sharing_gs-push[main]       526.3752 (1.0)      526.3752 (1.0)      526.3752 (1.0)      0.0000 (1.0)      526.3752 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.5529 (1.0)      6.5529 (1.0)      6.5529 (1.0)      0.0000 (1.0)      6.5529 (1.0)      0.0000 (1.0)           0;0  0.1526 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.6567 (1.02)     6.6567 (1.02)     6.6567 (1.02)     0.0000 (1.0)      6.6567 (1.02)     0.0000 (1.0)           0;0  0.1502 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     271.1343 (1.02)     271.1343 (1.02)     271.1343 (1.02)     0.0000 (1.0)      271.1343 (1.02)     0.0000 (1.0)           0;0  0.0037 (0.98)          1           1
test_sharing_s3-fetch[main]       265.0696 (1.0)      265.0696 (1.0)      265.0696 (1.0)      0.0000 (1.0)      265.0696 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5990 (1.04)     6.5990 (1.04)     6.5990 (1.04)     0.0000 (1.0)      6.5990 (1.04)     0.0000 (1.0)           0;0  0.1515 (0.96)          1           1
test_sharing_s3-fetch-noop[main]       6.3289 (1.0)      6.3289 (1.0)      6.3289 (1.0)      0.0000 (1.0)      6.3289 (1.0)      0.0000 (1.0)           0;0  0.1580 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     304.7519 (1.0)      304.7519 (1.0)      304.7519 (1.0)      0.0000 (1.0)      304.7519 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
test_sharing_s3-push[main]       309.6215 (1.02)     309.6215 (1.02)     309.6215 (1.02)     0.0000 (1.0)      309.6215 (1.02)     0.0000 (1.0)           0;0  0.0032 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5487 (1.0)      6.5487 (1.0)      6.5487 (1.0)      0.0000 (1.0)      6.5487 (1.0)      0.0000 (1.0)           0;0  0.1527 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.7542 (1.03)     6.7542 (1.03)     6.7542 (1.03)     0.0000 (1.0)      6.7542 (1.03)     0.0000 (1.0)           0;0  0.1481 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.8195 (3.81)     19.8195 (3.81)     19.8195 (3.81)     0.0000 (1.0)      19.8195 (3.81)     0.0000 (1.0)           0;0  0.0505 (0.26)          1           1
test_status-status[3.10.0]     19.6073 (3.77)     19.6073 (3.77)     19.6073 (3.77)     0.0000 (1.0)      19.6073 (3.77)     0.0000 (1.0)           0;0  0.0510 (0.27)          1           1
test_status-status[3.53.2]     18.2174 (3.50)     18.2174 (3.50)     18.2174 (3.50)     0.0000 (1.0)      18.2174 (3.50)     0.0000 (1.0)           0;0  0.0549 (0.29)          1           1
test_status-status[3.60.1]      5.1976 (1.0)       5.1976 (1.0)       5.1976 (1.0)      0.0000 (1.0)       5.1976 (1.0)      0.0000 (1.0)           0;0  0.1924 (1.0)           1           1
test_status-status[main]        5.4691 (1.05)      5.4691 (1.05)      5.4691 (1.05)     0.0000 (1.0)       5.4691 (1.05)     0.0000 (1.0)           0;0  0.1828 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7621 (1.73)     4.7621 (1.73)     4.7621 (1.73)     0.0000 (1.0)      4.7621 (1.73)     0.0000 (1.0)           0;0  0.2100 (0.58)          1           1
test_status-status-changed[3.10.0]     5.1423 (1.87)     5.1423 (1.87)     5.1423 (1.87)     0.0000 (1.0)      5.1423 (1.87)     0.0000 (1.0)           0;0  0.1945 (0.53)          1           1
test_status-status-changed[3.53.2]     4.9518 (1.80)     4.9518 (1.80)     4.9518 (1.80)     0.0000 (1.0)      4.9518 (1.80)     0.0000 (1.0)           0;0  0.2019 (0.56)          1           1
test_status-status-changed[3.60.1]     2.7485 (1.0)      2.7485 (1.0)      2.7485 (1.0)      0.0000 (1.0)      2.7485 (1.0)      0.0000 (1.0)           0;0  0.3638 (1.0)           1           1
test_status-status-changed[main]       2.9623 (1.08)     2.9623 (1.08)     2.9623 (1.08)     0.0000 (1.0)      2.9623 (1.08)     0.0000 (1.0)           0;0  0.3376 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9812 (1.89)     4.9812 (1.89)     4.9812 (1.89)     0.0000 (1.0)      4.9812 (1.89)     0.0000 (1.0)           0;0  0.2008 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     4.9596 (1.88)     4.9596 (1.88)     4.9596 (1.88)     0.0000 (1.0)      4.9596 (1.88)     0.0000 (1.0)           0;0  0.2016 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.7873 (1.81)     4.7873 (1.81)     4.7873 (1.81)     0.0000 (1.0)      4.7873 (1.81)     0.0000 (1.0)           0;0  0.2089 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.6395 (1.0)      2.6395 (1.0)      2.6395 (1.0)      0.0000 (1.0)      2.6395 (1.0)      0.0000 (1.0)           0;0  0.3789 (1.0)           1           1
test_status-status-changed-noop[main]       2.8719 (1.09)     2.8719 (1.09)     2.8719 (1.09)     0.0000 (1.0)      2.8719 (1.09)     0.0000 (1.0)           0;0  0.3482 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7831 (1.80)     4.7831 (1.80)     4.7831 (1.80)     0.0000 (1.0)      4.7831 (1.80)     0.0000 (1.0)           0;0  0.2091 (0.55)          1           1
test_status-status-noop[3.10.0]     5.0287 (1.90)     5.0287 (1.90)     5.0287 (1.90)     0.0000 (1.0)      5.0287 (1.90)     0.0000 (1.0)           0;0  0.1989 (0.53)          1           1
test_status-status-noop[3.53.2]     4.8454 (1.83)     4.8454 (1.83)     4.8454 (1.83)     0.0000 (1.0)      4.8454 (1.83)     0.0000 (1.0)           0;0  0.2064 (0.55)          1           1
test_status-status-noop[3.60.1]     2.6511 (1.0)      2.6511 (1.0)      2.6511 (1.0)      0.0000 (1.0)      2.6511 (1.0)      0.0000 (1.0)           0;0  0.3772 (1.0)           1           1
test_status-status-noop[main]       2.9106 (1.10)     2.9106 (1.10)     2.9106 (1.10)     0.0000 (1.0)      2.9106 (1.10)     0.0000 (1.0)           0;0  0.3436 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     155.3100 (3.36)     155.3100 (3.36)     155.3100 (3.36)     0.0000 (1.0)      155.3100 (3.36)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     161.1087 (3.49)     161.1087 (3.49)     161.1087 (3.49)     0.0000 (1.0)      161.1087 (3.49)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.53.2]     118.3335 (2.56)     118.3335 (2.56)     118.3335 (2.56)     0.0000 (1.0)      118.3335 (2.56)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_update-import-url[3.60.1]      46.2263 (1.0)       46.2263 (1.0)       46.2263 (1.0)      0.0000 (1.0)       46.2263 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        47.9352 (1.04)      47.9352 (1.04)      47.9352 (1.04)     0.0000 (1.0)       47.9352 (1.04)     0.0000 (1.0)           0;0  0.0209 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     139.6112 (3.88)     139.6112 (3.88)     139.6112 (3.88)     0.0000 (1.0)      139.6112 (3.88)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     143.4927 (3.99)     143.4927 (3.99)     143.4927 (3.99)     0.0000 (1.0)      143.4927 (3.99)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     109.9506 (3.05)     109.9506 (3.05)     109.9506 (3.05)     0.0000 (1.0)      109.9506 (3.05)     0.0000 (1.0)           0;0  0.0091 (0.33)          1           1
test_update-update[3.60.1]      35.9995 (1.0)       35.9995 (1.0)       35.9995 (1.0)      0.0000 (1.0)       35.9995 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
test_update-update[main]        36.7730 (1.02)      36.7730 (1.02)      36.7730 (1.02)     0.0000 (1.0)       36.7730 (1.02)     0.0000 (1.0)           0;0  0.0272 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0755 (2.02)     16.0755 (2.02)     16.0755 (2.02)     0.0000 (1.0)      16.0755 (2.02)     0.0000 (1.0)           0;0  0.0622 (0.50)          1           1
test_update-update-noop[3.10.0]     17.0805 (2.14)     17.0805 (2.14)     17.0805 (2.14)     0.0000 (1.0)      17.0805 (2.14)     0.0000 (1.0)           0;0  0.0585 (0.47)          1           1
test_update-update-noop[3.53.2]     16.4226 (2.06)     16.4226 (2.06)     16.4226 (2.06)     0.0000 (1.0)      16.4226 (2.06)     0.0000 (1.0)           0;0  0.0609 (0.49)          1           1
test_update-update-noop[3.60.1]      7.9654 (1.0)       7.9654 (1.0)       7.9654 (1.0)      0.0000 (1.0)       7.9654 (1.0)      0.0000 (1.0)           0;0  0.1255 (1.0)           1           1
test_update-update-noop[main]        8.6148 (1.08)      8.6148 (1.08)      8.6148 (1.08)     0.0000 (1.0)       8.6148 (1.08)     0.0000 (1.0)           0;0  0.1161 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean