Wed Jul 30 00:42:02 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     83.9948 (3.74)     83.9948 (3.74)     83.9948 (3.74)     0.0000 (1.0)      83.9948 (3.74)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_add_copy-add[3.10.0]     84.7696 (3.77)     84.7696 (3.77)     84.7696 (3.77)     0.0000 (1.0)      84.7696 (3.77)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.53.2]     75.2408 (3.35)     75.2408 (3.35)     75.2408 (3.35)     0.0000 (1.0)      75.2408 (3.35)     0.0000 (1.0)           0;0  0.0133 (0.30)          1           1
test_add_copy-add[3.60.1]     22.4764 (1.0)      22.4764 (1.0)      22.4764 (1.0)      0.0000 (1.0)      22.4764 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_add_copy-add[main]       22.8814 (1.02)     22.8814 (1.02)     22.8814 (1.02)     0.0000 (1.0)      22.8814 (1.02)     0.0000 (1.0)           0;0  0.0437 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.7530 (6.67)     28.7530 (6.67)     28.7530 (6.67)     0.0000 (1.0)      28.7530 (6.67)     0.0000 (1.0)           0;0  0.0348 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.0804 (6.75)     29.0804 (6.75)     29.0804 (6.75)     0.0000 (1.0)      29.0804 (6.75)     0.0000 (1.0)           0;0  0.0344 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     27.6464 (6.41)     27.6464 (6.41)     27.6464 (6.41)     0.0000 (1.0)      27.6464 (6.41)     0.0000 (1.0)           0;0  0.0362 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.3110 (1.0)       4.3110 (1.0)       4.3110 (1.0)      0.0000 (1.0)       4.3110 (1.0)      0.0000 (1.0)           0;0  0.2320 (1.0)           1           1
test_add_copy-add-noop[main]        4.3347 (1.01)      4.3347 (1.01)      4.3347 (1.01)     0.0000 (1.0)       4.3347 (1.01)     0.0000 (1.0)           0;0  0.2307 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.8924 (4.16)     67.8924 (4.16)     67.8924 (4.16)     0.0000 (1.0)      67.8924 (4.16)     0.0000 (1.0)           0;0  0.0147 (0.24)          1           1
test_add_hardlink-add[3.10.0]     67.3051 (4.12)     67.3051 (4.12)     67.3051 (4.12)     0.0000 (1.0)      67.3051 (4.12)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.7827 (3.85)     62.7827 (3.85)     62.7827 (3.85)     0.0000 (1.0)      62.7827 (3.85)     0.0000 (1.0)           0;0  0.0159 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.3182 (1.0)      16.3182 (1.0)      16.3182 (1.0)      0.0000 (1.0)      16.3182 (1.0)      0.0000 (1.0)           0;0  0.0613 (1.0)           1           1
test_add_hardlink-add[main]       17.0473 (1.04)     17.0473 (1.04)     17.0473 (1.04)     0.0000 (1.0)      17.0473 (1.04)     0.0000 (1.0)           0;0  0.0587 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     35.2316 (7.96)     35.2316 (7.96)     35.2316 (7.96)     0.0000 (1.0)      35.2316 (7.96)     0.0000 (1.0)           0;0  0.0284 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.2443 (7.96)     35.2443 (7.96)     35.2443 (7.96)     0.0000 (1.0)      35.2443 (7.96)     0.0000 (1.0)           0;0  0.0284 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     33.3181 (7.53)     33.3181 (7.53)     33.3181 (7.53)     0.0000 (1.0)      33.3181 (7.53)     0.0000 (1.0)           0;0  0.0300 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5489 (1.03)      4.5489 (1.03)      4.5489 (1.03)     0.0000 (1.0)       4.5489 (1.03)     0.0000 (1.0)           0;0  0.2198 (0.97)          1           1
test_add_hardlink-add-noop[main]        4.4268 (1.0)       4.4268 (1.0)       4.4268 (1.0)      0.0000 (1.0)       4.4268 (1.0)      0.0000 (1.0)           0;0  0.2259 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     70.5798 (2.04)     70.5798 (2.04)     70.5798 (2.04)     0.0000 (1.0)      70.5798 (2.04)     0.0000 (1.0)           0;0  0.0142 (0.49)          1           1
test_add_symlink-add[3.10.0]     71.0158 (2.06)     71.0158 (2.06)     71.0158 (2.06)     0.0000 (1.0)      71.0158 (2.06)     0.0000 (1.0)           0;0  0.0141 (0.49)          1           1
test_add_symlink-add[3.53.2]     64.7044 (1.87)     64.7044 (1.87)     64.7044 (1.87)     0.0000 (1.0)      64.7044 (1.87)     0.0000 (1.0)           0;0  0.0155 (0.53)          1           1
test_add_symlink-add[3.60.1]     34.5381 (1.0)      34.5381 (1.0)      34.5381 (1.0)      0.0000 (1.0)      34.5381 (1.0)      0.0000 (1.0)           0;0  0.0290 (1.0)           1           1
test_add_symlink-add[main]       34.9555 (1.01)     34.9555 (1.01)     34.9555 (1.01)     0.0000 (1.0)      34.9555 (1.01)     0.0000 (1.0)           0;0  0.0286 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.0778 (8.32)     48.0778 (8.32)     48.0778 (8.32)     0.0000 (1.0)      48.0778 (8.32)     0.0000 (1.0)           0;0  0.0208 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.5170 (8.22)     47.5170 (8.22)     47.5170 (8.22)     0.0000 (1.0)      47.5170 (8.22)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.4516 (8.03)     46.4516 (8.03)     46.4516 (8.03)     0.0000 (1.0)      46.4516 (8.03)     0.0000 (1.0)           0;0  0.0215 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.8339 (1.01)      5.8339 (1.01)      5.8339 (1.01)     0.0000 (1.0)       5.8339 (1.01)     0.0000 (1.0)           0;0  0.1714 (0.99)          1           1
test_add_symlink-add-noop[main]        5.7816 (1.0)       5.7816 (1.0)       5.7816 (1.0)      0.0000 (1.0)       5.7816 (1.0)      0.0000 (1.0)           0;0  0.1730 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.5065 (1.95)     40.5065 (1.95)     40.5065 (1.95)     0.0000 (1.0)      40.5065 (1.95)     0.0000 (1.0)           0;0  0.0247 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     60.1899 (2.89)     60.1899 (2.89)     60.1899 (2.89)     0.0000 (1.0)      60.1899 (2.89)     0.0000 (1.0)           0;0  0.0166 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     27.3649 (1.32)     27.3649 (1.32)     27.3649 (1.32)     0.0000 (1.0)      27.3649 (1.32)     0.0000 (1.0)           0;0  0.0365 (0.76)          1           1
test_checkout_copy-checkout[3.60.1]     20.7955 (1.0)      20.7955 (1.0)      20.7955 (1.0)      0.0000 (1.0)      20.7955 (1.0)      0.0000 (1.0)           0;0  0.0481 (1.0)           1           1
test_checkout_copy-checkout[main]       21.4218 (1.03)     21.4218 (1.03)     21.4218 (1.03)     0.0000 (1.0)      21.4218 (1.03)     0.0000 (1.0)           0;0  0.0467 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3408 (1.65)     5.3408 (1.65)     5.3408 (1.65)     0.0000 (1.0)      5.3408 (1.65)     0.0000 (1.0)           0;0  0.1872 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.4865 (1.70)     5.4865 (1.70)     5.4865 (1.70)     0.0000 (1.0)      5.4865 (1.70)     0.0000 (1.0)           0;0  0.1823 (0.59)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4021 (1.67)     5.4021 (1.67)     5.4021 (1.67)     0.0000 (1.0)      5.4021 (1.67)     0.0000 (1.0)           0;0  0.1851 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2472 (1.00)     3.2472 (1.00)     3.2472 (1.00)     0.0000 (1.0)      3.2472 (1.00)     0.0000 (1.0)           0;0  0.3080 (1.00)          1           1
test_checkout_copy-checkout-noop[main]       3.2368 (1.0)      3.2368 (1.0)      3.2368 (1.0)      0.0000 (1.0)      3.2368 (1.0)      0.0000 (1.0)           0;0  0.3089 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.4578 (2.21)     8.4578 (2.21)     8.4578 (2.21)     0.0000 (1.0)      8.4578 (2.21)     0.0000 (1.0)           0;0  0.1182 (0.45)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.2211 (1.62)     6.2211 (1.62)     6.2211 (1.62)     0.0000 (1.0)      6.2211 (1.62)     0.0000 (1.0)           0;0  0.1607 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1843 (1.61)     6.1843 (1.61)     6.1843 (1.61)     0.0000 (1.0)      6.1843 (1.61)     0.0000 (1.0)           0;0  0.1617 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8338 (1.0)      3.8338 (1.0)      3.8338 (1.0)      0.0000 (1.0)      3.8338 (1.0)      0.0000 (1.0)           0;0  0.2608 (1.0)           1           1
test_checkout_copy-checkout-update[main]       3.8932 (1.02)     3.8932 (1.02)     3.8932 (1.02)     0.0000 (1.0)      3.8932 (1.02)     0.0000 (1.0)           0;0  0.2569 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.7837 (3.06)     21.7837 (3.06)     21.7837 (3.06)     0.0000 (1.0)      21.7837 (3.06)     0.0000 (1.0)           0;0  0.0459 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7625 (2.22)     15.7625 (2.22)     15.7625 (2.22)     0.0000 (1.0)      15.7625 (2.22)     0.0000 (1.0)           0;0  0.0634 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.0984 (1.98)     14.0984 (1.98)     14.0984 (1.98)     0.0000 (1.0)      14.0984 (1.98)     0.0000 (1.0)           0;0  0.0709 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.1086 (1.0)       7.1086 (1.0)       7.1086 (1.0)      0.0000 (1.0)       7.1086 (1.0)      0.0000 (1.0)           0;0  0.1407 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.6005 (1.07)      7.6005 (1.07)      7.6005 (1.07)     0.0000 (1.0)       7.6005 (1.07)     0.0000 (1.0)           0;0  0.1316 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3339 (1.65)     5.3339 (1.65)     5.3339 (1.65)     0.0000 (1.0)      5.3339 (1.65)     0.0000 (1.0)           0;0  0.1875 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5554 (1.72)     5.5554 (1.72)     5.5554 (1.72)     0.0000 (1.0)      5.5554 (1.72)     0.0000 (1.0)           0;0  0.1800 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3766 (1.67)     5.3766 (1.67)     5.3766 (1.67)     0.0000 (1.0)      5.3766 (1.67)     0.0000 (1.0)           0;0  0.1860 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2254 (1.0)      3.2254 (1.0)      3.2254 (1.0)      0.0000 (1.0)      3.2254 (1.0)      0.0000 (1.0)           0;0  0.3100 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.2324 (1.00)     3.2324 (1.00)     3.2324 (1.00)     0.0000 (1.0)      3.2324 (1.00)     0.0000 (1.0)           0;0  0.3094 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.5426 (2.24)     8.5426 (2.24)     8.5426 (2.24)     0.0000 (1.0)      8.5426 (2.24)     0.0000 (1.0)           0;0  0.1171 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.2789 (1.65)     6.2789 (1.65)     6.2789 (1.65)     0.0000 (1.0)      6.2789 (1.65)     0.0000 (1.0)           0;0  0.1593 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1484 (1.61)     6.1484 (1.61)     6.1484 (1.61)     0.0000 (1.0)      6.1484 (1.61)     0.0000 (1.0)           0;0  0.1626 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8150 (1.0)      3.8150 (1.0)      3.8150 (1.0)      0.0000 (1.0)      3.8150 (1.0)      0.0000 (1.0)           0;0  0.2621 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.8188 (1.00)     3.8188 (1.00)     3.8188 (1.00)     0.0000 (1.0)      3.8188 (1.00)     0.0000 (1.0)           0;0  0.2619 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.1461 (2.59)     25.1461 (2.59)     25.1461 (2.59)     0.0000 (1.0)      25.1461 (2.59)     0.0000 (1.0)           0;0  0.0398 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     18.5860 (1.91)     18.5860 (1.91)     18.5860 (1.91)     0.0000 (1.0)      18.5860 (1.91)     0.0000 (1.0)           0;0  0.0538 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.3381 (1.78)     17.3381 (1.78)     17.3381 (1.78)     0.0000 (1.0)      17.3381 (1.78)     0.0000 (1.0)           0;0  0.0577 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]      9.7168 (1.0)       9.7168 (1.0)       9.7168 (1.0)      0.0000 (1.0)       9.7168 (1.0)      0.0000 (1.0)           0;0  0.1029 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.5285 (1.08)     10.5285 (1.08)     10.5285 (1.08)     0.0000 (1.0)      10.5285 (1.08)     0.0000 (1.0)           0;0  0.0950 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7026 (1.59)     6.7026 (1.59)     6.7026 (1.59)     0.0000 (1.0)      6.7026 (1.59)     0.0000 (1.0)           0;0  0.1492 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7847 (1.61)     6.7847 (1.61)     6.7847 (1.61)     0.0000 (1.0)      6.7847 (1.61)     0.0000 (1.0)           0;0  0.1474 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6005 (1.56)     6.6005 (1.56)     6.6005 (1.56)     0.0000 (1.0)      6.6005 (1.56)     0.0000 (1.0)           0;0  0.1515 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2259 (1.0)      4.2259 (1.0)      4.2259 (1.0)      0.0000 (1.0)      4.2259 (1.0)      0.0000 (1.0)           0;0  0.2366 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.2987 (1.02)     4.2987 (1.02)     4.2987 (1.02)     0.0000 (1.0)      4.2987 (1.02)     0.0000 (1.0)           0;0  0.2326 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.7319 (1.87)     10.7319 (1.87)     10.7319 (1.87)     0.0000 (1.0)      10.7319 (1.87)     0.0000 (1.0)           0;0  0.0932 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4396 (1.47)      8.4396 (1.47)      8.4396 (1.47)     0.0000 (1.0)       8.4396 (1.47)     0.0000 (1.0)           0;0  0.1185 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.2904 (1.44)      8.2904 (1.44)      8.2904 (1.44)     0.0000 (1.0)       8.2904 (1.44)     0.0000 (1.0)           0;0  0.1206 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7535 (1.0)       5.7535 (1.0)       5.7535 (1.0)      0.0000 (1.0)       5.7535 (1.0)      0.0000 (1.0)           0;0  0.1738 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.7981 (1.01)      5.7981 (1.01)      5.7981 (1.01)     0.0000 (1.0)       5.7981 (1.01)     0.0000 (1.0)           0;0  0.1725 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1020 (1.80)     4.1020 (1.80)     4.1020 (1.80)     0.0000 (1.0)      4.1020 (1.80)     0.0000 (1.0)           0;0  0.2438 (0.55)          1           1
test_data_status-data-changed[3.10.0]     4.5860 (2.02)     4.5860 (2.02)     4.5860 (2.02)     0.0000 (1.0)      4.5860 (2.02)     0.0000 (1.0)           0;0  0.2181 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.4915 (1.97)     4.4915 (1.97)     4.4915 (1.97)     0.0000 (1.0)      4.4915 (1.97)     0.0000 (1.0)           0;0  0.2226 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3310 (1.02)     2.3310 (1.02)     2.3310 (1.02)     0.0000 (1.0)      2.3310 (1.02)     0.0000 (1.0)           0;0  0.4290 (0.98)          1           1
test_data_status-data-changed[main]       2.2746 (1.0)      2.2746 (1.0)      2.2746 (1.0)      0.0000 (1.0)      2.2746 (1.0)      0.0000 (1.0)           0;0  0.4396 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9988 (1.75)     3.9988 (1.75)     3.9988 (1.75)     0.0000 (1.0)      3.9988 (1.75)     0.0000 (1.0)           0;0  0.2501 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.6509 (2.04)     4.6509 (2.04)     4.6509 (2.04)     0.0000 (1.0)      4.6509 (2.04)     0.0000 (1.0)           0;0  0.2150 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.4825 (1.97)     4.4825 (1.97)     4.4825 (1.97)     0.0000 (1.0)      4.4825 (1.97)     0.0000 (1.0)           0;0  0.2231 (0.51)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2803 (1.0)      2.2803 (1.0)      2.2803 (1.0)      0.0000 (1.0)      2.2803 (1.0)      0.0000 (1.0)           0;0  0.4385 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.3923 (1.05)     2.3923 (1.05)     2.3923 (1.05)     0.0000 (1.0)      2.3923 (1.05)     0.0000 (1.0)           0;0  0.4180 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2429 (3.72)     18.2429 (3.72)     18.2429 (3.72)     0.0000 (1.0)      18.2429 (3.72)     0.0000 (1.0)           0;0  0.0548 (0.27)          1           1
test_data_status-data-new[3.10.0]     18.9740 (3.87)     18.9740 (3.87)     18.9740 (3.87)     0.0000 (1.0)      18.9740 (3.87)     0.0000 (1.0)           0;0  0.0527 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.2778 (3.73)     18.2778 (3.73)     18.2778 (3.73)     0.0000 (1.0)      18.2778 (3.73)     0.0000 (1.0)           0;0  0.0547 (0.27)          1           1
test_data_status-data-new[3.60.1]      4.9062 (1.0)       4.9062 (1.0)       4.9062 (1.0)      0.0000 (1.0)       4.9062 (1.0)      0.0000 (1.0)           0;0  0.2038 (1.0)           1           1
test_data_status-data-new[main]        5.1932 (1.06)      5.1932 (1.06)      5.1932 (1.06)     0.0000 (1.0)       5.1932 (1.06)     0.0000 (1.0)           0;0  0.1926 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0889 (1.80)     4.0889 (1.80)     4.0889 (1.80)     0.0000 (1.0)      4.0889 (1.80)     0.0000 (1.0)           0;0  0.2446 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.7515 (2.10)     4.7515 (2.10)     4.7515 (2.10)     0.0000 (1.0)      4.7515 (2.10)     0.0000 (1.0)           0;0  0.2105 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.4230 (1.95)     4.4230 (1.95)     4.4230 (1.95)     0.0000 (1.0)      4.4230 (1.95)     0.0000 (1.0)           0;0  0.2261 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.3392 (1.03)     2.3392 (1.03)     2.3392 (1.03)     0.0000 (1.0)      2.3392 (1.03)     0.0000 (1.0)           0;0  0.4275 (0.97)          1           1
test_data_status-data-noop[main]       2.2656 (1.0)      2.2656 (1.0)      2.2656 (1.0)      0.0000 (1.0)      2.2656 (1.0)      0.0000 (1.0)           0;0  0.4414 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1573 (1.28)     7.1573 (1.28)     7.1573 (1.28)     0.0000 (1.0)      7.1573 (1.28)     0.0000 (1.0)           0;0  0.1397 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8247 (1.40)     7.8247 (1.40)     7.8247 (1.40)     0.0000 (1.0)      7.8247 (1.40)     0.0000 (1.0)           0;0  0.1278 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7957 (1.40)     7.7957 (1.40)     7.7957 (1.40)     0.0000 (1.0)      7.7957 (1.40)     0.0000 (1.0)           0;0  0.1283 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6963 (1.02)     5.6963 (1.02)     5.6963 (1.02)     0.0000 (1.0)      5.6963 (1.02)     0.0000 (1.0)           0;0  0.1756 (0.98)          1           1
test_data_status_all_flags-data-changed[main]       5.5794 (1.0)      5.5794 (1.0)      5.5794 (1.0)      0.0000 (1.0)      5.5794 (1.0)      0.0000 (1.0)           0;0  0.1792 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2382 (1.28)     7.2382 (1.28)     7.2382 (1.28)     0.0000 (1.0)      7.2382 (1.28)     0.0000 (1.0)           0;0  0.1382 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8359 (1.38)     7.8359 (1.38)     7.8359 (1.38)     0.0000 (1.0)      7.8359 (1.38)     0.0000 (1.0)           0;0  0.1276 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8015 (1.37)     7.8015 (1.37)     7.8015 (1.37)     0.0000 (1.0)      7.8015 (1.37)     0.0000 (1.0)           0;0  0.1282 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7844 (1.02)     5.7844 (1.02)     5.7844 (1.02)     0.0000 (1.0)      5.7844 (1.02)     0.0000 (1.0)           0;0  0.1729 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.6745 (1.0)      5.6745 (1.0)      5.6745 (1.0)      0.0000 (1.0)      5.6745 (1.0)      0.0000 (1.0)           0;0  0.1762 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.2602 (2.64)     21.2602 (2.64)     21.2602 (2.64)     0.0000 (1.0)      21.2602 (2.64)     0.0000 (1.0)           0;0  0.0470 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.5316 (2.80)     22.5316 (2.80)     22.5316 (2.80)     0.0000 (1.0)      22.5316 (2.80)     0.0000 (1.0)           0;0  0.0444 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.6022 (2.81)     22.6022 (2.81)     22.6022 (2.81)     0.0000 (1.0)      22.6022 (2.81)     0.0000 (1.0)           0;0  0.0442 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0492 (1.0)       8.0492 (1.0)       8.0492 (1.0)      0.0000 (1.0)       8.0492 (1.0)      0.0000 (1.0)           0;0  0.1242 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1605 (1.01)      8.1605 (1.01)      8.1605 (1.01)     0.0000 (1.0)       8.1605 (1.01)     0.0000 (1.0)           0;0  0.1225 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4967 (1.34)     6.4967 (1.34)     6.4967 (1.34)     0.0000 (1.0)      6.4967 (1.34)     0.0000 (1.0)           0;0  0.1539 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2684 (1.50)     7.2684 (1.50)     7.2684 (1.50)     0.0000 (1.0)      7.2684 (1.50)     0.0000 (1.0)           0;0  0.1376 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.2257 (1.49)     7.2257 (1.49)     7.2257 (1.49)     0.0000 (1.0)      7.2257 (1.49)     0.0000 (1.0)           0;0  0.1384 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8557 (1.0)      4.8557 (1.0)      4.8557 (1.0)      0.0000 (1.0)      4.8557 (1.0)      0.0000 (1.0)           0;0  0.2059 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.9297 (1.02)     4.9297 (1.02)     4.9297 (1.02)     0.0000 (1.0)      4.9297 (1.02)     0.0000 (1.0)           0;0  0.2029 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.1960 (2.68)     18.1960 (2.68)     18.1960 (2.68)     0.0000 (1.0)      18.1960 (2.68)     0.0000 (1.0)           0;0  0.0550 (0.37)          1           1
test_diff-diff[3.10.0]     19.2742 (2.84)     19.2742 (2.84)     19.2742 (2.84)     0.0000 (1.0)      19.2742 (2.84)     0.0000 (1.0)           0;0  0.0519 (0.35)          1           1
test_diff-diff[3.53.2]     19.1449 (2.82)     19.1449 (2.82)     19.1449 (2.82)     0.0000 (1.0)      19.1449 (2.82)     0.0000 (1.0)           0;0  0.0522 (0.35)          1           1
test_diff-diff[3.60.1]      6.7903 (1.0)       6.7903 (1.0)       6.7903 (1.0)      0.0000 (1.0)       6.7903 (1.0)      0.0000 (1.0)           0;0  0.1473 (1.0)           1           1
test_diff-diff[main]        7.2206 (1.06)      7.2206 (1.06)      7.2206 (1.06)     0.0000 (1.0)       7.2206 (1.06)     0.0000 (1.0)           0;0  0.1385 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0077 (1.71)     6.0077 (1.71)     6.0077 (1.71)     0.0000 (1.0)      6.0077 (1.71)     0.0000 (1.0)           0;0  0.1665 (0.58)          1           1
test_diff-diff-changed[3.10.0]     6.9544 (1.98)     6.9544 (1.98)     6.9544 (1.98)     0.0000 (1.0)      6.9544 (1.98)     0.0000 (1.0)           0;0  0.1438 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.7805 (1.65)     5.7805 (1.65)     5.7805 (1.65)     0.0000 (1.0)      5.7805 (1.65)     0.0000 (1.0)           0;0  0.1730 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.5680 (1.02)     3.5680 (1.02)     3.5680 (1.02)     0.0000 (1.0)      3.5680 (1.02)     0.0000 (1.0)           0;0  0.2803 (0.98)          1           1
test_diff-diff-changed[main]       3.5122 (1.0)      3.5122 (1.0)      3.5122 (1.0)      0.0000 (1.0)      3.5122 (1.0)      0.0000 (1.0)           0;0  0.2847 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3588 (1.51)     5.3588 (1.51)     5.3588 (1.51)     0.0000 (1.0)      5.3588 (1.51)     0.0000 (1.0)           0;0  0.1866 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0111 (1.69)     6.0111 (1.69)     6.0111 (1.69)     0.0000 (1.0)      6.0111 (1.69)     0.0000 (1.0)           0;0  0.1664 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.9153 (1.66)     5.9153 (1.66)     5.9153 (1.66)     0.0000 (1.0)      5.9153 (1.66)     0.0000 (1.0)           0;0  0.1691 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.5916 (1.01)     3.5916 (1.01)     3.5916 (1.01)     0.0000 (1.0)      3.5916 (1.01)     0.0000 (1.0)           0;0  0.2784 (0.99)          1           1
test_diff-diff-changed-noop[main]       3.5533 (1.0)      3.5533 (1.0)      3.5533 (1.0)      0.0000 (1.0)      3.5533 (1.0)      0.0000 (1.0)           0;0  0.2814 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1133 (1.17)     4.1133 (1.17)     4.1133 (1.17)     0.0000 (1.0)      4.1133 (1.17)     0.0000 (1.0)           0;0  0.2431 (0.85)          1           1
test_diff-diff-noop[3.10.0]     5.0471 (1.44)     5.0471 (1.44)     5.0471 (1.44)     0.0000 (1.0)      5.0471 (1.44)     0.0000 (1.0)           0;0  0.1981 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.6830 (1.62)     5.6830 (1.62)     5.6830 (1.62)     0.0000 (1.0)      5.6830 (1.62)     0.0000 (1.0)           0;0  0.1760 (0.62)          1           1
test_diff-diff-noop[3.60.1]     3.6264 (1.03)     3.6264 (1.03)     3.6264 (1.03)     0.0000 (1.0)      3.6264 (1.03)     0.0000 (1.0)           0;0  0.2758 (0.97)          1           1
test_diff-diff-noop[main]       3.5125 (1.0)      3.5125 (1.0)      3.5125 (1.0)      0.0000 (1.0)      3.5125 (1.0)      0.0000 (1.0)           0;0  0.2847 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.1063 (1.0)      1.1063 (1.0)      1.1063 (1.0)      0.0000 (1.0)      1.1063 (1.0)      0.0000 (1.0)           0;0  0.9039 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.9314 (4.46)     4.9314 (4.46)     4.9314 (4.46)     0.0000 (1.0)      4.9314 (4.46)     0.0000 (1.0)           0;0  0.2028 (0.22)          1           1
test_exp_show-exp[3.53.2]     3.2357 (2.92)     3.2357 (2.92)     3.2357 (2.92)     0.0000 (1.0)      3.2357 (2.92)     0.0000 (1.0)           0;0  0.3091 (0.34)          1           1
test_exp_show-exp[3.60.1]     3.6425 (3.29)     3.6425 (3.29)     3.6425 (3.29)     0.0000 (1.0)      3.6425 (3.29)     0.0000 (1.0)           0;0  0.2745 (0.30)          1           1
test_exp_show-exp[main]       4.0575 (3.67)     4.0575 (3.67)     4.0575 (3.67)     0.0000 (1.0)      4.0575 (3.67)     0.0000 (1.0)           0;0  0.2465 (0.27)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     65.4051 (2.85)     65.4051 (2.85)     65.4051 (2.85)     0.0000 (1.0)      65.4051 (2.85)     0.0000 (1.0)           0;0  0.0153 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.6485 (3.12)     71.6485 (3.12)     71.6485 (3.12)     0.0000 (1.0)      71.6485 (3.12)     0.0000 (1.0)           0;0  0.0140 (0.32)          1           1
test_fetch-fetch[3.53.2]     34.7456 (1.51)     34.7456 (1.51)     34.7456 (1.51)     0.0000 (1.0)      34.7456 (1.51)     0.0000 (1.0)           0;0  0.0288 (0.66)          1           1
test_fetch-fetch[3.60.1]     23.2100 (1.01)     23.2100 (1.01)     23.2100 (1.01)     0.0000 (1.0)      23.2100 (1.01)     0.0000 (1.0)           0;0  0.0431 (0.99)          1           1
test_fetch-fetch[main]       22.9691 (1.0)      22.9691 (1.0)      22.9691 (1.0)      0.0000 (1.0)      22.9691 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8248 (1.01)     2.8248 (1.01)     2.8248 (1.01)     0.0000 (1.0)      2.8248 (1.01)     0.0000 (1.0)           0;0  0.3540 (0.99)          1           1
test_gc-gc[3.10.0]     2.9192 (1.05)     2.9192 (1.05)     2.9192 (1.05)     0.0000 (1.0)      2.9192 (1.05)     0.0000 (1.0)           0;0  0.3426 (0.96)          1           1
test_gc-gc[3.53.2]     2.8103 (1.01)     2.8103 (1.01)     2.8103 (1.01)     0.0000 (1.0)      2.8103 (1.01)     0.0000 (1.0)           0;0  0.3558 (0.99)          1           1
test_gc-gc[3.60.1]     2.7907 (1.0)      2.7907 (1.0)      2.7907 (1.0)      0.0000 (1.0)      2.7907 (1.0)      0.0000 (1.0)           0;0  0.3583 (1.0)           1           1
test_gc-gc[main]       2.9806 (1.07)     2.9806 (1.07)     2.9806 (1.07)     0.0000 (1.0)      2.9806 (1.07)     0.0000 (1.0)           0;0  0.3355 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     135.6720 (2.74)     135.6720 (2.74)     135.6720 (2.74)     0.0000 (1.0)      135.6720 (2.74)     0.0000 (1.0)           0;0  0.0074 (0.36)          1           1
test_get-get[3.10.0]     167.9785 (3.39)     167.9785 (3.39)     167.9785 (3.39)     0.0000 (1.0)      167.9785 (3.39)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_get-get[3.53.2]     163.0415 (3.29)     163.0415 (3.29)     163.0415 (3.29)     0.0000 (1.0)      163.0415 (3.29)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.60.1]      49.4939 (1.0)       49.4939 (1.0)       49.4939 (1.0)      0.0000 (1.0)       49.4939 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
test_get-get[main]        49.8152 (1.01)      49.8152 (1.01)      49.8152 (1.01)     0.0000 (1.0)       49.8152 (1.01)     0.0000 (1.0)           0;0  0.0201 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.4788 (2.66)     44.4788 (2.66)     44.4788 (2.66)     0.0000 (1.0)      44.4788 (2.66)     0.0000 (1.0)           0;0  0.0225 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.4402 (2.84)     47.4402 (2.84)     47.4402 (2.84)     0.0000 (1.0)      47.4402 (2.84)     0.0000 (1.0)           0;0  0.0211 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.8107 (1.01)     16.8107 (1.01)     16.8107 (1.01)     0.0000 (1.0)      16.8107 (1.01)     0.0000 (1.0)           0;0  0.0595 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.6913 (1.0)      16.6913 (1.0)      16.6913 (1.0)      0.0000 (1.0)      16.6913 (1.0)      0.0000 (1.0)           0;0  0.0599 (1.0)           1           1
test_get_url-get-url[main]       16.9121 (1.01)     16.9121 (1.01)     16.9121 (1.01)     0.0000 (1.0)      16.9121 (1.01)     0.0000 (1.0)           0;0  0.0591 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.1347 (1.01)     132.7004 (1.0)      127.4661 (1.00)     1.3945 (1.0)      127.1237 (1.00)     1.5284 (1.0)          20;7  7.8452 (1.00)        100           1
test_help---help[3.10.0]     124.1506 (1.0)      133.6597 (1.01)     127.4598 (1.00)     2.1982 (1.58)     127.2500 (1.00)     2.7875 (1.82)         32;2  7.8456 (1.00)        100           1
test_help---help[3.53.2]     124.2826 (1.00)     133.7349 (1.01)     127.3315 (1.0)      1.9732 (1.41)     126.8487 (1.0)      3.0437 (1.99)         31;1  7.8535 (1.0)         100           1
test_help---help[3.60.1]     124.2142 (1.00)     141.0263 (1.06)     129.5672 (1.02)     2.8388 (2.04)     129.1941 (1.02)     3.6091 (2.36)         24;2  7.7180 (0.98)        100           1
test_help---help[main]       126.7199 (1.02)     173.4881 (1.31)     132.7322 (1.04)     6.6222 (4.75)     131.3010 (1.04)     2.2376 (1.46)          5;9  7.5340 (0.96)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     227.4121 (2.95)     227.4121 (2.95)     227.4121 (2.95)     0.0000 (1.0)      227.4121 (2.95)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     256.9477 (3.34)     256.9477 (3.34)     256.9477 (3.34)     0.0000 (1.0)      256.9477 (3.34)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      77.0036 (1.0)       77.0036 (1.0)       77.0036 (1.0)      0.0000 (1.0)       77.0036 (1.0)      0.0000 (1.0)           0;0  0.0130 (1.0)           1           1
test_import-import[main]        77.5057 (1.01)      77.5057 (1.01)      77.5057 (1.01)     0.0000 (1.0)       77.5057 (1.01)     0.0000 (1.0)           0;0  0.0129 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     157.1787 (3.36)     157.1787 (3.36)     157.1787 (3.36)     0.0000 (1.0)      157.1787 (3.36)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     161.3465 (3.45)     161.3465 (3.45)     161.3465 (3.45)     0.0000 (1.0)      161.3465 (3.45)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_import_url-import-url[3.53.2]     118.7822 (2.54)     118.7822 (2.54)     118.7822 (2.54)     0.0000 (1.0)      118.7822 (2.54)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_import_url-import-url[3.60.1]      46.7524 (1.0)       46.7524 (1.0)       46.7524 (1.0)      0.0000 (1.0)       46.7524 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_import_url-import-url[main]        47.6910 (1.02)      47.6910 (1.02)      47.6910 (1.02)     0.0000 (1.0)       47.6910 (1.02)     0.0000 (1.0)           0;0  0.0210 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     396.2540 (1.01)     425.5694 (1.02)     404.5276 (1.0)       5.3319 (1.10)     403.9843 (1.0)      5.6347 (1.0)          30;3  2.4720 (1.0)         100           1
test_init-init[3.10.0]     404.0544 (1.03)     443.0966 (1.07)     414.6622 (1.03)      6.1731 (1.28)     414.0661 (1.02)     8.6414 (1.53)         24;2  2.4116 (0.98)        100           1
test_init-init[3.53.2]     394.4885 (1.00)     415.2680 (1.0)      404.9771 (1.00)      4.8408 (1.0)      404.9443 (1.00)     6.8004 (1.21)         32;0  2.4693 (1.00)        100           1
test_init-init[3.60.1]     393.3672 (1.00)     422.5100 (1.02)     407.8381 (1.01)      5.7835 (1.19)     407.8272 (1.01)     8.2828 (1.47)         31;0  2.4520 (0.99)        100           1
test_init-init[main]       392.7131 (1.0)      500.9516 (1.21)     408.9517 (1.01)     12.6275 (2.61)     406.9091 (1.01)     7.2450 (1.29)          6;3  2.4453 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     550.1157 (1.0)      550.1157 (1.0)      550.1157 (1.0)      0.0000 (1.0)      550.1157 (1.0)      0.0000 (1.0)           0;0  1.8178 (1.0)           1           1
test_list-list[3.10.0]     648.5336 (1.18)     648.5336 (1.18)     648.5336 (1.18)     0.0000 (1.0)      648.5336 (1.18)     0.0000 (1.0)           0;0  1.5419 (0.85)          1           1
test_list-list[3.53.2]     627.7836 (1.14)     627.7836 (1.14)     627.7836 (1.14)     0.0000 (1.0)      627.7836 (1.14)     0.0000 (1.0)           0;0  1.5929 (0.88)          1           1
test_list-list[3.60.1]     607.3535 (1.10)     607.3535 (1.10)     607.3535 (1.10)     0.0000 (1.0)      607.3535 (1.10)     0.0000 (1.0)           0;0  1.6465 (0.91)          1           1
test_list-list[main]       567.3776 (1.03)     567.3776 (1.03)     567.3776 (1.03)     0.0000 (1.0)      567.3776 (1.03)     0.0000 (1.0)           0;0  1.7625 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     405.7081 (1.0)      405.7081 (1.0)      405.7081 (1.0)      0.0000 (1.0)      405.7081 (1.0)      0.0000 (1.0)           0;0  2.4648 (1.0)           1           1
test_list-list-dvc-only[3.10.0]     408.4957 (1.01)     408.4957 (1.01)     408.4957 (1.01)     0.0000 (1.0)      408.4957 (1.01)     0.0000 (1.0)           0;0  2.4480 (0.99)          1           1
test_list-list-dvc-only[3.53.2]     437.7867 (1.08)     437.7867 (1.08)     437.7867 (1.08)     0.0000 (1.0)      437.7867 (1.08)     0.0000 (1.0)           0;0  2.2842 (0.93)          1           1
test_list-list-dvc-only[3.60.1]     468.3191 (1.15)     468.3191 (1.15)     468.3191 (1.15)     0.0000 (1.0)      468.3191 (1.15)     0.0000 (1.0)           0;0  2.1353 (0.87)          1           1
test_list-list-dvc-only[main]       439.6750 (1.08)     439.6750 (1.08)     439.6750 (1.08)     0.0000 (1.0)      439.6750 (1.08)     0.0000 (1.0)           0;0  2.2744 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5604 (1.0)      2.5604 (1.0)      2.5604 (1.0)      0.0000 (1.0)      2.5604 (1.0)      0.0000 (1.0)           0;0  0.3906 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6924 (1.05)     2.6924 (1.05)     2.6924 (1.05)     0.0000 (1.0)      2.6924 (1.05)     0.0000 (1.0)           0;0  0.3714 (0.95)          1           1
test_list-list-recursive[3.53.2]     3.0559 (1.19)     3.0559 (1.19)     3.0559 (1.19)     0.0000 (1.0)      3.0559 (1.19)     0.0000 (1.0)           0;0  0.3272 (0.84)          1           1
test_list-list-recursive[3.60.1]     3.1555 (1.23)     3.1555 (1.23)     3.1555 (1.23)     0.0000 (1.0)      3.1555 (1.23)     0.0000 (1.0)           0;0  0.3169 (0.81)          1           1
test_list-list-recursive[main]       3.0242 (1.18)     3.0242 (1.18)     3.0242 (1.18)     0.0000 (1.0)      3.0242 (1.18)     0.0000 (1.0)           0;0  0.3307 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     400.6975 (1.0)      400.6975 (1.0)      400.6975 (1.0)      0.0000 (1.0)      400.6975 (1.0)      0.0000 (1.0)           0;0  2.4956 (1.0)           1           1
test_list-list-shallow[3.10.0]     421.6230 (1.05)     421.6230 (1.05)     421.6230 (1.05)     0.0000 (1.0)      421.6230 (1.05)     0.0000 (1.0)           0;0  2.3718 (0.95)          1           1
test_list-list-shallow[3.53.2]     465.7814 (1.16)     465.7814 (1.16)     465.7814 (1.16)     0.0000 (1.0)      465.7814 (1.16)     0.0000 (1.0)           0;0  2.1469 (0.86)          1           1
test_list-list-shallow[3.60.1]     447.7733 (1.12)     447.7733 (1.12)     447.7733 (1.12)     0.0000 (1.0)      447.7733 (1.12)     0.0000 (1.0)           0;0  2.2333 (0.89)          1           1
test_list-list-shallow[main]       452.8099 (1.13)     452.8099 (1.13)     452.8099 (1.13)     0.0000 (1.0)      452.8099 (1.13)     0.0000 (1.0)           0;0  2.2084 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.0771 (3.20)     12.0771 (3.20)     12.0771 (3.20)     0.0000 (1.0)      12.0771 (3.20)     0.0000 (1.0)           0;0  0.0828 (0.31)          1           1
test_partial_add-add[3.10.0]     12.5030 (3.31)     12.5030 (3.31)     12.5030 (3.31)     0.0000 (1.0)      12.5030 (3.31)     0.0000 (1.0)           0;0  0.0800 (0.30)          1           1
test_partial_add-add[3.53.2]     11.0158 (2.92)     11.0158 (2.92)     11.0158 (2.92)     0.0000 (1.0)      11.0158 (2.92)     0.0000 (1.0)           0;0  0.0908 (0.34)          1           1
test_partial_add-add[3.60.1]      3.7719 (1.0)       3.7719 (1.0)       3.7719 (1.0)      0.0000 (1.0)       3.7719 (1.0)      0.0000 (1.0)           0;0  0.2651 (1.0)           1           1
test_partial_add-add[main]        4.3600 (1.16)      4.3600 (1.16)      4.3600 (1.16)     0.0000 (1.0)       4.3600 (1.16)     0.0000 (1.0)           0;0  0.2294 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     82.6195 (4.06)     82.6195 (4.06)     82.6195 (4.06)     0.0000 (1.0)      82.6195 (4.06)     0.0000 (1.0)           0;0  0.0121 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     83.6874 (4.11)     83.6874 (4.11)     83.6874 (4.11)     0.0000 (1.0)      83.6874 (4.11)     0.0000 (1.0)           0;0  0.0119 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     75.2728 (3.70)     75.2728 (3.70)     75.2728 (3.70)     0.0000 (1.0)      75.2728 (3.70)     0.0000 (1.0)           0;0  0.0133 (0.27)          1           1
test_partial_add-add-partial[3.60.1]     20.3472 (1.0)      20.3472 (1.0)      20.3472 (1.0)      0.0000 (1.0)      20.3472 (1.0)      0.0000 (1.0)           0;0  0.0491 (1.0)           1           1
test_partial_add-add-partial[main]       20.4185 (1.00)     20.4185 (1.00)     20.4185 (1.00)     0.0000 (1.0)      20.4185 (1.00)     0.0000 (1.0)           0;0  0.0490 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5627 (1.0)      4.5627 (1.0)      4.5627 (1.0)      0.0000 (1.0)      4.5627 (1.0)      0.0000 (1.0)           0;0  0.2192 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8961 (1.29)     5.8961 (1.29)     5.8961 (1.29)     0.0000 (1.0)      5.8961 (1.29)     0.0000 (1.0)           0;0  0.1696 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1054 (1.56)     7.1054 (1.56)     7.1054 (1.56)     0.0000 (1.0)      7.1054 (1.56)     0.0000 (1.0)           0;0  0.1407 (0.64)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.9098 (1.51)     6.9098 (1.51)     6.9098 (1.51)     0.0000 (1.0)      6.9098 (1.51)     0.0000 (1.0)           0;0  0.1447 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.9619 (1.53)     6.9619 (1.53)     6.9619 (1.53)     0.0000 (1.0)      6.9619 (1.53)     0.0000 (1.0)           0;0  0.1436 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5404 (1.0)      2.5404 (1.0)      2.5404 (1.0)      0.0000 (1.0)      2.5404 (1.0)      0.0000 (1.0)           0;0  0.3936 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7976 (1.49)     3.7976 (1.49)     3.7976 (1.49)     0.0000 (1.0)      3.7976 (1.49)     0.0000 (1.0)           0;0  0.2633 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.7935 (1.49)     3.7935 (1.49)     3.7935 (1.49)     0.0000 (1.0)      3.7935 (1.49)     0.0000 (1.0)           0;0  0.2636 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.9500 (1.55)     3.9500 (1.55)     3.9500 (1.55)     0.0000 (1.0)      3.9500 (1.55)     0.0000 (1.0)           0;0  0.2532 (0.64)          1           1
test_partial_add-gc-noop[main]       3.8026 (1.50)     3.8026 (1.50)     3.8026 (1.50)     0.0000 (1.0)      3.8026 (1.50)     0.0000 (1.0)           0;0  0.2630 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7467 (2.17)     7.7467 (2.17)     7.7467 (2.17)     0.0000 (1.0)      7.7467 (2.17)     0.0000 (1.0)           0;0  0.1291 (0.46)          1           1
test_partial_add-push[3.10.0]     6.9497 (1.95)     6.9497 (1.95)     6.9497 (1.95)     0.0000 (1.0)      6.9497 (1.95)     0.0000 (1.0)           0;0  0.1439 (0.51)          1           1
test_partial_add-push[3.53.2]     3.6683 (1.03)     3.6683 (1.03)     3.6683 (1.03)     0.0000 (1.0)      3.6683 (1.03)     0.0000 (1.0)           0;0  0.2726 (0.97)          1           1
test_partial_add-push[3.60.1]     3.5669 (1.0)      3.5669 (1.0)      3.5669 (1.0)      0.0000 (1.0)      3.5669 (1.0)      0.0000 (1.0)           0;0  0.2804 (1.0)           1           1
test_partial_add-push[main]       3.5756 (1.00)     3.5756 (1.00)     3.5756 (1.00)     0.0000 (1.0)      3.5756 (1.00)     0.0000 (1.0)           0;0  0.2797 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.3944 (2.24)     45.3944 (2.24)     45.3944 (2.24)     0.0000 (1.0)      45.3944 (2.24)     0.0000 (1.0)           0;0  0.0220 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     41.0748 (2.03)     41.0748 (2.03)     41.0748 (2.03)     0.0000 (1.0)      41.0748 (2.03)     0.0000 (1.0)           0;0  0.0243 (0.49)          1           1
test_partial_add-push-partial[3.53.2]     21.2770 (1.05)     21.2770 (1.05)     21.2770 (1.05)     0.0000 (1.0)      21.2770 (1.05)     0.0000 (1.0)           0;0  0.0470 (0.95)          1           1
test_partial_add-push-partial[3.60.1]     20.2355 (1.0)      20.2355 (1.0)      20.2355 (1.0)      0.0000 (1.0)      20.2355 (1.0)      0.0000 (1.0)           0;0  0.0494 (1.0)           1           1
test_partial_add-push-partial[main]       20.5063 (1.01)     20.5063 (1.01)     20.5063 (1.01)     0.0000 (1.0)      20.5063 (1.01)     0.0000 (1.0)           0;0  0.0488 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     87.7861 (3.88)     87.7861 (3.88)     87.7861 (3.88)     0.0000 (1.0)      87.7861 (3.88)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_partial_remove-add[3.10.0]     88.0065 (3.89)     88.0065 (3.89)     88.0065 (3.89)     0.0000 (1.0)      88.0065 (3.89)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_partial_remove-add[3.53.2]     77.7830 (3.44)     77.7830 (3.44)     77.7830 (3.44)     0.0000 (1.0)      77.7830 (3.44)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.6048 (1.0)      22.6048 (1.0)      22.6048 (1.0)      0.0000 (1.0)      22.6048 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_partial_remove-add[main]       23.7830 (1.05)     23.7830 (1.05)     23.7830 (1.05)     0.0000 (1.0)      23.7830 (1.05)     0.0000 (1.0)           0;0  0.0420 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     49.7543 (13.26)    49.7543 (13.26)    49.7543 (13.26)    0.0000 (1.0)      49.7543 (13.26)    0.0000 (1.0)           0;0  0.0201 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     50.5008 (13.45)    50.5008 (13.45)    50.5008 (13.45)    0.0000 (1.0)      50.5008 (13.45)    0.0000 (1.0)           0;0  0.0198 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     45.0107 (11.99)    45.0107 (11.99)    45.0107 (11.99)    0.0000 (1.0)      45.0107 (11.99)    0.0000 (1.0)           0;0  0.0222 (0.08)          1           1
test_partial_remove-add-update[3.60.1]      3.8092 (1.01)      3.8092 (1.01)      3.8092 (1.01)     0.0000 (1.0)       3.8092 (1.01)     0.0000 (1.0)           0;0  0.2625 (0.99)          1           1
test_partial_remove-add-update[main]        3.7535 (1.0)       3.7535 (1.0)       3.7535 (1.0)      0.0000 (1.0)       3.7535 (1.0)      0.0000 (1.0)           0;0  0.2664 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6590 (1.0)      2.6590 (1.0)      2.6590 (1.0)      0.0000 (1.0)      2.6590 (1.0)      0.0000 (1.0)           0;0  0.3761 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6836 (1.39)     3.6836 (1.39)     3.6836 (1.39)     0.0000 (1.0)      3.6836 (1.39)     0.0000 (1.0)           0;0  0.2715 (0.72)          1           1
test_partial_remove-gc[3.53.2]     3.6466 (1.37)     3.6466 (1.37)     3.6466 (1.37)     0.0000 (1.0)      3.6466 (1.37)     0.0000 (1.0)           0;0  0.2742 (0.73)          1           1
test_partial_remove-gc[3.60.1]     3.6424 (1.37)     3.6424 (1.37)     3.6424 (1.37)     0.0000 (1.0)      3.6424 (1.37)     0.0000 (1.0)           0;0  0.2745 (0.73)          1           1
test_partial_remove-gc[main]       3.6572 (1.38)     3.6572 (1.38)     3.6572 (1.38)     0.0000 (1.0)      3.6572 (1.38)     0.0000 (1.0)           0;0  0.2734 (0.73)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8778 (1.0)      4.8778 (1.0)      4.8778 (1.0)      0.0000 (1.0)      4.8778 (1.0)      0.0000 (1.0)           0;0  0.2050 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.8038 (1.19)     5.8038 (1.19)     5.8038 (1.19)     0.0000 (1.0)      5.8038 (1.19)     0.0000 (1.0)           0;0  0.1723 (0.84)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8527 (1.40)     6.8527 (1.40)     6.8527 (1.40)     0.0000 (1.0)      6.8527 (1.40)     0.0000 (1.0)           0;0  0.1459 (0.71)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.4033 (1.31)     6.4033 (1.31)     6.4033 (1.31)     0.0000 (1.0)      6.4033 (1.31)     0.0000 (1.0)           0;0  0.1562 (0.76)          1           1
test_partial_remove-gc-cloud[main]       6.4105 (1.31)     6.4105 (1.31)     6.4105 (1.31)     0.0000 (1.0)      6.4105 (1.31)     0.0000 (1.0)           0;0  0.1560 (0.76)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.4616 (2.32)     52.4616 (2.32)     52.4616 (2.32)     0.0000 (1.0)      52.4616 (2.32)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.3755 (2.05)     46.3755 (2.05)     46.3755 (2.05)     0.0000 (1.0)      46.3755 (2.05)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_partial_remove-push[3.53.2]     22.7019 (1.00)     22.7019 (1.00)     22.7019 (1.00)     0.0000 (1.0)      22.7019 (1.00)     0.0000 (1.0)           0;0  0.0440 (1.00)          1           1
test_partial_remove-push[3.60.1]     22.5942 (1.0)      22.5942 (1.0)      22.5942 (1.0)      0.0000 (1.0)      22.5942 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_partial_remove-push[main]       22.6515 (1.00)     22.6515 (1.00)     22.6515 (1.00)     0.0000 (1.0)      22.6515 (1.00)     0.0000 (1.0)           0;0  0.0441 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.0144 (1.0)      4.0144 (1.0)      4.0144 (1.0)      0.0000 (1.0)      4.0144 (1.0)      0.0000 (1.0)           0;0  0.2491 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.1305 (1.03)     4.1305 (1.03)     4.1305 (1.03)     0.0000 (1.0)      4.1305 (1.03)     0.0000 (1.0)           0;0  0.2421 (0.97)          1           1
test_partial_remove-push-update[3.53.2]     7.3253 (1.82)     7.3253 (1.82)     7.3253 (1.82)     0.0000 (1.0)      7.3253 (1.82)     0.0000 (1.0)           0;0  0.1365 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.3197 (1.82)     7.3197 (1.82)     7.3197 (1.82)     0.0000 (1.0)      7.3197 (1.82)     0.0000 (1.0)           0;0  0.1366 (0.55)          1           1
test_partial_remove-push-update[main]       7.0039 (1.74)     7.0039 (1.74)     7.0039 (1.74)     0.0000 (1.0)      7.0039 (1.74)     0.0000 (1.0)           0;0  0.1428 (0.57)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     486.5355 (1.0)      489.6439 (1.0)      488.3197 (1.0)      1.4068 (1.0)      488.9164 (1.0)      2.4921 (1.0)           1;0  2.0478 (1.0)           5           3
test_plots-plots-diff[3.10.0]     887.2564 (1.82)     894.9763 (1.83)     891.4328 (1.83)     3.2860 (2.34)     893.0947 (1.83)     5.2672 (2.11)          2;0  1.1218 (0.55)          5           3
test_plots-plots-diff[3.53.2]     796.3688 (1.64)     808.7312 (1.65)     801.5252 (1.64)     4.5123 (3.21)     800.5936 (1.64)     4.3615 (1.75)          2;0  1.2476 (0.61)          5           3
test_plots-plots-diff[3.60.1]     799.9169 (1.64)     813.7248 (1.66)     804.5023 (1.65)     6.0241 (4.28)     800.7827 (1.64)     8.7365 (3.51)          1;0  1.2430 (0.61)          5           3
test_plots-plots-diff[main]       799.6253 (1.64)     812.4610 (1.66)     806.7374 (1.65)     4.7608 (3.38)     807.0563 (1.65)     5.9435 (2.38)          2;0  1.2396 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       503.9118 (1.0)        511.9966 (1.0)        507.0146 (1.0)      3.0438 (1.0)        506.8041 (1.0)       3.1703 (1.0)           2;0  1.9723 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,129.8174 (2.24)     1,140.0596 (2.23)     1,136.0183 (2.24)     3.8760 (1.27)     1,137.2903 (2.24)      4.4866 (1.42)          2;0  0.8803 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       879.2589 (1.74)       887.5940 (1.73)       883.0736 (1.74)     3.4007 (1.12)       883.8950 (1.74)      5.3414 (1.68)          2;0  1.1324 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       878.1546 (1.74)       891.4934 (1.74)       882.4941 (1.74)     5.2287 (1.72)       881.5092 (1.74)      4.7636 (1.50)          1;1  1.1332 (0.57)          5           3
test_plots-plots-diff-json[main]         884.1368 (1.75)       899.4143 (1.76)       892.2862 (1.76)     7.5063 (2.47)       895.2699 (1.77)     14.2835 (4.51)          2;0  1.1207 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     405.0899 (1.0)      421.2386 (1.0)      411.1259 (1.0)       7.5976 (3.05)     406.2808 (1.0)      12.8108 (4.18)          1;0  2.4323 (1.0)           5           3
test_plots-plots-show[3.10.0]     712.3442 (1.76)     719.0288 (1.71)     715.2054 (1.74)      2.4949 (1.0)      715.0812 (1.76)      3.0650 (1.0)           2;0  1.3982 (0.57)          5           3
test_plots-plots-show[3.53.2]     684.2034 (1.69)     701.4409 (1.67)     689.8787 (1.68)      6.7521 (2.71)     688.2920 (1.69)      6.6102 (2.16)          1;0  1.4495 (0.60)          5           3
test_plots-plots-show[3.60.1]     687.3367 (1.70)     696.7977 (1.65)     691.2817 (1.68)      3.7163 (1.49)     689.9075 (1.70)      5.2403 (1.71)          2;0  1.4466 (0.59)          5           3
test_plots-plots-show[main]       690.0583 (1.70)     753.7437 (1.79)     716.4694 (1.74)     31.6755 (12.70)    700.3676 (1.72)     59.0504 (19.27)         1;0  1.3957 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     419.8033 (1.0)      445.7486 (1.0)      429.3001 (1.0)      10.5019 (3.81)     426.3988 (1.0)      14.9579 (3.51)          1;0  2.3294 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     843.5712 (2.01)     856.0779 (1.92)     849.2422 (1.98)      4.5165 (1.64)     848.9853 (1.99)      4.7099 (1.11)          2;0  1.1775 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     731.1679 (1.74)     737.8306 (1.66)     735.0944 (1.71)      2.7582 (1.0)      734.6404 (1.72)      4.2567 (1.0)           1;0  1.3604 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     741.3569 (1.77)     752.3550 (1.69)     745.0090 (1.74)      4.3526 (1.58)     744.5114 (1.75)      4.6237 (1.09)          1;0  1.3423 (0.58)          5           3
test_plots-plots-show-json[main]       738.3671 (1.76)     762.8282 (1.71)     745.9640 (1.74)      9.9971 (3.62)     742.1778 (1.74)     11.7579 (2.76)          1;0  1.3405 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.2938 (2.38)     51.2938 (2.38)     51.2938 (2.38)     0.0000 (1.0)      51.2938 (2.38)     0.0000 (1.0)           0;0  0.0195 (0.42)          1           1
test_push-push[3.10.0]     45.5502 (2.11)     45.5502 (2.11)     45.5502 (2.11)     0.0000 (1.0)      45.5502 (2.11)     0.0000 (1.0)           0;0  0.0220 (0.47)          1           1
test_push-push[3.53.2]     22.3408 (1.04)     22.3408 (1.04)     22.3408 (1.04)     0.0000 (1.0)      22.3408 (1.04)     0.0000 (1.0)           0;0  0.0448 (0.96)          1           1
test_push-push[3.60.1]     21.5474 (1.0)      21.5474 (1.0)      21.5474 (1.0)      0.0000 (1.0)      21.5474 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_push-push[main]       21.8444 (1.01)     21.8444 (1.01)     21.8444 (1.01)     0.0000 (1.0)      21.8444 (1.01)     0.0000 (1.0)           0;0  0.0458 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.5832 (2.77)     64.5832 (2.77)     64.5832 (2.77)     0.0000 (1.0)      64.5832 (2.77)     0.0000 (1.0)           0;0  0.0155 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.1600 (3.01)     70.1600 (3.01)     70.1600 (3.01)     0.0000 (1.0)      70.1600 (3.01)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.5407 (1.44)     33.5407 (1.44)     33.5407 (1.44)     0.0000 (1.0)      33.5407 (1.44)     0.0000 (1.0)           0;0  0.0298 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.2886 (1.0)      23.2886 (1.0)      23.2886 (1.0)      0.0000 (1.0)      23.2886 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_sharing-fetch[main]       23.2985 (1.00)     23.2985 (1.00)     23.2985 (1.00)     0.0000 (1.0)      23.2985 (1.00)     0.0000 (1.0)           0;0  0.0429 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2238 (1.0)      1.2238 (1.0)      1.2238 (1.0)      0.0000 (1.0)      1.2238 (1.0)      0.0000 (1.0)           0;0  0.8171 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5737 (2.92)     3.5737 (2.92)     3.5737 (2.92)     0.0000 (1.0)      3.5737 (2.92)     0.0000 (1.0)           0;0  0.2798 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6617 (4.63)     5.6617 (4.63)     5.6617 (4.63)     0.0000 (1.0)      5.6617 (4.63)     0.0000 (1.0)           0;0  0.1766 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.7466 (4.70)     5.7466 (4.70)     5.7466 (4.70)     0.0000 (1.0)      5.7466 (4.70)     0.0000 (1.0)           0;0  0.1740 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7909 (4.73)     5.7909 (4.73)     5.7909 (4.73)     0.0000 (1.0)      5.7909 (4.73)     0.0000 (1.0)           0;0  0.1727 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.5766 (2.43)     52.5766 (2.43)     52.5766 (2.43)     0.0000 (1.0)      52.5766 (2.43)     0.0000 (1.0)           0;0  0.0190 (0.41)          1           1
test_sharing-push[3.10.0]     46.8727 (2.17)     46.8727 (2.17)     46.8727 (2.17)     0.0000 (1.0)      46.8727 (2.17)     0.0000 (1.0)           0;0  0.0213 (0.46)          1           1
test_sharing-push[3.53.2]     22.5794 (1.04)     22.5794 (1.04)     22.5794 (1.04)     0.0000 (1.0)      22.5794 (1.04)     0.0000 (1.0)           0;0  0.0443 (0.96)          1           1
test_sharing-push[3.60.1]     21.6273 (1.0)      21.6273 (1.0)      21.6273 (1.0)      0.0000 (1.0)      21.6273 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
test_sharing-push[main]       22.4462 (1.04)     22.4462 (1.04)     22.4462 (1.04)     0.0000 (1.0)      22.4462 (1.04)     0.0000 (1.0)           0;0  0.0446 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0800 (1.0)      2.0800 (1.0)      2.0800 (1.0)      0.0000 (1.0)      2.0800 (1.0)      0.0000 (1.0)           0;0  0.4808 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2057 (1.06)     2.2057 (1.06)     2.2057 (1.06)     0.0000 (1.0)      2.2057 (1.06)     0.0000 (1.0)           0;0  0.4534 (0.94)          1           1
test_sharing-push-noop[3.53.2]     5.9201 (2.85)     5.9201 (2.85)     5.9201 (2.85)     0.0000 (1.0)      5.9201 (2.85)     0.0000 (1.0)           0;0  0.1689 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.0818 (2.92)     6.0818 (2.92)     6.0818 (2.92)     0.0000 (1.0)      6.0818 (2.92)     0.0000 (1.0)           0;0  0.1644 (0.34)          1           1
test_sharing-push-noop[main]       6.2062 (2.98)     6.2062 (2.98)     6.2062 (2.98)     0.0000 (1.0)      6.2062 (2.98)     0.0000 (1.0)           0;0  0.1611 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.4552 (3.72)     19.4552 (3.72)     19.4552 (3.72)     0.0000 (1.0)      19.4552 (3.72)     0.0000 (1.0)           0;0  0.0514 (0.27)          1           1
test_status-status[3.10.0]     20.0278 (3.83)     20.0278 (3.83)     20.0278 (3.83)     0.0000 (1.0)      20.0278 (3.83)     0.0000 (1.0)           0;0  0.0499 (0.26)          1           1
test_status-status[3.53.2]     18.0299 (3.45)     18.0299 (3.45)     18.0299 (3.45)     0.0000 (1.0)      18.0299 (3.45)     0.0000 (1.0)           0;0  0.0555 (0.29)          1           1
test_status-status[3.60.1]      5.2361 (1.00)      5.2361 (1.00)      5.2361 (1.00)     0.0000 (1.0)       5.2361 (1.00)     0.0000 (1.0)           0;0  0.1910 (1.00)          1           1
test_status-status[main]        5.2284 (1.0)       5.2284 (1.0)       5.2284 (1.0)      0.0000 (1.0)       5.2284 (1.0)      0.0000 (1.0)           0;0  0.1913 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6684 (1.75)     4.6684 (1.75)     4.6684 (1.75)     0.0000 (1.0)      4.6684 (1.75)     0.0000 (1.0)           0;0  0.2142 (0.57)          1           1
test_status-status-changed[3.10.0]     5.0043 (1.88)     5.0043 (1.88)     5.0043 (1.88)     0.0000 (1.0)      5.0043 (1.88)     0.0000 (1.0)           0;0  0.1998 (0.53)          1           1
test_status-status-changed[3.53.2]     4.9874 (1.87)     4.9874 (1.87)     4.9874 (1.87)     0.0000 (1.0)      4.9874 (1.87)     0.0000 (1.0)           0;0  0.2005 (0.53)          1           1
test_status-status-changed[3.60.1]     2.7625 (1.04)     2.7625 (1.04)     2.7625 (1.04)     0.0000 (1.0)      2.7625 (1.04)     0.0000 (1.0)           0;0  0.3620 (0.96)          1           1
test_status-status-changed[main]       2.6611 (1.0)      2.6611 (1.0)      2.6611 (1.0)      0.0000 (1.0)      2.6611 (1.0)      0.0000 (1.0)           0;0  0.3758 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7840 (1.82)     4.7840 (1.82)     4.7840 (1.82)     0.0000 (1.0)      4.7840 (1.82)     0.0000 (1.0)           0;0  0.2090 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.9042 (1.86)     4.9042 (1.86)     4.9042 (1.86)     0.0000 (1.0)      4.9042 (1.86)     0.0000 (1.0)           0;0  0.2039 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.7826 (1.82)     4.7826 (1.82)     4.7826 (1.82)     0.0000 (1.0)      4.7826 (1.82)     0.0000 (1.0)           0;0  0.2091 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.6724 (1.02)     2.6724 (1.02)     2.6724 (1.02)     0.0000 (1.0)      2.6724 (1.02)     0.0000 (1.0)           0;0  0.3742 (0.98)          1           1
test_status-status-changed-noop[main]       2.6299 (1.0)      2.6299 (1.0)      2.6299 (1.0)      0.0000 (1.0)      2.6299 (1.0)      0.0000 (1.0)           0;0  0.3802 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7876 (1.82)     4.7876 (1.82)     4.7876 (1.82)     0.0000 (1.0)      4.7876 (1.82)     0.0000 (1.0)           0;0  0.2089 (0.55)          1           1
test_status-status-noop[3.10.0]     4.9063 (1.87)     4.9063 (1.87)     4.9063 (1.87)     0.0000 (1.0)      4.9063 (1.87)     0.0000 (1.0)           0;0  0.2038 (0.54)          1           1
test_status-status-noop[3.53.2]     4.6595 (1.77)     4.6595 (1.77)     4.6595 (1.77)     0.0000 (1.0)      4.6595 (1.77)     0.0000 (1.0)           0;0  0.2146 (0.56)          1           1
test_status-status-noop[3.60.1]     2.6578 (1.01)     2.6578 (1.01)     2.6578 (1.01)     0.0000 (1.0)      2.6578 (1.01)     0.0000 (1.0)           0;0  0.3762 (0.99)          1           1
test_status-status-noop[main]       2.6279 (1.0)      2.6279 (1.0)      2.6279 (1.0)      0.0000 (1.0)      2.6279 (1.0)      0.0000 (1.0)           0;0  0.3805 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     152.6162 (3.31)     152.6162 (3.31)     152.6162 (3.31)     0.0000 (1.0)      152.6162 (3.31)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_update-import-url[3.10.0]     157.1400 (3.41)     157.1400 (3.41)     157.1400 (3.41)     0.0000 (1.0)      157.1400 (3.41)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_update-import-url[3.53.2]     114.7000 (2.49)     114.7000 (2.49)     114.7000 (2.49)     0.0000 (1.0)      114.7000 (2.49)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_update-import-url[3.60.1]      46.0813 (1.0)       46.0813 (1.0)       46.0813 (1.0)      0.0000 (1.0)       46.0813 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_update-import-url[main]        46.6357 (1.01)      46.6357 (1.01)      46.6357 (1.01)     0.0000 (1.0)       46.6357 (1.01)     0.0000 (1.0)           0;0  0.0214 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     136.8069 (3.87)     136.8069 (3.87)     136.8069 (3.87)     0.0000 (1.0)      136.8069 (3.87)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     141.1038 (3.99)     141.1038 (3.99)     141.1038 (3.99)     0.0000 (1.0)      141.1038 (3.99)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.53.2]     107.1756 (3.03)     107.1756 (3.03)     107.1756 (3.03)     0.0000 (1.0)      107.1756 (3.03)     0.0000 (1.0)           0;0  0.0093 (0.33)          1           1
test_update-update[3.60.1]      35.3759 (1.00)      35.3759 (1.00)      35.3759 (1.00)     0.0000 (1.0)       35.3759 (1.00)     0.0000 (1.0)           0;0  0.0283 (1.00)          1           1
test_update-update[main]        35.3348 (1.0)       35.3348 (1.0)       35.3348 (1.0)      0.0000 (1.0)       35.3348 (1.0)      0.0000 (1.0)           0;0  0.0283 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.8435 (2.08)     15.8435 (2.08)     15.8435 (2.08)     0.0000 (1.0)      15.8435 (2.08)     0.0000 (1.0)           0;0  0.0631 (0.48)          1           1
test_update-update-noop[3.10.0]     16.5988 (2.18)     16.5988 (2.18)     16.5988 (2.18)     0.0000 (1.0)      16.5988 (2.18)     0.0000 (1.0)           0;0  0.0602 (0.46)          1           1
test_update-update-noop[3.53.2]     15.6580 (2.06)     15.6580 (2.06)     15.6580 (2.06)     0.0000 (1.0)      15.6580 (2.06)     0.0000 (1.0)           0;0  0.0639 (0.49)          1           1
test_update-update-noop[3.60.1]      7.6946 (1.01)      7.6946 (1.01)      7.6946 (1.01)     0.0000 (1.0)       7.6946 (1.01)     0.0000 (1.0)           0;0  0.1300 (0.99)          1           1
test_update-update-noop[main]        7.6052 (1.0)       7.6052 (1.0)       7.6052 (1.0)      0.0000 (1.0)       7.6052 (1.0)      0.0000 (1.0)           0;0  0.1315 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean