Sun Aug 10 00:58:36 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.6824 (3.77)     84.6824 (3.77)     84.6824 (3.77)     0.0000 (1.0)      84.6824 (3.77)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.10.0]     85.4199 (3.80)     85.4199 (3.80)     85.4199 (3.80)     0.0000 (1.0)      85.4199 (3.80)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_add_copy-add[3.53.2]     77.4754 (3.45)     77.4754 (3.45)     77.4754 (3.45)     0.0000 (1.0)      77.4754 (3.45)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_add_copy-add[3.60.1]     22.4808 (1.0)      22.4808 (1.0)      22.4808 (1.0)      0.0000 (1.0)      22.4808 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_add_copy-add[main]       23.0599 (1.03)     23.0599 (1.03)     23.0599 (1.03)     0.0000 (1.0)      23.0599 (1.03)     0.0000 (1.0)           0;0  0.0434 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.9225 (6.53)     28.9225 (6.53)     28.9225 (6.53)     0.0000 (1.0)      28.9225 (6.53)     0.0000 (1.0)           0;0  0.0346 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.4249 (6.64)     29.4249 (6.64)     29.4249 (6.64)     0.0000 (1.0)      29.4249 (6.64)     0.0000 (1.0)           0;0  0.0340 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.0314 (6.33)     28.0314 (6.33)     28.0314 (6.33)     0.0000 (1.0)      28.0314 (6.33)     0.0000 (1.0)           0;0  0.0357 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4313 (1.0)       4.4313 (1.0)       4.4313 (1.0)      0.0000 (1.0)       4.4313 (1.0)      0.0000 (1.0)           0;0  0.2257 (1.0)           1           1
test_add_copy-add-noop[main]        4.4431 (1.00)      4.4431 (1.00)      4.4431 (1.00)     0.0000 (1.0)       4.4431 (1.00)     0.0000 (1.0)           0;0  0.2251 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.4305 (4.01)     64.4305 (4.01)     64.4305 (4.01)     0.0000 (1.0)      64.4305 (4.01)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.10.0]     64.3475 (4.01)     64.3475 (4.01)     64.3475 (4.01)     0.0000 (1.0)      64.3475 (4.01)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.53.2]     59.0950 (3.68)     59.0950 (3.68)     59.0950 (3.68)     0.0000 (1.0)      59.0950 (3.68)     0.0000 (1.0)           0;0  0.0169 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.0525 (1.0)      16.0525 (1.0)      16.0525 (1.0)      0.0000 (1.0)      16.0525 (1.0)      0.0000 (1.0)           0;0  0.0623 (1.0)           1           1
test_add_hardlink-add[main]       16.7094 (1.04)     16.7094 (1.04)     16.7094 (1.04)     0.0000 (1.0)      16.7094 (1.04)     0.0000 (1.0)           0;0  0.0598 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.2580 (7.45)     33.2580 (7.45)     33.2580 (7.45)     0.0000 (1.0)      33.2580 (7.45)     0.0000 (1.0)           0;0  0.0301 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.5947 (7.52)     33.5947 (7.52)     33.5947 (7.52)     0.0000 (1.0)      33.5947 (7.52)     0.0000 (1.0)           0;0  0.0298 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     32.1169 (7.19)     32.1169 (7.19)     32.1169 (7.19)     0.0000 (1.0)      32.1169 (7.19)     0.0000 (1.0)           0;0  0.0311 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5392 (1.02)      4.5392 (1.02)      4.5392 (1.02)     0.0000 (1.0)       4.5392 (1.02)     0.0000 (1.0)           0;0  0.2203 (0.98)          1           1
test_add_hardlink-add-noop[main]        4.4671 (1.0)       4.4671 (1.0)       4.4671 (1.0)      0.0000 (1.0)       4.4671 (1.0)      0.0000 (1.0)           0;0  0.2239 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     73.3329 (2.01)     73.3329 (2.01)     73.3329 (2.01)     0.0000 (1.0)      73.3329 (2.01)     0.0000 (1.0)           0;0  0.0136 (0.50)          1           1
test_add_symlink-add[3.10.0]     75.0620 (2.05)     75.0620 (2.05)     75.0620 (2.05)     0.0000 (1.0)      75.0620 (2.05)     0.0000 (1.0)           0;0  0.0133 (0.49)          1           1
test_add_symlink-add[3.53.2]     70.0162 (1.91)     70.0162 (1.91)     70.0162 (1.91)     0.0000 (1.0)      70.0162 (1.91)     0.0000 (1.0)           0;0  0.0143 (0.52)          1           1
test_add_symlink-add[3.60.1]     36.5622 (1.0)      36.5622 (1.0)      36.5622 (1.0)      0.0000 (1.0)      36.5622 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
test_add_symlink-add[main]       37.4674 (1.02)     37.4674 (1.02)     37.4674 (1.02)     0.0000 (1.0)      37.4674 (1.02)     0.0000 (1.0)           0;0  0.0267 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.3412 (7.82)     48.3412 (7.82)     48.3412 (7.82)     0.0000 (1.0)      48.3412 (7.82)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     49.5485 (8.02)     49.5485 (8.02)     49.5485 (8.02)     0.0000 (1.0)      49.5485 (8.02)     0.0000 (1.0)           0;0  0.0202 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.3976 (7.83)     48.3976 (7.83)     48.3976 (7.83)     0.0000 (1.0)      48.3976 (7.83)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      6.1785 (1.0)       6.1785 (1.0)       6.1785 (1.0)      0.0000 (1.0)       6.1785 (1.0)      0.0000 (1.0)           0;0  0.1619 (1.0)           1           1
test_add_symlink-add-noop[main]        6.1991 (1.00)      6.1991 (1.00)      6.1991 (1.00)     0.0000 (1.0)       6.1991 (1.00)     0.0000 (1.0)           0;0  0.1613 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.7830 (2.00)     41.7830 (2.00)     41.7830 (2.00)     0.0000 (1.0)      41.7830 (2.00)     0.0000 (1.0)           0;0  0.0239 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     60.6497 (2.90)     60.6497 (2.90)     60.6497 (2.90)     0.0000 (1.0)      60.6497 (2.90)     0.0000 (1.0)           0;0  0.0165 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     28.3061 (1.35)     28.3061 (1.35)     28.3061 (1.35)     0.0000 (1.0)      28.3061 (1.35)     0.0000 (1.0)           0;0  0.0353 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     20.8994 (1.0)      20.8994 (1.0)      20.8994 (1.0)      0.0000 (1.0)      20.8994 (1.0)      0.0000 (1.0)           0;0  0.0478 (1.0)           1           1
test_checkout_copy-checkout[main]       21.4974 (1.03)     21.4974 (1.03)     21.4974 (1.03)     0.0000 (1.0)      21.4974 (1.03)     0.0000 (1.0)           0;0  0.0465 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4343 (1.65)     5.4343 (1.65)     5.4343 (1.65)     0.0000 (1.0)      5.4343 (1.65)     0.0000 (1.0)           0;0  0.1840 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6534 (1.71)     5.6534 (1.71)     5.6534 (1.71)     0.0000 (1.0)      5.6534 (1.71)     0.0000 (1.0)           0;0  0.1769 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5127 (1.67)     5.5127 (1.67)     5.5127 (1.67)     0.0000 (1.0)      5.5127 (1.67)     0.0000 (1.0)           0;0  0.1814 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3351 (1.01)     3.3351 (1.01)     3.3351 (1.01)     0.0000 (1.0)      3.3351 (1.01)     0.0000 (1.0)           0;0  0.2998 (0.99)          1           1
test_checkout_copy-checkout-noop[main]       3.2998 (1.0)      3.2998 (1.0)      3.2998 (1.0)      0.0000 (1.0)      3.2998 (1.0)      0.0000 (1.0)           0;0  0.3031 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6578 (2.14)     8.6578 (2.14)     8.6578 (2.14)     0.0000 (1.0)      8.6578 (2.14)     0.0000 (1.0)           0;0  0.1155 (0.47)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.2565 (1.55)     6.2565 (1.55)     6.2565 (1.55)     0.0000 (1.0)      6.2565 (1.55)     0.0000 (1.0)           0;0  0.1598 (0.65)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2349 (1.54)     6.2349 (1.54)     6.2349 (1.54)     0.0000 (1.0)      6.2349 (1.54)     0.0000 (1.0)           0;0  0.1604 (0.65)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0644 (1.00)     4.0644 (1.00)     4.0644 (1.00)     0.0000 (1.0)      4.0644 (1.00)     0.0000 (1.0)           0;0  0.2460 (1.00)          1           1
test_checkout_copy-checkout-update[main]       4.0444 (1.0)      4.0444 (1.0)      4.0444 (1.0)      0.0000 (1.0)      4.0444 (1.0)      0.0000 (1.0)           0;0  0.2473 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.0538 (3.05)     22.0538 (3.05)     22.0538 (3.05)     0.0000 (1.0)      22.0538 (3.05)     0.0000 (1.0)           0;0  0.0453 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7746 (2.18)     15.7746 (2.18)     15.7746 (2.18)     0.0000 (1.0)      15.7746 (2.18)     0.0000 (1.0)           0;0  0.0634 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.3540 (1.98)     14.3540 (1.98)     14.3540 (1.98)     0.0000 (1.0)      14.3540 (1.98)     0.0000 (1.0)           0;0  0.0697 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2350 (1.0)       7.2350 (1.0)       7.2350 (1.0)      0.0000 (1.0)       7.2350 (1.0)      0.0000 (1.0)           0;0  0.1382 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.7226 (1.07)      7.7226 (1.07)      7.7226 (1.07)     0.0000 (1.0)       7.7226 (1.07)     0.0000 (1.0)           0;0  0.1295 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.2959 (1.62)     5.2959 (1.62)     5.2959 (1.62)     0.0000 (1.0)      5.2959 (1.62)     0.0000 (1.0)           0;0  0.1888 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5192 (1.69)     5.5192 (1.69)     5.5192 (1.69)     0.0000 (1.0)      5.5192 (1.69)     0.0000 (1.0)           0;0  0.1812 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3495 (1.64)     5.3495 (1.64)     5.3495 (1.64)     0.0000 (1.0)      5.3495 (1.64)     0.0000 (1.0)           0;0  0.1869 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2595 (1.0)      3.2595 (1.0)      3.2595 (1.0)      0.0000 (1.0)      3.2595 (1.0)      0.0000 (1.0)           0;0  0.3068 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3269 (1.02)     3.3269 (1.02)     3.3269 (1.02)     0.0000 (1.0)      3.3269 (1.02)     0.0000 (1.0)           0;0  0.3006 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.5362 (2.22)     8.5362 (2.22)     8.5362 (2.22)     0.0000 (1.0)      8.5362 (2.22)     0.0000 (1.0)           0;0  0.1171 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4586 (1.68)     6.4586 (1.68)     6.4586 (1.68)     0.0000 (1.0)      6.4586 (1.68)     0.0000 (1.0)           0;0  0.1548 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1370 (1.60)     6.1370 (1.60)     6.1370 (1.60)     0.0000 (1.0)      6.1370 (1.60)     0.0000 (1.0)           0;0  0.1629 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8475 (1.0)      3.8475 (1.0)      3.8475 (1.0)      0.0000 (1.0)      3.8475 (1.0)      0.0000 (1.0)           0;0  0.2599 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.9156 (1.02)     3.9156 (1.02)     3.9156 (1.02)     0.0000 (1.0)      3.9156 (1.02)     0.0000 (1.0)           0;0  0.2554 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.0068 (2.54)     26.0068 (2.54)     26.0068 (2.54)     0.0000 (1.0)      26.0068 (2.54)     0.0000 (1.0)           0;0  0.0385 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     19.4943 (1.90)     19.4943 (1.90)     19.4943 (1.90)     0.0000 (1.0)      19.4943 (1.90)     0.0000 (1.0)           0;0  0.0513 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.8522 (1.74)     17.8522 (1.74)     17.8522 (1.74)     0.0000 (1.0)      17.8522 (1.74)     0.0000 (1.0)           0;0  0.0560 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.2504 (1.0)      10.2504 (1.0)      10.2504 (1.0)      0.0000 (1.0)      10.2504 (1.0)      0.0000 (1.0)           0;0  0.0976 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.8207 (1.06)     10.8207 (1.06)     10.8207 (1.06)     0.0000 (1.0)      10.8207 (1.06)     0.0000 (1.0)           0;0  0.0924 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8717 (1.55)     6.8717 (1.55)     6.8717 (1.55)     0.0000 (1.0)      6.8717 (1.55)     0.0000 (1.0)           0;0  0.1455 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.1274 (1.61)     7.1274 (1.61)     7.1274 (1.61)     0.0000 (1.0)      7.1274 (1.61)     0.0000 (1.0)           0;0  0.1403 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.8284 (1.54)     6.8284 (1.54)     6.8284 (1.54)     0.0000 (1.0)      6.8284 (1.54)     0.0000 (1.0)           0;0  0.1464 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.4402 (1.0)      4.4402 (1.0)      4.4402 (1.0)      0.0000 (1.0)      4.4402 (1.0)      0.0000 (1.0)           0;0  0.2252 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4858 (1.01)     4.4858 (1.01)     4.4858 (1.01)     0.0000 (1.0)      4.4858 (1.01)     0.0000 (1.0)           0;0  0.2229 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.0531 (1.86)     11.0531 (1.86)     11.0531 (1.86)     0.0000 (1.0)      11.0531 (1.86)     0.0000 (1.0)           0;0  0.0905 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6482 (1.46)      8.6482 (1.46)      8.6482 (1.46)     0.0000 (1.0)       8.6482 (1.46)     0.0000 (1.0)           0;0  0.1156 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.6530 (1.46)      8.6530 (1.46)      8.6530 (1.46)     0.0000 (1.0)       8.6530 (1.46)     0.0000 (1.0)           0;0  0.1156 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9437 (1.0)       5.9437 (1.0)       5.9437 (1.0)      0.0000 (1.0)       5.9437 (1.0)      0.0000 (1.0)           0;0  0.1682 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.1249 (1.03)      6.1249 (1.03)      6.1249 (1.03)     0.0000 (1.0)       6.1249 (1.03)     0.0000 (1.0)           0;0  0.1633 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9934 (1.68)     3.9934 (1.68)     3.9934 (1.68)     0.0000 (1.0)      3.9934 (1.68)     0.0000 (1.0)           0;0  0.2504 (0.60)          1           1
test_data_status-data-changed[3.10.0]     4.7112 (1.98)     4.7112 (1.98)     4.7112 (1.98)     0.0000 (1.0)      4.7112 (1.98)     0.0000 (1.0)           0;0  0.2123 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.5813 (1.93)     4.5813 (1.93)     4.5813 (1.93)     0.0000 (1.0)      4.5813 (1.93)     0.0000 (1.0)           0;0  0.2183 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.3766 (1.0)      2.3766 (1.0)      2.3766 (1.0)      0.0000 (1.0)      2.3766 (1.0)      0.0000 (1.0)           0;0  0.4208 (1.0)           1           1
test_data_status-data-changed[main]       2.4172 (1.02)     2.4172 (1.02)     2.4172 (1.02)     0.0000 (1.0)      2.4172 (1.02)     0.0000 (1.0)           0;0  0.4137 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1644 (1.76)     4.1644 (1.76)     4.1644 (1.76)     0.0000 (1.0)      4.1644 (1.76)     0.0000 (1.0)           0;0  0.2401 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7207 (2.00)     4.7207 (2.00)     4.7207 (2.00)     0.0000 (1.0)      4.7207 (2.00)     0.0000 (1.0)           0;0  0.2118 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6827 (1.98)     4.6827 (1.98)     4.6827 (1.98)     0.0000 (1.0)      4.6827 (1.98)     0.0000 (1.0)           0;0  0.2136 (0.51)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3740 (1.00)     2.3740 (1.00)     2.3740 (1.00)     0.0000 (1.0)      2.3740 (1.00)     0.0000 (1.0)           0;0  0.4212 (1.00)          1           1
test_data_status-data-changed-noop[main]       2.3662 (1.0)      2.3662 (1.0)      2.3662 (1.0)      0.0000 (1.0)      2.3662 (1.0)      0.0000 (1.0)           0;0  0.4226 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.9222 (3.83)     18.9222 (3.83)     18.9222 (3.83)     0.0000 (1.0)      18.9222 (3.83)     0.0000 (1.0)           0;0  0.0528 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.7074 (3.98)     19.7074 (3.98)     19.7074 (3.98)     0.0000 (1.0)      19.7074 (3.98)     0.0000 (1.0)           0;0  0.0507 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.6488 (3.97)     19.6488 (3.97)     19.6488 (3.97)     0.0000 (1.0)      19.6488 (3.97)     0.0000 (1.0)           0;0  0.0509 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.9468 (1.00)      4.9468 (1.00)      4.9468 (1.00)     0.0000 (1.0)       4.9468 (1.00)     0.0000 (1.0)           0;0  0.2021 (1.00)          1           1
test_data_status-data-new[main]        4.9468 (1.0)       4.9468 (1.0)       4.9468 (1.0)      0.0000 (1.0)       4.9468 (1.0)      0.0000 (1.0)           0;0  0.2022 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1522 (1.76)     4.1522 (1.76)     4.1522 (1.76)     0.0000 (1.0)      4.1522 (1.76)     0.0000 (1.0)           0;0  0.2408 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.8064 (2.03)     4.8064 (2.03)     4.8064 (2.03)     0.0000 (1.0)      4.8064 (2.03)     0.0000 (1.0)           0;0  0.2081 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.6302 (1.96)     4.6302 (1.96)     4.6302 (1.96)     0.0000 (1.0)      4.6302 (1.96)     0.0000 (1.0)           0;0  0.2160 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.3840 (1.01)     2.3840 (1.01)     2.3840 (1.01)     0.0000 (1.0)      2.3840 (1.01)     0.0000 (1.0)           0;0  0.4195 (0.99)          1           1
test_data_status-data-noop[main]       2.3639 (1.0)      2.3639 (1.0)      2.3639 (1.0)      0.0000 (1.0)      2.3639 (1.0)      0.0000 (1.0)           0;0  0.4230 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.0636 (1.24)     7.0636 (1.24)     7.0636 (1.24)     0.0000 (1.0)      7.0636 (1.24)     0.0000 (1.0)           0;0  0.1416 (0.80)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7771 (1.37)     7.7771 (1.37)     7.7771 (1.37)     0.0000 (1.0)      7.7771 (1.37)     0.0000 (1.0)           0;0  0.1286 (0.73)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8189 (1.38)     7.8189 (1.38)     7.8189 (1.38)     0.0000 (1.0)      7.8189 (1.38)     0.0000 (1.0)           0;0  0.1279 (0.73)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6842 (1.0)      5.6842 (1.0)      5.6842 (1.0)      0.0000 (1.0)      5.6842 (1.0)      0.0000 (1.0)           0;0  0.1759 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.7359 (1.01)     5.7359 (1.01)     5.7359 (1.01)     0.0000 (1.0)      5.7359 (1.01)     0.0000 (1.0)           0;0  0.1743 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.0936 (1.24)     7.0936 (1.24)     7.0936 (1.24)     0.0000 (1.0)      7.0936 (1.24)     0.0000 (1.0)           0;0  0.1410 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6926 (1.35)     7.6926 (1.35)     7.6926 (1.35)     0.0000 (1.0)      7.6926 (1.35)     0.0000 (1.0)           0;0  0.1300 (0.74)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7128 (1.35)     7.7128 (1.35)     7.7128 (1.35)     0.0000 (1.0)      7.7128 (1.35)     0.0000 (1.0)           0;0  0.1297 (0.74)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7085 (1.0)      5.7085 (1.0)      5.7085 (1.0)      0.0000 (1.0)      5.7085 (1.0)      0.0000 (1.0)           0;0  0.1752 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8814 (1.03)     5.8814 (1.03)     5.8814 (1.03)     0.0000 (1.0)      5.8814 (1.03)     0.0000 (1.0)           0;0  0.1700 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.4898 (2.65)     21.4898 (2.65)     21.4898 (2.65)     0.0000 (1.0)      21.4898 (2.65)     0.0000 (1.0)           0;0  0.0465 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.7671 (2.81)     22.7671 (2.81)     22.7671 (2.81)     0.0000 (1.0)      22.7671 (2.81)     0.0000 (1.0)           0;0  0.0439 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.4650 (2.77)     22.4650 (2.77)     22.4650 (2.77)     0.0000 (1.0)      22.4650 (2.77)     0.0000 (1.0)           0;0  0.0445 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.1050 (1.0)       8.1050 (1.0)       8.1050 (1.0)      0.0000 (1.0)       8.1050 (1.0)      0.0000 (1.0)           0;0  0.1234 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3086 (1.03)      8.3086 (1.03)      8.3086 (1.03)     0.0000 (1.0)       8.3086 (1.03)     0.0000 (1.0)           0;0  0.1204 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.3510 (1.30)     6.3510 (1.30)     6.3510 (1.30)     0.0000 (1.0)      6.3510 (1.30)     0.0000 (1.0)           0;0  0.1575 (0.77)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1043 (1.45)     7.1043 (1.45)     7.1043 (1.45)     0.0000 (1.0)      7.1043 (1.45)     0.0000 (1.0)           0;0  0.1408 (0.69)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1079 (1.45)     7.1079 (1.45)     7.1079 (1.45)     0.0000 (1.0)      7.1079 (1.45)     0.0000 (1.0)           0;0  0.1407 (0.69)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8917 (1.0)      4.8917 (1.0)      4.8917 (1.0)      0.0000 (1.0)      4.8917 (1.0)      0.0000 (1.0)           0;0  0.2044 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.8970 (1.00)     4.8970 (1.00)     4.8970 (1.00)     0.0000 (1.0)      4.8970 (1.00)     0.0000 (1.0)           0;0  0.2042 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.4882 (2.69)     18.4882 (2.69)     18.4882 (2.69)     0.0000 (1.0)      18.4882 (2.69)     0.0000 (1.0)           0;0  0.0541 (0.37)          1           1
test_diff-diff[3.10.0]     19.2462 (2.80)     19.2462 (2.80)     19.2462 (2.80)     0.0000 (1.0)      19.2462 (2.80)     0.0000 (1.0)           0;0  0.0520 (0.36)          1           1
test_diff-diff[3.53.2]     19.0197 (2.77)     19.0197 (2.77)     19.0197 (2.77)     0.0000 (1.0)      19.0197 (2.77)     0.0000 (1.0)           0;0  0.0526 (0.36)          1           1
test_diff-diff[3.60.1]      6.8748 (1.0)       6.8748 (1.0)       6.8748 (1.0)      0.0000 (1.0)       6.8748 (1.0)      0.0000 (1.0)           0;0  0.1455 (1.0)           1           1
test_diff-diff[main]        6.9948 (1.02)      6.9948 (1.02)      6.9948 (1.02)     0.0000 (1.0)       6.9948 (1.02)     0.0000 (1.0)           0;0  0.1430 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0189 (1.79)     6.0189 (1.79)     6.0189 (1.79)     0.0000 (1.0)      6.0189 (1.79)     0.0000 (1.0)           0;0  0.1661 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.6513 (1.97)     6.6513 (1.97)     6.6513 (1.97)     0.0000 (1.0)      6.6513 (1.97)     0.0000 (1.0)           0;0  0.1503 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.4863 (1.63)     5.4863 (1.63)     5.4863 (1.63)     0.0000 (1.0)      5.4863 (1.63)     0.0000 (1.0)           0;0  0.1823 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.3692 (1.0)      3.3692 (1.0)      3.3692 (1.0)      0.0000 (1.0)      3.3692 (1.0)      0.0000 (1.0)           0;0  0.2968 (1.0)           1           1
test_diff-diff-changed[main]       3.3931 (1.01)     3.3931 (1.01)     3.3931 (1.01)     0.0000 (1.0)      3.3931 (1.01)     0.0000 (1.0)           0;0  0.2947 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0441 (1.49)     5.0441 (1.49)     5.0441 (1.49)     0.0000 (1.0)      5.0441 (1.49)     0.0000 (1.0)           0;0  0.1983 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6656 (1.68)     5.6656 (1.68)     5.6656 (1.68)     0.0000 (1.0)      5.6656 (1.68)     0.0000 (1.0)           0;0  0.1765 (0.60)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5816 (1.65)     5.5816 (1.65)     5.5816 (1.65)     0.0000 (1.0)      5.5816 (1.65)     0.0000 (1.0)           0;0  0.1792 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3743 (1.0)      3.3743 (1.0)      3.3743 (1.0)      0.0000 (1.0)      3.3743 (1.0)      0.0000 (1.0)           0;0  0.2964 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.3854 (1.00)     3.3854 (1.00)     3.3854 (1.00)     0.0000 (1.0)      3.3854 (1.00)     0.0000 (1.0)           0;0  0.2954 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.9691 (1.19)     3.9691 (1.19)     3.9691 (1.19)     0.0000 (1.0)      3.9691 (1.19)     0.0000 (1.0)           0;0  0.2519 (0.84)          1           1
test_diff-diff-noop[3.10.0]     4.7839 (1.43)     4.7839 (1.43)     4.7839 (1.43)     0.0000 (1.0)      4.7839 (1.43)     0.0000 (1.0)           0;0  0.2090 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.5484 (1.66)     5.5484 (1.66)     5.5484 (1.66)     0.0000 (1.0)      5.5484 (1.66)     0.0000 (1.0)           0;0  0.1802 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3707 (1.01)     3.3707 (1.01)     3.3707 (1.01)     0.0000 (1.0)      3.3707 (1.01)     0.0000 (1.0)           0;0  0.2967 (0.99)          1           1
test_diff-diff-noop[main]       3.3453 (1.0)      3.3453 (1.0)      3.3453 (1.0)      0.0000 (1.0)      3.3453 (1.0)      0.0000 (1.0)           0;0  0.2989 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0137 (1.0)      1.0137 (1.0)      1.0137 (1.0)      0.0000 (1.0)      1.0137 (1.0)      0.0000 (1.0)           0;0  0.9865 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.5804 (4.52)     4.5804 (4.52)     4.5804 (4.52)     0.0000 (1.0)      4.5804 (4.52)     0.0000 (1.0)           0;0  0.2183 (0.22)          1           1
test_exp_show-exp[3.53.2]     2.8409 (2.80)     2.8409 (2.80)     2.8409 (2.80)     0.0000 (1.0)      2.8409 (2.80)     0.0000 (1.0)           0;0  0.3520 (0.36)          1           1
test_exp_show-exp[3.60.1]     2.7465 (2.71)     2.7465 (2.71)     2.7465 (2.71)     0.0000 (1.0)      2.7465 (2.71)     0.0000 (1.0)           0;0  0.3641 (0.37)          1           1
test_exp_show-exp[main]       6.2421 (6.16)     6.2421 (6.16)     6.2421 (6.16)     0.0000 (1.0)      6.2421 (6.16)     0.0000 (1.0)           0;0  0.1602 (0.16)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.9709 (2.86)     66.9709 (2.86)     66.9709 (2.86)     0.0000 (1.0)      66.9709 (2.86)     0.0000 (1.0)           0;0  0.0149 (0.35)          1           1
test_fetch-fetch[3.10.0]     72.2600 (3.09)     72.2600 (3.09)     72.2600 (3.09)     0.0000 (1.0)      72.2600 (3.09)     0.0000 (1.0)           0;0  0.0138 (0.32)          1           1
test_fetch-fetch[3.53.2]     33.2777 (1.42)     33.2777 (1.42)     33.2777 (1.42)     0.0000 (1.0)      33.2777 (1.42)     0.0000 (1.0)           0;0  0.0301 (0.70)          1           1
test_fetch-fetch[3.60.1]     23.4025 (1.0)      23.4025 (1.0)      23.4025 (1.0)      0.0000 (1.0)      23.4025 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
test_fetch-fetch[main]       23.4052 (1.00)     23.4052 (1.00)     23.4052 (1.00)     0.0000 (1.0)      23.4052 (1.00)     0.0000 (1.0)           0;0  0.0427 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8458 (1.00)     2.8458 (1.00)     2.8458 (1.00)     0.0000 (1.0)      2.8458 (1.00)     0.0000 (1.0)           0;0  0.3514 (1.00)          1           1
test_gc-gc[3.10.0]     2.9321 (1.03)     2.9321 (1.03)     2.9321 (1.03)     0.0000 (1.0)      2.9321 (1.03)     0.0000 (1.0)           0;0  0.3411 (0.97)          1           1
test_gc-gc[3.53.2]     2.8792 (1.01)     2.8792 (1.01)     2.8792 (1.01)     0.0000 (1.0)      2.8792 (1.01)     0.0000 (1.0)           0;0  0.3473 (0.99)          1           1
test_gc-gc[3.60.1]     2.8609 (1.01)     2.8609 (1.01)     2.8609 (1.01)     0.0000 (1.0)      2.8609 (1.01)     0.0000 (1.0)           0;0  0.3495 (0.99)          1           1
test_gc-gc[main]       2.8374 (1.0)      2.8374 (1.0)      2.8374 (1.0)      0.0000 (1.0)      2.8374 (1.0)      0.0000 (1.0)           0;0  0.3524 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     135.7214 (2.73)     135.7214 (2.73)     135.7214 (2.73)     0.0000 (1.0)      135.7214 (2.73)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     168.5584 (3.38)     168.5584 (3.38)     168.5584 (3.38)     0.0000 (1.0)      168.5584 (3.38)     0.0000 (1.0)           0;0  0.0059 (0.30)          1           1
test_get-get[3.53.2]     145.3923 (2.92)     145.3923 (2.92)     145.3923 (2.92)     0.0000 (1.0)      145.3923 (2.92)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[3.60.1]      50.5377 (1.01)      50.5377 (1.01)      50.5377 (1.01)     0.0000 (1.0)       50.5377 (1.01)     0.0000 (1.0)           0;0  0.0198 (0.99)          1           1
test_get-get[main]        49.8022 (1.0)       49.8022 (1.0)       49.8022 (1.0)      0.0000 (1.0)       49.8022 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.3986 (2.74)     45.3986 (2.74)     45.3986 (2.74)     0.0000 (1.0)      45.3986 (2.74)     0.0000 (1.0)           0;0  0.0220 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.3273 (2.91)     48.3273 (2.91)     48.3273 (2.91)     0.0000 (1.0)      48.3273 (2.91)     0.0000 (1.0)           0;0  0.0207 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.8846 (1.02)     16.8846 (1.02)     16.8846 (1.02)     0.0000 (1.0)      16.8846 (1.02)     0.0000 (1.0)           0;0  0.0592 (0.98)          1           1
test_get_url-get-url[3.60.1]     16.5952 (1.0)      16.5952 (1.0)      16.5952 (1.0)      0.0000 (1.0)      16.5952 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
test_get_url-get-url[main]       17.1271 (1.03)     17.1271 (1.03)     17.1271 (1.03)     0.0000 (1.0)      17.1271 (1.03)     0.0000 (1.0)           0;0  0.0584 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.3708 (1.01)     128.2722 (1.02)     125.0848 (1.01)     0.9820 (1.16)     124.9835 (1.01)     0.8913 (1.0)          22;7  7.9946 (0.99)        100           1
test_help---help[3.10.0]     122.0290 (1.0)      126.3006 (1.0)      123.4797 (1.0)      0.9058 (1.07)     123.3491 (1.0)      1.0824 (1.21)         33;3  8.0985 (1.0)         100           1
test_help---help[3.53.2]     123.5477 (1.01)     130.4708 (1.03)     125.3545 (1.02)     1.3128 (1.55)     125.0500 (1.01)     1.3570 (1.52)         23;5  7.9774 (0.99)        100           1
test_help---help[3.60.1]     124.3894 (1.02)     129.2477 (1.02)     125.7480 (1.02)     0.8470 (1.0)      125.5954 (1.02)     1.0865 (1.22)         23;2  7.9524 (0.98)        100           1
test_help---help[main]       124.2567 (1.02)     159.0881 (1.26)     127.0905 (1.03)     4.7492 (5.61)     125.7795 (1.02)     1.4768 (1.66)          7;9  7.8684 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     225.1567 (2.98)     225.1567 (2.98)     225.1567 (2.98)     0.0000 (1.0)      225.1567 (2.98)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     254.2705 (3.36)     254.2705 (3.36)     254.2705 (3.36)     0.0000 (1.0)      254.2705 (3.36)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      75.9202 (1.00)      75.9202 (1.00)      75.9202 (1.00)     0.0000 (1.0)       75.9202 (1.00)     0.0000 (1.0)           0;0  0.0132 (1.00)          1           1
test_import-import[main]        75.6426 (1.0)       75.6426 (1.0)       75.6426 (1.0)      0.0000 (1.0)       75.6426 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     155.5055 (3.37)     155.5055 (3.37)     155.5055 (3.37)     0.0000 (1.0)      155.5055 (3.37)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     157.7310 (3.42)     157.7310 (3.42)     157.7310 (3.42)     0.0000 (1.0)      157.7310 (3.42)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.9138 (2.55)     117.9138 (2.55)     117.9138 (2.55)     0.0000 (1.0)      117.9138 (2.55)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_import_url-import-url[3.60.1]      46.1607 (1.0)       46.1607 (1.0)       46.1607 (1.0)      0.0000 (1.0)       46.1607 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_import_url-import-url[main]        46.5145 (1.01)      46.5145 (1.01)      46.5145 (1.01)     0.0000 (1.0)       46.5145 (1.01)     0.0000 (1.0)           0;0  0.0215 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     393.0876 (1.01)     440.3772 (1.0)      405.5884 (1.0)       8.6583 (1.0)      403.9713 (1.0)      11.6454 (1.0)          22;1  2.4656 (1.0)         100           1
test_init-init[3.10.0]     403.4142 (1.04)     455.6030 (1.03)     425.7702 (1.05)     11.9388 (1.38)     424.7984 (1.05)     17.2802 (1.48)         33;0  2.3487 (0.95)        100           1
test_init-init[3.53.2]     389.4282 (1.00)     440.4457 (1.00)     407.7634 (1.01)     10.4677 (1.21)     406.7022 (1.01)     14.7675 (1.27)         32;1  2.4524 (0.99)        100           1
test_init-init[3.60.1]     388.9173 (1.0)      444.4771 (1.01)     412.1434 (1.02)     12.6362 (1.46)     410.4448 (1.02)     20.3503 (1.75)         36;0  2.4263 (0.98)        100           1
test_init-init[main]       417.3970 (1.07)     672.2286 (1.53)     436.3015 (1.08)     28.0192 (3.24)     431.4679 (1.07)     15.3232 (1.32)          3;3  2.2920 (0.93)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     572.3010 (1.08)     572.3010 (1.08)     572.3010 (1.08)     0.0000 (1.0)      572.3010 (1.08)     0.0000 (1.0)           0;0  1.7473 (0.92)          1           1
test_list-list[3.10.0]     651.8845 (1.23)     651.8845 (1.23)     651.8845 (1.23)     0.0000 (1.0)      651.8845 (1.23)     0.0000 (1.0)           0;0  1.5340 (0.81)          1           1
test_list-list[3.53.2]     578.2863 (1.09)     578.2863 (1.09)     578.2863 (1.09)     0.0000 (1.0)      578.2863 (1.09)     0.0000 (1.0)           0;0  1.7292 (0.91)          1           1
test_list-list[3.60.1]     528.2642 (1.0)      528.2642 (1.0)      528.2642 (1.0)      0.0000 (1.0)      528.2642 (1.0)      0.0000 (1.0)           0;0  1.8930 (1.0)           1           1
test_list-list[main]       542.3499 (1.03)     542.3499 (1.03)     542.3499 (1.03)     0.0000 (1.0)      542.3499 (1.03)     0.0000 (1.0)           0;0  1.8438 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     426.0597 (1.08)     426.0597 (1.08)     426.0597 (1.08)     0.0000 (1.0)      426.0597 (1.08)     0.0000 (1.0)           0;0  2.3471 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     417.0327 (1.06)     417.0327 (1.06)     417.0327 (1.06)     0.0000 (1.0)      417.0327 (1.06)     0.0000 (1.0)           0;0  2.3979 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     409.9954 (1.04)     409.9954 (1.04)     409.9954 (1.04)     0.0000 (1.0)      409.9954 (1.04)     0.0000 (1.0)           0;0  2.4391 (0.96)          1           1
test_list-list-dvc-only[3.60.1]     392.7061 (1.0)      392.7061 (1.0)      392.7061 (1.0)      0.0000 (1.0)      392.7061 (1.0)      0.0000 (1.0)           0;0  2.5464 (1.0)           1           1
test_list-list-dvc-only[main]       399.1340 (1.02)     399.1340 (1.02)     399.1340 (1.02)     0.0000 (1.0)      399.1340 (1.02)     0.0000 (1.0)           0;0  2.5054 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7224 (1.02)     2.7224 (1.02)     2.7224 (1.02)     0.0000 (1.0)      2.7224 (1.02)     0.0000 (1.0)           0;0  0.3673 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.6820 (1.0)      2.6820 (1.0)      2.6820 (1.0)      0.0000 (1.0)      2.6820 (1.0)      0.0000 (1.0)           0;0  0.3729 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.8225 (1.05)     2.8225 (1.05)     2.8225 (1.05)     0.0000 (1.0)      2.8225 (1.05)     0.0000 (1.0)           0;0  0.3543 (0.95)          1           1
test_list-list-recursive[3.60.1]     2.7685 (1.03)     2.7685 (1.03)     2.7685 (1.03)     0.0000 (1.0)      2.7685 (1.03)     0.0000 (1.0)           0;0  0.3612 (0.97)          1           1
test_list-list-recursive[main]       2.9333 (1.09)     2.9333 (1.09)     2.9333 (1.09)     0.0000 (1.0)      2.9333 (1.09)     0.0000 (1.0)           0;0  0.3409 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     412.4546 (1.05)     412.4546 (1.05)     412.4546 (1.05)     0.0000 (1.0)      412.4546 (1.05)     0.0000 (1.0)           0;0  2.4245 (0.95)          1           1
test_list-list-shallow[3.10.0]     424.0250 (1.08)     424.0250 (1.08)     424.0250 (1.08)     0.0000 (1.0)      424.0250 (1.08)     0.0000 (1.0)           0;0  2.3584 (0.92)          1           1
test_list-list-shallow[3.53.2]     402.1904 (1.03)     402.1904 (1.03)     402.1904 (1.03)     0.0000 (1.0)      402.1904 (1.03)     0.0000 (1.0)           0;0  2.4864 (0.97)          1           1
test_list-list-shallow[3.60.1]     391.4902 (1.0)      391.4902 (1.0)      391.4902 (1.0)      0.0000 (1.0)      391.4902 (1.0)      0.0000 (1.0)           0;0  2.5543 (1.0)           1           1
test_list-list-shallow[main]       400.9138 (1.02)     400.9138 (1.02)     400.9138 (1.02)     0.0000 (1.0)      400.9138 (1.02)     0.0000 (1.0)           0;0  2.4943 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.1689 (3.59)     72.1689 (3.59)     72.1689 (3.59)     0.0000 (1.0)      72.1689 (3.59)     0.0000 (1.0)           0;0  0.0139 (0.28)          1           1
test_partial_add-add[3.10.0]     73.1376 (3.64)     73.1376 (3.64)     73.1376 (3.64)     0.0000 (1.0)      73.1376 (3.64)     0.0000 (1.0)           0;0  0.0137 (0.28)          1           1
test_partial_add-add[3.53.2]     66.0223 (3.28)     66.0223 (3.28)     66.0223 (3.28)     0.0000 (1.0)      66.0223 (3.28)     0.0000 (1.0)           0;0  0.0151 (0.30)          1           1
test_partial_add-add[3.60.1]     20.1129 (1.0)      20.1129 (1.0)      20.1129 (1.0)      0.0000 (1.0)      20.1129 (1.0)      0.0000 (1.0)           0;0  0.0497 (1.0)           1           1
test_partial_add-add[main]       20.8145 (1.03)     20.8145 (1.03)     20.8145 (1.03)     0.0000 (1.0)      20.8145 (1.03)     0.0000 (1.0)           0;0  0.0480 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     60.1533 (7.53)     60.1533 (7.53)     60.1533 (7.53)     0.0000 (1.0)      60.1533 (7.53)     0.0000 (1.0)           0;0  0.0166 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     61.6686 (7.72)     61.6686 (7.72)     61.6686 (7.72)     0.0000 (1.0)      61.6686 (7.72)     0.0000 (1.0)           0;0  0.0162 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     56.5226 (7.08)     56.5226 (7.08)     56.5226 (7.08)     0.0000 (1.0)      56.5226 (7.08)     0.0000 (1.0)           0;0  0.0177 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.9888 (1.0)       7.9888 (1.0)       7.9888 (1.0)      0.0000 (1.0)       7.9888 (1.0)      0.0000 (1.0)           0;0  0.1252 (1.0)           1           1
test_partial_add-add-partial[main]        7.9981 (1.00)      7.9981 (1.00)      7.9981 (1.00)     0.0000 (1.0)       7.9981 (1.00)     0.0000 (1.0)           0;0  0.1250 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3415 (1.0)      4.3415 (1.0)      4.3415 (1.0)      0.0000 (1.0)      4.3415 (1.0)      0.0000 (1.0)           0;0  0.2303 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.7607 (1.33)     5.7607 (1.33)     5.7607 (1.33)     0.0000 (1.0)      5.7607 (1.33)     0.0000 (1.0)           0;0  0.1736 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6870 (1.54)     6.6870 (1.54)     6.6870 (1.54)     0.0000 (1.0)      6.6870 (1.54)     0.0000 (1.0)           0;0  0.1495 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6358 (1.53)     6.6358 (1.53)     6.6358 (1.53)     0.0000 (1.0)      6.6358 (1.53)     0.0000 (1.0)           0;0  0.1507 (0.65)          1           1
test_partial_add-gc-cloud-noop[main]       6.7087 (1.55)     6.7087 (1.55)     6.7087 (1.55)     0.0000 (1.0)      6.7087 (1.55)     0.0000 (1.0)           0;0  0.1491 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4159 (1.0)      2.4159 (1.0)      2.4159 (1.0)      0.0000 (1.0)      2.4159 (1.0)      0.0000 (1.0)           0;0  0.4139 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7258 (1.54)     3.7258 (1.54)     3.7258 (1.54)     0.0000 (1.0)      3.7258 (1.54)     0.0000 (1.0)           0;0  0.2684 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.8513 (1.59)     3.8513 (1.59)     3.8513 (1.59)     0.0000 (1.0)      3.8513 (1.59)     0.0000 (1.0)           0;0  0.2597 (0.63)          1           1
test_partial_add-gc-noop[3.60.1]     3.8088 (1.58)     3.8088 (1.58)     3.8088 (1.58)     0.0000 (1.0)      3.8088 (1.58)     0.0000 (1.0)           0;0  0.2625 (0.63)          1           1
test_partial_add-gc-noop[main]       3.8261 (1.58)     3.8261 (1.58)     3.8261 (1.58)     0.0000 (1.0)      3.8261 (1.58)     0.0000 (1.0)           0;0  0.2614 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     46.3521 (2.40)     46.3521 (2.40)     46.3521 (2.40)     0.0000 (1.0)      46.3521 (2.40)     0.0000 (1.0)           0;0  0.0216 (0.42)          1           1
test_partial_add-push[3.10.0]     40.9913 (2.12)     40.9913 (2.12)     40.9913 (2.12)     0.0000 (1.0)      40.9913 (2.12)     0.0000 (1.0)           0;0  0.0244 (0.47)          1           1
test_partial_add-push[3.53.2]     20.0875 (1.04)     20.0875 (1.04)     20.0875 (1.04)     0.0000 (1.0)      20.0875 (1.04)     0.0000 (1.0)           0;0  0.0498 (0.96)          1           1
test_partial_add-push[3.60.1]     19.6629 (1.02)     19.6629 (1.02)     19.6629 (1.02)     0.0000 (1.0)      19.6629 (1.02)     0.0000 (1.0)           0;0  0.0509 (0.98)          1           1
test_partial_add-push[main]       19.3291 (1.0)      19.3291 (1.0)      19.3291 (1.0)      0.0000 (1.0)      19.3291 (1.0)      0.0000 (1.0)           0;0  0.0517 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.5774 (1.13)     11.5774 (1.13)     11.5774 (1.13)     0.0000 (1.0)      11.5774 (1.13)     0.0000 (1.0)           0;0  0.0864 (0.89)          1           1
test_partial_add-push-partial[3.10.0]     10.7200 (1.04)     10.7200 (1.04)     10.7200 (1.04)     0.0000 (1.0)      10.7200 (1.04)     0.0000 (1.0)           0;0  0.0933 (0.96)          1           1
test_partial_add-push-partial[3.53.2]     10.9364 (1.06)     10.9364 (1.06)     10.9364 (1.06)     0.0000 (1.0)      10.9364 (1.06)     0.0000 (1.0)           0;0  0.0914 (0.94)          1           1
test_partial_add-push-partial[3.60.1]     10.2691 (1.0)      10.2691 (1.0)      10.2691 (1.0)      0.0000 (1.0)      10.2691 (1.0)      0.0000 (1.0)           0;0  0.0974 (1.0)           1           1
test_partial_add-push-partial[main]       10.4160 (1.01)     10.4160 (1.01)     10.4160 (1.01)     0.0000 (1.0)      10.4160 (1.01)     0.0000 (1.0)           0;0  0.0960 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.7484 (3.84)     86.7484 (3.84)     86.7484 (3.84)     0.0000 (1.0)      86.7484 (3.84)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_partial_remove-add[3.10.0]     86.4199 (3.82)     86.4199 (3.82)     86.4199 (3.82)     0.0000 (1.0)      86.4199 (3.82)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.53.2]     77.8433 (3.44)     77.8433 (3.44)     77.8433 (3.44)     0.0000 (1.0)      77.8433 (3.44)     0.0000 (1.0)           0;0  0.0128 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.5999 (1.0)      22.5999 (1.0)      22.5999 (1.0)      0.0000 (1.0)      22.5999 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_partial_remove-add[main]       23.5679 (1.04)     23.5679 (1.04)     23.5679 (1.04)     0.0000 (1.0)      23.5679 (1.04)     0.0000 (1.0)           0;0  0.0424 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.8656 (8.56)     8.8656 (8.56)     8.8656 (8.56)     0.0000 (1.0)      8.8656 (8.56)     0.0000 (1.0)           0;0  0.1128 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.6427 (8.35)     8.6427 (8.35)     8.6427 (8.35)     0.0000 (1.0)      8.6427 (8.35)     0.0000 (1.0)           0;0  0.1157 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.7659 (7.50)     7.7659 (7.50)     7.7659 (7.50)     0.0000 (1.0)      7.7659 (7.50)     0.0000 (1.0)           0;0  0.1288 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.0352 (1.0)      1.0352 (1.0)      1.0352 (1.0)      0.0000 (1.0)      1.0352 (1.0)      0.0000 (1.0)           0;0  0.9660 (1.0)           1           1
test_partial_remove-add-update[main]       1.0519 (1.02)     1.0519 (1.02)     1.0519 (1.02)     0.0000 (1.0)      1.0519 (1.02)     0.0000 (1.0)           0;0  0.9506 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2506 (1.0)      3.2506 (1.0)      3.2506 (1.0)      0.0000 (1.0)      3.2506 (1.0)      0.0000 (1.0)           0;0  0.3076 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6556 (1.12)     3.6556 (1.12)     3.6556 (1.12)     0.0000 (1.0)      3.6556 (1.12)     0.0000 (1.0)           0;0  0.2736 (0.89)          1           1
test_partial_remove-gc[3.53.2]     3.5335 (1.09)     3.5335 (1.09)     3.5335 (1.09)     0.0000 (1.0)      3.5335 (1.09)     0.0000 (1.0)           0;0  0.2830 (0.92)          1           1
test_partial_remove-gc[3.60.1]     3.7244 (1.15)     3.7244 (1.15)     3.7244 (1.15)     0.0000 (1.0)      3.7244 (1.15)     0.0000 (1.0)           0;0  0.2685 (0.87)          1           1
test_partial_remove-gc[main]       3.6122 (1.11)     3.6122 (1.11)     3.6122 (1.11)     0.0000 (1.0)      3.6122 (1.11)     0.0000 (1.0)           0;0  0.2768 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8169 (1.0)      4.8169 (1.0)      4.8169 (1.0)      0.0000 (1.0)      4.8169 (1.0)      0.0000 (1.0)           0;0  0.2076 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.2108 (1.08)     5.2108 (1.08)     5.2108 (1.08)     0.0000 (1.0)      5.2108 (1.08)     0.0000 (1.0)           0;0  0.1919 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8801 (1.01)     4.8801 (1.01)     4.8801 (1.01)     0.0000 (1.0)      4.8801 (1.01)     0.0000 (1.0)           0;0  0.2049 (0.99)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8376 (1.00)     4.8376 (1.00)     4.8376 (1.00)     0.0000 (1.0)      4.8376 (1.00)     0.0000 (1.0)           0;0  0.2067 (1.00)          1           1
test_partial_remove-gc-cloud[main]       4.8501 (1.01)     4.8501 (1.01)     4.8501 (1.01)     0.0000 (1.0)      4.8501 (1.01)     0.0000 (1.0)           0;0  0.2062 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.0546 (2.35)     52.0546 (2.35)     52.0546 (2.35)     0.0000 (1.0)      52.0546 (2.35)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.1172 (2.08)     46.1172 (2.08)     46.1172 (2.08)     0.0000 (1.0)      46.1172 (2.08)     0.0000 (1.0)           0;0  0.0217 (0.48)          1           1
test_partial_remove-push[3.53.2]     22.7946 (1.03)     22.7946 (1.03)     22.7946 (1.03)     0.0000 (1.0)      22.7946 (1.03)     0.0000 (1.0)           0;0  0.0439 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.1804 (1.0)      22.1804 (1.0)      22.1804 (1.0)      0.0000 (1.0)      22.1804 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
test_partial_remove-push[main]       22.6422 (1.02)     22.6422 (1.02)     22.6422 (1.02)     0.0000 (1.0)      22.6422 (1.02)     0.0000 (1.0)           0;0  0.0442 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7925 (1.0)      1.7925 (1.0)      1.7925 (1.0)      0.0000 (1.0)      1.7925 (1.0)      0.0000 (1.0)           0;0  0.5579 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8139 (1.01)     1.8139 (1.01)     1.8139 (1.01)     0.0000 (1.0)      1.8139 (1.01)     0.0000 (1.0)           0;0  0.5513 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.4834 (1.39)     2.4834 (1.39)     2.4834 (1.39)     0.0000 (1.0)      2.4834 (1.39)     0.0000 (1.0)           0;0  0.4027 (0.72)          1           1
test_partial_remove-push-update[3.60.1]     2.4805 (1.38)     2.4805 (1.38)     2.4805 (1.38)     0.0000 (1.0)      2.4805 (1.38)     0.0000 (1.0)           0;0  0.4031 (0.72)          1           1
test_partial_remove-push-update[main]       2.5178 (1.40)     2.5178 (1.40)     2.5178 (1.40)     0.0000 (1.0)      2.5178 (1.40)     0.0000 (1.0)           0;0  0.3972 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     487.1353 (1.0)      493.2542 (1.0)      490.2477 (1.0)      2.8471 (1.25)     491.5716 (1.0)      5.0799 (2.09)          3;0  2.0398 (1.0)           5           3
test_plots-plots-diff[3.10.0]     876.7583 (1.80)     883.3298 (1.79)     880.4200 (1.80)     2.6798 (1.18)     880.8936 (1.79)     4.3652 (1.80)          2;0  1.1358 (0.56)          5           3
test_plots-plots-diff[3.53.2]     797.3172 (1.64)     803.6099 (1.63)     800.6489 (1.63)     2.2779 (1.0)      800.4123 (1.63)     2.4267 (1.0)           2;0  1.2490 (0.61)          5           3
test_plots-plots-diff[3.60.1]     798.3616 (1.64)     807.9571 (1.64)     804.2763 (1.64)     3.6601 (1.61)     805.5611 (1.64)     4.2215 (1.74)          2;0  1.2434 (0.61)          5           3
test_plots-plots-diff[main]       800.5300 (1.64)     807.5426 (1.64)     803.5506 (1.64)     3.1428 (1.38)     803.0468 (1.63)     5.7339 (2.36)          1;0  1.2445 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       504.2070 (1.0)        510.4665 (1.0)        506.7196 (1.0)      2.3603 (1.0)        505.9334 (1.0)       2.7335 (1.0)           2;0  1.9735 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,118.6542 (2.22)     1,135.4524 (2.22)     1,125.4941 (2.22)     7.0802 (3.00)     1,123.3108 (2.22)     11.6515 (4.26)          1;0  0.8885 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       877.5245 (1.74)       884.8384 (1.73)       881.6089 (1.74)     3.1734 (1.34)       881.2932 (1.74)      5.5612 (2.03)          2;0  1.1343 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       875.9309 (1.74)       894.0591 (1.75)       883.8582 (1.74)     6.9346 (2.94)       882.8500 (1.74)      9.6887 (3.54)          2;0  1.1314 (0.57)          5           3
test_plots-plots-diff-json[main]         880.9936 (1.75)       887.9290 (1.74)       883.9964 (1.74)     3.0829 (1.31)       883.9233 (1.75)      5.5819 (2.04)          1;0  1.1312 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     405.3955 (1.0)      408.0859 (1.0)      406.4970 (1.0)      1.0664 (1.0)      406.3556 (1.0)      1.5796 (1.0)           2;0  2.4600 (1.0)           5           3
test_plots-plots-show[3.10.0]     711.1176 (1.75)     718.0030 (1.76)     713.9373 (1.76)     2.6959 (2.53)     713.3129 (1.76)     3.8446 (2.43)          2;0  1.4007 (0.57)          5           3
test_plots-plots-show[3.53.2]     684.3609 (1.69)     690.0296 (1.69)     687.1116 (1.69)     2.2521 (2.11)     687.4801 (1.69)     3.5191 (2.23)          2;0  1.4554 (0.59)          5           3
test_plots-plots-show[3.60.1]     685.1681 (1.69)     692.0473 (1.70)     689.8671 (1.70)     2.7078 (2.54)     690.8921 (1.70)     2.3284 (1.47)          1;1  1.4496 (0.59)          5           3
test_plots-plots-show[main]       686.5532 (1.69)     690.1884 (1.69)     687.8760 (1.69)     1.4812 (1.39)     687.8006 (1.69)     2.0974 (1.33)          1;0  1.4538 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     420.8722 (1.0)      425.2899 (1.0)      423.0084 (1.0)      1.7728 (1.64)     422.4466 (1.0)      2.7475 (1.81)          2;0  2.3640 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     843.1084 (2.00)     852.4964 (2.00)     846.8729 (2.00)     3.6720 (3.39)     845.5089 (2.00)     4.9786 (3.28)          2;0  1.1808 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     730.4539 (1.74)     737.3220 (1.73)     734.3623 (1.74)     2.6704 (2.47)     734.6250 (1.74)     3.8868 (2.56)          2;0  1.3617 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     735.7687 (1.75)     738.5087 (1.74)     737.3636 (1.74)     1.0830 (1.0)      737.8305 (1.75)     1.5191 (1.0)           2;0  1.3562 (0.57)          5           3
test_plots-plots-show-json[main]       739.5361 (1.76)     747.6718 (1.76)     744.4231 (1.76)     3.8962 (3.60)     746.6110 (1.77)     6.9345 (4.56)          1;0  1.3433 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.5580 (2.35)     51.5580 (2.35)     51.5580 (2.35)     0.0000 (1.0)      51.5580 (2.35)     0.0000 (1.0)           0;0  0.0194 (0.43)          1           1
test_push-push[3.10.0]     46.1347 (2.10)     46.1347 (2.10)     46.1347 (2.10)     0.0000 (1.0)      46.1347 (2.10)     0.0000 (1.0)           0;0  0.0217 (0.48)          1           1
test_push-push[3.53.2]     22.5855 (1.03)     22.5855 (1.03)     22.5855 (1.03)     0.0000 (1.0)      22.5855 (1.03)     0.0000 (1.0)           0;0  0.0443 (0.97)          1           1
test_push-push[3.60.1]     21.9554 (1.0)      21.9554 (1.0)      21.9554 (1.0)      0.0000 (1.0)      21.9554 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
test_push-push[main]       22.1397 (1.01)     22.1397 (1.01)     22.1397 (1.01)     0.0000 (1.0)      22.1397 (1.01)     0.0000 (1.0)           0;0  0.0452 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.9364 (2.70)     64.9364 (2.70)     64.9364 (2.70)     0.0000 (1.0)      64.9364 (2.70)     0.0000 (1.0)           0;0  0.0154 (0.37)          1           1
test_sharing-fetch[3.10.0]     69.6384 (2.90)     69.6384 (2.90)     69.6384 (2.90)     0.0000 (1.0)      69.6384 (2.90)     0.0000 (1.0)           0;0  0.0144 (0.35)          1           1
test_sharing-fetch[3.53.2]     32.2106 (1.34)     32.2106 (1.34)     32.2106 (1.34)     0.0000 (1.0)      32.2106 (1.34)     0.0000 (1.0)           0;0  0.0310 (0.75)          1           1
test_sharing-fetch[3.60.1]     24.0458 (1.0)      24.0458 (1.0)      24.0458 (1.0)      0.0000 (1.0)      24.0458 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
test_sharing-fetch[main]       24.1832 (1.01)     24.1832 (1.01)     24.1832 (1.01)     0.0000 (1.0)      24.1832 (1.01)     0.0000 (1.0)           0;0  0.0414 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2546 (1.0)      1.2546 (1.0)      1.2546 (1.0)      0.0000 (1.0)      1.2546 (1.0)      0.0000 (1.0)           0;0  0.7971 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5988 (2.87)     3.5988 (2.87)     3.5988 (2.87)     0.0000 (1.0)      3.5988 (2.87)     0.0000 (1.0)           0;0  0.2779 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.6558 (4.51)     5.6558 (4.51)     5.6558 (4.51)     0.0000 (1.0)      5.6558 (4.51)     0.0000 (1.0)           0;0  0.1768 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     6.0375 (4.81)     6.0375 (4.81)     6.0375 (4.81)     0.0000 (1.0)      6.0375 (4.81)     0.0000 (1.0)           0;0  0.1656 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9681 (4.76)     5.9681 (4.76)     5.9681 (4.76)     0.0000 (1.0)      5.9681 (4.76)     0.0000 (1.0)           0;0  0.1676 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.4598 (2.36)     53.4598 (2.36)     53.4598 (2.36)     0.0000 (1.0)      53.4598 (2.36)     0.0000 (1.0)           0;0  0.0187 (0.42)          1           1
test_sharing-push[3.10.0]     47.7782 (2.11)     47.7782 (2.11)     47.7782 (2.11)     0.0000 (1.0)      47.7782 (2.11)     0.0000 (1.0)           0;0  0.0209 (0.47)          1           1
test_sharing-push[3.53.2]     23.4072 (1.03)     23.4072 (1.03)     23.4072 (1.03)     0.0000 (1.0)      23.4072 (1.03)     0.0000 (1.0)           0;0  0.0427 (0.97)          1           1
test_sharing-push[3.60.1]     22.6637 (1.0)      22.6637 (1.0)      22.6637 (1.0)      0.0000 (1.0)      22.6637 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
test_sharing-push[main]       22.9283 (1.01)     22.9283 (1.01)     22.9283 (1.01)     0.0000 (1.0)      22.9283 (1.01)     0.0000 (1.0)           0;0  0.0436 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2941 (1.11)     2.2941 (1.11)     2.2941 (1.11)     0.0000 (1.0)      2.2941 (1.11)     0.0000 (1.0)           0;0  0.4359 (0.90)          1           1
test_sharing-push-noop[3.10.0]     2.0623 (1.0)      2.0623 (1.0)      2.0623 (1.0)      0.0000 (1.0)      2.0623 (1.0)      0.0000 (1.0)           0;0  0.4849 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.1375 (2.98)     6.1375 (2.98)     6.1375 (2.98)     0.0000 (1.0)      6.1375 (2.98)     0.0000 (1.0)           0;0  0.1629 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.1894 (3.00)     6.1894 (3.00)     6.1894 (3.00)     0.0000 (1.0)      6.1894 (3.00)     0.0000 (1.0)           0;0  0.1616 (0.33)          1           1
test_sharing-push-noop[main]       6.3592 (3.08)     6.3592 (3.08)     6.3592 (3.08)     0.0000 (1.0)      6.3592 (3.08)     0.0000 (1.0)           0;0  0.1573 (0.32)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     158.9932 (1.06)     158.9932 (1.06)     158.9932 (1.06)     0.0000 (1.0)      158.9932 (1.06)     0.0000 (1.0)           0;0  0.0063 (0.95)          1           1
test_sharing_azure-fetch[main]       150.4168 (1.0)      150.4168 (1.0)      150.4168 (1.0)      0.0000 (1.0)      150.4168 (1.0)      0.0000 (1.0)           0;0  0.0066 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.5910 (1.0)      6.5910 (1.0)      6.5910 (1.0)      0.0000 (1.0)      6.5910 (1.0)      0.0000 (1.0)           0;0  0.1517 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6684 (1.01)     6.6684 (1.01)     6.6684 (1.01)     0.0000 (1.0)      6.6684 (1.01)     0.0000 (1.0)           0;0  0.1500 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     158.5358 (1.02)     158.5358 (1.02)     158.5358 (1.02)     0.0000 (1.0)      158.5358 (1.02)     0.0000 (1.0)           0;0  0.0063 (0.98)          1           1
test_sharing_azure-push[main]       155.3651 (1.0)      155.3651 (1.0)      155.3651 (1.0)      0.0000 (1.0)      155.3651 (1.0)      0.0000 (1.0)           0;0  0.0064 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.0988 (1.0)      7.0988 (1.0)      7.0988 (1.0)      0.0000 (1.0)      7.0988 (1.0)      0.0000 (1.0)           0;0  0.1409 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.1563 (1.01)     7.1563 (1.01)     7.1563 (1.01)     0.0000 (1.0)      7.1563 (1.01)     0.0000 (1.0)           0;0  0.1397 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     253.3268 (1.02)     253.3268 (1.02)     253.3268 (1.02)     0.0000 (1.0)      253.3268 (1.02)     0.0000 (1.0)           0;0  0.0039 (0.98)          1           1
test_sharing_gs-fetch[main]       247.2769 (1.0)      247.2769 (1.0)      247.2769 (1.0)      0.0000 (1.0)      247.2769 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     18.9481 (1.0)      18.9481 (1.0)      18.9481 (1.0)      0.0000 (1.0)      18.9481 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       18.9640 (1.00)     18.9640 (1.00)     18.9640 (1.00)     0.0000 (1.0)      18.9640 (1.00)     0.0000 (1.0)           0;0  0.0527 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     708.6828 (1.00)     708.6828 (1.00)     708.6828 (1.00)     0.0000 (1.0)      708.6828 (1.00)     0.0000 (1.0)           0;0  0.0014 (1.00)          1           1
test_sharing_gs-push[main]       708.0809 (1.0)      708.0809 (1.0)      708.0809 (1.0)      0.0000 (1.0)      708.0809 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.5456 (1.0)      6.5456 (1.0)      6.5456 (1.0)      0.0000 (1.0)      6.5456 (1.0)      0.0000 (1.0)           0;0  0.1528 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.6949 (1.02)     6.6949 (1.02)     6.6949 (1.02)     0.0000 (1.0)      6.6949 (1.02)     0.0000 (1.0)           0;0  0.1494 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     219.5922 (1.03)     219.5922 (1.03)     219.5922 (1.03)     0.0000 (1.0)      219.5922 (1.03)     0.0000 (1.0)           0;0  0.0046 (0.97)          1           1
test_sharing_s3-fetch[main]       212.5401 (1.0)      212.5401 (1.0)      212.5401 (1.0)      0.0000 (1.0)      212.5401 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2269 (1.0)      6.2269 (1.0)      6.2269 (1.0)      0.0000 (1.0)      6.2269 (1.0)      0.0000 (1.0)           0;0  0.1606 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.2953 (1.01)     6.2953 (1.01)     6.2953 (1.01)     0.0000 (1.0)      6.2953 (1.01)     0.0000 (1.0)           0;0  0.1588 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     240.0178 (1.0)      240.0178 (1.0)      240.0178 (1.0)      0.0000 (1.0)      240.0178 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
test_sharing_s3-push[main]       243.6597 (1.02)     243.6597 (1.02)     243.6597 (1.02)     0.0000 (1.0)      243.6597 (1.02)     0.0000 (1.0)           0;0  0.0041 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.4346 (1.00)     6.4346 (1.00)     6.4346 (1.00)     0.0000 (1.0)      6.4346 (1.00)     0.0000 (1.0)           0;0  0.1554 (1.00)          1           1
test_sharing_s3-push-noop[main]       6.4119 (1.0)      6.4119 (1.0)      6.4119 (1.0)      0.0000 (1.0)      6.4119 (1.0)      0.0000 (1.0)           0;0  0.1560 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     18.9133 (3.65)     18.9133 (3.65)     18.9133 (3.65)     0.0000 (1.0)      18.9133 (3.65)     0.0000 (1.0)           0;0  0.0529 (0.27)          1           1
test_status-status[3.10.0]     19.0813 (3.68)     19.0813 (3.68)     19.0813 (3.68)     0.0000 (1.0)      19.0813 (3.68)     0.0000 (1.0)           0;0  0.0524 (0.27)          1           1
test_status-status[3.53.2]     17.4250 (3.36)     17.4250 (3.36)     17.4250 (3.36)     0.0000 (1.0)      17.4250 (3.36)     0.0000 (1.0)           0;0  0.0574 (0.30)          1           1
test_status-status[3.60.1]      5.1809 (1.0)       5.1809 (1.0)       5.1809 (1.0)      0.0000 (1.0)       5.1809 (1.0)      0.0000 (1.0)           0;0  0.1930 (1.0)           1           1
test_status-status[main]        5.3594 (1.03)      5.3594 (1.03)      5.3594 (1.03)     0.0000 (1.0)       5.3594 (1.03)     0.0000 (1.0)           0;0  0.1866 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8681 (1.84)     4.8681 (1.84)     4.8681 (1.84)     0.0000 (1.0)      4.8681 (1.84)     0.0000 (1.0)           0;0  0.2054 (0.54)          1           1
test_status-status-changed[3.10.0]     5.0640 (1.92)     5.0640 (1.92)     5.0640 (1.92)     0.0000 (1.0)      5.0640 (1.92)     0.0000 (1.0)           0;0  0.1975 (0.52)          1           1
test_status-status-changed[3.53.2]     4.8472 (1.83)     4.8472 (1.83)     4.8472 (1.83)     0.0000 (1.0)      4.8472 (1.83)     0.0000 (1.0)           0;0  0.2063 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6433 (1.0)      2.6433 (1.0)      2.6433 (1.0)      0.0000 (1.0)      2.6433 (1.0)      0.0000 (1.0)           0;0  0.3783 (1.0)           1           1
test_status-status-changed[main]       2.6571 (1.01)     2.6571 (1.01)     2.6571 (1.01)     0.0000 (1.0)      2.6571 (1.01)     0.0000 (1.0)           0;0  0.3764 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9644 (1.94)     4.9644 (1.94)     4.9644 (1.94)     0.0000 (1.0)      4.9644 (1.94)     0.0000 (1.0)           0;0  0.2014 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.0061 (1.96)     5.0061 (1.96)     5.0061 (1.96)     0.0000 (1.0)      5.0061 (1.96)     0.0000 (1.0)           0;0  0.1998 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     4.7431 (1.85)     4.7431 (1.85)     4.7431 (1.85)     0.0000 (1.0)      4.7431 (1.85)     0.0000 (1.0)           0;0  0.2108 (0.54)          1           1
test_status-status-changed-noop[3.60.1]     2.5692 (1.00)     2.5692 (1.00)     2.5692 (1.00)     0.0000 (1.0)      2.5692 (1.00)     0.0000 (1.0)           0;0  0.3892 (1.00)          1           1
test_status-status-changed-noop[main]       2.5598 (1.0)      2.5598 (1.0)      2.5598 (1.0)      0.0000 (1.0)      2.5598 (1.0)      0.0000 (1.0)           0;0  0.3906 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8536 (1.90)     4.8536 (1.90)     4.8536 (1.90)     0.0000 (1.0)      4.8536 (1.90)     0.0000 (1.0)           0;0  0.2060 (0.53)          1           1
test_status-status-noop[3.10.0]     5.1134 (2.00)     5.1134 (2.00)     5.1134 (2.00)     0.0000 (1.0)      5.1134 (2.00)     0.0000 (1.0)           0;0  0.1956 (0.50)          1           1
test_status-status-noop[3.53.2]     4.6200 (1.81)     4.6200 (1.81)     4.6200 (1.81)     0.0000 (1.0)      4.6200 (1.81)     0.0000 (1.0)           0;0  0.2164 (0.55)          1           1
test_status-status-noop[3.60.1]     2.5566 (1.0)      2.5566 (1.0)      2.5566 (1.0)      0.0000 (1.0)      2.5566 (1.0)      0.0000 (1.0)           0;0  0.3911 (1.0)           1           1
test_status-status-noop[main]       2.6178 (1.02)     2.6178 (1.02)     2.6178 (1.02)     0.0000 (1.0)      2.6178 (1.02)     0.0000 (1.0)           0;0  0.3820 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     157.1318 (3.38)     157.1318 (3.38)     157.1318 (3.38)     0.0000 (1.0)      157.1318 (3.38)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     163.3150 (3.51)     163.3150 (3.51)     163.3150 (3.51)     0.0000 (1.0)      163.3150 (3.51)     0.0000 (1.0)           0;0  0.0061 (0.28)          1           1
test_update-import-url[3.53.2]     119.6197 (2.57)     119.6197 (2.57)     119.6197 (2.57)     0.0000 (1.0)      119.6197 (2.57)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_update-import-url[3.60.1]      46.4625 (1.0)       46.4625 (1.0)       46.4625 (1.0)      0.0000 (1.0)       46.4625 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_update-import-url[main]        47.0858 (1.01)      47.0858 (1.01)      47.0858 (1.01)     0.0000 (1.0)       47.0858 (1.01)     0.0000 (1.0)           0;0  0.0212 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     138.9209 (3.92)     138.9209 (3.92)     138.9209 (3.92)     0.0000 (1.0)      138.9209 (3.92)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     144.6480 (4.08)     144.6480 (4.08)     144.6480 (4.08)     0.0000 (1.0)      144.6480 (4.08)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.53.2]     113.1419 (3.19)     113.1419 (3.19)     113.1419 (3.19)     0.0000 (1.0)      113.1419 (3.19)     0.0000 (1.0)           0;0  0.0088 (0.31)          1           1
test_update-update[3.60.1]      35.7170 (1.01)      35.7170 (1.01)      35.7170 (1.01)     0.0000 (1.0)       35.7170 (1.01)     0.0000 (1.0)           0;0  0.0280 (0.99)          1           1
test_update-update[main]        35.4682 (1.0)       35.4682 (1.0)       35.4682 (1.0)      0.0000 (1.0)       35.4682 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1615 (2.12)     16.1615 (2.12)     16.1615 (2.12)     0.0000 (1.0)      16.1615 (2.12)     0.0000 (1.0)           0;0  0.0619 (0.47)          1           1
test_update-update-noop[3.10.0]     16.6223 (2.18)     16.6223 (2.18)     16.6223 (2.18)     0.0000 (1.0)      16.6223 (2.18)     0.0000 (1.0)           0;0  0.0602 (0.46)          1           1
test_update-update-noop[3.53.2]     16.3294 (2.14)     16.3294 (2.14)     16.3294 (2.14)     0.0000 (1.0)      16.3294 (2.14)     0.0000 (1.0)           0;0  0.0612 (0.47)          1           1
test_update-update-noop[3.60.1]      7.7565 (1.02)      7.7565 (1.02)      7.7565 (1.02)     0.0000 (1.0)       7.7565 (1.02)     0.0000 (1.0)           0;0  0.1289 (0.98)          1           1
test_update-update-noop[main]        7.6232 (1.0)       7.6232 (1.0)       7.6232 (1.0)      0.0000 (1.0)       7.6232 (1.0)      0.0000 (1.0)           0;0  0.1312 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean