Tue Nov  4 00:50:21 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     83.7684 (3.71)     83.7684 (3.71)     83.7684 (3.71)     0.0000 (1.0)      83.7684 (3.71)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_add_copy-add[3.10.0]     84.6669 (3.75)     84.6669 (3.75)     84.6669 (3.75)     0.0000 (1.0)      84.6669 (3.75)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.53.2]     77.6405 (3.43)     77.6405 (3.43)     77.6405 (3.43)     0.0000 (1.0)      77.6405 (3.43)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_add_copy-add[3.60.1]     22.6059 (1.0)      22.6059 (1.0)      22.6059 (1.0)      0.0000 (1.0)      22.6059 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_add_copy-add[main]       23.9268 (1.06)     23.9268 (1.06)     23.9268 (1.06)     0.0000 (1.0)      23.9268 (1.06)     0.0000 (1.0)           0;0  0.0418 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.4382 (6.55)     28.4382 (6.55)     28.4382 (6.55)     0.0000 (1.0)      28.4382 (6.55)     0.0000 (1.0)           0;0  0.0352 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.9423 (6.67)     28.9423 (6.67)     28.9423 (6.67)     0.0000 (1.0)      28.9423 (6.67)     0.0000 (1.0)           0;0  0.0346 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     27.6184 (6.37)     27.6184 (6.37)     27.6184 (6.37)     0.0000 (1.0)      27.6184 (6.37)     0.0000 (1.0)           0;0  0.0362 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.3389 (1.0)       4.3389 (1.0)       4.3389 (1.0)      0.0000 (1.0)       4.3389 (1.0)      0.0000 (1.0)           0;0  0.2305 (1.0)           1           1
test_add_copy-add-noop[main]        4.4847 (1.03)      4.4847 (1.03)      4.4847 (1.03)     0.0000 (1.0)       4.4847 (1.03)     0.0000 (1.0)           0;0  0.2230 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.7166 (4.24)     66.7166 (4.24)     66.7166 (4.24)     0.0000 (1.0)      66.7166 (4.24)     0.0000 (1.0)           0;0  0.0150 (0.24)          1           1
test_add_hardlink-add[3.10.0]     66.9178 (4.25)     66.9178 (4.25)     66.9178 (4.25)     0.0000 (1.0)      66.9178 (4.25)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.3356 (3.96)     62.3356 (3.96)     62.3356 (3.96)     0.0000 (1.0)      62.3356 (3.96)     0.0000 (1.0)           0;0  0.0160 (0.25)          1           1
test_add_hardlink-add[3.60.1]     15.7327 (1.0)      15.7327 (1.0)      15.7327 (1.0)      0.0000 (1.0)      15.7327 (1.0)      0.0000 (1.0)           0;0  0.0636 (1.0)           1           1
test_add_hardlink-add[main]       17.2521 (1.10)     17.2521 (1.10)     17.2521 (1.10)     0.0000 (1.0)      17.2521 (1.10)     0.0000 (1.0)           0;0  0.0580 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.3799 (7.82)     33.3799 (7.82)     33.3799 (7.82)     0.0000 (1.0)      33.3799 (7.82)     0.0000 (1.0)           0;0  0.0300 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     34.2801 (8.03)     34.2801 (8.03)     34.2801 (8.03)     0.0000 (1.0)      34.2801 (8.03)     0.0000 (1.0)           0;0  0.0292 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     32.2966 (7.57)     32.2966 (7.57)     32.2966 (7.57)     0.0000 (1.0)      32.2966 (7.57)     0.0000 (1.0)           0;0  0.0310 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2667 (1.0)       4.2667 (1.0)       4.2667 (1.0)      0.0000 (1.0)       4.2667 (1.0)      0.0000 (1.0)           0;0  0.2344 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.3524 (1.02)      4.3524 (1.02)      4.3524 (1.02)     0.0000 (1.0)       4.3524 (1.02)     0.0000 (1.0)           0;0  0.2298 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     67.7362 (1.95)     67.7362 (1.95)     67.7362 (1.95)     0.0000 (1.0)      67.7362 (1.95)     0.0000 (1.0)           0;0  0.0148 (0.51)          1           1
test_add_symlink-add[3.10.0]     68.6201 (1.98)     68.6201 (1.98)     68.6201 (1.98)     0.0000 (1.0)      68.6201 (1.98)     0.0000 (1.0)           0;0  0.0146 (0.51)          1           1
test_add_symlink-add[3.53.2]     62.9666 (1.81)     62.9666 (1.81)     62.9666 (1.81)     0.0000 (1.0)      62.9666 (1.81)     0.0000 (1.0)           0;0  0.0159 (0.55)          1           1
test_add_symlink-add[3.60.1]     34.7408 (1.0)      34.7408 (1.0)      34.7408 (1.0)      0.0000 (1.0)      34.7408 (1.0)      0.0000 (1.0)           0;0  0.0288 (1.0)           1           1
test_add_symlink-add[main]       37.0310 (1.07)     37.0310 (1.07)     37.0310 (1.07)     0.0000 (1.0)      37.0310 (1.07)     0.0000 (1.0)           0;0  0.0270 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.1686 (8.16)     46.1686 (8.16)     46.1686 (8.16)     0.0000 (1.0)      46.1686 (8.16)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     46.8557 (8.29)     46.8557 (8.29)     46.8557 (8.29)     0.0000 (1.0)      46.8557 (8.29)     0.0000 (1.0)           0;0  0.0213 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.1801 (8.17)     46.1801 (8.17)     46.1801 (8.17)     0.0000 (1.0)      46.1801 (8.17)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.6546 (1.0)       5.6546 (1.0)       5.6546 (1.0)      0.0000 (1.0)       5.6546 (1.0)      0.0000 (1.0)           0;0  0.1768 (1.0)           1           1
test_add_symlink-add-noop[main]        5.9398 (1.05)      5.9398 (1.05)      5.9398 (1.05)     0.0000 (1.0)       5.9398 (1.05)     0.0000 (1.0)           0;0  0.1684 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.5056 (1.87)     39.5056 (1.87)     39.5056 (1.87)     0.0000 (1.0)      39.5056 (1.87)     0.0000 (1.0)           0;0  0.0253 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     54.9251 (2.60)     54.9251 (2.60)     54.9251 (2.60)     0.0000 (1.0)      54.9251 (2.60)     0.0000 (1.0)           0;0  0.0182 (0.38)          1           1
test_checkout_copy-checkout[3.53.2]     27.5068 (1.30)     27.5068 (1.30)     27.5068 (1.30)     0.0000 (1.0)      27.5068 (1.30)     0.0000 (1.0)           0;0  0.0364 (0.77)          1           1
test_checkout_copy-checkout[3.60.1]     21.1265 (1.0)      21.1265 (1.0)      21.1265 (1.0)      0.0000 (1.0)      21.1265 (1.0)      0.0000 (1.0)           0;0  0.0473 (1.0)           1           1
test_checkout_copy-checkout[main]       22.3364 (1.06)     22.3364 (1.06)     22.3364 (1.06)     0.0000 (1.0)      22.3364 (1.06)     0.0000 (1.0)           0;0  0.0448 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3793 (1.69)     5.3793 (1.69)     5.3793 (1.69)     0.0000 (1.0)      5.3793 (1.69)     0.0000 (1.0)           0;0  0.1859 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6291 (1.77)     5.6291 (1.77)     5.6291 (1.77)     0.0000 (1.0)      5.6291 (1.77)     0.0000 (1.0)           0;0  0.1776 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5037 (1.73)     5.5037 (1.73)     5.5037 (1.73)     0.0000 (1.0)      5.5037 (1.73)     0.0000 (1.0)           0;0  0.1817 (0.58)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.1846 (1.0)      3.1846 (1.0)      3.1846 (1.0)      0.0000 (1.0)      3.1846 (1.0)      0.0000 (1.0)           0;0  0.3140 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4171 (1.07)     3.4171 (1.07)     3.4171 (1.07)     0.0000 (1.0)      3.4171 (1.07)     0.0000 (1.0)           0;0  0.2926 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.6838 (1.95)     7.6838 (1.95)     7.6838 (1.95)     0.0000 (1.0)      7.6838 (1.95)     0.0000 (1.0)           0;0  0.1301 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3248 (1.60)     6.3248 (1.60)     6.3248 (1.60)     0.0000 (1.0)      6.3248 (1.60)     0.0000 (1.0)           0;0  0.1581 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2512 (1.59)     6.2512 (1.59)     6.2512 (1.59)     0.0000 (1.0)      6.2512 (1.59)     0.0000 (1.0)           0;0  0.1600 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9432 (1.0)      3.9432 (1.0)      3.9432 (1.0)      0.0000 (1.0)      3.9432 (1.0)      0.0000 (1.0)           0;0  0.2536 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.2515 (1.08)     4.2515 (1.08)     4.2515 (1.08)     0.0000 (1.0)      4.2515 (1.08)     0.0000 (1.0)           0;0  0.2352 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     20.1689 (2.74)     20.1689 (2.74)     20.1689 (2.74)     0.0000 (1.0)      20.1689 (2.74)     0.0000 (1.0)           0;0  0.0496 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.8561 (2.15)     15.8561 (2.15)     15.8561 (2.15)     0.0000 (1.0)      15.8561 (2.15)     0.0000 (1.0)           0;0  0.0631 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     13.9071 (1.89)     13.9071 (1.89)     13.9071 (1.89)     0.0000 (1.0)      13.9071 (1.89)     0.0000 (1.0)           0;0  0.0719 (0.53)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3612 (1.0)       7.3612 (1.0)       7.3612 (1.0)      0.0000 (1.0)       7.3612 (1.0)      0.0000 (1.0)           0;0  0.1358 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.5098 (1.16)      8.5098 (1.16)      8.5098 (1.16)     0.0000 (1.0)       8.5098 (1.16)     0.0000 (1.0)           0;0  0.1175 (0.87)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4199 (1.71)     5.4199 (1.71)     5.4199 (1.71)     0.0000 (1.0)      5.4199 (1.71)     0.0000 (1.0)           0;0  0.1845 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6256 (1.78)     5.6256 (1.78)     5.6256 (1.78)     0.0000 (1.0)      5.6256 (1.78)     0.0000 (1.0)           0;0  0.1778 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4989 (1.74)     5.4989 (1.74)     5.4989 (1.74)     0.0000 (1.0)      5.4989 (1.74)     0.0000 (1.0)           0;0  0.1819 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.1645 (1.0)      3.1645 (1.0)      3.1645 (1.0)      0.0000 (1.0)      3.1645 (1.0)      0.0000 (1.0)           0;0  0.3160 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3668 (1.06)     3.3668 (1.06)     3.3668 (1.06)     0.0000 (1.0)      3.3668 (1.06)     0.0000 (1.0)           0;0  0.2970 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.7432 (2.07)     7.7432 (2.07)     7.7432 (2.07)     0.0000 (1.0)      7.7432 (2.07)     0.0000 (1.0)           0;0  0.1291 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.2919 (1.68)     6.2919 (1.68)     6.2919 (1.68)     0.0000 (1.0)      6.2919 (1.68)     0.0000 (1.0)           0;0  0.1589 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1283 (1.64)     6.1283 (1.64)     6.1283 (1.64)     0.0000 (1.0)      6.1283 (1.64)     0.0000 (1.0)           0;0  0.1632 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.7396 (1.0)      3.7396 (1.0)      3.7396 (1.0)      0.0000 (1.0)      3.7396 (1.0)      0.0000 (1.0)           0;0  0.2674 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.2525 (1.14)     4.2525 (1.14)     4.2525 (1.14)     0.0000 (1.0)      4.2525 (1.14)     0.0000 (1.0)           0;0  0.2352 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.1314 (2.46)     24.1314 (2.46)     24.1314 (2.46)     0.0000 (1.0)      24.1314 (2.46)     0.0000 (1.0)           0;0  0.0414 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     18.5077 (1.89)     18.5077 (1.89)     18.5077 (1.89)     0.0000 (1.0)      18.5077 (1.89)     0.0000 (1.0)           0;0  0.0540 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.1688 (1.75)     17.1688 (1.75)     17.1688 (1.75)     0.0000 (1.0)      17.1688 (1.75)     0.0000 (1.0)           0;0  0.0582 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]      9.7964 (1.0)       9.7964 (1.0)       9.7964 (1.0)      0.0000 (1.0)       9.7964 (1.0)      0.0000 (1.0)           0;0  0.1021 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.1859 (1.14)     11.1859 (1.14)     11.1859 (1.14)     0.0000 (1.0)      11.1859 (1.14)     0.0000 (1.0)           0;0  0.0894 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6914 (1.64)     6.6914 (1.64)     6.6914 (1.64)     0.0000 (1.0)      6.6914 (1.64)     0.0000 (1.0)           0;0  0.1494 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.6891 (1.63)     6.6891 (1.63)     6.6891 (1.63)     0.0000 (1.0)      6.6891 (1.63)     0.0000 (1.0)           0;0  0.1495 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.5635 (1.60)     6.5635 (1.60)     6.5635 (1.60)     0.0000 (1.0)      6.5635 (1.60)     0.0000 (1.0)           0;0  0.1524 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.0925 (1.0)      4.0925 (1.0)      4.0925 (1.0)      0.0000 (1.0)      4.0925 (1.0)      0.0000 (1.0)           0;0  0.2443 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3507 (1.06)     4.3507 (1.06)     4.3507 (1.06)     0.0000 (1.0)      4.3507 (1.06)     0.0000 (1.0)           0;0  0.2298 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.7513 (1.75)     9.7513 (1.75)     9.7513 (1.75)     0.0000 (1.0)      9.7513 (1.75)     0.0000 (1.0)           0;0  0.1026 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.3561 (1.50)     8.3561 (1.50)     8.3561 (1.50)     0.0000 (1.0)      8.3561 (1.50)     0.0000 (1.0)           0;0  0.1197 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.3185 (1.49)     8.3185 (1.49)     8.3185 (1.49)     0.0000 (1.0)      8.3185 (1.49)     0.0000 (1.0)           0;0  0.1202 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.5643 (1.0)      5.5643 (1.0)      5.5643 (1.0)      0.0000 (1.0)      5.5643 (1.0)      0.0000 (1.0)           0;0  0.1797 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.0129 (1.08)     6.0129 (1.08)     6.0129 (1.08)     0.0000 (1.0)      6.0129 (1.08)     0.0000 (1.0)           0;0  0.1663 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1499 (1.69)     4.1499 (1.69)     4.1499 (1.69)     0.0000 (1.0)      4.1499 (1.69)     0.0000 (1.0)           0;0  0.2410 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.9248 (2.00)     4.9248 (2.00)     4.9248 (2.00)     0.0000 (1.0)      4.9248 (2.00)     0.0000 (1.0)           0;0  0.2031 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.8390 (1.97)     4.8390 (1.97)     4.8390 (1.97)     0.0000 (1.0)      4.8390 (1.97)     0.0000 (1.0)           0;0  0.2067 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.4576 (1.0)      2.4576 (1.0)      2.4576 (1.0)      0.0000 (1.0)      2.4576 (1.0)      0.0000 (1.0)           0;0  0.4069 (1.0)           1           1
test_data_status-data-changed[main]       2.7115 (1.10)     2.7115 (1.10)     2.7115 (1.10)     0.0000 (1.0)      2.7115 (1.10)     0.0000 (1.0)           0;0  0.3688 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.4121 (1.82)     4.4121 (1.82)     4.4121 (1.82)     0.0000 (1.0)      4.4121 (1.82)     0.0000 (1.0)           0;0  0.2267 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8875 (2.01)     4.8875 (2.01)     4.8875 (2.01)     0.0000 (1.0)      4.8875 (2.01)     0.0000 (1.0)           0;0  0.2046 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7725 (1.97)     4.7725 (1.97)     4.7725 (1.97)     0.0000 (1.0)      4.7725 (1.97)     0.0000 (1.0)           0;0  0.2095 (0.51)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4257 (1.0)      2.4257 (1.0)      2.4257 (1.0)      0.0000 (1.0)      2.4257 (1.0)      0.0000 (1.0)           0;0  0.4122 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6029 (1.07)     2.6029 (1.07)     2.6029 (1.07)     0.0000 (1.0)      2.6029 (1.07)     0.0000 (1.0)           0;0  0.3842 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.7446 (3.78)     18.7446 (3.78)     18.7446 (3.78)     0.0000 (1.0)      18.7446 (3.78)     0.0000 (1.0)           0;0  0.0533 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.7906 (3.99)     19.7906 (3.99)     19.7906 (3.99)     0.0000 (1.0)      19.7906 (3.99)     0.0000 (1.0)           0;0  0.0505 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.1959 (3.87)     19.1959 (3.87)     19.1959 (3.87)     0.0000 (1.0)      19.1959 (3.87)     0.0000 (1.0)           0;0  0.0521 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9569 (1.0)       4.9569 (1.0)       4.9569 (1.0)      0.0000 (1.0)       4.9569 (1.0)      0.0000 (1.0)           0;0  0.2017 (1.0)           1           1
test_data_status-data-new[main]        5.2146 (1.05)      5.2146 (1.05)      5.2146 (1.05)     0.0000 (1.0)       5.2146 (1.05)     0.0000 (1.0)           0;0  0.1918 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1860 (1.68)     4.1860 (1.68)     4.1860 (1.68)     0.0000 (1.0)      4.1860 (1.68)     0.0000 (1.0)           0;0  0.2389 (0.59)          1           1
test_data_status-data-noop[3.10.0]     4.8631 (1.95)     4.8631 (1.95)     4.8631 (1.95)     0.0000 (1.0)      4.8631 (1.95)     0.0000 (1.0)           0;0  0.2056 (0.51)          1           1
test_data_status-data-noop[3.53.2]     4.8040 (1.93)     4.8040 (1.93)     4.8040 (1.93)     0.0000 (1.0)      4.8040 (1.93)     0.0000 (1.0)           0;0  0.2082 (0.52)          1           1
test_data_status-data-noop[3.60.1]     2.4883 (1.0)      2.4883 (1.0)      2.4883 (1.0)      0.0000 (1.0)      2.4883 (1.0)      0.0000 (1.0)           0;0  0.4019 (1.0)           1           1
test_data_status-data-noop[main]       2.6480 (1.06)     2.6480 (1.06)     2.6480 (1.06)     0.0000 (1.0)      2.6480 (1.06)     0.0000 (1.0)           0;0  0.3776 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.4130 (1.43)     7.4130 (1.43)     7.4130 (1.43)     0.0000 (1.0)      7.4130 (1.43)     0.0000 (1.0)           0;0  0.1349 (0.70)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6098 (1.47)     7.6098 (1.47)     7.6098 (1.47)     0.0000 (1.0)      7.6098 (1.47)     0.0000 (1.0)           0;0  0.1314 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6819 (1.49)     7.6819 (1.49)     7.6819 (1.49)     0.0000 (1.0)      7.6819 (1.49)     0.0000 (1.0)           0;0  0.1302 (0.67)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.1702 (1.0)      5.1702 (1.0)      5.1702 (1.0)      0.0000 (1.0)      5.1702 (1.0)      0.0000 (1.0)           0;0  0.1934 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.3958 (1.04)     5.3958 (1.04)     5.3958 (1.04)     0.0000 (1.0)      5.3958 (1.04)     0.0000 (1.0)           0;0  0.1853 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.3720 (1.40)     7.3720 (1.40)     7.3720 (1.40)     0.0000 (1.0)      7.3720 (1.40)     0.0000 (1.0)           0;0  0.1356 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6041 (1.44)     7.6041 (1.44)     7.6041 (1.44)     0.0000 (1.0)      7.6041 (1.44)     0.0000 (1.0)           0;0  0.1315 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.4274 (1.41)     7.4274 (1.41)     7.4274 (1.41)     0.0000 (1.0)      7.4274 (1.41)     0.0000 (1.0)           0;0  0.1346 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.2832 (1.0)      5.2832 (1.0)      5.2832 (1.0)      0.0000 (1.0)      5.2832 (1.0)      0.0000 (1.0)           0;0  0.1893 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.4192 (1.03)     5.4192 (1.03)     5.4192 (1.03)     0.0000 (1.0)      5.4192 (1.03)     0.0000 (1.0)           0;0  0.1845 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.1155 (2.72)     21.1155 (2.72)     21.1155 (2.72)     0.0000 (1.0)      21.1155 (2.72)     0.0000 (1.0)           0;0  0.0474 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.7205 (2.80)     21.7205 (2.80)     21.7205 (2.80)     0.0000 (1.0)      21.7205 (2.80)     0.0000 (1.0)           0;0  0.0460 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.8563 (2.82)     21.8563 (2.82)     21.8563 (2.82)     0.0000 (1.0)      21.8563 (2.82)     0.0000 (1.0)           0;0  0.0458 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.7610 (1.0)       7.7610 (1.0)       7.7610 (1.0)      0.0000 (1.0)       7.7610 (1.0)      0.0000 (1.0)           0;0  0.1288 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.0653 (1.04)      8.0653 (1.04)      8.0653 (1.04)     0.0000 (1.0)       8.0653 (1.04)     0.0000 (1.0)           0;0  0.1240 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.7063 (1.46)     6.7063 (1.46)     6.7063 (1.46)     0.0000 (1.0)      6.7063 (1.46)     0.0000 (1.0)           0;0  0.1491 (0.68)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2859 (1.59)     7.2859 (1.59)     7.2859 (1.59)     0.0000 (1.0)      7.2859 (1.59)     0.0000 (1.0)           0;0  0.1373 (0.63)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9614 (1.52)     6.9614 (1.52)     6.9614 (1.52)     0.0000 (1.0)      6.9614 (1.52)     0.0000 (1.0)           0;0  0.1437 (0.66)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5825 (1.0)      4.5825 (1.0)      4.5825 (1.0)      0.0000 (1.0)      4.5825 (1.0)      0.0000 (1.0)           0;0  0.2182 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.9222 (1.07)     4.9222 (1.07)     4.9222 (1.07)     0.0000 (1.0)      4.9222 (1.07)     0.0000 (1.0)           0;0  0.2032 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.1501 (2.68)     18.1501 (2.68)     18.1501 (2.68)     0.0000 (1.0)      18.1501 (2.68)     0.0000 (1.0)           0;0  0.0551 (0.37)          1           1
test_diff-diff[3.10.0]     19.2227 (2.84)     19.2227 (2.84)     19.2227 (2.84)     0.0000 (1.0)      19.2227 (2.84)     0.0000 (1.0)           0;0  0.0520 (0.35)          1           1
test_diff-diff[3.53.2]     19.3198 (2.86)     19.3198 (2.86)     19.3198 (2.86)     0.0000 (1.0)      19.3198 (2.86)     0.0000 (1.0)           0;0  0.0518 (0.35)          1           1
test_diff-diff[3.60.1]      6.7662 (1.0)       6.7662 (1.0)       6.7662 (1.0)      0.0000 (1.0)       6.7662 (1.0)      0.0000 (1.0)           0;0  0.1478 (1.0)           1           1
test_diff-diff[main]        7.8797 (1.16)      7.8797 (1.16)      7.8797 (1.16)     0.0000 (1.0)       7.8797 (1.16)     0.0000 (1.0)           0;0  0.1269 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0753 (1.84)     6.0753 (1.84)     6.0753 (1.84)     0.0000 (1.0)      6.0753 (1.84)     0.0000 (1.0)           0;0  0.1646 (0.54)          1           1
test_diff-diff-changed[3.10.0]     6.8152 (2.06)     6.8152 (2.06)     6.8152 (2.06)     0.0000 (1.0)      6.8152 (2.06)     0.0000 (1.0)           0;0  0.1467 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.5592 (1.68)     5.5592 (1.68)     5.5592 (1.68)     0.0000 (1.0)      5.5592 (1.68)     0.0000 (1.0)           0;0  0.1799 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3087 (1.0)      3.3087 (1.0)      3.3087 (1.0)      0.0000 (1.0)      3.3087 (1.0)      0.0000 (1.0)           0;0  0.3022 (1.0)           1           1
test_diff-diff-changed[main]       4.1720 (1.26)     4.1720 (1.26)     4.1720 (1.26)     0.0000 (1.0)      4.1720 (1.26)     0.0000 (1.0)           0;0  0.2397 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1429 (1.54)     5.1429 (1.54)     5.1429 (1.54)     0.0000 (1.0)      5.1429 (1.54)     0.0000 (1.0)           0;0  0.1944 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7912 (1.74)     5.7912 (1.74)     5.7912 (1.74)     0.0000 (1.0)      5.7912 (1.74)     0.0000 (1.0)           0;0  0.1727 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6629 (1.70)     5.6629 (1.70)     5.6629 (1.70)     0.0000 (1.0)      5.6629 (1.70)     0.0000 (1.0)           0;0  0.1766 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3342 (1.0)      3.3342 (1.0)      3.3342 (1.0)      0.0000 (1.0)      3.3342 (1.0)      0.0000 (1.0)           0;0  0.2999 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2157 (1.26)     4.2157 (1.26)     4.2157 (1.26)     0.0000 (1.0)      4.2157 (1.26)     0.0000 (1.0)           0;0  0.2372 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2118 (1.27)     4.2118 (1.27)     4.2118 (1.27)     0.0000 (1.0)      4.2118 (1.27)     0.0000 (1.0)           0;0  0.2374 (0.79)          1           1
test_diff-diff-noop[3.10.0]     4.9633 (1.50)     4.9633 (1.50)     4.9633 (1.50)     0.0000 (1.0)      4.9633 (1.50)     0.0000 (1.0)           0;0  0.2015 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.6236 (1.70)     5.6236 (1.70)     5.6236 (1.70)     0.0000 (1.0)      5.6236 (1.70)     0.0000 (1.0)           0;0  0.1778 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.3069 (1.0)      3.3069 (1.0)      3.3069 (1.0)      0.0000 (1.0)      3.3069 (1.0)      0.0000 (1.0)           0;0  0.3024 (1.0)           1           1
test_diff-diff-noop[main]       4.1950 (1.27)     4.1950 (1.27)     4.1950 (1.27)     0.0000 (1.0)      4.1950 (1.27)     0.0000 (1.0)           0;0  0.2384 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.1013 (1.0)       1.1013 (1.0)       1.1013 (1.0)      0.0000 (1.0)       1.1013 (1.0)      0.0000 (1.0)           0;0  0.9080 (1.0)           1           1
test_exp_show-exp[3.10.0]     11.8377 (10.75)    11.8377 (10.75)    11.8377 (10.75)    0.0000 (1.0)      11.8377 (10.75)    0.0000 (1.0)           0;0  0.0845 (0.09)          1           1
test_exp_show-exp[3.53.2]      6.3901 (5.80)      6.3901 (5.80)      6.3901 (5.80)     0.0000 (1.0)       6.3901 (5.80)     0.0000 (1.0)           0;0  0.1565 (0.17)          1           1
test_exp_show-exp[3.60.1]      7.7000 (6.99)      7.7000 (6.99)      7.7000 (6.99)     0.0000 (1.0)       7.7000 (6.99)     0.0000 (1.0)           0;0  0.1299 (0.14)          1           1
test_exp_show-exp[main]       10.9776 (9.97)     10.9776 (9.97)     10.9776 (9.97)     0.0000 (1.0)      10.9776 (9.97)     0.0000 (1.0)           0;0  0.0911 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     61.1859 (2.67)     61.1859 (2.67)     61.1859 (2.67)     0.0000 (1.0)      61.1859 (2.67)     0.0000 (1.0)           0;0  0.0163 (0.37)          1           1
test_fetch-fetch[3.10.0]     66.0352 (2.88)     66.0352 (2.88)     66.0352 (2.88)     0.0000 (1.0)      66.0352 (2.88)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_fetch-fetch[3.53.2]     33.3771 (1.46)     33.3771 (1.46)     33.3771 (1.46)     0.0000 (1.0)      33.3771 (1.46)     0.0000 (1.0)           0;0  0.0300 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.1582 (1.01)     23.1582 (1.01)     23.1582 (1.01)     0.0000 (1.0)      23.1582 (1.01)     0.0000 (1.0)           0;0  0.0432 (0.99)          1           1
test_fetch-fetch[main]       22.9274 (1.0)      22.9274 (1.0)      22.9274 (1.0)      0.0000 (1.0)      22.9274 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.0354 (1.0)      2.0354 (1.0)      2.0354 (1.0)      0.0000 (1.0)      2.0354 (1.0)      0.0000 (1.0)           0;0  0.4913 (1.0)           1           1
test_gc-gc[3.10.0]     2.1486 (1.06)     2.1486 (1.06)     2.1486 (1.06)     0.0000 (1.0)      2.1486 (1.06)     0.0000 (1.0)           0;0  0.4654 (0.95)          1           1
test_gc-gc[3.53.2]     2.0837 (1.02)     2.0837 (1.02)     2.0837 (1.02)     0.0000 (1.0)      2.0837 (1.02)     0.0000 (1.0)           0;0  0.4799 (0.98)          1           1
test_gc-gc[3.60.1]     2.0354 (1.00)     2.0354 (1.00)     2.0354 (1.00)     0.0000 (1.0)      2.0354 (1.00)     0.0000 (1.0)           0;0  0.4913 (1.00)          1           1
test_gc-gc[main]       2.2436 (1.10)     2.2436 (1.10)     2.2436 (1.10)     0.0000 (1.0)      2.2436 (1.10)     0.0000 (1.0)           0;0  0.4457 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     128.4248 (2.72)     128.4248 (2.72)     128.4248 (2.72)     0.0000 (1.0)      128.4248 (2.72)     0.0000 (1.0)           0;0  0.0078 (0.37)          1           1
test_get-get[3.10.0]     157.0005 (3.33)     157.0005 (3.33)     157.0005 (3.33)     0.0000 (1.0)      157.0005 (3.33)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_get-get[3.53.2]     141.6413 (3.01)     141.6413 (3.01)     141.6413 (3.01)     0.0000 (1.0)      141.6413 (3.01)     0.0000 (1.0)           0;0  0.0071 (0.33)          1           1
test_get-get[3.60.1]      47.8616 (1.02)      47.8616 (1.02)      47.8616 (1.02)     0.0000 (1.0)       47.8616 (1.02)     0.0000 (1.0)           0;0  0.0209 (0.98)          1           1
test_get-get[main]        47.1342 (1.0)       47.1342 (1.0)       47.1342 (1.0)      0.0000 (1.0)       47.1342 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     31.8881 (3.55)     31.8881 (3.55)     31.8881 (3.55)     0.0000 (1.0)      31.8881 (3.55)     0.0000 (1.0)           0;0  0.0314 (0.28)          1           1
test_get_url-get-url[3.10.0]     36.0032 (4.01)     36.0032 (4.01)     36.0032 (4.01)     0.0000 (1.0)      36.0032 (4.01)     0.0000 (1.0)           0;0  0.0278 (0.25)          1           1
test_get_url-get-url[3.53.2]      8.9715 (1.0)       8.9715 (1.0)       8.9715 (1.0)      0.0000 (1.0)       8.9715 (1.0)      0.0000 (1.0)           0;0  0.1115 (1.0)           1           1
test_get_url-get-url[3.60.1]      9.0565 (1.01)      9.0565 (1.01)      9.0565 (1.01)     0.0000 (1.0)       9.0565 (1.01)     0.0000 (1.0)           0;0  0.1104 (0.99)          1           1
test_get_url-get-url[main]        9.0629 (1.01)      9.0629 (1.01)      9.0629 (1.01)     0.0000 (1.0)       9.0629 (1.01)     0.0000 (1.0)           0;0  0.1103 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     151.7833 (1.07)     172.0931 (1.04)     157.3237 (1.06)     3.8478 (1.26)     156.9154 (1.07)     3.7693 (1.38)         23;6  6.3563 (0.94)        100           1
test_help---help[3.10.0]     146.0973 (1.03)     165.9466 (1.0)      150.5298 (1.01)     3.0532 (1.0)      149.8499 (1.02)     3.7556 (1.37)         18;2  6.6432 (0.99)        100           1
test_help---help[3.53.2]     150.2777 (1.06)     173.1879 (1.04)     155.5548 (1.05)     3.8099 (1.25)     154.5528 (1.05)     2.8698 (1.05)         15;9  6.4286 (0.95)        100           1
test_help---help[3.60.1]     150.2954 (1.06)     168.7909 (1.02)     156.1517 (1.05)     3.6408 (1.19)     155.1863 (1.06)     2.7399 (1.0)         23;14  6.4040 (0.95)        100           1
test_help---help[main]       141.7232 (1.0)      182.4510 (1.10)     148.3751 (1.0)      6.5637 (2.15)     146.6653 (1.0)      4.3399 (1.58)          9;7  6.7397 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     217.8518 (2.90)     217.8518 (2.90)     217.8518 (2.90)     0.0000 (1.0)      217.8518 (2.90)     0.0000 (1.0)           0;0  0.0046 (0.34)          1           1
test_import-import[3.10.0]     247.7298 (3.30)     247.7298 (3.30)     247.7298 (3.30)     0.0000 (1.0)      247.7298 (3.30)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      75.1344 (1.0)       75.1344 (1.0)       75.1344 (1.0)      0.0000 (1.0)       75.1344 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        76.5445 (1.02)      76.5445 (1.02)      76.5445 (1.02)     0.0000 (1.0)       76.5445 (1.02)     0.0000 (1.0)           0;0  0.0131 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     147.0802 (3.22)     147.0802 (3.22)     147.0802 (3.22)     0.0000 (1.0)      147.0802 (3.22)     0.0000 (1.0)           0;0  0.0068 (0.31)          1           1
test_import_url-import-url[3.10.0]     150.7193 (3.30)     150.7193 (3.30)     150.7193 (3.30)     0.0000 (1.0)      150.7193 (3.30)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_import_url-import-url[3.53.2]     114.3218 (2.50)     114.3218 (2.50)     114.3218 (2.50)     0.0000 (1.0)      114.3218 (2.50)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_import_url-import-url[3.60.1]      45.6630 (1.0)       45.6630 (1.0)       45.6630 (1.0)      0.0000 (1.0)       45.6630 (1.0)      0.0000 (1.0)           0;0  0.0219 (1.0)           1           1
test_import_url-import-url[main]        47.1799 (1.03)      47.1799 (1.03)      47.1799 (1.03)     0.0000 (1.0)       47.1799 (1.03)     0.0000 (1.0)           0;0  0.0212 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     447.2268 (1.04)     500.2567 (1.05)     466.2190 (1.04)     10.7433 (1.13)     464.7758 (1.04)     14.0939 (1.34)         32;1  2.1449 (0.96)        100           1
test_init-init[3.10.0]     446.3364 (1.04)     493.7848 (1.04)     469.2438 (1.05)      9.4837 (1.0)      469.0435 (1.05)     13.2829 (1.26)         32;0  2.1311 (0.95)        100           1
test_init-init[3.53.2]     430.1767 (1.00)     491.1774 (1.03)     453.0028 (1.01)     12.1134 (1.28)     453.1537 (1.02)     16.1404 (1.53)         36;1  2.2075 (0.99)        100           1
test_init-init[3.60.1]     428.6816 (1.0)      476.5511 (1.0)      446.8861 (1.0)       9.5623 (1.01)     445.1500 (1.0)      10.5336 (1.0)          27;3  2.2377 (1.0)         100           1
test_init-init[main]       463.7452 (1.08)     519.4383 (1.09)     483.1270 (1.08)     10.6700 (1.13)     482.6837 (1.08)     15.0339 (1.43)         28;1  2.0698 (0.92)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     624.2425 (1.08)     624.2425 (1.08)     624.2425 (1.08)     0.0000 (1.0)      624.2425 (1.08)     0.0000 (1.0)           0;0  1.6019 (0.93)          1           1
test_list-list[3.10.0]     743.5682 (1.28)     743.5682 (1.28)     743.5682 (1.28)     0.0000 (1.0)      743.5682 (1.28)     0.0000 (1.0)           0;0  1.3449 (0.78)          1           1
test_list-list[3.53.2]     625.8286 (1.08)     625.8286 (1.08)     625.8286 (1.08)     0.0000 (1.0)      625.8286 (1.08)     0.0000 (1.0)           0;0  1.5979 (0.92)          1           1
test_list-list[3.60.1]     578.7452 (1.0)      578.7452 (1.0)      578.7452 (1.0)      0.0000 (1.0)      578.7452 (1.0)      0.0000 (1.0)           0;0  1.7279 (1.0)           1           1
test_list-list[main]       589.1409 (1.02)     589.1409 (1.02)     589.1409 (1.02)     0.0000 (1.0)      589.1409 (1.02)     0.0000 (1.0)           0;0  1.6974 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     445.4543 (1.09)     445.4543 (1.09)     445.4543 (1.09)     0.0000 (1.0)      445.4543 (1.09)     0.0000 (1.0)           0;0  2.2449 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     441.9842 (1.08)     441.9842 (1.08)     441.9842 (1.08)     0.0000 (1.0)      441.9842 (1.08)     0.0000 (1.0)           0;0  2.2625 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     416.8270 (1.02)     416.8270 (1.02)     416.8270 (1.02)     0.0000 (1.0)      416.8270 (1.02)     0.0000 (1.0)           0;0  2.3991 (0.98)          1           1
test_list-list-dvc-only[3.60.1]     410.0570 (1.0)      410.0570 (1.0)      410.0570 (1.0)      0.0000 (1.0)      410.0570 (1.0)      0.0000 (1.0)           0;0  2.4387 (1.0)           1           1
test_list-list-dvc-only[main]       415.7745 (1.01)     415.7745 (1.01)     415.7745 (1.01)     0.0000 (1.0)      415.7745 (1.01)     0.0000 (1.0)           0;0  2.4052 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.3912 (1.0)      2.3912 (1.0)      2.3912 (1.0)      0.0000 (1.0)      2.3912 (1.0)      0.0000 (1.0)           0;0  0.4182 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5322 (1.06)     2.5322 (1.06)     2.5322 (1.06)     0.0000 (1.0)      2.5322 (1.06)     0.0000 (1.0)           0;0  0.3949 (0.94)          1           1
test_list-list-recursive[3.53.2]     2.7056 (1.13)     2.7056 (1.13)     2.7056 (1.13)     0.0000 (1.0)      2.7056 (1.13)     0.0000 (1.0)           0;0  0.3696 (0.88)          1           1
test_list-list-recursive[3.60.1]     2.7783 (1.16)     2.7783 (1.16)     2.7783 (1.16)     0.0000 (1.0)      2.7783 (1.16)     0.0000 (1.0)           0;0  0.3599 (0.86)          1           1
test_list-list-recursive[main]       2.7341 (1.14)     2.7341 (1.14)     2.7341 (1.14)     0.0000 (1.0)      2.7341 (1.14)     0.0000 (1.0)           0;0  0.3657 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     438.1502 (1.06)     438.1502 (1.06)     438.1502 (1.06)     0.0000 (1.0)      438.1502 (1.06)     0.0000 (1.0)           0;0  2.2823 (0.94)          1           1
test_list-list-shallow[3.10.0]     439.1517 (1.07)     439.1517 (1.07)     439.1517 (1.07)     0.0000 (1.0)      439.1517 (1.07)     0.0000 (1.0)           0;0  2.2771 (0.94)          1           1
test_list-list-shallow[3.53.2]     417.4892 (1.01)     417.4892 (1.01)     417.4892 (1.01)     0.0000 (1.0)      417.4892 (1.01)     0.0000 (1.0)           0;0  2.3953 (0.99)          1           1
test_list-list-shallow[3.60.1]     411.5502 (1.0)      411.5502 (1.0)      411.5502 (1.0)      0.0000 (1.0)      411.5502 (1.0)      0.0000 (1.0)           0;0  2.4298 (1.0)           1           1
test_list-list-shallow[main]       413.8682 (1.01)     413.8682 (1.01)     413.8682 (1.01)     0.0000 (1.0)      413.8682 (1.01)     0.0000 (1.0)           0;0  2.4162 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     69.4391 (3.62)     69.4391 (3.62)     69.4391 (3.62)     0.0000 (1.0)      69.4391 (3.62)     0.0000 (1.0)           0;0  0.0144 (0.28)          1           1
test_partial_add-add[3.10.0]     70.2564 (3.67)     70.2564 (3.67)     70.2564 (3.67)     0.0000 (1.0)      70.2564 (3.67)     0.0000 (1.0)           0;0  0.0142 (0.27)          1           1
test_partial_add-add[3.53.2]     62.6044 (3.27)     62.6044 (3.27)     62.6044 (3.27)     0.0000 (1.0)      62.6044 (3.27)     0.0000 (1.0)           0;0  0.0160 (0.31)          1           1
test_partial_add-add[3.60.1]     19.1666 (1.0)      19.1666 (1.0)      19.1666 (1.0)      0.0000 (1.0)      19.1666 (1.0)      0.0000 (1.0)           0;0  0.0522 (1.0)           1           1
test_partial_add-add[main]       20.4499 (1.07)     20.4499 (1.07)     20.4499 (1.07)     0.0000 (1.0)      20.4499 (1.07)     0.0000 (1.0)           0;0  0.0489 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     57.5842 (7.55)     57.5842 (7.55)     57.5842 (7.55)     0.0000 (1.0)      57.5842 (7.55)     0.0000 (1.0)           0;0  0.0174 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     58.0340 (7.61)     58.0340 (7.61)     58.0340 (7.61)     0.0000 (1.0)      58.0340 (7.61)     0.0000 (1.0)           0;0  0.0172 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     53.0135 (6.95)     53.0135 (6.95)     53.0135 (6.95)     0.0000 (1.0)      53.0135 (6.95)     0.0000 (1.0)           0;0  0.0189 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.6274 (1.0)       7.6274 (1.0)       7.6274 (1.0)      0.0000 (1.0)       7.6274 (1.0)      0.0000 (1.0)           0;0  0.1311 (1.0)           1           1
test_partial_add-add-partial[main]        7.7766 (1.02)      7.7766 (1.02)      7.7766 (1.02)     0.0000 (1.0)       7.7766 (1.02)     0.0000 (1.0)           0;0  0.1286 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5714 (1.0)      4.5714 (1.0)      4.5714 (1.0)      0.0000 (1.0)      4.5714 (1.0)      0.0000 (1.0)           0;0  0.2188 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1449 (1.34)     6.1449 (1.34)     6.1449 (1.34)     0.0000 (1.0)      6.1449 (1.34)     0.0000 (1.0)           0;0  0.1627 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.0180 (1.54)     7.0180 (1.54)     7.0180 (1.54)     0.0000 (1.0)      7.0180 (1.54)     0.0000 (1.0)           0;0  0.1425 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.1130 (1.56)     7.1130 (1.56)     7.1130 (1.56)     0.0000 (1.0)      7.1130 (1.56)     0.0000 (1.0)           0;0  0.1406 (0.64)          1           1
test_partial_add-gc-cloud-noop[main]       7.2005 (1.58)     7.2005 (1.58)     7.2005 (1.58)     0.0000 (1.0)      7.2005 (1.58)     0.0000 (1.0)           0;0  0.1389 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6152 (1.0)      2.6152 (1.0)      2.6152 (1.0)      0.0000 (1.0)      2.6152 (1.0)      0.0000 (1.0)           0;0  0.3824 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9552 (1.51)     3.9552 (1.51)     3.9552 (1.51)     0.0000 (1.0)      3.9552 (1.51)     0.0000 (1.0)           0;0  0.2528 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.9784 (1.52)     3.9784 (1.52)     3.9784 (1.52)     0.0000 (1.0)      3.9784 (1.52)     0.0000 (1.0)           0;0  0.2514 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     4.3225 (1.65)     4.3225 (1.65)     4.3225 (1.65)     0.0000 (1.0)      4.3225 (1.65)     0.0000 (1.0)           0;0  0.2313 (0.61)          1           1
test_partial_add-gc-noop[main]       4.0287 (1.54)     4.0287 (1.54)     4.0287 (1.54)     0.0000 (1.0)      4.0287 (1.54)     0.0000 (1.0)           0;0  0.2482 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     42.0080 (2.25)     42.0080 (2.25)     42.0080 (2.25)     0.0000 (1.0)      42.0080 (2.25)     0.0000 (1.0)           0;0  0.0238 (0.45)          1           1
test_partial_add-push[3.10.0]     37.0567 (1.98)     37.0567 (1.98)     37.0567 (1.98)     0.0000 (1.0)      37.0567 (1.98)     0.0000 (1.0)           0;0  0.0270 (0.50)          1           1
test_partial_add-push[3.53.2]     19.5936 (1.05)     19.5936 (1.05)     19.5936 (1.05)     0.0000 (1.0)      19.5936 (1.05)     0.0000 (1.0)           0;0  0.0510 (0.95)          1           1
test_partial_add-push[3.60.1]     19.2900 (1.03)     19.2900 (1.03)     19.2900 (1.03)     0.0000 (1.0)      19.2900 (1.03)     0.0000 (1.0)           0;0  0.0518 (0.97)          1           1
test_partial_add-push[main]       18.7079 (1.0)      18.7079 (1.0)      18.7079 (1.0)      0.0000 (1.0)      18.7079 (1.0)      0.0000 (1.0)           0;0  0.0535 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.8935 (1.07)     10.8935 (1.07)     10.8935 (1.07)     0.0000 (1.0)      10.8935 (1.07)     0.0000 (1.0)           0;0  0.0918 (0.93)          1           1
test_partial_add-push-partial[3.10.0]     10.1660 (1.00)     10.1660 (1.00)     10.1660 (1.00)     0.0000 (1.0)      10.1660 (1.00)     0.0000 (1.0)           0;0  0.0984 (1.00)          1           1
test_partial_add-push-partial[3.53.2]     10.4420 (1.03)     10.4420 (1.03)     10.4420 (1.03)     0.0000 (1.0)      10.4420 (1.03)     0.0000 (1.0)           0;0  0.0958 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.1338 (1.0)      10.1338 (1.0)      10.1338 (1.0)      0.0000 (1.0)      10.1338 (1.0)      0.0000 (1.0)           0;0  0.0987 (1.0)           1           1
test_partial_add-push-partial[main]       10.1764 (1.00)     10.1764 (1.00)     10.1764 (1.00)     0.0000 (1.0)      10.1764 (1.00)     0.0000 (1.0)           0;0  0.0983 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     84.1537 (3.79)     84.1537 (3.79)     84.1537 (3.79)     0.0000 (1.0)      84.1537 (3.79)     0.0000 (1.0)           0;0  0.0119 (0.26)          1           1
test_partial_remove-add[3.10.0]     84.8950 (3.82)     84.8950 (3.82)     84.8950 (3.82)     0.0000 (1.0)      84.8950 (3.82)     0.0000 (1.0)           0;0  0.0118 (0.26)          1           1
test_partial_remove-add[3.53.2]     75.5483 (3.40)     75.5483 (3.40)     75.5483 (3.40)     0.0000 (1.0)      75.5483 (3.40)     0.0000 (1.0)           0;0  0.0132 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.2263 (1.0)      22.2263 (1.0)      22.2263 (1.0)      0.0000 (1.0)      22.2263 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
test_partial_remove-add[main]       23.5798 (1.06)     23.5798 (1.06)     23.5798 (1.06)     0.0000 (1.0)      23.5798 (1.06)     0.0000 (1.0)           0;0  0.0424 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.4090 (8.06)     8.4090 (8.06)     8.4090 (8.06)     0.0000 (1.0)      8.4090 (8.06)     0.0000 (1.0)           0;0  0.1189 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.5236 (8.17)     8.5236 (8.17)     8.5236 (8.17)     0.0000 (1.0)      8.5236 (8.17)     0.0000 (1.0)           0;0  0.1173 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.4466 (7.13)     7.4466 (7.13)     7.4466 (7.13)     0.0000 (1.0)      7.4466 (7.13)     0.0000 (1.0)           0;0  0.1343 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0437 (1.0)      1.0437 (1.0)      1.0437 (1.0)      0.0000 (1.0)      1.0437 (1.0)      0.0000 (1.0)           0;0  0.9581 (1.0)           1           1
test_partial_remove-add-update[main]       1.0745 (1.03)     1.0745 (1.03)     1.0745 (1.03)     0.0000 (1.0)      1.0745 (1.03)     0.0000 (1.0)           0;0  0.9307 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.4984 (1.0)      3.4984 (1.0)      3.4984 (1.0)      0.0000 (1.0)      3.4984 (1.0)      0.0000 (1.0)           0;0  0.2858 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7468 (1.07)     3.7468 (1.07)     3.7468 (1.07)     0.0000 (1.0)      3.7468 (1.07)     0.0000 (1.0)           0;0  0.2669 (0.93)          1           1
test_partial_remove-gc[3.53.2]     3.6461 (1.04)     3.6461 (1.04)     3.6461 (1.04)     0.0000 (1.0)      3.6461 (1.04)     0.0000 (1.0)           0;0  0.2743 (0.96)          1           1
test_partial_remove-gc[3.60.1]     4.0252 (1.15)     4.0252 (1.15)     4.0252 (1.15)     0.0000 (1.0)      4.0252 (1.15)     0.0000 (1.0)           0;0  0.2484 (0.87)          1           1
test_partial_remove-gc[main]       3.7887 (1.08)     3.7887 (1.08)     3.7887 (1.08)     0.0000 (1.0)      3.7887 (1.08)     0.0000 (1.0)           0;0  0.2639 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.0576 (1.06)     5.0576 (1.06)     5.0576 (1.06)     0.0000 (1.0)      5.0576 (1.06)     0.0000 (1.0)           0;0  0.1977 (0.94)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1598 (1.08)     5.1598 (1.08)     5.1598 (1.08)     0.0000 (1.0)      5.1598 (1.08)     0.0000 (1.0)           0;0  0.1938 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0333 (1.06)     5.0333 (1.06)     5.0333 (1.06)     0.0000 (1.0)      5.0333 (1.06)     0.0000 (1.0)           0;0  0.1987 (0.95)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.9965 (1.05)     4.9965 (1.05)     4.9965 (1.05)     0.0000 (1.0)      4.9965 (1.05)     0.0000 (1.0)           0;0  0.2001 (0.95)          1           1
test_partial_remove-gc-cloud[main]       4.7592 (1.0)      4.7592 (1.0)      4.7592 (1.0)      0.0000 (1.0)      4.7592 (1.0)      0.0000 (1.0)           0;0  0.2101 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     47.4919 (2.15)     47.4919 (2.15)     47.4919 (2.15)     0.0000 (1.0)      47.4919 (2.15)     0.0000 (1.0)           0;0  0.0211 (0.46)          1           1
test_partial_remove-push[3.10.0]     41.7730 (1.89)     41.7730 (1.89)     41.7730 (1.89)     0.0000 (1.0)      41.7730 (1.89)     0.0000 (1.0)           0;0  0.0239 (0.53)          1           1
test_partial_remove-push[3.53.2]     22.6763 (1.03)     22.6763 (1.03)     22.6763 (1.03)     0.0000 (1.0)      22.6763 (1.03)     0.0000 (1.0)           0;0  0.0441 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.0465 (1.00)     22.0465 (1.00)     22.0465 (1.00)     0.0000 (1.0)      22.0465 (1.00)     0.0000 (1.0)           0;0  0.0454 (1.00)          1           1
test_partial_remove-push[main]       22.0449 (1.0)      22.0449 (1.0)      22.0449 (1.0)      0.0000 (1.0)      22.0449 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7878 (1.0)      1.7878 (1.0)      1.7878 (1.0)      0.0000 (1.0)      1.7878 (1.0)      0.0000 (1.0)           0;0  0.5593 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.7946 (1.00)     1.7946 (1.00)     1.7946 (1.00)     0.0000 (1.0)      1.7946 (1.00)     0.0000 (1.0)           0;0  0.5572 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.5130 (1.41)     2.5130 (1.41)     2.5130 (1.41)     0.0000 (1.0)      2.5130 (1.41)     0.0000 (1.0)           0;0  0.3979 (0.71)          1           1
test_partial_remove-push-update[3.60.1]     2.7154 (1.52)     2.7154 (1.52)     2.7154 (1.52)     0.0000 (1.0)      2.7154 (1.52)     0.0000 (1.0)           0;0  0.3683 (0.66)          1           1
test_partial_remove-push-update[main]       2.5009 (1.40)     2.5009 (1.40)     2.5009 (1.40)     0.0000 (1.0)      2.5009 (1.40)     0.0000 (1.0)           0;0  0.3999 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     560.8983 (1.0)      567.1604 (1.0)      564.9652 (1.0)       2.4850 (1.10)     565.3178 (1.0)       3.0895 (1.65)          1;0  1.7700 (1.0)           5           3
test_plots-plots-diff[3.10.0]     977.0271 (1.74)     985.9740 (1.74)     981.2276 (1.74)      3.3489 (1.48)     981.5814 (1.74)      4.3997 (2.35)          2;0  1.0191 (0.58)          5           3
test_plots-plots-diff[3.53.2]     920.5452 (1.64)     925.9117 (1.63)     921.9103 (1.63)      2.2626 (1.0)      921.1797 (1.63)      1.8743 (1.0)           1;1  1.0847 (0.61)          5           3
test_plots-plots-diff[3.60.1]     932.7338 (1.66)     963.3273 (1.70)     943.9667 (1.67)     12.1880 (5.39)     944.3806 (1.67)     15.6228 (8.34)          1;0  1.0594 (0.60)          5           3
test_plots-plots-diff[main]       945.5792 (1.69)     962.5453 (1.70)     956.3479 (1.69)      8.0622 (3.56)     961.5347 (1.70)     13.6408 (7.28)          1;0  1.0456 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       576.6587 (1.0)        587.7255 (1.0)        579.5740 (1.0)       4.6055 (1.0)        578.0549 (1.0)       3.6425 (1.0)           1;1  1.7254 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,189.0394 (2.06)     1,222.0534 (2.08)     1,209.7321 (2.09)     12.9718 (2.82)     1,210.2853 (2.09)     16.6189 (4.56)          1;0  0.8266 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]       991.5428 (1.72)     1,007.5721 (1.71)       997.8190 (1.72)      6.5558 (1.42)       997.5692 (1.73)     10.0194 (2.75)          1;0  1.0022 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]     1,000.5320 (1.74)     1,015.5544 (1.73)     1,006.5673 (1.74)      6.2203 (1.35)     1,003.4831 (1.74)      9.3736 (2.57)          1;0  0.9935 (0.58)          5           3
test_plots-plots-diff-json[main]       1,025.2169 (1.78)     1,047.5854 (1.78)     1,032.6760 (1.78)      9.0048 (1.96)     1,031.8615 (1.79)     10.7600 (2.95)          1;0  0.9684 (0.56)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     446.9869 (1.0)      461.4908 (1.0)      451.4242 (1.0)       5.9612 (1.30)     448.9624 (1.0)       6.9870 (1.0)           1;0  2.2152 (1.0)           5           3
test_plots-plots-show[3.10.0]     797.5181 (1.78)     808.1769 (1.75)     802.3598 (1.78)      4.5954 (1.0)      800.7372 (1.78)      7.8983 (1.13)          2;0  1.2463 (0.56)          5           3
test_plots-plots-show[3.53.2]     775.4533 (1.73)     800.9757 (1.74)     785.4585 (1.74)     12.0669 (2.63)     778.5597 (1.73)     21.1157 (3.02)          1;0  1.2731 (0.57)          5           3
test_plots-plots-show[3.60.1]     796.9087 (1.78)     819.4619 (1.78)     803.0663 (1.78)      9.3162 (2.03)     799.0395 (1.78)      7.9921 (1.14)          1;1  1.2452 (0.56)          5           3
test_plots-plots-show[main]       791.3612 (1.77)     836.5247 (1.81)     802.2425 (1.78)     19.2904 (4.20)     794.6664 (1.77)     14.9951 (2.15)          1;1  1.2465 (0.56)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     464.9349 (1.0)      488.7969 (1.0)      475.0650 (1.0)       9.7005 (8.68)     470.4297 (1.0)      14.3974 (7.12)          2;0  2.1050 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     921.9137 (1.98)     924.4526 (1.89)     923.2917 (1.94)      1.1177 (1.0)      923.2408 (1.96)      2.0225 (1.0)           2;0  1.0831 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     825.1991 (1.77)     831.6497 (1.70)     828.3753 (1.74)      2.6374 (2.36)     828.8171 (1.76)      4.3528 (2.15)          2;0  1.2072 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     825.1619 (1.77)     857.9772 (1.76)     839.3829 (1.77)     11.9799 (10.72)    838.1810 (1.78)     12.9012 (6.38)          2;0  1.1914 (0.57)          5           3
test_plots-plots-show-json[main]       844.3225 (1.82)     854.2073 (1.75)     850.2483 (1.79)      4.0153 (3.59)     850.1315 (1.81)      6.0707 (3.00)          1;0  1.1761 (0.56)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     50.1125 (2.21)     50.1125 (2.21)     50.1125 (2.21)     0.0000 (1.0)      50.1125 (2.21)     0.0000 (1.0)           0;0  0.0200 (0.45)          1           1
test_push-push[3.10.0]     44.3469 (1.96)     44.3469 (1.96)     44.3469 (1.96)     0.0000 (1.0)      44.3469 (1.96)     0.0000 (1.0)           0;0  0.0225 (0.51)          1           1
test_push-push[3.53.2]     22.7054 (1.00)     22.7054 (1.00)     22.7054 (1.00)     0.0000 (1.0)      22.7054 (1.00)     0.0000 (1.0)           0;0  0.0440 (1.00)          1           1
test_push-push[3.60.1]     22.6567 (1.0)      22.6567 (1.0)      22.6567 (1.0)      0.0000 (1.0)      22.6567 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
test_push-push[main]       22.6761 (1.00)     22.6761 (1.00)     22.6761 (1.00)     0.0000 (1.0)      22.6761 (1.00)     0.0000 (1.0)           0;0  0.0441 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     59.6410 (2.67)     59.6410 (2.67)     59.6410 (2.67)     0.0000 (1.0)      59.6410 (2.67)     0.0000 (1.0)           0;0  0.0168 (0.37)          1           1
test_sharing-fetch[3.10.0]     64.6542 (2.89)     64.6542 (2.89)     64.6542 (2.89)     0.0000 (1.0)      64.6542 (2.89)     0.0000 (1.0)           0;0  0.0155 (0.35)          1           1
test_sharing-fetch[3.53.2]     32.5165 (1.45)     32.5165 (1.45)     32.5165 (1.45)     0.0000 (1.0)      32.5165 (1.45)     0.0000 (1.0)           0;0  0.0308 (0.69)          1           1
test_sharing-fetch[3.60.1]     22.3613 (1.0)      22.3613 (1.0)      22.3613 (1.0)      0.0000 (1.0)      22.3613 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
test_sharing-fetch[main]       22.8324 (1.02)     22.8324 (1.02)     22.8324 (1.02)     0.0000 (1.0)      22.8324 (1.02)     0.0000 (1.0)           0;0  0.0438 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2428 (1.0)      1.2428 (1.0)      1.2428 (1.0)      0.0000 (1.0)      1.2428 (1.0)      0.0000 (1.0)           0;0  0.8046 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6092 (2.90)     3.6092 (2.90)     3.6092 (2.90)     0.0000 (1.0)      3.6092 (2.90)     0.0000 (1.0)           0;0  0.2771 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.7637 (4.64)     5.7637 (4.64)     5.7637 (4.64)     0.0000 (1.0)      5.7637 (4.64)     0.0000 (1.0)           0;0  0.1735 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8992 (4.75)     5.8992 (4.75)     5.8992 (4.75)     0.0000 (1.0)      5.8992 (4.75)     0.0000 (1.0)           0;0  0.1695 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9110 (4.76)     5.9110 (4.76)     5.9110 (4.76)     0.0000 (1.0)      5.9110 (4.76)     0.0000 (1.0)           0;0  0.1692 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     47.8368 (2.18)     47.8368 (2.18)     47.8368 (2.18)     0.0000 (1.0)      47.8368 (2.18)     0.0000 (1.0)           0;0  0.0209 (0.46)          1           1
test_sharing-push[3.10.0]     42.3779 (1.93)     42.3779 (1.93)     42.3779 (1.93)     0.0000 (1.0)      42.3779 (1.93)     0.0000 (1.0)           0;0  0.0236 (0.52)          1           1
test_sharing-push[3.53.2]     22.9488 (1.05)     22.9488 (1.05)     22.9488 (1.05)     0.0000 (1.0)      22.9488 (1.05)     0.0000 (1.0)           0;0  0.0436 (0.96)          1           1
test_sharing-push[3.60.1]     21.9388 (1.0)      21.9388 (1.0)      21.9388 (1.0)      0.0000 (1.0)      21.9388 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
test_sharing-push[main]       22.3552 (1.02)     22.3552 (1.02)     22.3552 (1.02)     0.0000 (1.0)      22.3552 (1.02)     0.0000 (1.0)           0;0  0.0447 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0127 (1.0)      2.0127 (1.0)      2.0127 (1.0)      0.0000 (1.0)      2.0127 (1.0)      0.0000 (1.0)           0;0  0.4968 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0704 (1.03)     2.0704 (1.03)     2.0704 (1.03)     0.0000 (1.0)      2.0704 (1.03)     0.0000 (1.0)           0;0  0.4830 (0.97)          1           1
test_sharing-push-noop[3.53.2]     5.9157 (2.94)     5.9157 (2.94)     5.9157 (2.94)     0.0000 (1.0)      5.9157 (2.94)     0.0000 (1.0)           0;0  0.1690 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0734 (3.02)     6.0734 (3.02)     6.0734 (3.02)     0.0000 (1.0)      6.0734 (3.02)     0.0000 (1.0)           0;0  0.1647 (0.33)          1           1
test_sharing-push-noop[main]       6.2513 (3.11)     6.2513 (3.11)     6.2513 (3.11)     0.0000 (1.0)      6.2513 (3.11)     0.0000 (1.0)           0;0  0.1600 (0.32)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     181.2336 (1.05)     181.2336 (1.05)     181.2336 (1.05)     0.0000 (1.0)      181.2336 (1.05)     0.0000 (1.0)           0;0  0.0055 (0.96)          1           1
test_sharing_azure-fetch[main]       173.4279 (1.0)      173.4279 (1.0)      173.4279 (1.0)      0.0000 (1.0)      173.4279 (1.0)      0.0000 (1.0)           0;0  0.0058 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3142 (1.0)      6.3142 (1.0)      6.3142 (1.0)      0.0000 (1.0)      6.3142 (1.0)      0.0000 (1.0)           0;0  0.1584 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.3477 (1.01)     6.3477 (1.01)     6.3477 (1.01)     0.0000 (1.0)      6.3477 (1.01)     0.0000 (1.0)           0;0  0.1575 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     172.0855 (1.0)      172.0855 (1.0)      172.0855 (1.0)      0.0000 (1.0)      172.0855 (1.0)      0.0000 (1.0)           0;0  0.0058 (1.0)           1           1
test_sharing_azure-push[main]       172.1773 (1.00)     172.1773 (1.00)     172.1773 (1.00)     0.0000 (1.0)      172.1773 (1.00)     0.0000 (1.0)           0;0  0.0058 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6740 (1.0)      6.6740 (1.0)      6.6740 (1.0)      0.0000 (1.0)      6.6740 (1.0)      0.0000 (1.0)           0;0  0.1498 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.8795 (1.03)     6.8795 (1.03)     6.8795 (1.03)     0.0000 (1.0)      6.8795 (1.03)     0.0000 (1.0)           0;0  0.1454 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     217.3636 (1.0)      217.3636 (1.0)      217.3636 (1.0)      0.0000 (1.0)      217.3636 (1.0)      0.0000 (1.0)           0;0  0.0046 (1.0)           1           1
test_sharing_gs-fetch[main]       223.1232 (1.03)     223.1232 (1.03)     223.1232 (1.03)     0.0000 (1.0)      223.1232 (1.03)     0.0000 (1.0)           0;0  0.0045 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     6.4980 (1.0)      6.4980 (1.0)      6.4980 (1.0)      0.0000 (1.0)      6.4980 (1.0)      0.0000 (1.0)           0;0  0.1539 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       6.5967 (1.02)     6.5967 (1.02)     6.5967 (1.02)     0.0000 (1.0)      6.5967 (1.02)     0.0000 (1.0)           0;0  0.1516 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     608.5718 (1.0)      608.5718 (1.0)      608.5718 (1.0)      0.0000 (1.0)      608.5718 (1.0)      0.0000 (1.0)           0;0  0.0016 (1.0)           1           1
test_sharing_gs-push[main]       628.6811 (1.03)     628.6811 (1.03)     628.6811 (1.03)     0.0000 (1.0)      628.6811 (1.03)     0.0000 (1.0)           0;0  0.0016 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.5890 (1.0)      6.5890 (1.0)      6.5890 (1.0)      0.0000 (1.0)      6.5890 (1.0)      0.0000 (1.0)           0;0  0.1518 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.6789 (1.01)     6.6789 (1.01)     6.6789 (1.01)     0.0000 (1.0)      6.6789 (1.01)     0.0000 (1.0)           0;0  0.1497 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     260.1368 (1.06)     260.1368 (1.06)     260.1368 (1.06)     0.0000 (1.0)      260.1368 (1.06)     0.0000 (1.0)           0;0  0.0038 (0.94)          1           1
test_sharing_s3-fetch[main]       245.6540 (1.0)      245.6540 (1.0)      245.6540 (1.0)      0.0000 (1.0)      245.6540 (1.0)      0.0000 (1.0)           0;0  0.0041 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2946 (1.00)     6.2946 (1.00)     6.2946 (1.00)     0.0000 (1.0)      6.2946 (1.00)     0.0000 (1.0)           0;0  0.1589 (1.00)          1           1
test_sharing_s3-fetch-noop[main]       6.2821 (1.0)      6.2821 (1.0)      6.2821 (1.0)      0.0000 (1.0)      6.2821 (1.0)      0.0000 (1.0)           0;0  0.1592 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     264.0711 (1.0)      264.0711 (1.0)      264.0711 (1.0)      0.0000 (1.0)      264.0711 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
test_sharing_s3-push[main]       269.4111 (1.02)     269.4111 (1.02)     269.4111 (1.02)     0.0000 (1.0)      269.4111 (1.02)     0.0000 (1.0)           0;0  0.0037 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5628 (1.0)      6.5628 (1.0)      6.5628 (1.0)      0.0000 (1.0)      6.5628 (1.0)      0.0000 (1.0)           0;0  0.1524 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.5641 (1.00)     6.5641 (1.00)     6.5641 (1.00)     0.0000 (1.0)      6.5641 (1.00)     0.0000 (1.0)           0;0  0.1523 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     18.7827 (3.77)     18.7827 (3.77)     18.7827 (3.77)     0.0000 (1.0)      18.7827 (3.77)     0.0000 (1.0)           0;0  0.0532 (0.26)          1           1
test_status-status[3.10.0]     19.2532 (3.87)     19.2532 (3.87)     19.2532 (3.87)     0.0000 (1.0)      19.2532 (3.87)     0.0000 (1.0)           0;0  0.0519 (0.26)          1           1
test_status-status[3.53.2]     17.3132 (3.48)     17.3132 (3.48)     17.3132 (3.48)     0.0000 (1.0)      17.3132 (3.48)     0.0000 (1.0)           0;0  0.0578 (0.29)          1           1
test_status-status[3.60.1]      4.9773 (1.0)       4.9773 (1.0)       4.9773 (1.0)      0.0000 (1.0)       4.9773 (1.0)      0.0000 (1.0)           0;0  0.2009 (1.0)           1           1
test_status-status[main]        5.3495 (1.07)      5.3495 (1.07)      5.3495 (1.07)     0.0000 (1.0)       5.3495 (1.07)     0.0000 (1.0)           0;0  0.1869 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7885 (1.83)     4.7885 (1.83)     4.7885 (1.83)     0.0000 (1.0)      4.7885 (1.83)     0.0000 (1.0)           0;0  0.2088 (0.55)          1           1
test_status-status-changed[3.10.0]     4.9354 (1.89)     4.9354 (1.89)     4.9354 (1.89)     0.0000 (1.0)      4.9354 (1.89)     0.0000 (1.0)           0;0  0.2026 (0.53)          1           1
test_status-status-changed[3.53.2]     4.9973 (1.91)     4.9973 (1.91)     4.9973 (1.91)     0.0000 (1.0)      4.9973 (1.91)     0.0000 (1.0)           0;0  0.2001 (0.52)          1           1
test_status-status-changed[3.60.1]     2.6125 (1.0)      2.6125 (1.0)      2.6125 (1.0)      0.0000 (1.0)      2.6125 (1.0)      0.0000 (1.0)           0;0  0.3828 (1.0)           1           1
test_status-status-changed[main]       2.8556 (1.09)     2.8556 (1.09)     2.8556 (1.09)     0.0000 (1.0)      2.8556 (1.09)     0.0000 (1.0)           0;0  0.3502 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7472 (1.88)     4.7472 (1.88)     4.7472 (1.88)     0.0000 (1.0)      4.7472 (1.88)     0.0000 (1.0)           0;0  0.2106 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     4.9875 (1.98)     4.9875 (1.98)     4.9875 (1.98)     0.0000 (1.0)      4.9875 (1.98)     0.0000 (1.0)           0;0  0.2005 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     4.8623 (1.93)     4.8623 (1.93)     4.8623 (1.93)     0.0000 (1.0)      4.8623 (1.93)     0.0000 (1.0)           0;0  0.2057 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.5244 (1.0)      2.5244 (1.0)      2.5244 (1.0)      0.0000 (1.0)      2.5244 (1.0)      0.0000 (1.0)           0;0  0.3961 (1.0)           1           1
test_status-status-changed-noop[main]       2.7255 (1.08)     2.7255 (1.08)     2.7255 (1.08)     0.0000 (1.0)      2.7255 (1.08)     0.0000 (1.0)           0;0  0.3669 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8244 (1.92)     4.8244 (1.92)     4.8244 (1.92)     0.0000 (1.0)      4.8244 (1.92)     0.0000 (1.0)           0;0  0.2073 (0.52)          1           1
test_status-status-noop[3.10.0]     5.0137 (2.00)     5.0137 (2.00)     5.0137 (2.00)     0.0000 (1.0)      5.0137 (2.00)     0.0000 (1.0)           0;0  0.1995 (0.50)          1           1
test_status-status-noop[3.53.2]     4.9137 (1.96)     4.9137 (1.96)     4.9137 (1.96)     0.0000 (1.0)      4.9137 (1.96)     0.0000 (1.0)           0;0  0.2035 (0.51)          1           1
test_status-status-noop[3.60.1]     2.5083 (1.0)      2.5083 (1.0)      2.5083 (1.0)      0.0000 (1.0)      2.5083 (1.0)      0.0000 (1.0)           0;0  0.3987 (1.0)           1           1
test_status-status-noop[main]       2.7170 (1.08)     2.7170 (1.08)     2.7170 (1.08)     0.0000 (1.0)      2.7170 (1.08)     0.0000 (1.0)           0;0  0.3681 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     111.0261 (3.88)     111.0261 (3.88)     111.0261 (3.88)     0.0000 (1.0)      111.0261 (3.88)     0.0000 (1.0)           0;0  0.0090 (0.26)          1           1
test_update-import-url[3.10.0]     114.0058 (3.99)     114.0058 (3.99)     114.0058 (3.99)     0.0000 (1.0)      114.0058 (3.99)     0.0000 (1.0)           0;0  0.0088 (0.25)          1           1
test_update-import-url[3.53.2]      81.1903 (2.84)      81.1903 (2.84)      81.1903 (2.84)     0.0000 (1.0)       81.1903 (2.84)     0.0000 (1.0)           0;0  0.0123 (0.35)          1           1
test_update-import-url[3.60.1]      28.5987 (1.0)       28.5987 (1.0)       28.5987 (1.0)      0.0000 (1.0)       28.5987 (1.0)      0.0000 (1.0)           0;0  0.0350 (1.0)           1           1
test_update-import-url[main]        30.3137 (1.06)      30.3137 (1.06)      30.3137 (1.06)     0.0000 (1.0)       30.3137 (1.06)     0.0000 (1.0)           0;0  0.0330 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]      99.7415 (4.12)      99.7415 (4.12)      99.7415 (4.12)     0.0000 (1.0)       99.7415 (4.12)     0.0000 (1.0)           0;0  0.0100 (0.24)          1           1
test_update-update[3.10.0]     104.6186 (4.32)     104.6186 (4.32)     104.6186 (4.32)     0.0000 (1.0)      104.6186 (4.32)     0.0000 (1.0)           0;0  0.0096 (0.23)          1           1
test_update-update[3.53.2]      73.8057 (3.05)      73.8057 (3.05)      73.8057 (3.05)     0.0000 (1.0)       73.8057 (3.05)     0.0000 (1.0)           0;0  0.0135 (0.33)          1           1
test_update-update[3.60.1]      24.2073 (1.0)       24.2073 (1.0)       24.2073 (1.0)      0.0000 (1.0)       24.2073 (1.0)      0.0000 (1.0)           0;0  0.0413 (1.0)           1           1
test_update-update[main]        25.1080 (1.04)      25.1080 (1.04)      25.1080 (1.04)     0.0000 (1.0)       25.1080 (1.04)     0.0000 (1.0)           0;0  0.0398 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     11.6514 (1.68)     11.6514 (1.68)     11.6514 (1.68)     0.0000 (1.0)      11.6514 (1.68)     0.0000 (1.0)           0;0  0.0858 (0.60)          1           1
test_update-update-noop[3.10.0]     12.2921 (1.77)     12.2921 (1.77)     12.2921 (1.77)     0.0000 (1.0)      12.2921 (1.77)     0.0000 (1.0)           0;0  0.0814 (0.56)          1           1
test_update-update-noop[3.53.2]     12.0510 (1.74)     12.0510 (1.74)     12.0510 (1.74)     0.0000 (1.0)      12.0510 (1.74)     0.0000 (1.0)           0;0  0.0830 (0.58)          1           1
test_update-update-noop[3.60.1]      6.9373 (1.0)       6.9373 (1.0)       6.9373 (1.0)      0.0000 (1.0)       6.9373 (1.0)      0.0000 (1.0)           0;0  0.1441 (1.0)           1           1
test_update-update-noop[main]        7.6256 (1.10)      7.6256 (1.10)      7.6256 (1.10)     0.0000 (1.0)       7.6256 (1.10)     0.0000 (1.0)           0;0  0.1311 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean