Sat Jun 28 00:40:09 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     91.4568 (4.05)     91.4568 (4.05)     91.4568 (4.05)     0.0000 (1.0)      91.4568 (4.05)     0.0000 (1.0)           0;0  0.0109 (0.25)          1           1
test_add_copy-add[3.10.0]     91.1526 (4.04)     91.1526 (4.04)     91.1526 (4.04)     0.0000 (1.0)      91.1526 (4.04)     0.0000 (1.0)           0;0  0.0110 (0.25)          1           1
test_add_copy-add[3.53.2]     82.7980 (3.67)     82.7980 (3.67)     82.7980 (3.67)     0.0000 (1.0)      82.7980 (3.67)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_add_copy-add[3.60.1]     22.5822 (1.0)      22.5822 (1.0)      22.5822 (1.0)      0.0000 (1.0)      22.5822 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_add_copy-add[main]       23.2647 (1.03)     23.2647 (1.03)     23.2647 (1.03)     0.0000 (1.0)      23.2647 (1.03)     0.0000 (1.0)           0;0  0.0430 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.9677 (7.07)     30.9677 (7.07)     30.9677 (7.07)     0.0000 (1.0)      30.9677 (7.07)     0.0000 (1.0)           0;0  0.0323 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     31.3349 (7.15)     31.3349 (7.15)     31.3349 (7.15)     0.0000 (1.0)      31.3349 (7.15)     0.0000 (1.0)           0;0  0.0319 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     29.9249 (6.83)     29.9249 (6.83)     29.9249 (6.83)     0.0000 (1.0)      29.9249 (6.83)     0.0000 (1.0)           0;0  0.0334 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.3821 (1.0)       4.3821 (1.0)       4.3821 (1.0)      0.0000 (1.0)       4.3821 (1.0)      0.0000 (1.0)           0;0  0.2282 (1.0)           1           1
test_add_copy-add-noop[main]        4.4733 (1.02)      4.4733 (1.02)      4.4733 (1.02)     0.0000 (1.0)       4.4733 (1.02)     0.0000 (1.0)           0;0  0.2235 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     71.3413 (4.47)     71.3413 (4.47)     71.3413 (4.47)     0.0000 (1.0)      71.3413 (4.47)     0.0000 (1.0)           0;0  0.0140 (0.22)          1           1
test_add_hardlink-add[3.10.0]     72.1753 (4.52)     72.1753 (4.52)     72.1753 (4.52)     0.0000 (1.0)      72.1753 (4.52)     0.0000 (1.0)           0;0  0.0139 (0.22)          1           1
test_add_hardlink-add[3.53.2]     66.6110 (4.17)     66.6110 (4.17)     66.6110 (4.17)     0.0000 (1.0)      66.6110 (4.17)     0.0000 (1.0)           0;0  0.0150 (0.24)          1           1
test_add_hardlink-add[3.60.1]     15.9633 (1.0)      15.9633 (1.0)      15.9633 (1.0)      0.0000 (1.0)      15.9633 (1.0)      0.0000 (1.0)           0;0  0.0626 (1.0)           1           1
test_add_hardlink-add[main]       17.0446 (1.07)     17.0446 (1.07)     17.0446 (1.07)     0.0000 (1.0)      17.0446 (1.07)     0.0000 (1.0)           0;0  0.0587 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.1133 (8.12)     36.1133 (8.12)     36.1133 (8.12)     0.0000 (1.0)      36.1133 (8.12)     0.0000 (1.0)           0;0  0.0277 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     36.8090 (8.28)     36.8090 (8.28)     36.8090 (8.28)     0.0000 (1.0)      36.8090 (8.28)     0.0000 (1.0)           0;0  0.0272 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     34.8733 (7.84)     34.8733 (7.84)     34.8733 (7.84)     0.0000 (1.0)      34.8733 (7.84)     0.0000 (1.0)           0;0  0.0287 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.4475 (1.0)       4.4475 (1.0)       4.4475 (1.0)      0.0000 (1.0)       4.4475 (1.0)      0.0000 (1.0)           0;0  0.2248 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4537 (1.00)      4.4537 (1.00)      4.4537 (1.00)     0.0000 (1.0)       4.4537 (1.00)     0.0000 (1.0)           0;0  0.2245 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.6655 (2.16)     72.6655 (2.16)     72.6655 (2.16)     0.0000 (1.0)      72.6655 (2.16)     0.0000 (1.0)           0;0  0.0138 (0.46)          1           1
test_add_symlink-add[3.10.0]     74.2953 (2.21)     74.2953 (2.21)     74.2953 (2.21)     0.0000 (1.0)      74.2953 (2.21)     0.0000 (1.0)           0;0  0.0135 (0.45)          1           1
test_add_symlink-add[3.53.2]     69.2762 (2.06)     69.2762 (2.06)     69.2762 (2.06)     0.0000 (1.0)      69.2762 (2.06)     0.0000 (1.0)           0;0  0.0144 (0.49)          1           1
test_add_symlink-add[3.60.1]     33.6779 (1.0)      33.6779 (1.0)      33.6779 (1.0)      0.0000 (1.0)      33.6779 (1.0)      0.0000 (1.0)           0;0  0.0297 (1.0)           1           1
test_add_symlink-add[main]       34.5571 (1.03)     34.5571 (1.03)     34.5571 (1.03)     0.0000 (1.0)      34.5571 (1.03)     0.0000 (1.0)           0;0  0.0289 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.6479 (8.82)     47.6479 (8.82)     47.6479 (8.82)     0.0000 (1.0)      47.6479 (8.82)     0.0000 (1.0)           0;0  0.0210 (0.11)          1           1
test_add_symlink-add-noop[3.10.0]     47.8337 (8.86)     47.8337 (8.86)     47.8337 (8.86)     0.0000 (1.0)      47.8337 (8.86)     0.0000 (1.0)           0;0  0.0209 (0.11)          1           1
test_add_symlink-add-noop[3.53.2]     46.5906 (8.63)     46.5906 (8.63)     46.5906 (8.63)     0.0000 (1.0)      46.5906 (8.63)     0.0000 (1.0)           0;0  0.0215 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.4601 (1.01)      5.4601 (1.01)      5.4601 (1.01)     0.0000 (1.0)       5.4601 (1.01)     0.0000 (1.0)           0;0  0.1831 (0.99)          1           1
test_add_symlink-add-noop[main]        5.4015 (1.0)       5.4015 (1.0)       5.4015 (1.0)      0.0000 (1.0)       5.4015 (1.0)      0.0000 (1.0)           0;0  0.1851 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     44.0891 (2.07)     44.0891 (2.07)     44.0891 (2.07)     0.0000 (1.0)      44.0891 (2.07)     0.0000 (1.0)           0;0  0.0227 (0.48)          1           1
test_checkout_copy-checkout[3.10.0]     62.0635 (2.92)     62.0635 (2.92)     62.0635 (2.92)     0.0000 (1.0)      62.0635 (2.92)     0.0000 (1.0)           0;0  0.0161 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     29.8083 (1.40)     29.8083 (1.40)     29.8083 (1.40)     0.0000 (1.0)      29.8083 (1.40)     0.0000 (1.0)           0;0  0.0335 (0.71)          1           1
test_checkout_copy-checkout[3.60.1]     21.2846 (1.0)      21.2846 (1.0)      21.2846 (1.0)      0.0000 (1.0)      21.2846 (1.0)      0.0000 (1.0)           0;0  0.0470 (1.0)           1           1
test_checkout_copy-checkout[main]       22.3331 (1.05)     22.3331 (1.05)     22.3331 (1.05)     0.0000 (1.0)      22.3331 (1.05)     0.0000 (1.0)           0;0  0.0448 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4801 (1.59)     5.4801 (1.59)     5.4801 (1.59)     0.0000 (1.0)      5.4801 (1.59)     0.0000 (1.0)           0;0  0.1825 (0.63)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7047 (1.66)     5.7047 (1.66)     5.7047 (1.66)     0.0000 (1.0)      5.7047 (1.66)     0.0000 (1.0)           0;0  0.1753 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8079 (1.69)     5.8079 (1.69)     5.8079 (1.69)     0.0000 (1.0)      5.8079 (1.69)     0.0000 (1.0)           0;0  0.1722 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.4466 (1.0)      3.4466 (1.0)      3.4466 (1.0)      0.0000 (1.0)      3.4466 (1.0)      0.0000 (1.0)           0;0  0.2901 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5475 (1.03)     3.5475 (1.03)     3.5475 (1.03)     0.0000 (1.0)      3.5475 (1.03)     0.0000 (1.0)           0;0  0.2819 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5972 (2.09)     8.5972 (2.09)     8.5972 (2.09)     0.0000 (1.0)      8.5972 (2.09)     0.0000 (1.0)           0;0  0.1163 (0.48)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3894 (1.55)     6.3894 (1.55)     6.3894 (1.55)     0.0000 (1.0)      6.3894 (1.55)     0.0000 (1.0)           0;0  0.1565 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5358 (1.59)     6.5358 (1.59)     6.5358 (1.59)     0.0000 (1.0)      6.5358 (1.59)     0.0000 (1.0)           0;0  0.1530 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.1180 (1.0)      4.1180 (1.0)      4.1180 (1.0)      0.0000 (1.0)      4.1180 (1.0)      0.0000 (1.0)           0;0  0.2428 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4830 (1.09)     4.4830 (1.09)     4.4830 (1.09)     0.0000 (1.0)      4.4830 (1.09)     0.0000 (1.0)           0;0  0.2231 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.6722 (3.34)     24.6722 (3.34)     24.6722 (3.34)     0.0000 (1.0)      24.6722 (3.34)     0.0000 (1.0)           0;0  0.0405 (0.30)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.0466 (2.44)     18.0466 (2.44)     18.0466 (2.44)     0.0000 (1.0)      18.0466 (2.44)     0.0000 (1.0)           0;0  0.0554 (0.41)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.3483 (2.21)     16.3483 (2.21)     16.3483 (2.21)     0.0000 (1.0)      16.3483 (2.21)     0.0000 (1.0)           0;0  0.0612 (0.45)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3899 (1.0)       7.3899 (1.0)       7.3899 (1.0)      0.0000 (1.0)       7.3899 (1.0)      0.0000 (1.0)           0;0  0.1353 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.3982 (1.14)      8.3982 (1.14)      8.3982 (1.14)     0.0000 (1.0)       8.3982 (1.14)     0.0000 (1.0)           0;0  0.1191 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6402 (1.64)     5.6402 (1.64)     5.6402 (1.64)     0.0000 (1.0)      5.6402 (1.64)     0.0000 (1.0)           0;0  0.1773 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8569 (1.70)     5.8569 (1.70)     5.8569 (1.70)     0.0000 (1.0)      5.8569 (1.70)     0.0000 (1.0)           0;0  0.1707 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4905 (1.60)     5.4905 (1.60)     5.4905 (1.60)     0.0000 (1.0)      5.4905 (1.60)     0.0000 (1.0)           0;0  0.1821 (0.63)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.4417 (1.00)     3.4417 (1.00)     3.4417 (1.00)     0.0000 (1.0)      3.4417 (1.00)     0.0000 (1.0)           0;0  0.2906 (1.00)          1           1
test_checkout_hardlink-checkout-noop[main]       3.4398 (1.0)      3.4398 (1.0)      3.4398 (1.0)      0.0000 (1.0)      3.4398 (1.0)      0.0000 (1.0)           0;0  0.2907 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.9862 (2.17)     8.9862 (2.17)     8.9862 (2.17)     0.0000 (1.0)      8.9862 (2.17)     0.0000 (1.0)           0;0  0.1113 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6215 (1.60)     6.6215 (1.60)     6.6215 (1.60)     0.0000 (1.0)      6.6215 (1.60)     0.0000 (1.0)           0;0  0.1510 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3946 (1.55)     6.3946 (1.55)     6.3946 (1.55)     0.0000 (1.0)      6.3946 (1.55)     0.0000 (1.0)           0;0  0.1564 (0.65)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.1669 (1.01)     4.1669 (1.01)     4.1669 (1.01)     0.0000 (1.0)      4.1669 (1.01)     0.0000 (1.0)           0;0  0.2400 (0.99)          1           1
test_checkout_hardlink-checkout-update[main]       4.1377 (1.0)      4.1377 (1.0)      4.1377 (1.0)      0.0000 (1.0)      4.1377 (1.0)      0.0000 (1.0)           0;0  0.2417 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.6086 (2.58)     27.6086 (2.58)     27.6086 (2.58)     0.0000 (1.0)      27.6086 (2.58)     0.0000 (1.0)           0;0  0.0362 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     20.8574 (1.95)     20.8574 (1.95)     20.8574 (1.95)     0.0000 (1.0)      20.8574 (1.95)     0.0000 (1.0)           0;0  0.0479 (0.51)          1           1
test_checkout_symlink-checkout[3.53.2]     19.4187 (1.82)     19.4187 (1.82)     19.4187 (1.82)     0.0000 (1.0)      19.4187 (1.82)     0.0000 (1.0)           0;0  0.0515 (0.55)          1           1
test_checkout_symlink-checkout[3.60.1]     10.6829 (1.0)      10.6829 (1.0)      10.6829 (1.0)      0.0000 (1.0)      10.6829 (1.0)      0.0000 (1.0)           0;0  0.0936 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.4184 (1.07)     11.4184 (1.07)     11.4184 (1.07)     0.0000 (1.0)      11.4184 (1.07)     0.0000 (1.0)           0;0  0.0876 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7842 (1.54)     6.7842 (1.54)     6.7842 (1.54)     0.0000 (1.0)      6.7842 (1.54)     0.0000 (1.0)           0;0  0.1474 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8586 (1.55)     6.8586 (1.55)     6.8586 (1.55)     0.0000 (1.0)      6.8586 (1.55)     0.0000 (1.0)           0;0  0.1458 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7650 (1.53)     6.7650 (1.53)     6.7650 (1.53)     0.0000 (1.0)      6.7650 (1.53)     0.0000 (1.0)           0;0  0.1478 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.4178 (1.0)      4.4178 (1.0)      4.4178 (1.0)      0.0000 (1.0)      4.4178 (1.0)      0.0000 (1.0)           0;0  0.2264 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4758 (1.01)     4.4758 (1.01)     4.4758 (1.01)     0.0000 (1.0)      4.4758 (1.01)     0.0000 (1.0)           0;0  0.2234 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6617 (1.79)     10.6617 (1.79)     10.6617 (1.79)     0.0000 (1.0)      10.6617 (1.79)     0.0000 (1.0)           0;0  0.0938 (0.56)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4562 (1.42)      8.4562 (1.42)      8.4562 (1.42)     0.0000 (1.0)       8.4562 (1.42)     0.0000 (1.0)           0;0  0.1183 (0.71)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3337 (1.40)      8.3337 (1.40)      8.3337 (1.40)     0.0000 (1.0)       8.3337 (1.40)     0.0000 (1.0)           0;0  0.1200 (0.72)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9724 (1.0)       5.9724 (1.0)       5.9724 (1.0)      0.0000 (1.0)       5.9724 (1.0)      0.0000 (1.0)           0;0  0.1674 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.9911 (1.00)      5.9911 (1.00)      5.9911 (1.00)     0.0000 (1.0)       5.9911 (1.00)     0.0000 (1.0)           0;0  0.1669 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.8876 (1.73)     3.8876 (1.73)     3.8876 (1.73)     0.0000 (1.0)      3.8876 (1.73)     0.0000 (1.0)           0;0  0.2572 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.4678 (1.99)     4.4678 (1.99)     4.4678 (1.99)     0.0000 (1.0)      4.4678 (1.99)     0.0000 (1.0)           0;0  0.2238 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.4575 (1.99)     4.4575 (1.99)     4.4575 (1.99)     0.0000 (1.0)      4.4575 (1.99)     0.0000 (1.0)           0;0  0.2243 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.2414 (1.0)      2.2414 (1.0)      2.2414 (1.0)      0.0000 (1.0)      2.2414 (1.0)      0.0000 (1.0)           0;0  0.4461 (1.0)           1           1
test_data_status-data-changed[main]       2.3158 (1.03)     2.3158 (1.03)     2.3158 (1.03)     0.0000 (1.0)      2.3158 (1.03)     0.0000 (1.0)           0;0  0.4318 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1753 (1.85)     4.1753 (1.85)     4.1753 (1.85)     0.0000 (1.0)      4.1753 (1.85)     0.0000 (1.0)           0;0  0.2395 (0.54)          1           1
test_data_status-data-changed-noop[3.10.0]     4.6582 (2.06)     4.6582 (2.06)     4.6582 (2.06)     0.0000 (1.0)      4.6582 (2.06)     0.0000 (1.0)           0;0  0.2147 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5406 (2.01)     4.5406 (2.01)     4.5406 (2.01)     0.0000 (1.0)      4.5406 (2.01)     0.0000 (1.0)           0;0  0.2202 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2600 (1.0)      2.2600 (1.0)      2.2600 (1.0)      0.0000 (1.0)      2.2600 (1.0)      0.0000 (1.0)           0;0  0.4425 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.2661 (1.00)     2.2661 (1.00)     2.2661 (1.00)     0.0000 (1.0)      2.2661 (1.00)     0.0000 (1.0)           0;0  0.4413 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.2645 (3.91)     19.2645 (3.91)     19.2645 (3.91)     0.0000 (1.0)      19.2645 (3.91)     0.0000 (1.0)           0;0  0.0519 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.7259 (4.01)     19.7259 (4.01)     19.7259 (4.01)     0.0000 (1.0)      19.7259 (4.01)     0.0000 (1.0)           0;0  0.0507 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.0321 (4.07)     20.0321 (4.07)     20.0321 (4.07)     0.0000 (1.0)      20.0321 (4.07)     0.0000 (1.0)           0;0  0.0499 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.9233 (1.0)       4.9233 (1.0)       4.9233 (1.0)      0.0000 (1.0)       4.9233 (1.0)      0.0000 (1.0)           0;0  0.2031 (1.0)           1           1
test_data_status-data-new[main]        4.9890 (1.01)      4.9890 (1.01)      4.9890 (1.01)     0.0000 (1.0)       4.9890 (1.01)     0.0000 (1.0)           0;0  0.2004 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9676 (1.76)     3.9676 (1.76)     3.9676 (1.76)     0.0000 (1.0)      3.9676 (1.76)     0.0000 (1.0)           0;0  0.2520 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.6672 (2.07)     4.6672 (2.07)     4.6672 (2.07)     0.0000 (1.0)      4.6672 (2.07)     0.0000 (1.0)           0;0  0.2143 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.4458 (1.97)     4.4458 (1.97)     4.4458 (1.97)     0.0000 (1.0)      4.4458 (1.97)     0.0000 (1.0)           0;0  0.2249 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.2548 (1.0)      2.2548 (1.0)      2.2548 (1.0)      0.0000 (1.0)      2.2548 (1.0)      0.0000 (1.0)           0;0  0.4435 (1.0)           1           1
test_data_status-data-noop[main]       2.2642 (1.00)     2.2642 (1.00)     2.2642 (1.00)     0.0000 (1.0)      2.2642 (1.00)     0.0000 (1.0)           0;0  0.4417 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.0498 (1.28)     7.0498 (1.28)     7.0498 (1.28)     0.0000 (1.0)      7.0498 (1.28)     0.0000 (1.0)           0;0  0.1418 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6251 (1.38)     7.6251 (1.38)     7.6251 (1.38)     0.0000 (1.0)      7.6251 (1.38)     0.0000 (1.0)           0;0  0.1311 (0.72)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5705 (1.37)     7.5705 (1.37)     7.5705 (1.37)     0.0000 (1.0)      7.5705 (1.37)     0.0000 (1.0)           0;0  0.1321 (0.73)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5133 (1.0)      5.5133 (1.0)      5.5133 (1.0)      0.0000 (1.0)      5.5133 (1.0)      0.0000 (1.0)           0;0  0.1814 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.6578 (1.03)     5.6578 (1.03)     5.6578 (1.03)     0.0000 (1.0)      5.6578 (1.03)     0.0000 (1.0)           0;0  0.1767 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.0919 (1.27)     7.0919 (1.27)     7.0919 (1.27)     0.0000 (1.0)      7.0919 (1.27)     0.0000 (1.0)           0;0  0.1410 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7555 (1.39)     7.7555 (1.39)     7.7555 (1.39)     0.0000 (1.0)      7.7555 (1.39)     0.0000 (1.0)           0;0  0.1289 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6582 (1.37)     7.6582 (1.37)     7.6582 (1.37)     0.0000 (1.0)      7.6582 (1.37)     0.0000 (1.0)           0;0  0.1306 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6004 (1.00)     5.6004 (1.00)     5.6004 (1.00)     0.0000 (1.0)      5.6004 (1.00)     0.0000 (1.0)           0;0  0.1786 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.5805 (1.0)      5.5805 (1.0)      5.5805 (1.0)      0.0000 (1.0)      5.5805 (1.0)      0.0000 (1.0)           0;0  0.1792 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     23.0892 (2.88)     23.0892 (2.88)     23.0892 (2.88)     0.0000 (1.0)      23.0892 (2.88)     0.0000 (1.0)           0;0  0.0433 (0.35)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.9596 (2.99)     23.9596 (2.99)     23.9596 (2.99)     0.0000 (1.0)      23.9596 (2.99)     0.0000 (1.0)           0;0  0.0417 (0.33)          1           1
test_data_status_all_flags-data-new[3.53.2]     23.8923 (2.98)     23.8923 (2.98)     23.8923 (2.98)     0.0000 (1.0)      23.8923 (2.98)     0.0000 (1.0)           0;0  0.0419 (0.34)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0140 (1.0)       8.0140 (1.0)       8.0140 (1.0)      0.0000 (1.0)       8.0140 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2076 (1.02)      8.2076 (1.02)      8.2076 (1.02)     0.0000 (1.0)       8.2076 (1.02)     0.0000 (1.0)           0;0  0.1218 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5713 (1.38)     6.5713 (1.38)     6.5713 (1.38)     0.0000 (1.0)      6.5713 (1.38)     0.0000 (1.0)           0;0  0.1522 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     6.9370 (1.45)     6.9370 (1.45)     6.9370 (1.45)     0.0000 (1.0)      6.9370 (1.45)     0.0000 (1.0)           0;0  0.1442 (0.69)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.8649 (1.44)     6.8649 (1.44)     6.8649 (1.44)     0.0000 (1.0)      6.8649 (1.44)     0.0000 (1.0)           0;0  0.1457 (0.70)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7750 (1.0)      4.7750 (1.0)      4.7750 (1.0)      0.0000 (1.0)      4.7750 (1.0)      0.0000 (1.0)           0;0  0.2094 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.8330 (1.01)     4.8330 (1.01)     4.8330 (1.01)     0.0000 (1.0)      4.8330 (1.01)     0.0000 (1.0)           0;0  0.2069 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.2383 (2.79)     19.2383 (2.79)     19.2383 (2.79)     0.0000 (1.0)      19.2383 (2.79)     0.0000 (1.0)           0;0  0.0520 (0.36)          1           1
test_diff-diff[3.10.0]     20.3457 (2.95)     20.3457 (2.95)     20.3457 (2.95)     0.0000 (1.0)      20.3457 (2.95)     0.0000 (1.0)           0;0  0.0492 (0.34)          1           1
test_diff-diff[3.53.2]     20.7604 (3.01)     20.7604 (3.01)     20.7604 (3.01)     0.0000 (1.0)      20.7604 (3.01)     0.0000 (1.0)           0;0  0.0482 (0.33)          1           1
test_diff-diff[3.60.1]      6.9054 (1.00)      6.9054 (1.00)      6.9054 (1.00)     0.0000 (1.0)       6.9054 (1.00)     0.0000 (1.0)           0;0  0.1448 (1.00)          1           1
test_diff-diff[main]        6.8925 (1.0)       6.8925 (1.0)       6.8925 (1.0)      0.0000 (1.0)       6.8925 (1.0)      0.0000 (1.0)           0;0  0.1451 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.8813 (1.79)     5.8813 (1.79)     5.8813 (1.79)     0.0000 (1.0)      5.8813 (1.79)     0.0000 (1.0)           0;0  0.1700 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.7422 (2.05)     6.7422 (2.05)     6.7422 (2.05)     0.0000 (1.0)      6.7422 (2.05)     0.0000 (1.0)           0;0  0.1483 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.5192 (1.68)     5.5192 (1.68)     5.5192 (1.68)     0.0000 (1.0)      5.5192 (1.68)     0.0000 (1.0)           0;0  0.1812 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3155 (1.01)     3.3155 (1.01)     3.3155 (1.01)     0.0000 (1.0)      3.3155 (1.01)     0.0000 (1.0)           0;0  0.3016 (0.99)          1           1
test_diff-diff-changed[main]       3.2846 (1.0)      3.2846 (1.0)      3.2846 (1.0)      0.0000 (1.0)      3.2846 (1.0)      0.0000 (1.0)           0;0  0.3044 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0221 (1.51)     5.0221 (1.51)     5.0221 (1.51)     0.0000 (1.0)      5.0221 (1.51)     0.0000 (1.0)           0;0  0.1991 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6583 (1.70)     5.6583 (1.70)     5.6583 (1.70)     0.0000 (1.0)      5.6583 (1.70)     0.0000 (1.0)           0;0  0.1767 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.3840 (1.62)     5.3840 (1.62)     5.3840 (1.62)     0.0000 (1.0)      5.3840 (1.62)     0.0000 (1.0)           0;0  0.1857 (0.62)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4481 (1.04)     3.4481 (1.04)     3.4481 (1.04)     0.0000 (1.0)      3.4481 (1.04)     0.0000 (1.0)           0;0  0.2900 (0.96)          1           1
test_diff-diff-changed-noop[main]       3.3236 (1.0)      3.3236 (1.0)      3.3236 (1.0)      0.0000 (1.0)      3.3236 (1.0)      0.0000 (1.0)           0;0  0.3009 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.9159 (1.18)     3.9159 (1.18)     3.9159 (1.18)     0.0000 (1.0)      3.9159 (1.18)     0.0000 (1.0)           0;0  0.2554 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.7546 (1.43)     4.7546 (1.43)     4.7546 (1.43)     0.0000 (1.0)      4.7546 (1.43)     0.0000 (1.0)           0;0  0.2103 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.5162 (1.66)     5.5162 (1.66)     5.5162 (1.66)     0.0000 (1.0)      5.5162 (1.66)     0.0000 (1.0)           0;0  0.1813 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3239 (1.0)      3.3239 (1.0)      3.3239 (1.0)      0.0000 (1.0)      3.3239 (1.0)      0.0000 (1.0)           0;0  0.3009 (1.0)           1           1
test_diff-diff-noop[main]       3.3347 (1.00)     3.3347 (1.00)     3.3347 (1.00)     0.0000 (1.0)      3.3347 (1.00)     0.0000 (1.0)           0;0  0.2999 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0235 (1.0)      1.0235 (1.0)      1.0235 (1.0)      0.0000 (1.0)      1.0235 (1.0)      0.0000 (1.0)           0;0  0.9770 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.2995 (4.20)     4.2995 (4.20)     4.2995 (4.20)     0.0000 (1.0)      4.2995 (4.20)     0.0000 (1.0)           0;0  0.2326 (0.24)          1           1
test_exp_show-exp[3.53.2]     2.7890 (2.72)     2.7890 (2.72)     2.7890 (2.72)     0.0000 (1.0)      2.7890 (2.72)     0.0000 (1.0)           0;0  0.3586 (0.37)          1           1
test_exp_show-exp[3.60.1]     2.6213 (2.56)     2.6213 (2.56)     2.6213 (2.56)     0.0000 (1.0)      2.6213 (2.56)     0.0000 (1.0)           0;0  0.3815 (0.39)          1           1
test_exp_show-exp[main]       4.1856 (4.09)     4.1856 (4.09)     4.1856 (4.09)     0.0000 (1.0)      4.1856 (4.09)     0.0000 (1.0)           0;0  0.2389 (0.24)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     74.5277 (3.20)     74.5277 (3.20)     74.5277 (3.20)     0.0000 (1.0)      74.5277 (3.20)     0.0000 (1.0)           0;0  0.0134 (0.31)          1           1
test_fetch-fetch[3.10.0]     74.8985 (3.21)     74.8985 (3.21)     74.8985 (3.21)     0.0000 (1.0)      74.8985 (3.21)     0.0000 (1.0)           0;0  0.0134 (0.31)          1           1
test_fetch-fetch[3.53.2]     35.1542 (1.51)     35.1542 (1.51)     35.1542 (1.51)     0.0000 (1.0)      35.1542 (1.51)     0.0000 (1.0)           0;0  0.0284 (0.66)          1           1
test_fetch-fetch[3.60.1]     23.5736 (1.01)     23.5736 (1.01)     23.5736 (1.01)     0.0000 (1.0)      23.5736 (1.01)     0.0000 (1.0)           0;0  0.0424 (0.99)          1           1
test_fetch-fetch[main]       23.3180 (1.0)      23.3180 (1.0)      23.3180 (1.0)      0.0000 (1.0)      23.3180 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8201 (1.0)      2.8201 (1.0)      2.8201 (1.0)      0.0000 (1.0)      2.8201 (1.0)      0.0000 (1.0)           0;0  0.3546 (1.0)           1           1
test_gc-gc[3.10.0]     2.8972 (1.03)     2.8972 (1.03)     2.8972 (1.03)     0.0000 (1.0)      2.8972 (1.03)     0.0000 (1.0)           0;0  0.3452 (0.97)          1           1
test_gc-gc[3.53.2]     2.8476 (1.01)     2.8476 (1.01)     2.8476 (1.01)     0.0000 (1.0)      2.8476 (1.01)     0.0000 (1.0)           0;0  0.3512 (0.99)          1           1
test_gc-gc[3.60.1]     2.8383 (1.01)     2.8383 (1.01)     2.8383 (1.01)     0.0000 (1.0)      2.8383 (1.01)     0.0000 (1.0)           0;0  0.3523 (0.99)          1           1
test_gc-gc[main]       3.0442 (1.08)     3.0442 (1.08)     3.0442 (1.08)     0.0000 (1.0)      3.0442 (1.08)     0.0000 (1.0)           0;0  0.3285 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     136.2506 (2.74)     136.2506 (2.74)     136.2506 (2.74)     0.0000 (1.0)      136.2506 (2.74)     0.0000 (1.0)           0;0  0.0073 (0.36)          1           1
test_get-get[3.10.0]     169.8313 (3.42)     169.8313 (3.42)     169.8313 (3.42)     0.0000 (1.0)      169.8313 (3.42)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_get-get[3.53.2]     149.0248 (3.00)     149.0248 (3.00)     149.0248 (3.00)     0.0000 (1.0)      149.0248 (3.00)     0.0000 (1.0)           0;0  0.0067 (0.33)          1           1
test_get-get[3.60.1]      49.6738 (1.0)       49.6738 (1.0)       49.6738 (1.0)      0.0000 (1.0)       49.6738 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
test_get-get[main]        49.6774 (1.00)      49.6774 (1.00)      49.6774 (1.00)     0.0000 (1.0)       49.6774 (1.00)     0.0000 (1.0)           0;0  0.0201 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.9586 (2.71)     44.9586 (2.71)     44.9586 (2.71)     0.0000 (1.0)      44.9586 (2.71)     0.0000 (1.0)           0;0  0.0222 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.6786 (2.87)     47.6786 (2.87)     47.6786 (2.87)     0.0000 (1.0)      47.6786 (2.87)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.6570 (1.00)     16.6570 (1.00)     16.6570 (1.00)     0.0000 (1.0)      16.6570 (1.00)     0.0000 (1.0)           0;0  0.0600 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.6252 (1.00)     16.6252 (1.00)     16.6252 (1.00)     0.0000 (1.0)      16.6252 (1.00)     0.0000 (1.0)           0;0  0.0601 (1.00)          1           1
test_get_url-get-url[main]       16.6112 (1.0)      16.6112 (1.0)      16.6112 (1.0)      0.0000 (1.0)      16.6112 (1.0)      0.0000 (1.0)           0;0  0.0602 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.4179 (1.02)     131.5854 (1.0)      125.7807 (1.02)     1.6909 (1.0)      125.3046 (1.02)     1.5311 (1.15)         24;7  7.9503 (0.98)        100           1
test_help---help[3.10.0]     121.5039 (1.0)      136.7895 (1.04)     123.6030 (1.0)      1.8050 (1.07)     123.1639 (1.0)      1.3301 (1.0)           8;6  8.0904 (1.0)         100           1
test_help---help[3.53.2]     123.2655 (1.01)     134.5144 (1.02)     126.8599 (1.03)     2.4678 (1.46)     126.4942 (1.03)     3.2009 (2.41)         26;4  7.8827 (0.97)        100           1
test_help---help[3.60.1]     123.6971 (1.02)     148.9381 (1.13)     128.3149 (1.04)     5.1598 (3.05)     126.4308 (1.03)     3.2246 (2.42)        12;13  7.7933 (0.96)        100           1
test_help---help[main]       124.1663 (1.02)     144.9507 (1.10)     127.9171 (1.03)     2.8575 (1.69)     127.1127 (1.03)     2.9401 (2.21)         20;2  7.8176 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     225.0656 (2.99)     225.0656 (2.99)     225.0656 (2.99)     0.0000 (1.0)      225.0656 (2.99)     0.0000 (1.0)           0;0  0.0044 (0.33)          1           1
test_import-import[3.10.0]     254.9907 (3.38)     254.9907 (3.38)     254.9907 (3.38)     0.0000 (1.0)      254.9907 (3.38)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      75.3545 (1.0)       75.3545 (1.0)       75.3545 (1.0)      0.0000 (1.0)       75.3545 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        75.6291 (1.00)      75.6291 (1.00)      75.6291 (1.00)     0.0000 (1.0)       75.6291 (1.00)     0.0000 (1.0)           0;0  0.0132 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     160.5554 (3.49)     160.5554 (3.49)     160.5554 (3.49)     0.0000 (1.0)      160.5554 (3.49)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_import_url-import-url[3.10.0]     163.4279 (3.56)     163.4279 (3.56)     163.4279 (3.56)     0.0000 (1.0)      163.4279 (3.56)     0.0000 (1.0)           0;0  0.0061 (0.28)          1           1
test_import_url-import-url[3.53.2]     122.7324 (2.67)     122.7324 (2.67)     122.7324 (2.67)     0.0000 (1.0)      122.7324 (2.67)     0.0000 (1.0)           0;0  0.0081 (0.37)          1           1
test_import_url-import-url[3.60.1]      45.9518 (1.0)       45.9518 (1.0)       45.9518 (1.0)      0.0000 (1.0)       45.9518 (1.0)      0.0000 (1.0)           0;0  0.0218 (1.0)           1           1
test_import_url-import-url[main]        46.5515 (1.01)      46.5515 (1.01)      46.5515 (1.01)     0.0000 (1.0)       46.5515 (1.01)     0.0000 (1.0)           0;0  0.0215 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     376.6284 (1.01)     410.7240 (1.06)     381.2057 (1.01)      4.6638 (1.88)     380.1691 (1.01)     2.8891 (1.07)          8;8  2.6233 (0.99)        100           1
test_init-init[3.10.0]     388.2089 (1.04)     485.6948 (1.25)     393.2126 (1.04)      9.7757 (3.95)     391.5305 (1.04)     2.7975 (1.04)          2;5  2.5432 (0.96)        100           1
test_init-init[3.53.2]     373.0910 (1.0)      415.6554 (1.07)     376.8776 (1.0)       4.6314 (1.87)     376.0468 (1.0)      2.8173 (1.04)          4;4  2.6534 (1.0)         100           1
test_init-init[3.60.1]     375.0824 (1.01)     388.6563 (1.0)      378.5748 (1.00)      2.4744 (1.0)      377.8153 (1.00)     2.7008 (1.0)          22;4  2.6415 (1.00)        100           1
test_init-init[main]       375.3504 (1.01)     461.2066 (1.19)     381.9668 (1.01)     11.8190 (4.78)     379.3086 (1.01)     3.7347 (1.38)          4;6  2.6180 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     571.4173 (1.08)     571.4173 (1.08)     571.4173 (1.08)     0.0000 (1.0)      571.4173 (1.08)     0.0000 (1.0)           0;0  1.7500 (0.92)          1           1
test_list-list[3.10.0]     674.2615 (1.28)     674.2615 (1.28)     674.2615 (1.28)     0.0000 (1.0)      674.2615 (1.28)     0.0000 (1.0)           0;0  1.4831 (0.78)          1           1
test_list-list[3.53.2]     550.8129 (1.04)     550.8129 (1.04)     550.8129 (1.04)     0.0000 (1.0)      550.8129 (1.04)     0.0000 (1.0)           0;0  1.8155 (0.96)          1           1
test_list-list[3.60.1]     527.4960 (1.0)      527.4960 (1.0)      527.4960 (1.0)      0.0000 (1.0)      527.4960 (1.0)      0.0000 (1.0)           0;0  1.8957 (1.0)           1           1
test_list-list[main]       534.6294 (1.01)     534.6294 (1.01)     534.6294 (1.01)     0.0000 (1.0)      534.6294 (1.01)     0.0000 (1.0)           0;0  1.8705 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     421.1852 (1.08)     421.1852 (1.08)     421.1852 (1.08)     0.0000 (1.0)      421.1852 (1.08)     0.0000 (1.0)           0;0  2.3743 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     428.0468 (1.09)     428.0468 (1.09)     428.0468 (1.09)     0.0000 (1.0)      428.0468 (1.09)     0.0000 (1.0)           0;0  2.3362 (0.91)          1           1
test_list-list-dvc-only[3.53.2]     391.0477 (1.0)      391.0477 (1.0)      391.0477 (1.0)      0.0000 (1.0)      391.0477 (1.0)      0.0000 (1.0)           0;0  2.5572 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     393.9863 (1.01)     393.9863 (1.01)     393.9863 (1.01)     0.0000 (1.0)      393.9863 (1.01)     0.0000 (1.0)           0;0  2.5382 (0.99)          1           1
test_list-list-dvc-only[main]       415.0881 (1.06)     415.0881 (1.06)     415.0881 (1.06)     0.0000 (1.0)      415.0881 (1.06)     0.0000 (1.0)           0;0  2.4091 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6994 (1.0)      2.6994 (1.0)      2.6994 (1.0)      0.0000 (1.0)      2.6994 (1.0)      0.0000 (1.0)           0;0  0.3704 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7561 (1.02)     2.7561 (1.02)     2.7561 (1.02)     0.0000 (1.0)      2.7561 (1.02)     0.0000 (1.0)           0;0  0.3628 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.8259 (1.05)     2.8259 (1.05)     2.8259 (1.05)     0.0000 (1.0)      2.8259 (1.05)     0.0000 (1.0)           0;0  0.3539 (0.96)          1           1
test_list-list-recursive[3.60.1]     2.8099 (1.04)     2.8099 (1.04)     2.8099 (1.04)     0.0000 (1.0)      2.8099 (1.04)     0.0000 (1.0)           0;0  0.3559 (0.96)          1           1
test_list-list-recursive[main]       2.9541 (1.09)     2.9541 (1.09)     2.9541 (1.09)     0.0000 (1.0)      2.9541 (1.09)     0.0000 (1.0)           0;0  0.3385 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     410.5147 (1.04)     410.5147 (1.04)     410.5147 (1.04)     0.0000 (1.0)      410.5147 (1.04)     0.0000 (1.0)           0;0  2.4360 (0.96)          1           1
test_list-list-shallow[3.10.0]     430.6099 (1.09)     430.6099 (1.09)     430.6099 (1.09)     0.0000 (1.0)      430.6099 (1.09)     0.0000 (1.0)           0;0  2.3223 (0.92)          1           1
test_list-list-shallow[3.53.2]     402.0985 (1.02)     402.0985 (1.02)     402.0985 (1.02)     0.0000 (1.0)      402.0985 (1.02)     0.0000 (1.0)           0;0  2.4870 (0.98)          1           1
test_list-list-shallow[3.60.1]     396.0432 (1.0)      396.0432 (1.0)      396.0432 (1.0)      0.0000 (1.0)      396.0432 (1.0)      0.0000 (1.0)           0;0  2.5250 (1.0)           1           1
test_list-list-shallow[main]       412.8435 (1.04)     412.8435 (1.04)     412.8435 (1.04)     0.0000 (1.0)      412.8435 (1.04)     0.0000 (1.0)           0;0  2.4222 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.5677 (3.41)     12.5677 (3.41)     12.5677 (3.41)     0.0000 (1.0)      12.5677 (3.41)     0.0000 (1.0)           0;0  0.0796 (0.29)          1           1
test_partial_add-add[3.10.0]     12.8225 (3.48)     12.8225 (3.48)     12.8225 (3.48)     0.0000 (1.0)      12.8225 (3.48)     0.0000 (1.0)           0;0  0.0780 (0.29)          1           1
test_partial_add-add[3.53.2]     11.6017 (3.15)     11.6017 (3.15)     11.6017 (3.15)     0.0000 (1.0)      11.6017 (3.15)     0.0000 (1.0)           0;0  0.0862 (0.32)          1           1
test_partial_add-add[3.60.1]      3.6811 (1.0)       3.6811 (1.0)       3.6811 (1.0)      0.0000 (1.0)       3.6811 (1.0)      0.0000 (1.0)           0;0  0.2717 (1.0)           1           1
test_partial_add-add[main]        4.3672 (1.19)      4.3672 (1.19)      4.3672 (1.19)     0.0000 (1.0)       4.3672 (1.19)     0.0000 (1.0)           0;0  0.2290 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     85.2751 (4.32)     85.2751 (4.32)     85.2751 (4.32)     0.0000 (1.0)      85.2751 (4.32)     0.0000 (1.0)           0;0  0.0117 (0.23)          1           1
test_partial_add-add-partial[3.10.0]     85.6595 (4.34)     85.6595 (4.34)     85.6595 (4.34)     0.0000 (1.0)      85.6595 (4.34)     0.0000 (1.0)           0;0  0.0117 (0.23)          1           1
test_partial_add-add-partial[3.53.2]     77.8111 (3.94)     77.8111 (3.94)     77.8111 (3.94)     0.0000 (1.0)      77.8111 (3.94)     0.0000 (1.0)           0;0  0.0129 (0.25)          1           1
test_partial_add-add-partial[3.60.1]     19.7442 (1.0)      19.7442 (1.0)      19.7442 (1.0)      0.0000 (1.0)      19.7442 (1.0)      0.0000 (1.0)           0;0  0.0506 (1.0)           1           1
test_partial_add-add-partial[main]       20.0002 (1.01)     20.0002 (1.01)     20.0002 (1.01)     0.0000 (1.0)      20.0002 (1.01)     0.0000 (1.0)           0;0  0.0500 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5714 (1.0)      4.5714 (1.0)      4.5714 (1.0)      0.0000 (1.0)      4.5714 (1.0)      0.0000 (1.0)           0;0  0.2188 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9976 (1.31)     5.9976 (1.31)     5.9976 (1.31)     0.0000 (1.0)      5.9976 (1.31)     0.0000 (1.0)           0;0  0.1667 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1276 (1.56)     7.1276 (1.56)     7.1276 (1.56)     0.0000 (1.0)      7.1276 (1.56)     0.0000 (1.0)           0;0  0.1403 (0.64)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.9359 (1.52)     6.9359 (1.52)     6.9359 (1.52)     0.0000 (1.0)      6.9359 (1.52)     0.0000 (1.0)           0;0  0.1442 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.8814 (1.51)     6.8814 (1.51)     6.8814 (1.51)     0.0000 (1.0)      6.8814 (1.51)     0.0000 (1.0)           0;0  0.1453 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4950 (1.0)      2.4950 (1.0)      2.4950 (1.0)      0.0000 (1.0)      2.4950 (1.0)      0.0000 (1.0)           0;0  0.4008 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7162 (1.49)     3.7162 (1.49)     3.7162 (1.49)     0.0000 (1.0)      3.7162 (1.49)     0.0000 (1.0)           0;0  0.2691 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.7813 (1.52)     3.7813 (1.52)     3.7813 (1.52)     0.0000 (1.0)      3.7813 (1.52)     0.0000 (1.0)           0;0  0.2645 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.7441 (1.50)     3.7441 (1.50)     3.7441 (1.50)     0.0000 (1.0)      3.7441 (1.50)     0.0000 (1.0)           0;0  0.2671 (0.67)          1           1
test_partial_add-gc-noop[main]       3.7499 (1.50)     3.7499 (1.50)     3.7499 (1.50)     0.0000 (1.0)      3.7499 (1.50)     0.0000 (1.0)           0;0  0.2667 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.6410 (2.17)     7.6410 (2.17)     7.6410 (2.17)     0.0000 (1.0)      7.6410 (2.17)     0.0000 (1.0)           0;0  0.1309 (0.46)          1           1
test_partial_add-push[3.10.0]     6.8224 (1.94)     6.8224 (1.94)     6.8224 (1.94)     0.0000 (1.0)      6.8224 (1.94)     0.0000 (1.0)           0;0  0.1466 (0.52)          1           1
test_partial_add-push[3.53.2]     3.6472 (1.04)     3.6472 (1.04)     3.6472 (1.04)     0.0000 (1.0)      3.6472 (1.04)     0.0000 (1.0)           0;0  0.2742 (0.97)          1           1
test_partial_add-push[3.60.1]     3.5608 (1.01)     3.5608 (1.01)     3.5608 (1.01)     0.0000 (1.0)      3.5608 (1.01)     0.0000 (1.0)           0;0  0.2808 (0.99)          1           1
test_partial_add-push[main]       3.5229 (1.0)      3.5229 (1.0)      3.5229 (1.0)      0.0000 (1.0)      3.5229 (1.0)      0.0000 (1.0)           0;0  0.2839 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.2166 (2.26)     45.2166 (2.26)     45.2166 (2.26)     0.0000 (1.0)      45.2166 (2.26)     0.0000 (1.0)           0;0  0.0221 (0.44)          1           1
test_partial_add-push-partial[3.10.0]     39.6476 (1.98)     39.6476 (1.98)     39.6476 (1.98)     0.0000 (1.0)      39.6476 (1.98)     0.0000 (1.0)           0;0  0.0252 (0.50)          1           1
test_partial_add-push-partial[3.53.2]     20.7307 (1.04)     20.7307 (1.04)     20.7307 (1.04)     0.0000 (1.0)      20.7307 (1.04)     0.0000 (1.0)           0;0  0.0482 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     20.5028 (1.03)     20.5028 (1.03)     20.5028 (1.03)     0.0000 (1.0)      20.5028 (1.03)     0.0000 (1.0)           0;0  0.0488 (0.98)          1           1
test_partial_add-push-partial[main]       20.0012 (1.0)      20.0012 (1.0)      20.0012 (1.0)      0.0000 (1.0)      20.0012 (1.0)      0.0000 (1.0)           0;0  0.0500 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     91.9444 (4.07)     91.9444 (4.07)     91.9444 (4.07)     0.0000 (1.0)      91.9444 (4.07)     0.0000 (1.0)           0;0  0.0109 (0.25)          1           1
test_partial_remove-add[3.10.0]     91.7889 (4.07)     91.7889 (4.07)     91.7889 (4.07)     0.0000 (1.0)      91.7889 (4.07)     0.0000 (1.0)           0;0  0.0109 (0.25)          1           1
test_partial_remove-add[3.53.2]     82.6138 (3.66)     82.6138 (3.66)     82.6138 (3.66)     0.0000 (1.0)      82.6138 (3.66)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_partial_remove-add[3.60.1]     22.5695 (1.0)      22.5695 (1.0)      22.5695 (1.0)      0.0000 (1.0)      22.5695 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_partial_remove-add[main]       23.1450 (1.03)     23.1450 (1.03)     23.1450 (1.03)     0.0000 (1.0)      23.1450 (1.03)     0.0000 (1.0)           0;0  0.0432 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     50.7738 (13.77)    50.7738 (13.77)    50.7738 (13.77)    0.0000 (1.0)      50.7738 (13.77)    0.0000 (1.0)           0;0  0.0197 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     51.2422 (13.89)    51.2422 (13.89)    51.2422 (13.89)    0.0000 (1.0)      51.2422 (13.89)    0.0000 (1.0)           0;0  0.0195 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     46.5633 (12.62)    46.5633 (12.62)    46.5633 (12.62)    0.0000 (1.0)      46.5633 (12.62)    0.0000 (1.0)           0;0  0.0215 (0.08)          1           1
test_partial_remove-add-update[3.60.1]      3.6883 (1.0)       3.6883 (1.0)       3.6883 (1.0)      0.0000 (1.0)       3.6883 (1.0)      0.0000 (1.0)           0;0  0.2711 (1.0)           1           1
test_partial_remove-add-update[main]        3.7062 (1.00)      3.7062 (1.00)      3.7062 (1.00)     0.0000 (1.0)       3.7062 (1.00)     0.0000 (1.0)           0;0  0.2698 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6672 (1.0)      2.6672 (1.0)      2.6672 (1.0)      0.0000 (1.0)      2.6672 (1.0)      0.0000 (1.0)           0;0  0.3749 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6290 (1.36)     3.6290 (1.36)     3.6290 (1.36)     0.0000 (1.0)      3.6290 (1.36)     0.0000 (1.0)           0;0  0.2756 (0.73)          1           1
test_partial_remove-gc[3.53.2]     3.6110 (1.35)     3.6110 (1.35)     3.6110 (1.35)     0.0000 (1.0)      3.6110 (1.35)     0.0000 (1.0)           0;0  0.2769 (0.74)          1           1
test_partial_remove-gc[3.60.1]     3.6158 (1.36)     3.6158 (1.36)     3.6158 (1.36)     0.0000 (1.0)      3.6158 (1.36)     0.0000 (1.0)           0;0  0.2766 (0.74)          1           1
test_partial_remove-gc[main]       3.6106 (1.35)     3.6106 (1.35)     3.6106 (1.35)     0.0000 (1.0)      3.6106 (1.35)     0.0000 (1.0)           0;0  0.2770 (0.74)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8137 (1.0)      4.8137 (1.0)      4.8137 (1.0)      0.0000 (1.0)      4.8137 (1.0)      0.0000 (1.0)           0;0  0.2077 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.2532 (1.30)     6.2532 (1.30)     6.2532 (1.30)     0.0000 (1.0)      6.2532 (1.30)     0.0000 (1.0)           0;0  0.1599 (0.77)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.9536 (1.44)     6.9536 (1.44)     6.9536 (1.44)     0.0000 (1.0)      6.9536 (1.44)     0.0000 (1.0)           0;0  0.1438 (0.69)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.7979 (1.41)     6.7979 (1.41)     6.7979 (1.41)     0.0000 (1.0)      6.7979 (1.41)     0.0000 (1.0)           0;0  0.1471 (0.71)          1           1
test_partial_remove-gc-cloud[main]       6.6097 (1.37)     6.6097 (1.37)     6.6097 (1.37)     0.0000 (1.0)      6.6097 (1.37)     0.0000 (1.0)           0;0  0.1513 (0.73)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.2989 (2.36)     52.2989 (2.36)     52.2989 (2.36)     0.0000 (1.0)      52.2989 (2.36)     0.0000 (1.0)           0;0  0.0191 (0.42)          1           1
test_partial_remove-push[3.10.0]     45.7314 (2.07)     45.7314 (2.07)     45.7314 (2.07)     0.0000 (1.0)      45.7314 (2.07)     0.0000 (1.0)           0;0  0.0219 (0.48)          1           1
test_partial_remove-push[3.53.2]     22.8254 (1.03)     22.8254 (1.03)     22.8254 (1.03)     0.0000 (1.0)      22.8254 (1.03)     0.0000 (1.0)           0;0  0.0438 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.4747 (1.01)     22.4747 (1.01)     22.4747 (1.01)     0.0000 (1.0)      22.4747 (1.01)     0.0000 (1.0)           0;0  0.0445 (0.99)          1           1
test_partial_remove-push[main]       22.1457 (1.0)      22.1457 (1.0)      22.1457 (1.0)      0.0000 (1.0)      22.1457 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8866 (1.00)     3.8866 (1.00)     3.8866 (1.00)     0.0000 (1.0)      3.8866 (1.00)     0.0000 (1.0)           0;0  0.2573 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     3.8813 (1.0)      3.8813 (1.0)      3.8813 (1.0)      0.0000 (1.0)      3.8813 (1.0)      0.0000 (1.0)           0;0  0.2576 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.0633 (1.82)     7.0633 (1.82)     7.0633 (1.82)     0.0000 (1.0)      7.0633 (1.82)     0.0000 (1.0)           0;0  0.1416 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     6.9675 (1.80)     6.9675 (1.80)     6.9675 (1.80)     0.0000 (1.0)      6.9675 (1.80)     0.0000 (1.0)           0;0  0.1435 (0.56)          1           1
test_partial_remove-push-update[main]       7.2005 (1.86)     7.2005 (1.86)     7.2005 (1.86)     0.0000 (1.0)      7.2005 (1.86)     0.0000 (1.0)           0;0  0.1389 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     515.7124 (1.0)      523.5915 (1.0)      519.8540 (1.0)      3.0931 (1.09)     520.9371 (1.0)       4.5119 (1.11)          2;0  1.9236 (1.0)           5           3
test_plots-plots-diff[3.10.0]     933.3818 (1.81)     940.6837 (1.80)     937.4718 (1.80)     2.8265 (1.0)      937.4360 (1.80)      4.0735 (1.0)           2;0  1.0667 (0.55)          5           3
test_plots-plots-diff[3.53.2]     850.6426 (1.65)     868.7650 (1.66)     857.9774 (1.65)     6.6084 (2.34)     856.7916 (1.64)      5.3091 (1.30)          2;1  1.1655 (0.61)          5           3
test_plots-plots-diff[3.60.1]     842.9278 (1.63)     865.9799 (1.65)     856.6452 (1.65)     9.4194 (3.33)     861.1077 (1.65)     13.9571 (3.43)          1;0  1.1673 (0.61)          5           3
test_plots-plots-diff[main]       854.2725 (1.66)     873.7324 (1.67)     862.5699 (1.66)     7.4848 (2.65)     860.5731 (1.65)     10.3017 (2.53)          2;0  1.1593 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       533.3839 (1.0)        541.8910 (1.0)        537.5681 (1.0)      3.8434 (1.30)       536.5355 (1.0)       7.0364 (1.49)          2;0  1.8602 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,176.3816 (2.21)     1,183.4700 (2.18)     1,180.6366 (2.20)     2.9588 (1.0)      1,180.5398 (2.20)      4.7198 (1.0)           1;0  0.8470 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       927.1336 (1.74)       940.9154 (1.74)       932.8748 (1.74)     6.2153 (2.10)       931.1479 (1.74)     11.2225 (2.38)          1;0  1.0720 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]       920.3144 (1.73)       938.3835 (1.73)       930.7561 (1.73)     6.6931 (2.26)       931.6914 (1.74)      7.7594 (1.64)          2;0  1.0744 (0.58)          5           3
test_plots-plots-diff-json[main]         932.3020 (1.75)       944.8308 (1.74)       939.1160 (1.75)     5.9801 (2.02)       941.7176 (1.76)     11.0738 (2.35)          2;0  1.0648 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     430.5774 (1.0)      433.9248 (1.0)      432.1057 (1.0)      1.4090 (1.0)      432.5454 (1.0)       2.2742 (1.0)           2;0  2.3142 (1.0)           5           3
test_plots-plots-show[3.10.0]     755.7602 (1.76)     779.9455 (1.80)     767.1103 (1.78)     9.2582 (6.57)     768.8591 (1.78)     12.8378 (5.64)          2;0  1.3036 (0.56)          5           3
test_plots-plots-show[3.53.2]     741.2193 (1.72)     752.4189 (1.73)     745.7002 (1.73)     4.2133 (2.99)     744.7064 (1.72)      4.9283 (2.17)          2;0  1.3410 (0.58)          5           3
test_plots-plots-show[3.60.1]     733.0096 (1.70)     747.2328 (1.72)     740.5969 (1.71)     6.8571 (4.87)     742.2387 (1.72)     13.2505 (5.83)          1;0  1.3503 (0.58)          5           3
test_plots-plots-show[main]       736.9009 (1.71)     755.7862 (1.74)     744.1585 (1.72)     7.8959 (5.60)     742.9730 (1.72)     12.5896 (5.54)          1;0  1.3438 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     444.0470 (1.0)      452.1700 (1.0)      448.3772 (1.0)      3.6146 (1.18)     447.3248 (1.0)       6.3722 (1.48)          3;0  2.2303 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     894.7110 (2.01)     902.5117 (2.00)     897.9658 (2.00)     3.0608 (1.0)      896.8165 (2.00)      4.2940 (1.0)           2;0  1.1136 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     783.8410 (1.77)     795.3062 (1.76)     789.7939 (1.76)     4.5932 (1.50)     789.4874 (1.76)      7.3908 (1.72)          2;0  1.2662 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     777.7989 (1.75)     802.2582 (1.77)     786.9892 (1.76)     9.8728 (3.23)     785.5134 (1.76)     14.2971 (3.33)          1;0  1.2707 (0.57)          5           3
test_plots-plots-show-json[main]       786.0675 (1.77)     800.7157 (1.77)     791.5636 (1.77)     5.7089 (1.87)     791.1632 (1.77)      7.1698 (1.67)          1;0  1.2633 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.3702 (2.39)     52.3702 (2.39)     52.3702 (2.39)     0.0000 (1.0)      52.3702 (2.39)     0.0000 (1.0)           0;0  0.0191 (0.42)          1           1
test_push-push[3.10.0]     46.9597 (2.14)     46.9597 (2.14)     46.9597 (2.14)     0.0000 (1.0)      46.9597 (2.14)     0.0000 (1.0)           0;0  0.0213 (0.47)          1           1
test_push-push[3.53.2]     22.8412 (1.04)     22.8412 (1.04)     22.8412 (1.04)     0.0000 (1.0)      22.8412 (1.04)     0.0000 (1.0)           0;0  0.0438 (0.96)          1           1
test_push-push[3.60.1]     22.3988 (1.02)     22.3988 (1.02)     22.3988 (1.02)     0.0000 (1.0)      22.3988 (1.02)     0.0000 (1.0)           0;0  0.0446 (0.98)          1           1
test_push-push[main]       21.9009 (1.0)      21.9009 (1.0)      21.9009 (1.0)      0.0000 (1.0)      21.9009 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.7879 (2.86)     65.7879 (2.86)     65.7879 (2.86)     0.0000 (1.0)      65.7879 (2.86)     0.0000 (1.0)           0;0  0.0152 (0.35)          1           1
test_sharing-fetch[3.10.0]     71.0856 (3.09)     71.0856 (3.09)     71.0856 (3.09)     0.0000 (1.0)      71.0856 (3.09)     0.0000 (1.0)           0;0  0.0141 (0.32)          1           1
test_sharing-fetch[3.53.2]     35.3893 (1.54)     35.3893 (1.54)     35.3893 (1.54)     0.0000 (1.0)      35.3893 (1.54)     0.0000 (1.0)           0;0  0.0283 (0.65)          1           1
test_sharing-fetch[3.60.1]     23.0139 (1.0)      23.0139 (1.0)      23.0139 (1.0)      0.0000 (1.0)      23.0139 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_sharing-fetch[main]       23.1207 (1.00)     23.1207 (1.00)     23.1207 (1.00)     0.0000 (1.0)      23.1207 (1.00)     0.0000 (1.0)           0;0  0.0433 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2771 (1.0)      1.2771 (1.0)      1.2771 (1.0)      0.0000 (1.0)      1.2771 (1.0)      0.0000 (1.0)           0;0  0.7830 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.4953 (2.74)     3.4953 (2.74)     3.4953 (2.74)     0.0000 (1.0)      3.4953 (2.74)     0.0000 (1.0)           0;0  0.2861 (0.37)          1           1
test_sharing-fetch-noop[3.53.2]     5.6318 (4.41)     5.6318 (4.41)     5.6318 (4.41)     0.0000 (1.0)      5.6318 (4.41)     0.0000 (1.0)           0;0  0.1776 (0.23)          1           1
test_sharing-fetch-noop[3.60.1]     5.7425 (4.50)     5.7425 (4.50)     5.7425 (4.50)     0.0000 (1.0)      5.7425 (4.50)     0.0000 (1.0)           0;0  0.1741 (0.22)          1           1
test_sharing-fetch-noop[main]       5.8365 (4.57)     5.8365 (4.57)     5.8365 (4.57)     0.0000 (1.0)      5.8365 (4.57)     0.0000 (1.0)           0;0  0.1713 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.6475 (2.36)     51.6475 (2.36)     51.6475 (2.36)     0.0000 (1.0)      51.6475 (2.36)     0.0000 (1.0)           0;0  0.0194 (0.42)          1           1
test_sharing-push[3.10.0]     46.1760 (2.11)     46.1760 (2.11)     46.1760 (2.11)     0.0000 (1.0)      46.1760 (2.11)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_sharing-push[3.53.2]     22.6753 (1.04)     22.6753 (1.04)     22.6753 (1.04)     0.0000 (1.0)      22.6753 (1.04)     0.0000 (1.0)           0;0  0.0441 (0.96)          1           1
test_sharing-push[3.60.1]     21.8676 (1.0)      21.8676 (1.0)      21.8676 (1.0)      0.0000 (1.0)      21.8676 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
test_sharing-push[main]       22.0925 (1.01)     22.0925 (1.01)     22.0925 (1.01)     0.0000 (1.0)      22.0925 (1.01)     0.0000 (1.0)           0;0  0.0453 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0977 (1.04)     2.0977 (1.04)     2.0977 (1.04)     0.0000 (1.0)      2.0977 (1.04)     0.0000 (1.0)           0;0  0.4767 (0.96)          1           1
test_sharing-push-noop[3.10.0]     2.0231 (1.0)      2.0231 (1.0)      2.0231 (1.0)      0.0000 (1.0)      2.0231 (1.0)      0.0000 (1.0)           0;0  0.4943 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.8089 (2.87)     5.8089 (2.87)     5.8089 (2.87)     0.0000 (1.0)      5.8089 (2.87)     0.0000 (1.0)           0;0  0.1722 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.9160 (2.92)     5.9160 (2.92)     5.9160 (2.92)     0.0000 (1.0)      5.9160 (2.92)     0.0000 (1.0)           0;0  0.1690 (0.34)          1           1
test_sharing-push-noop[main]       5.8733 (2.90)     5.8733 (2.90)     5.8733 (2.90)     0.0000 (1.0)      5.8733 (2.90)     0.0000 (1.0)           0;0  0.1703 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.8856 (4.03)     20.8856 (4.03)     20.8856 (4.03)     0.0000 (1.0)      20.8856 (4.03)     0.0000 (1.0)           0;0  0.0479 (0.25)          1           1
test_status-status[3.10.0]     21.3441 (4.12)     21.3441 (4.12)     21.3441 (4.12)     0.0000 (1.0)      21.3441 (4.12)     0.0000 (1.0)           0;0  0.0469 (0.24)          1           1
test_status-status[3.53.2]     19.3774 (3.74)     19.3774 (3.74)     19.3774 (3.74)     0.0000 (1.0)      19.3774 (3.74)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_status-status[3.60.1]      5.1860 (1.0)       5.1860 (1.0)       5.1860 (1.0)      0.0000 (1.0)       5.1860 (1.0)      0.0000 (1.0)           0;0  0.1928 (1.0)           1           1
test_status-status[main]        5.3856 (1.04)      5.3856 (1.04)      5.3856 (1.04)     0.0000 (1.0)       5.3856 (1.04)     0.0000 (1.0)           0;0  0.1857 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6208 (1.73)     4.6208 (1.73)     4.6208 (1.73)     0.0000 (1.0)      4.6208 (1.73)     0.0000 (1.0)           0;0  0.2164 (0.58)          1           1
test_status-status-changed[3.10.0]     5.0640 (1.89)     5.0640 (1.89)     5.0640 (1.89)     0.0000 (1.0)      5.0640 (1.89)     0.0000 (1.0)           0;0  0.1975 (0.53)          1           1
test_status-status-changed[3.53.2]     4.8700 (1.82)     4.8700 (1.82)     4.8700 (1.82)     0.0000 (1.0)      4.8700 (1.82)     0.0000 (1.0)           0;0  0.2053 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6743 (1.0)      2.6743 (1.0)      2.6743 (1.0)      0.0000 (1.0)      2.6743 (1.0)      0.0000 (1.0)           0;0  0.3739 (1.0)           1           1
test_status-status-changed[main]       2.6745 (1.00)     2.6745 (1.00)     2.6745 (1.00)     0.0000 (1.0)      2.6745 (1.00)     0.0000 (1.0)           0;0  0.3739 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9038 (1.88)     4.9038 (1.88)     4.9038 (1.88)     0.0000 (1.0)      4.9038 (1.88)     0.0000 (1.0)           0;0  0.2039 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     4.9047 (1.88)     4.9047 (1.88)     4.9047 (1.88)     0.0000 (1.0)      4.9047 (1.88)     0.0000 (1.0)           0;0  0.2039 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.6954 (1.80)     4.6954 (1.80)     4.6954 (1.80)     0.0000 (1.0)      4.6954 (1.80)     0.0000 (1.0)           0;0  0.2130 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.6047 (1.0)      2.6047 (1.0)      2.6047 (1.0)      0.0000 (1.0)      2.6047 (1.0)      0.0000 (1.0)           0;0  0.3839 (1.0)           1           1
test_status-status-changed-noop[main]       2.6086 (1.00)     2.6086 (1.00)     2.6086 (1.00)     0.0000 (1.0)      2.6086 (1.00)     0.0000 (1.0)           0;0  0.3833 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8108 (1.86)     4.8108 (1.86)     4.8108 (1.86)     0.0000 (1.0)      4.8108 (1.86)     0.0000 (1.0)           0;0  0.2079 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9861 (1.93)     4.9861 (1.93)     4.9861 (1.93)     0.0000 (1.0)      4.9861 (1.93)     0.0000 (1.0)           0;0  0.2006 (0.52)          1           1
test_status-status-noop[3.53.2]     4.5987 (1.78)     4.5987 (1.78)     4.5987 (1.78)     0.0000 (1.0)      4.5987 (1.78)     0.0000 (1.0)           0;0  0.2175 (0.56)          1           1
test_status-status-noop[3.60.1]     2.5872 (1.0)      2.5872 (1.0)      2.5872 (1.0)      0.0000 (1.0)      2.5872 (1.0)      0.0000 (1.0)           0;0  0.3865 (1.0)           1           1
test_status-status-noop[main]       2.6185 (1.01)     2.6185 (1.01)     2.6185 (1.01)     0.0000 (1.0)      2.6185 (1.01)     0.0000 (1.0)           0;0  0.3819 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     160.2727 (3.47)     160.2727 (3.47)     160.2727 (3.47)     0.0000 (1.0)      160.2727 (3.47)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.10.0]     165.3184 (3.57)     165.3184 (3.57)     165.3184 (3.57)     0.0000 (1.0)      165.3184 (3.57)     0.0000 (1.0)           0;0  0.0060 (0.28)          1           1
test_update-import-url[3.53.2]     124.1152 (2.68)     124.1152 (2.68)     124.1152 (2.68)     0.0000 (1.0)      124.1152 (2.68)     0.0000 (1.0)           0;0  0.0081 (0.37)          1           1
test_update-import-url[3.60.1]      46.2523 (1.0)       46.2523 (1.0)       46.2523 (1.0)      0.0000 (1.0)       46.2523 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        47.2205 (1.02)      47.2205 (1.02)      47.2205 (1.02)     0.0000 (1.0)       47.2205 (1.02)     0.0000 (1.0)           0;0  0.0212 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     141.7277 (3.96)     141.7277 (3.96)     141.7277 (3.96)     0.0000 (1.0)      141.7277 (3.96)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.10.0]     146.7058 (4.09)     146.7058 (4.09)     146.7058 (4.09)     0.0000 (1.0)      146.7058 (4.09)     0.0000 (1.0)           0;0  0.0068 (0.24)          1           1
test_update-update[3.53.2]     112.5943 (3.14)     112.5943 (3.14)     112.5943 (3.14)     0.0000 (1.0)      112.5943 (3.14)     0.0000 (1.0)           0;0  0.0089 (0.32)          1           1
test_update-update[3.60.1]      35.8350 (1.0)       35.8350 (1.0)       35.8350 (1.0)      0.0000 (1.0)       35.8350 (1.0)      0.0000 (1.0)           0;0  0.0279 (1.0)           1           1
test_update-update[main]        35.8645 (1.00)      35.8645 (1.00)      35.8645 (1.00)     0.0000 (1.0)       35.8645 (1.00)     0.0000 (1.0)           0;0  0.0279 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0918 (2.07)     16.0918 (2.07)     16.0918 (2.07)     0.0000 (1.0)      16.0918 (2.07)     0.0000 (1.0)           0;0  0.0621 (0.48)          1           1
test_update-update-noop[3.10.0]     17.0069 (2.19)     17.0069 (2.19)     17.0069 (2.19)     0.0000 (1.0)      17.0069 (2.19)     0.0000 (1.0)           0;0  0.0588 (0.46)          1           1
test_update-update-noop[3.53.2]     16.2266 (2.09)     16.2266 (2.09)     16.2266 (2.09)     0.0000 (1.0)      16.2266 (2.09)     0.0000 (1.0)           0;0  0.0616 (0.48)          1           1
test_update-update-noop[3.60.1]      7.7589 (1.0)       7.7589 (1.0)       7.7589 (1.0)      0.0000 (1.0)       7.7589 (1.0)      0.0000 (1.0)           0;0  0.1289 (1.0)           1           1
test_update-update-noop[main]        7.7610 (1.00)      7.7610 (1.00)      7.7610 (1.00)     0.0000 (1.0)       7.7610 (1.00)     0.0000 (1.0)           0;0  0.1288 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean