Tue Oct 22 00:54:30 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     96.0422 (3.97)     96.0422 (3.97)     96.0422 (3.97)     0.0000 (1.0)      96.0422 (3.97)     0.0000 (1.0)           0;0  0.0104 (0.25)          1           1
test_add_copy-add[3.10.0]     91.5441 (3.78)     91.5441 (3.78)     91.5441 (3.78)     0.0000 (1.0)      91.5441 (3.78)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_add_copy-add[3.53.2]     82.2773 (3.40)     82.2773 (3.40)     82.2773 (3.40)     0.0000 (1.0)      82.2773 (3.40)     0.0000 (1.0)           0;0  0.0122 (0.29)          1           1
test_add_copy-add[main]       24.2137 (1.0)      24.2137 (1.0)      24.2137 (1.0)      0.0000 (1.0)      24.2137 (1.0)      0.0000 (1.0)           0;0  0.0413 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     33.8907 (7.17)     33.8907 (7.17)     33.8907 (7.17)     0.0000 (1.0)      33.8907 (7.17)     0.0000 (1.0)           0;0  0.0295 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     31.6759 (6.70)     31.6759 (6.70)     31.6759 (6.70)     0.0000 (1.0)      31.6759 (6.70)     0.0000 (1.0)           0;0  0.0316 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     29.9546 (6.34)     29.9546 (6.34)     29.9546 (6.34)     0.0000 (1.0)      29.9546 (6.34)     0.0000 (1.0)           0;0  0.0334 (0.16)          1           1
test_add_copy-add-noop[main]        4.7254 (1.0)       4.7254 (1.0)       4.7254 (1.0)      0.0000 (1.0)       4.7254 (1.0)      0.0000 (1.0)           0;0  0.2116 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     75.7934 (4.42)     75.7934 (4.42)     75.7934 (4.42)     0.0000 (1.0)      75.7934 (4.42)     0.0000 (1.0)           0;0  0.0132 (0.23)          1           1
test_add_hardlink-add[3.10.0]     71.9894 (4.20)     71.9894 (4.20)     71.9894 (4.20)     0.0000 (1.0)      71.9894 (4.20)     0.0000 (1.0)           0;0  0.0139 (0.24)          1           1
test_add_hardlink-add[3.53.2]     65.8048 (3.84)     65.8048 (3.84)     65.8048 (3.84)     0.0000 (1.0)      65.8048 (3.84)     0.0000 (1.0)           0;0  0.0152 (0.26)          1           1
test_add_hardlink-add[main]       17.1347 (1.0)      17.1347 (1.0)      17.1347 (1.0)      0.0000 (1.0)      17.1347 (1.0)      0.0000 (1.0)           0;0  0.0584 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     38.8943 (8.47)     38.8943 (8.47)     38.8943 (8.47)     0.0000 (1.0)      38.8943 (8.47)     0.0000 (1.0)           0;0  0.0257 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     36.3214 (7.91)     36.3214 (7.91)     36.3214 (7.91)     0.0000 (1.0)      36.3214 (7.91)     0.0000 (1.0)           0;0  0.0275 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.1763 (7.44)     34.1763 (7.44)     34.1763 (7.44)     0.0000 (1.0)      34.1763 (7.44)     0.0000 (1.0)           0;0  0.0293 (0.13)          1           1
test_add_hardlink-add-noop[main]        4.5921 (1.0)       4.5921 (1.0)       4.5921 (1.0)      0.0000 (1.0)       4.5921 (1.0)      0.0000 (1.0)           0;0  0.2178 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     81.4954 (2.17)     81.4954 (2.17)     81.4954 (2.17)     0.0000 (1.0)      81.4954 (2.17)     0.0000 (1.0)           0;0  0.0123 (0.46)          1           1
test_add_symlink-add[3.10.0]     77.1836 (2.05)     77.1836 (2.05)     77.1836 (2.05)     0.0000 (1.0)      77.1836 (2.05)     0.0000 (1.0)           0;0  0.0130 (0.49)          1           1
test_add_symlink-add[3.53.2]     73.1992 (1.95)     73.1992 (1.95)     73.1992 (1.95)     0.0000 (1.0)      73.1992 (1.95)     0.0000 (1.0)           0;0  0.0137 (0.51)          1           1
test_add_symlink-add[main]       37.5947 (1.0)      37.5947 (1.0)      37.5947 (1.0)      0.0000 (1.0)      37.5947 (1.0)      0.0000 (1.0)           0;0  0.0266 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     52.7826 (8.50)     52.7826 (8.50)     52.7826 (8.50)     0.0000 (1.0)      52.7826 (8.50)     0.0000 (1.0)           0;0  0.0189 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     50.9520 (8.21)     50.9520 (8.21)     50.9520 (8.21)     0.0000 (1.0)      50.9520 (8.21)     0.0000 (1.0)           0;0  0.0196 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.3013 (7.78)     48.3013 (7.78)     48.3013 (7.78)     0.0000 (1.0)      48.3013 (7.78)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[main]        6.2083 (1.0)       6.2083 (1.0)       6.2083 (1.0)      0.0000 (1.0)       6.2083 (1.0)      0.0000 (1.0)           0;0  0.1611 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     44.7115 (2.09)     44.7115 (2.09)     44.7115 (2.09)     0.0000 (1.0)      44.7115 (2.09)     0.0000 (1.0)           0;0  0.0224 (0.48)          1           1
test_checkout_copy-checkout[3.10.0]     61.7347 (2.89)     61.7347 (2.89)     61.7347 (2.89)     0.0000 (1.0)      61.7347 (2.89)     0.0000 (1.0)           0;0  0.0162 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.3593 (1.37)     29.3593 (1.37)     29.3593 (1.37)     0.0000 (1.0)      29.3593 (1.37)     0.0000 (1.0)           0;0  0.0341 (0.73)          1           1
test_checkout_copy-checkout[main]       21.3676 (1.0)      21.3676 (1.0)      21.3676 (1.0)      0.0000 (1.0)      21.3676 (1.0)      0.0000 (1.0)           0;0  0.0468 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.2545 (1.75)     6.2545 (1.75)     6.2545 (1.75)     0.0000 (1.0)      6.2545 (1.75)     0.0000 (1.0)           0;0  0.1599 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.1716 (1.73)     6.1716 (1.73)     6.1716 (1.73)     0.0000 (1.0)      6.1716 (1.73)     0.0000 (1.0)           0;0  0.1620 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7697 (1.62)     5.7697 (1.62)     5.7697 (1.62)     0.0000 (1.0)      5.7697 (1.62)     0.0000 (1.0)           0;0  0.1733 (0.62)          1           1
test_checkout_copy-checkout-noop[main]       3.5667 (1.0)      3.5667 (1.0)      3.5667 (1.0)      0.0000 (1.0)      3.5667 (1.0)      0.0000 (1.0)           0;0  0.2804 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     9.7372 (2.33)     9.7372 (2.33)     9.7372 (2.33)     0.0000 (1.0)      9.7372 (2.33)     0.0000 (1.0)           0;0  0.1027 (0.43)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.7462 (1.62)     6.7462 (1.62)     6.7462 (1.62)     0.0000 (1.0)      6.7462 (1.62)     0.0000 (1.0)           0;0  0.1482 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4626 (1.55)     6.4626 (1.55)     6.4626 (1.55)     0.0000 (1.0)      6.4626 (1.55)     0.0000 (1.0)           0;0  0.1547 (0.65)          1           1
test_checkout_copy-checkout-update[main]       4.1719 (1.0)      4.1719 (1.0)      4.1719 (1.0)      0.0000 (1.0)      4.1719 (1.0)      0.0000 (1.0)           0;0  0.2397 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     26.2023 (3.15)     26.2023 (3.15)     26.2023 (3.15)     0.0000 (1.0)      26.2023 (3.15)     0.0000 (1.0)           0;0  0.0382 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.1333 (2.18)     18.1333 (2.18)     18.1333 (2.18)     0.0000 (1.0)      18.1333 (2.18)     0.0000 (1.0)           0;0  0.0551 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.3100 (1.96)     16.3100 (1.96)     16.3100 (1.96)     0.0000 (1.0)      16.3100 (1.96)     0.0000 (1.0)           0;0  0.0613 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.3271 (1.0)       8.3271 (1.0)       8.3271 (1.0)      0.0000 (1.0)       8.3271 (1.0)      0.0000 (1.0)           0;0  0.1201 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.6765 (1.70)     6.6765 (1.70)     6.6765 (1.70)     0.0000 (1.0)      6.6765 (1.70)     0.0000 (1.0)           0;0  0.1498 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.3388 (1.61)     6.3388 (1.61)     6.3388 (1.61)     0.0000 (1.0)      6.3388 (1.61)     0.0000 (1.0)           0;0  0.1578 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.9698 (1.52)     5.9698 (1.52)     5.9698 (1.52)     0.0000 (1.0)      5.9698 (1.52)     0.0000 (1.0)           0;0  0.1675 (0.66)          1           1
test_checkout_hardlink-checkout-noop[main]       3.9338 (1.0)      3.9338 (1.0)      3.9338 (1.0)      0.0000 (1.0)      3.9338 (1.0)      0.0000 (1.0)           0;0  0.2542 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     9.9560 (2.23)     9.9560 (2.23)     9.9560 (2.23)     0.0000 (1.0)      9.9560 (2.23)     0.0000 (1.0)           0;0  0.1004 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     7.1990 (1.61)     7.1990 (1.61)     7.1990 (1.61)     0.0000 (1.0)      7.1990 (1.61)     0.0000 (1.0)           0;0  0.1389 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.9619 (1.56)     6.9619 (1.56)     6.9619 (1.56)     0.0000 (1.0)      6.9619 (1.56)     0.0000 (1.0)           0;0  0.1436 (0.64)          1           1
test_checkout_hardlink-checkout-update[main]       4.4735 (1.0)      4.4735 (1.0)      4.4735 (1.0)      0.0000 (1.0)      4.4735 (1.0)      0.0000 (1.0)           0;0  0.2235 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     29.3270 (2.52)     29.3270 (2.52)     29.3270 (2.52)     0.0000 (1.0)      29.3270 (2.52)     0.0000 (1.0)           0;0  0.0341 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.9504 (1.89)     21.9504 (1.89)     21.9504 (1.89)     0.0000 (1.0)      21.9504 (1.89)     0.0000 (1.0)           0;0  0.0456 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     20.0962 (1.73)     20.0962 (1.73)     20.0962 (1.73)     0.0000 (1.0)      20.0962 (1.73)     0.0000 (1.0)           0;0  0.0498 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.6440 (1.0)      11.6440 (1.0)      11.6440 (1.0)      0.0000 (1.0)      11.6440 (1.0)      0.0000 (1.0)           0;0  0.0859 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.7122 (1.62)     7.7122 (1.62)     7.7122 (1.62)     0.0000 (1.0)      7.7122 (1.62)     0.0000 (1.0)           0;0  0.1297 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.6089 (1.60)     7.6089 (1.60)     7.6089 (1.60)     0.0000 (1.0)      7.6089 (1.60)     0.0000 (1.0)           0;0  0.1314 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.0938 (1.49)     7.0938 (1.49)     7.0938 (1.49)     0.0000 (1.0)      7.0938 (1.49)     0.0000 (1.0)           0;0  0.1410 (0.67)          1           1
test_checkout_symlink-checkout-noop[main]       4.7574 (1.0)      4.7574 (1.0)      4.7574 (1.0)      0.0000 (1.0)      4.7574 (1.0)      0.0000 (1.0)           0;0  0.2102 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     12.1334 (1.94)     12.1334 (1.94)     12.1334 (1.94)     0.0000 (1.0)      12.1334 (1.94)     0.0000 (1.0)           0;0  0.0824 (0.52)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.1987 (1.47)      9.1987 (1.47)      9.1987 (1.47)     0.0000 (1.0)       9.1987 (1.47)     0.0000 (1.0)           0;0  0.1087 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.7846 (1.40)      8.7846 (1.40)      8.7846 (1.40)     0.0000 (1.0)       8.7846 (1.40)     0.0000 (1.0)           0;0  0.1138 (0.71)          1           1
test_checkout_symlink-checkout-update[main]        6.2582 (1.0)       6.2582 (1.0)       6.2582 (1.0)      0.0000 (1.0)       6.2582 (1.0)      0.0000 (1.0)           0;0  0.1598 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.8226 (1.91)     4.8226 (1.91)     4.8226 (1.91)     0.0000 (1.0)      4.8226 (1.91)     0.0000 (1.0)           0;0  0.2074 (0.52)          1           1
test_data_status-data-changed[3.10.0]     4.8412 (1.91)     4.8412 (1.91)     4.8412 (1.91)     0.0000 (1.0)      4.8412 (1.91)     0.0000 (1.0)           0;0  0.2066 (0.52)          1           1
test_data_status-data-changed[3.53.2]     4.7055 (1.86)     4.7055 (1.86)     4.7055 (1.86)     0.0000 (1.0)      4.7055 (1.86)     0.0000 (1.0)           0;0  0.2125 (0.54)          1           1
test_data_status-data-changed[main]       2.5297 (1.0)      2.5297 (1.0)      2.5297 (1.0)      0.0000 (1.0)      2.5297 (1.0)      0.0000 (1.0)           0;0  0.3953 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.8495 (1.88)     4.8495 (1.88)     4.8495 (1.88)     0.0000 (1.0)      4.8495 (1.88)     0.0000 (1.0)           0;0  0.2062 (0.53)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0543 (1.95)     5.0543 (1.95)     5.0543 (1.95)     0.0000 (1.0)      5.0543 (1.95)     0.0000 (1.0)           0;0  0.1979 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7634 (1.84)     4.7634 (1.84)     4.7634 (1.84)     0.0000 (1.0)      4.7634 (1.84)     0.0000 (1.0)           0;0  0.2099 (0.54)          1           1
test_data_status-data-changed-noop[main]       2.5856 (1.0)      2.5856 (1.0)      2.5856 (1.0)      0.0000 (1.0)      2.5856 (1.0)      0.0000 (1.0)           0;0  0.3868 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     21.7760 (3.97)     21.7760 (3.97)     21.7760 (3.97)     0.0000 (1.0)      21.7760 (3.97)     0.0000 (1.0)           0;0  0.0459 (0.25)          1           1
test_data_status-data-new[3.10.0]     21.3944 (3.90)     21.3944 (3.90)     21.3944 (3.90)     0.0000 (1.0)      21.3944 (3.90)     0.0000 (1.0)           0;0  0.0467 (0.26)          1           1
test_data_status-data-new[3.53.2]     21.3113 (3.89)     21.3113 (3.89)     21.3113 (3.89)     0.0000 (1.0)      21.3113 (3.89)     0.0000 (1.0)           0;0  0.0469 (0.26)          1           1
test_data_status-data-new[main]        5.4844 (1.0)       5.4844 (1.0)       5.4844 (1.0)      0.0000 (1.0)       5.4844 (1.0)      0.0000 (1.0)           0;0  0.1823 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     5.0386 (1.97)     5.0386 (1.97)     5.0386 (1.97)     0.0000 (1.0)      5.0386 (1.97)     0.0000 (1.0)           0;0  0.1985 (0.51)          1           1
test_data_status-data-noop[3.10.0]     5.1436 (2.01)     5.1436 (2.01)     5.1436 (2.01)     0.0000 (1.0)      5.1436 (2.01)     0.0000 (1.0)           0;0  0.1944 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.6996 (1.84)     4.6996 (1.84)     4.6996 (1.84)     0.0000 (1.0)      4.6996 (1.84)     0.0000 (1.0)           0;0  0.2128 (0.54)          1           1
test_data_status-data-noop[main]       2.5571 (1.0)      2.5571 (1.0)      2.5571 (1.0)      0.0000 (1.0)      2.5571 (1.0)      0.0000 (1.0)           0;0  0.3911 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.6546 (1.11)     20.6546 (1.11)     20.6546 (1.11)     0.0000 (1.0)      20.6546 (1.11)     0.0000 (1.0)           0;0  0.0484 (0.90)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.6902 (1.11)     20.6902 (1.11)     20.6902 (1.11)     0.0000 (1.0)      20.6902 (1.11)     0.0000 (1.0)           0;0  0.0483 (0.90)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.5587 (1.11)     20.5587 (1.11)     20.5587 (1.11)     0.0000 (1.0)      20.5587 (1.11)     0.0000 (1.0)           0;0  0.0486 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       18.5655 (1.0)      18.5655 (1.0)      18.5655 (1.0)      0.0000 (1.0)      18.5655 (1.0)      0.0000 (1.0)           0;0  0.0539 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     21.0531 (1.13)     21.0531 (1.13)     21.0531 (1.13)     0.0000 (1.0)      21.0531 (1.13)     0.0000 (1.0)           0;0  0.0475 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     20.9510 (1.13)     20.9510 (1.13)     20.9510 (1.13)     0.0000 (1.0)      20.9510 (1.13)     0.0000 (1.0)           0;0  0.0477 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.7006 (1.11)     20.7006 (1.11)     20.7006 (1.11)     0.0000 (1.0)      20.7006 (1.11)     0.0000 (1.0)           0;0  0.0483 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.5667 (1.0)      18.5667 (1.0)      18.5667 (1.0)      0.0000 (1.0)      18.5667 (1.0)      0.0000 (1.0)           0;0  0.0539 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     37.4704 (1.74)     37.4704 (1.74)     37.4704 (1.74)     0.0000 (1.0)      37.4704 (1.74)     0.0000 (1.0)           0;0  0.0267 (0.57)          1           1
test_data_status_all_flags-data-new[3.10.0]     36.6874 (1.71)     36.6874 (1.71)     36.6874 (1.71)     0.0000 (1.0)      36.6874 (1.71)     0.0000 (1.0)           0;0  0.0273 (0.59)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.4862 (1.70)     36.4862 (1.70)     36.4862 (1.70)     0.0000 (1.0)      36.4862 (1.70)     0.0000 (1.0)           0;0  0.0274 (0.59)          1           1
test_data_status_all_flags-data-new[main]       21.5104 (1.0)      21.5104 (1.0)      21.5104 (1.0)      0.0000 (1.0)      21.5104 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     20.1285 (1.11)     20.1285 (1.11)     20.1285 (1.11)     0.0000 (1.0)      20.1285 (1.11)     0.0000 (1.0)           0;0  0.0497 (0.90)          1           1
test_data_status_all_flags-data-noop[3.10.0]     19.9858 (1.11)     19.9858 (1.11)     19.9858 (1.11)     0.0000 (1.0)      19.9858 (1.11)     0.0000 (1.0)           0;0  0.0500 (0.90)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.7006 (1.09)     19.7006 (1.09)     19.7006 (1.09)     0.0000 (1.0)      19.7006 (1.09)     0.0000 (1.0)           0;0  0.0508 (0.92)          1           1
test_data_status_all_flags-data-noop[main]       18.0627 (1.0)      18.0627 (1.0)      18.0627 (1.0)      0.0000 (1.0)      18.0627 (1.0)      0.0000 (1.0)           0;0  0.0554 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     21.0358 (2.70)     21.0358 (2.70)     21.0358 (2.70)     0.0000 (1.0)      21.0358 (2.70)     0.0000 (1.0)           0;0  0.0475 (0.37)          1           1
test_diff-diff[3.10.0]     20.4421 (2.62)     20.4421 (2.62)     20.4421 (2.62)     0.0000 (1.0)      20.4421 (2.62)     0.0000 (1.0)           0;0  0.0489 (0.38)          1           1
test_diff-diff[3.53.2]     21.0164 (2.69)     21.0164 (2.69)     21.0164 (2.69)     0.0000 (1.0)      21.0164 (2.69)     0.0000 (1.0)           0;0  0.0476 (0.37)          1           1
test_diff-diff[main]        7.8032 (1.0)       7.8032 (1.0)       7.8032 (1.0)      0.0000 (1.0)       7.8032 (1.0)      0.0000 (1.0)           0;0  0.1282 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.9053 (1.87)     6.9053 (1.87)     6.9053 (1.87)     0.0000 (1.0)      6.9053 (1.87)     0.0000 (1.0)           0;0  0.1448 (0.54)          1           1
test_diff-diff-changed[3.10.0]     7.0409 (1.90)     7.0409 (1.90)     7.0409 (1.90)     0.0000 (1.0)      7.0409 (1.90)     0.0000 (1.0)           0;0  0.1420 (0.53)          1           1
test_diff-diff-changed[3.53.2]     5.8548 (1.58)     5.8548 (1.58)     5.8548 (1.58)     0.0000 (1.0)      5.8548 (1.58)     0.0000 (1.0)           0;0  0.1708 (0.63)          1           1
test_diff-diff-changed[main]       3.7019 (1.0)      3.7019 (1.0)      3.7019 (1.0)      0.0000 (1.0)      3.7019 (1.0)      0.0000 (1.0)           0;0  0.2701 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.0026 (1.60)     6.0026 (1.60)     6.0026 (1.60)     0.0000 (1.0)      6.0026 (1.60)     0.0000 (1.0)           0;0  0.1666 (0.62)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9941 (1.60)     5.9941 (1.60)     5.9941 (1.60)     0.0000 (1.0)      5.9941 (1.60)     0.0000 (1.0)           0;0  0.1668 (0.63)          1           1
test_diff-diff-changed-noop[3.53.2]     5.8141 (1.55)     5.8141 (1.55)     5.8141 (1.55)     0.0000 (1.0)      5.8141 (1.55)     0.0000 (1.0)           0;0  0.1720 (0.65)          1           1
test_diff-diff-changed-noop[main]       3.7505 (1.0)      3.7505 (1.0)      3.7505 (1.0)      0.0000 (1.0)      3.7505 (1.0)      0.0000 (1.0)           0;0  0.2666 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.9066 (1.35)     4.9066 (1.35)     4.9066 (1.35)     0.0000 (1.0)      4.9066 (1.35)     0.0000 (1.0)           0;0  0.2038 (0.74)          1           1
test_diff-diff-noop[3.10.0]     4.9559 (1.36)     4.9559 (1.36)     4.9559 (1.36)     0.0000 (1.0)      4.9559 (1.36)     0.0000 (1.0)           0;0  0.2018 (0.73)          1           1
test_diff-diff-noop[3.53.2]     5.8949 (1.62)     5.8949 (1.62)     5.8949 (1.62)     0.0000 (1.0)      5.8949 (1.62)     0.0000 (1.0)           0;0  0.1696 (0.62)          1           1
test_diff-diff-noop[main]       3.6416 (1.0)      3.6416 (1.0)      3.6416 (1.0)      0.0000 (1.0)      3.6416 (1.0)      0.0000 (1.0)           0;0  0.2746 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0389 (1.0)      1.0389 (1.0)      1.0389 (1.0)      0.0000 (1.0)      1.0389 (1.0)      0.0000 (1.0)           0;0  0.9626 (1.0)           1           1
test_exp_show-exp[3.10.0]     7.2900 (7.02)     7.2900 (7.02)     7.2900 (7.02)     0.0000 (1.0)      7.2900 (7.02)     0.0000 (1.0)           0;0  0.1372 (0.14)          1           1
test_exp_show-exp[3.53.2]     4.7621 (4.58)     4.7621 (4.58)     4.7621 (4.58)     0.0000 (1.0)      4.7621 (4.58)     0.0000 (1.0)           0;0  0.2100 (0.22)          1           1
test_exp_show-exp[main]       7.0826 (6.82)     7.0826 (6.82)     7.0826 (6.82)     0.0000 (1.0)      7.0826 (6.82)     0.0000 (1.0)           0;0  0.1412 (0.15)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     69.5099 (2.85)     69.5099 (2.85)     69.5099 (2.85)     0.0000 (1.0)      69.5099 (2.85)     0.0000 (1.0)           0;0  0.0144 (0.35)          1           1
test_fetch-fetch[3.10.0]     73.4506 (3.01)     73.4506 (3.01)     73.4506 (3.01)     0.0000 (1.0)      73.4506 (3.01)     0.0000 (1.0)           0;0  0.0136 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.5598 (1.50)     36.5598 (1.50)     36.5598 (1.50)     0.0000 (1.0)      36.5598 (1.50)     0.0000 (1.0)           0;0  0.0274 (0.67)          1           1
test_fetch-fetch[main]       24.3710 (1.0)      24.3710 (1.0)      24.3710 (1.0)      0.0000 (1.0)      24.3710 (1.0)      0.0000 (1.0)           0;0  0.0410 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.1908 (1.08)     3.1908 (1.08)     3.1908 (1.08)     0.0000 (1.0)      3.1908 (1.08)     0.0000 (1.0)           0;0  0.3134 (0.93)          1           1
test_gc-gc[3.10.0]     3.0411 (1.03)     3.0411 (1.03)     3.0411 (1.03)     0.0000 (1.0)      3.0411 (1.03)     0.0000 (1.0)           0;0  0.3288 (0.97)          1           1
test_gc-gc[3.53.2]     3.0290 (1.02)     3.0290 (1.02)     3.0290 (1.02)     0.0000 (1.0)      3.0290 (1.02)     0.0000 (1.0)           0;0  0.3301 (0.98)          1           1
test_gc-gc[main]       2.9610 (1.0)      2.9610 (1.0)      2.9610 (1.0)      0.0000 (1.0)      2.9610 (1.0)      0.0000 (1.0)           0;0  0.3377 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     130.0543 (2.66)     130.0543 (2.66)     130.0543 (2.66)     0.0000 (1.0)      130.0543 (2.66)     0.0000 (1.0)           0;0  0.0077 (0.38)          1           1
test_get-get[3.10.0]     158.7658 (3.25)     158.7658 (3.25)     158.7658 (3.25)     0.0000 (1.0)      158.7658 (3.25)     0.0000 (1.0)           0;0  0.0063 (0.31)          1           1
test_get-get[3.53.2]     136.3061 (2.79)     136.3061 (2.79)     136.3061 (2.79)     0.0000 (1.0)      136.3061 (2.79)     0.0000 (1.0)           0;0  0.0073 (0.36)          1           1
test_get-get[main]        48.8822 (1.0)       48.8822 (1.0)       48.8822 (1.0)      0.0000 (1.0)       48.8822 (1.0)      0.0000 (1.0)           0;0  0.0205 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.5182 (2.68)     44.5182 (2.68)     44.5182 (2.68)     0.0000 (1.0)      44.5182 (2.68)     0.0000 (1.0)           0;0  0.0225 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.7052 (2.93)     48.7052 (2.93)     48.7052 (2.93)     0.0000 (1.0)      48.7052 (2.93)     0.0000 (1.0)           0;0  0.0205 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.6162 (1.0)      16.6162 (1.0)      16.6162 (1.0)      0.0000 (1.0)      16.6162 (1.0)      0.0000 (1.0)           0;0  0.0602 (1.0)           1           1
test_get_url-get-url[main]       16.7127 (1.01)     16.7127 (1.01)     16.7127 (1.01)     0.0000 (1.0)      16.7127 (1.01)     0.0000 (1.0)           0;0  0.0598 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.2555 (1.02)     132.9299 (1.00)     127.3570 (1.01)     1.6979 (1.0)      126.9282 (1.02)     1.7247 (1.01)         22;6  7.8519 (0.99)        100           1
test_help---help[3.10.0]     122.1845 (1.0)      163.9786 (1.24)     127.0570 (1.00)     6.4962 (3.83)     124.9178 (1.0)      3.7865 (2.22)          8;8  7.8705 (1.00)        100           1
test_help---help[3.53.2]     123.8261 (1.01)     132.5823 (1.0)      126.5200 (1.0)      1.7634 (1.04)     126.1251 (1.01)     1.8617 (1.09)         25;4  7.9039 (1.0)         100           1
test_help---help[main]       124.0725 (1.02)     155.0499 (1.17)     127.2461 (1.01)     4.2157 (2.48)     126.7160 (1.01)     1.7027 (1.0)           3;6  7.8588 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     233.7081 (3.03)     233.7081 (3.03)     233.7081 (3.03)     0.0000 (1.0)      233.7081 (3.03)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     256.5278 (3.32)     256.5278 (3.32)     256.5278 (3.32)     0.0000 (1.0)      256.5278 (3.32)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[main]        77.2404 (1.0)       77.2404 (1.0)       77.2404 (1.0)      0.0000 (1.0)       77.2404 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     167.3312 (3.49)     167.3312 (3.49)     167.3312 (3.49)     0.0000 (1.0)      167.3312 (3.49)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.10.0]     163.7093 (3.42)     163.7093 (3.42)     163.7093 (3.42)     0.0000 (1.0)      163.7093 (3.42)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.53.2]     122.6564 (2.56)     122.6564 (2.56)     122.6564 (2.56)     0.0000 (1.0)      122.6564 (2.56)     0.0000 (1.0)           0;0  0.0082 (0.39)          1           1
test_import_url-import-url[main]        47.8892 (1.0)       47.8892 (1.0)       47.8892 (1.0)      0.0000 (1.0)       47.8892 (1.0)      0.0000 (1.0)           0;0  0.0209 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     390.9401 (1.0)      416.5226 (1.02)     397.6288 (1.0)       3.6666 (1.21)     397.4839 (1.0)      3.8233 (1.08)         26;3  2.5149 (1.0)         100           1
test_init-init[3.10.0]     404.2800 (1.03)     424.3079 (1.04)     411.1901 (1.03)      3.2810 (1.08)     410.9098 (1.03)     3.8242 (1.09)         27;2  2.4320 (0.97)        100           1
test_init-init[3.53.2]     391.7639 (1.00)     406.6542 (1.0)      398.6012 (1.00)      3.0343 (1.0)      399.0186 (1.00)     3.5243 (1.0)          36;2  2.5088 (1.00)        100           1
test_init-init[main]       393.7884 (1.01)     485.4211 (1.19)     403.5379 (1.01)     15.7431 (5.19)     399.7160 (1.01)     4.2502 (1.21)         5;10  2.4781 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     587.7680 (1.06)     587.7680 (1.06)     587.7680 (1.06)     0.0000 (1.0)      587.7680 (1.06)     0.0000 (1.0)           0;0  1.7014 (0.95)          1           1
test_list-list[3.10.0]     686.0428 (1.23)     686.0428 (1.23)     686.0428 (1.23)     0.0000 (1.0)      686.0428 (1.23)     0.0000 (1.0)           0;0  1.4576 (0.81)          1           1
test_list-list[3.53.2]     574.4020 (1.03)     574.4020 (1.03)     574.4020 (1.03)     0.0000 (1.0)      574.4020 (1.03)     0.0000 (1.0)           0;0  1.7409 (0.97)          1           1
test_list-list[main]       555.9904 (1.0)      555.9904 (1.0)      555.9904 (1.0)      0.0000 (1.0)      555.9904 (1.0)      0.0000 (1.0)           0;0  1.7986 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     437.2916 (1.05)     437.2916 (1.05)     437.2916 (1.05)     0.0000 (1.0)      437.2916 (1.05)     0.0000 (1.0)           0;0  2.2868 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     448.8484 (1.08)     448.8484 (1.08)     448.8484 (1.08)     0.0000 (1.0)      448.8484 (1.08)     0.0000 (1.0)           0;0  2.2279 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     414.5165 (1.0)      414.5165 (1.0)      414.5165 (1.0)      0.0000 (1.0)      414.5165 (1.0)      0.0000 (1.0)           0;0  2.4124 (1.0)           1           1
test_list-list-dvc-only[main]       416.0794 (1.00)     416.0794 (1.00)     416.0794 (1.00)     0.0000 (1.0)      416.0794 (1.00)     0.0000 (1.0)           0;0  2.4034 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.1182 (1.08)     3.1182 (1.08)     3.1182 (1.08)     0.0000 (1.0)      3.1182 (1.08)     0.0000 (1.0)           0;0  0.3207 (0.93)          1           1
test_list-list-recursive[3.10.0]     2.8974 (1.0)      2.8974 (1.0)      2.8974 (1.0)      0.0000 (1.0)      2.8974 (1.0)      0.0000 (1.0)           0;0  0.3451 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.9785 (1.03)     2.9785 (1.03)     2.9785 (1.03)     0.0000 (1.0)      2.9785 (1.03)     0.0000 (1.0)           0;0  0.3357 (0.97)          1           1
test_list-list-recursive[main]       3.0339 (1.05)     3.0339 (1.05)     3.0339 (1.05)     0.0000 (1.0)      3.0339 (1.05)     0.0000 (1.0)           0;0  0.3296 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     430.9952 (1.04)     430.9952 (1.04)     430.9952 (1.04)     0.0000 (1.0)      430.9952 (1.04)     0.0000 (1.0)           0;0  2.3202 (0.96)          1           1
test_list-list-shallow[3.10.0]     439.7409 (1.06)     439.7409 (1.06)     439.7409 (1.06)     0.0000 (1.0)      439.7409 (1.06)     0.0000 (1.0)           0;0  2.2741 (0.94)          1           1
test_list-list-shallow[3.53.2]     418.4962 (1.01)     418.4962 (1.01)     418.4962 (1.01)     0.0000 (1.0)      418.4962 (1.01)     0.0000 (1.0)           0;0  2.3895 (0.99)          1           1
test_list-list-shallow[main]       414.0305 (1.0)      414.0305 (1.0)      414.0305 (1.0)      0.0000 (1.0)      414.0305 (1.0)      0.0000 (1.0)           0;0  2.4153 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     13.6112 (3.15)     13.6112 (3.15)     13.6112 (3.15)     0.0000 (1.0)      13.6112 (3.15)     0.0000 (1.0)           0;0  0.0735 (0.32)          1           1
test_partial_add-add[3.10.0]     12.9241 (2.99)     12.9241 (2.99)     12.9241 (2.99)     0.0000 (1.0)      12.9241 (2.99)     0.0000 (1.0)           0;0  0.0774 (0.33)          1           1
test_partial_add-add[3.53.2]     11.4954 (2.66)     11.4954 (2.66)     11.4954 (2.66)     0.0000 (1.0)      11.4954 (2.66)     0.0000 (1.0)           0;0  0.0870 (0.38)          1           1
test_partial_add-add[main]        4.3157 (1.0)       4.3157 (1.0)       4.3157 (1.0)      0.0000 (1.0)       4.3157 (1.0)      0.0000 (1.0)           0;0  0.2317 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     91.0376 (4.31)     91.0376 (4.31)     91.0376 (4.31)     0.0000 (1.0)      91.0376 (4.31)     0.0000 (1.0)           0;0  0.0110 (0.23)          1           1
test_partial_add-add-partial[3.10.0]     85.8999 (4.07)     85.8999 (4.07)     85.8999 (4.07)     0.0000 (1.0)      85.8999 (4.07)     0.0000 (1.0)           0;0  0.0116 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     77.7500 (3.68)     77.7500 (3.68)     77.7500 (3.68)     0.0000 (1.0)      77.7500 (3.68)     0.0000 (1.0)           0;0  0.0129 (0.27)          1           1
test_partial_add-add-partial[main]       21.1200 (1.0)      21.1200 (1.0)      21.1200 (1.0)      0.0000 (1.0)      21.1200 (1.0)      0.0000 (1.0)           0;0  0.0473 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.8668 (1.0)      5.8668 (1.0)      5.8668 (1.0)      0.0000 (1.0)      5.8668 (1.0)      0.0000 (1.0)           0;0  0.1705 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.7426 (1.15)     6.7426 (1.15)     6.7426 (1.15)     0.0000 (1.0)      6.7426 (1.15)     0.0000 (1.0)           0;0  0.1483 (0.87)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.8466 (1.34)     7.8466 (1.34)     7.8466 (1.34)     0.0000 (1.0)      7.8466 (1.34)     0.0000 (1.0)           0;0  0.1274 (0.75)          1           1
test_partial_add-gc-cloud-noop[main]       7.7760 (1.33)     7.7760 (1.33)     7.7760 (1.33)     0.0000 (1.0)      7.7760 (1.33)     0.0000 (1.0)           0;0  0.1286 (0.75)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.3990 (1.0)      3.3990 (1.0)      3.3990 (1.0)      0.0000 (1.0)      3.3990 (1.0)      0.0000 (1.0)           0;0  0.2942 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.3059 (1.27)     4.3059 (1.27)     4.3059 (1.27)     0.0000 (1.0)      4.3059 (1.27)     0.0000 (1.0)           0;0  0.2322 (0.79)          1           1
test_partial_add-gc-noop[3.53.2]     4.3327 (1.27)     4.3327 (1.27)     4.3327 (1.27)     0.0000 (1.0)      4.3327 (1.27)     0.0000 (1.0)           0;0  0.2308 (0.78)          1           1
test_partial_add-gc-noop[main]       4.2759 (1.26)     4.2759 (1.26)     4.2759 (1.26)     0.0000 (1.0)      4.2759 (1.26)     0.0000 (1.0)           0;0  0.2339 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.9902 (2.15)     7.9902 (2.15)     7.9902 (2.15)     0.0000 (1.0)      7.9902 (2.15)     0.0000 (1.0)           0;0  0.1252 (0.46)          1           1
test_partial_add-push[3.10.0]     6.9027 (1.86)     6.9027 (1.86)     6.9027 (1.86)     0.0000 (1.0)      6.9027 (1.86)     0.0000 (1.0)           0;0  0.1449 (0.54)          1           1
test_partial_add-push[3.53.2]     3.7973 (1.02)     3.7973 (1.02)     3.7973 (1.02)     0.0000 (1.0)      3.7973 (1.02)     0.0000 (1.0)           0;0  0.2633 (0.98)          1           1
test_partial_add-push[main]       3.7106 (1.0)      3.7106 (1.0)      3.7106 (1.0)      0.0000 (1.0)      3.7106 (1.0)      0.0000 (1.0)           0;0  0.2695 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     46.4415 (2.16)     46.4415 (2.16)     46.4415 (2.16)     0.0000 (1.0)      46.4415 (2.16)     0.0000 (1.0)           0;0  0.0215 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     40.0373 (1.87)     40.0373 (1.87)     40.0373 (1.87)     0.0000 (1.0)      40.0373 (1.87)     0.0000 (1.0)           0;0  0.0250 (0.54)          1           1
test_partial_add-push-partial[3.53.2]     21.7685 (1.01)     21.7685 (1.01)     21.7685 (1.01)     0.0000 (1.0)      21.7685 (1.01)     0.0000 (1.0)           0;0  0.0459 (0.99)          1           1
test_partial_add-push-partial[main]       21.4524 (1.0)      21.4524 (1.0)      21.4524 (1.0)      0.0000 (1.0)      21.4524 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     92.7616 (3.90)     92.7616 (3.90)     92.7616 (3.90)     0.0000 (1.0)      92.7616 (3.90)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.10.0]     87.2255 (3.67)     87.2255 (3.67)     87.2255 (3.67)     0.0000 (1.0)      87.2255 (3.67)     0.0000 (1.0)           0;0  0.0115 (0.27)          1           1
test_partial_remove-add[3.53.2]     79.5151 (3.35)     79.5151 (3.35)     79.5151 (3.35)     0.0000 (1.0)      79.5151 (3.35)     0.0000 (1.0)           0;0  0.0126 (0.30)          1           1
test_partial_remove-add[main]       23.7620 (1.0)      23.7620 (1.0)      23.7620 (1.0)      0.0000 (1.0)      23.7620 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     52.4090 (12.88)    52.4090 (12.88)    52.4090 (12.88)    0.0000 (1.0)      52.4090 (12.88)    0.0000 (1.0)           0;0  0.0191 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     49.9441 (12.28)    49.9441 (12.28)    49.9441 (12.28)    0.0000 (1.0)      49.9441 (12.28)    0.0000 (1.0)           0;0  0.0200 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.7562 (10.76)    43.7562 (10.76)    43.7562 (10.76)    0.0000 (1.0)      43.7562 (10.76)    0.0000 (1.0)           0;0  0.0229 (0.09)          1           1
test_partial_remove-add-update[main]        4.0681 (1.0)       4.0681 (1.0)       4.0681 (1.0)      0.0000 (1.0)       4.0681 (1.0)      0.0000 (1.0)           0;0  0.2458 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.0271 (1.0)      3.0271 (1.0)      3.0271 (1.0)      0.0000 (1.0)      3.0271 (1.0)      0.0000 (1.0)           0;0  0.3304 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.0120 (1.33)     4.0120 (1.33)     4.0120 (1.33)     0.0000 (1.0)      4.0120 (1.33)     0.0000 (1.0)           0;0  0.2493 (0.75)          1           1
test_partial_remove-gc[3.53.2]     4.0485 (1.34)     4.0485 (1.34)     4.0485 (1.34)     0.0000 (1.0)      4.0485 (1.34)     0.0000 (1.0)           0;0  0.2470 (0.75)          1           1
test_partial_remove-gc[main]       4.0629 (1.34)     4.0629 (1.34)     4.0629 (1.34)     0.0000 (1.0)      4.0629 (1.34)     0.0000 (1.0)           0;0  0.2461 (0.75)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.4172 (1.0)      5.4172 (1.0)      5.4172 (1.0)      0.0000 (1.0)      5.4172 (1.0)      0.0000 (1.0)           0;0  0.1846 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.5227 (1.20)     6.5227 (1.20)     6.5227 (1.20)     0.0000 (1.0)      6.5227 (1.20)     0.0000 (1.0)           0;0  0.1533 (0.83)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.0385 (1.30)     7.0385 (1.30)     7.0385 (1.30)     0.0000 (1.0)      7.0385 (1.30)     0.0000 (1.0)           0;0  0.1421 (0.77)          1           1
test_partial_remove-gc-cloud[main]       7.1114 (1.31)     7.1114 (1.31)     7.1114 (1.31)     0.0000 (1.0)      7.1114 (1.31)     0.0000 (1.0)           0;0  0.1406 (0.76)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.6473 (2.31)     51.6473 (2.31)     51.6473 (2.31)     0.0000 (1.0)      51.6473 (2.31)     0.0000 (1.0)           0;0  0.0194 (0.43)          1           1
test_partial_remove-push[3.10.0]     44.6869 (2.00)     44.6869 (2.00)     44.6869 (2.00)     0.0000 (1.0)      44.6869 (2.00)     0.0000 (1.0)           0;0  0.0224 (0.50)          1           1
test_partial_remove-push[3.53.2]     23.3254 (1.04)     23.3254 (1.04)     23.3254 (1.04)     0.0000 (1.0)      23.3254 (1.04)     0.0000 (1.0)           0;0  0.0429 (0.96)          1           1
test_partial_remove-push[main]       22.3366 (1.0)      22.3366 (1.0)      22.3366 (1.0)      0.0000 (1.0)      22.3366 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.3020 (1.09)     4.3020 (1.09)     4.3020 (1.09)     0.0000 (1.0)      4.3020 (1.09)     0.0000 (1.0)           0;0  0.2325 (0.92)          1           1
test_partial_remove-push-update[3.10.0]     3.9476 (1.0)      3.9476 (1.0)      3.9476 (1.0)      0.0000 (1.0)      3.9476 (1.0)      0.0000 (1.0)           0;0  0.2533 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.2833 (1.85)     7.2833 (1.85)     7.2833 (1.85)     0.0000 (1.0)      7.2833 (1.85)     0.0000 (1.0)           0;0  0.1373 (0.54)          1           1
test_partial_remove-push-update[main]       7.4201 (1.88)     7.4201 (1.88)     7.4201 (1.88)     0.0000 (1.0)      7.4201 (1.88)     0.0000 (1.0)           0;0  0.1348 (0.53)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     459.4754 (1.0)      464.5897 (1.0)      462.4279 (1.0)      1.8790 (1.0)      462.5850 (1.0)      2.0334 (1.0)           2;0  2.1625 (1.0)           5           3
test_plots-plots-diff[3.10.0]     829.5437 (1.81)     835.1210 (1.80)     831.8819 (1.80)     2.3189 (1.23)     830.9659 (1.80)     3.6966 (1.82)          2;0  1.2021 (0.56)          5           3
test_plots-plots-diff[3.53.2]     787.4090 (1.71)     796.7535 (1.71)     790.8472 (1.71)     3.8067 (2.03)     788.7867 (1.71)     5.1280 (2.52)          1;0  1.2645 (0.58)          5           3
test_plots-plots-diff[main]       788.8860 (1.72)     796.0693 (1.71)     792.3822 (1.71)     2.5990 (1.38)     792.2041 (1.71)     2.9425 (1.45)          2;0  1.2620 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       474.3283 (1.0)        479.6684 (1.0)        477.7102 (1.0)      2.3805 (1.0)        478.8475 (1.0)      3.9463 (1.0)           1;0  2.0933 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,055.8008 (2.23)     1,067.9500 (2.23)     1,058.8470 (2.22)     5.1437 (2.16)     1,056.5872 (2.21)     4.2787 (1.08)          1;1  0.9444 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       862.3334 (1.82)       870.2075 (1.81)       866.8995 (1.81)     3.1135 (1.31)       867.0022 (1.81)     4.6318 (1.17)          2;0  1.1535 (0.55)          5           3
test_plots-plots-diff-json[main]         857.2634 (1.81)       870.4488 (1.81)       863.7702 (1.81)     4.9058 (2.06)       864.0800 (1.80)     6.4979 (1.65)          2;0  1.1577 (0.55)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     425.3148 (1.0)      431.9055 (1.0)      427.1018 (1.0)      2.7548 (1.23)     425.8636 (1.0)      2.6940 (1.0)           1;0  2.3414 (1.0)           5           3
test_plots-plots-show[3.10.0]     681.6985 (1.60)     687.5280 (1.59)     685.2656 (1.60)     2.2343 (1.0)      685.5079 (1.61)     2.7578 (1.02)          2;0  1.4593 (0.62)          5           3
test_plots-plots-show[3.53.2]     658.2123 (1.55)     663.9843 (1.54)     660.8411 (1.55)     2.5651 (1.15)     660.7499 (1.55)     4.7003 (1.74)          2;0  1.5132 (0.65)          5           3
test_plots-plots-show[main]       657.4669 (1.55)     675.1381 (1.56)     664.1515 (1.56)     6.8663 (3.07)     661.4948 (1.55)     8.4963 (3.15)          1;0  1.5057 (0.64)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     438.8064 (1.0)      444.6900 (1.0)      441.8563 (1.0)      2.6751 (1.10)     440.6031 (1.0)      4.5889 (2.02)          3;0  2.2632 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     810.1827 (1.85)     816.5418 (1.84)     813.7890 (1.84)     2.4257 (1.0)      813.5054 (1.85)     3.1725 (1.39)          2;0  1.2288 (0.54)          5           3
test_plots-plots-show-json[3.53.2]     700.2027 (1.60)     707.3381 (1.59)     703.7940 (1.59)     2.5338 (1.04)     703.7397 (1.60)     2.2757 (1.0)           2;0  1.4209 (0.63)          5           3
test_plots-plots-show-json[main]       704.4857 (1.61)     725.8991 (1.63)     710.7124 (1.61)     8.7639 (3.61)     708.9779 (1.61)     8.4835 (3.73)          1;0  1.4070 (0.62)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.3540 (2.33)     53.3540 (2.33)     53.3540 (2.33)     0.0000 (1.0)      53.3540 (2.33)     0.0000 (1.0)           0;0  0.0187 (0.43)          1           1
test_push-push[3.10.0]     46.2539 (2.02)     46.2539 (2.02)     46.2539 (2.02)     0.0000 (1.0)      46.2539 (2.02)     0.0000 (1.0)           0;0  0.0216 (0.50)          1           1
test_push-push[3.53.2]     23.3915 (1.02)     23.3915 (1.02)     23.3915 (1.02)     0.0000 (1.0)      23.3915 (1.02)     0.0000 (1.0)           0;0  0.0428 (0.98)          1           1
test_push-push[main]       22.9306 (1.0)      22.9306 (1.0)      22.9306 (1.0)      0.0000 (1.0)      22.9306 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     67.1614 (2.80)     67.1614 (2.80)     67.1614 (2.80)     0.0000 (1.0)      67.1614 (2.80)     0.0000 (1.0)           0;0  0.0149 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.2873 (2.97)     71.2873 (2.97)     71.2873 (2.97)     0.0000 (1.0)      71.2873 (2.97)     0.0000 (1.0)           0;0  0.0140 (0.34)          1           1
test_sharing-fetch[3.53.2]     35.7757 (1.49)     35.7757 (1.49)     35.7757 (1.49)     0.0000 (1.0)      35.7757 (1.49)     0.0000 (1.0)           0;0  0.0280 (0.67)          1           1
test_sharing-fetch[main]       24.0137 (1.0)      24.0137 (1.0)      24.0137 (1.0)      0.0000 (1.0)      24.0137 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3928 (1.0)      1.3928 (1.0)      1.3928 (1.0)      0.0000 (1.0)      1.3928 (1.0)      0.0000 (1.0)           0;0  0.7180 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7371 (2.68)     3.7371 (2.68)     3.7371 (2.68)     0.0000 (1.0)      3.7371 (2.68)     0.0000 (1.0)           0;0  0.2676 (0.37)          1           1
test_sharing-fetch-noop[3.53.2]     6.2869 (4.51)     6.2869 (4.51)     6.2869 (4.51)     0.0000 (1.0)      6.2869 (4.51)     0.0000 (1.0)           0;0  0.1591 (0.22)          1           1
test_sharing-fetch-noop[main]       6.4237 (4.61)     6.4237 (4.61)     6.4237 (4.61)     0.0000 (1.0)      6.4237 (4.61)     0.0000 (1.0)           0;0  0.1557 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.2360 (2.36)     53.2360 (2.36)     53.2360 (2.36)     0.0000 (1.0)      53.2360 (2.36)     0.0000 (1.0)           0;0  0.0188 (0.42)          1           1
test_sharing-push[3.10.0]     46.0079 (2.04)     46.0079 (2.04)     46.0079 (2.04)     0.0000 (1.0)      46.0079 (2.04)     0.0000 (1.0)           0;0  0.0217 (0.49)          1           1
test_sharing-push[3.53.2]     23.5686 (1.04)     23.5686 (1.04)     23.5686 (1.04)     0.0000 (1.0)      23.5686 (1.04)     0.0000 (1.0)           0;0  0.0424 (0.96)          1           1
test_sharing-push[main]       22.5959 (1.0)      22.5959 (1.0)      22.5959 (1.0)      0.0000 (1.0)      22.5959 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.5019 (1.08)     2.5019 (1.08)     2.5019 (1.08)     0.0000 (1.0)      2.5019 (1.08)     0.0000 (1.0)           0;0  0.3997 (0.92)          1           1
test_sharing-push-noop[3.10.0]     2.3090 (1.0)      2.3090 (1.0)      2.3090 (1.0)      0.0000 (1.0)      2.3090 (1.0)      0.0000 (1.0)           0;0  0.4331 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.5304 (2.83)     6.5304 (2.83)     6.5304 (2.83)     0.0000 (1.0)      6.5304 (2.83)     0.0000 (1.0)           0;0  0.1531 (0.35)          1           1
test_sharing-push-noop[main]       6.6904 (2.90)     6.6904 (2.90)     6.6904 (2.90)     0.0000 (1.0)      6.6904 (2.90)     0.0000 (1.0)           0;0  0.1495 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     330.2119 (1.02)     330.2119 (1.02)     330.2119 (1.02)     0.0000 (1.0)      330.2119 (1.02)     0.0000 (1.0)           0;0  0.0030 (0.98)          1           1
test_sharing_azure-fetch[main]       324.5594 (1.0)      324.5594 (1.0)      324.5594 (1.0)      0.0000 (1.0)      324.5594 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     7.3720 (1.0)      7.3720 (1.0)      7.3720 (1.0)      0.0000 (1.0)      7.3720 (1.0)      0.0000 (1.0)           0;0  0.1356 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       7.4962 (1.02)     7.4962 (1.02)     7.4962 (1.02)     0.0000 (1.0)      7.4962 (1.02)     0.0000 (1.0)           0;0  0.1334 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     334.7939 (1.0)      334.7939 (1.0)      334.7939 (1.0)      0.0000 (1.0)      334.7939 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
test_sharing_azure-push[main]       346.7270 (1.04)     346.7270 (1.04)     346.7270 (1.04)     0.0000 (1.0)      346.7270 (1.04)     0.0000 (1.0)           0;0  0.0029 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.2158 (1.0)      8.2158 (1.0)      8.2158 (1.0)      0.0000 (1.0)      8.2158 (1.0)      0.0000 (1.0)           0;0  0.1217 (1.0)           1           1
test_sharing_azure-push-noop[main]       8.6672 (1.05)     8.6672 (1.05)     8.6672 (1.05)     0.0000 (1.0)      8.6672 (1.05)     0.0000 (1.0)           0;0  0.1154 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     277.9205 (1.04)     277.9205 (1.04)     277.9205 (1.04)     0.0000 (1.0)      277.9205 (1.04)     0.0000 (1.0)           0;0  0.0036 (0.96)          1           1
test_sharing_gs-fetch[main]       266.8489 (1.0)      266.8489 (1.0)      266.8489 (1.0)      0.0000 (1.0)      266.8489 (1.0)      0.0000 (1.0)           0;0  0.0037 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.6351 (1.0)      7.6351 (1.0)      7.6351 (1.0)      0.0000 (1.0)      7.6351 (1.0)      0.0000 (1.0)           0;0  0.1310 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.7566 (1.02)     7.7566 (1.02)     7.7566 (1.02)     0.0000 (1.0)      7.7566 (1.02)     0.0000 (1.0)           0;0  0.1289 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     567.9242 (1.01)     567.9242 (1.01)     567.9242 (1.01)     0.0000 (1.0)      567.9242 (1.01)     0.0000 (1.0)           0;0  0.0018 (0.99)          1           1
test_sharing_gs-push[main]       563.7747 (1.0)      563.7747 (1.0)      563.7747 (1.0)      0.0000 (1.0)      563.7747 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.4480 (1.02)     7.4480 (1.02)     7.4480 (1.02)     0.0000 (1.0)      7.4480 (1.02)     0.0000 (1.0)           0;0  0.1343 (0.98)          1           1
test_sharing_gs-push-noop[main]       7.3219 (1.0)      7.3219 (1.0)      7.3219 (1.0)      0.0000 (1.0)      7.3219 (1.0)      0.0000 (1.0)           0;0  0.1366 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     397.0704 (1.0)      397.0704 (1.0)      397.0704 (1.0)      0.0000 (1.0)      397.0704 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
test_sharing_s3-fetch[main]       401.3787 (1.01)     401.3787 (1.01)     401.3787 (1.01)     0.0000 (1.0)      401.3787 (1.01)     0.0000 (1.0)           0;0  0.0025 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.7825 (1.0)      6.7825 (1.0)      6.7825 (1.0)      0.0000 (1.0)      6.7825 (1.0)      0.0000 (1.0)           0;0  0.1474 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.9034 (1.02)     6.9034 (1.02)     6.9034 (1.02)     0.0000 (1.0)      6.9034 (1.02)     0.0000 (1.0)           0;0  0.1449 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     536.5237 (1.0)      536.5237 (1.0)      536.5237 (1.0)      0.0000 (1.0)      536.5237 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
test_sharing_s3-push[main]       545.6335 (1.02)     545.6335 (1.02)     545.6335 (1.02)     0.0000 (1.0)      545.6335 (1.02)     0.0000 (1.0)           0;0  0.0018 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.1803 (1.0)      7.1803 (1.0)      7.1803 (1.0)      0.0000 (1.0)      7.1803 (1.0)      0.0000 (1.0)           0;0  0.1393 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.3416 (1.02)     7.3416 (1.02)     7.3416 (1.02)     0.0000 (1.0)      7.3416 (1.02)     0.0000 (1.0)           0;0  0.1362 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.4040 (3.71)     22.4040 (3.71)     22.4040 (3.71)     0.0000 (1.0)      22.4040 (3.71)     0.0000 (1.0)           0;0  0.0446 (0.27)          1           1
test_status-status[3.10.0]     21.5202 (3.56)     21.5202 (3.56)     21.5202 (3.56)     0.0000 (1.0)      21.5202 (3.56)     0.0000 (1.0)           0;0  0.0465 (0.28)          1           1
test_status-status[3.53.2]     20.0273 (3.31)     20.0273 (3.31)     20.0273 (3.31)     0.0000 (1.0)      20.0273 (3.31)     0.0000 (1.0)           0;0  0.0499 (0.30)          1           1
test_status-status[main]        6.0427 (1.0)       6.0427 (1.0)       6.0427 (1.0)      0.0000 (1.0)       6.0427 (1.0)      0.0000 (1.0)           0;0  0.1655 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.3128 (1.75)     5.3128 (1.75)     5.3128 (1.75)     0.0000 (1.0)      5.3128 (1.75)     0.0000 (1.0)           0;0  0.1882 (0.57)          1           1
test_status-status-changed[3.10.0]     5.4120 (1.79)     5.4120 (1.79)     5.4120 (1.79)     0.0000 (1.0)      5.4120 (1.79)     0.0000 (1.0)           0;0  0.1848 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0461 (1.67)     5.0461 (1.67)     5.0461 (1.67)     0.0000 (1.0)      5.0461 (1.67)     0.0000 (1.0)           0;0  0.1982 (0.60)          1           1
test_status-status-changed[main]       3.0302 (1.0)      3.0302 (1.0)      3.0302 (1.0)      0.0000 (1.0)      3.0302 (1.0)      0.0000 (1.0)           0;0  0.3300 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.4517 (1.87)     5.4517 (1.87)     5.4517 (1.87)     0.0000 (1.0)      5.4517 (1.87)     0.0000 (1.0)           0;0  0.1834 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     5.2203 (1.79)     5.2203 (1.79)     5.2203 (1.79)     0.0000 (1.0)      5.2203 (1.79)     0.0000 (1.0)           0;0  0.1916 (0.56)          1           1
test_status-status-changed-noop[3.53.2]     5.1316 (1.76)     5.1316 (1.76)     5.1316 (1.76)     0.0000 (1.0)      5.1316 (1.76)     0.0000 (1.0)           0;0  0.1949 (0.57)          1           1
test_status-status-changed-noop[main]       2.9207 (1.0)      2.9207 (1.0)      2.9207 (1.0)      0.0000 (1.0)      2.9207 (1.0)      0.0000 (1.0)           0;0  0.3424 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.5358 (1.89)     5.5358 (1.89)     5.5358 (1.89)     0.0000 (1.0)      5.5358 (1.89)     0.0000 (1.0)           0;0  0.1806 (0.53)          1           1
test_status-status-noop[3.10.0]     5.4248 (1.85)     5.4248 (1.85)     5.4248 (1.85)     0.0000 (1.0)      5.4248 (1.85)     0.0000 (1.0)           0;0  0.1843 (0.54)          1           1
test_status-status-noop[3.53.2]     5.3245 (1.81)     5.3245 (1.81)     5.3245 (1.81)     0.0000 (1.0)      5.3245 (1.81)     0.0000 (1.0)           0;0  0.1878 (0.55)          1           1
test_status-status-noop[main]       2.9366 (1.0)      2.9366 (1.0)      2.9366 (1.0)      0.0000 (1.0)      2.9366 (1.0)      0.0000 (1.0)           0;0  0.3405 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     167.6017 (3.49)     167.6017 (3.49)     167.6017 (3.49)     0.0000 (1.0)      167.6017 (3.49)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.10.0]     164.6243 (3.43)     164.6243 (3.43)     164.6243 (3.43)     0.0000 (1.0)      164.6243 (3.43)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.53.2]     122.7780 (2.56)     122.7780 (2.56)     122.7780 (2.56)     0.0000 (1.0)      122.7780 (2.56)     0.0000 (1.0)           0;0  0.0081 (0.39)          1           1
test_update-import-url[main]        48.0365 (1.0)       48.0365 (1.0)       48.0365 (1.0)      0.0000 (1.0)       48.0365 (1.0)      0.0000 (1.0)           0;0  0.0208 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     150.4427 (4.16)     150.4427 (4.16)     150.4427 (4.16)     0.0000 (1.0)      150.4427 (4.16)     0.0000 (1.0)           0;0  0.0066 (0.24)          1           1
test_update-update[3.10.0]     147.7141 (4.08)     147.7141 (4.08)     147.7141 (4.08)     0.0000 (1.0)      147.7141 (4.08)     0.0000 (1.0)           0;0  0.0068 (0.25)          1           1
test_update-update[3.53.2]     111.4587 (3.08)     111.4587 (3.08)     111.4587 (3.08)     0.0000 (1.0)      111.4587 (3.08)     0.0000 (1.0)           0;0  0.0090 (0.32)          1           1
test_update-update[main]        36.1960 (1.0)       36.1960 (1.0)       36.1960 (1.0)      0.0000 (1.0)       36.1960 (1.0)      0.0000 (1.0)           0;0  0.0276 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     18.5122 (2.30)     18.5122 (2.30)     18.5122 (2.30)     0.0000 (1.0)      18.5122 (2.30)     0.0000 (1.0)           0;0  0.0540 (0.43)          1           1
test_update-update-noop[3.10.0]     17.5626 (2.19)     17.5626 (2.19)     17.5626 (2.19)     0.0000 (1.0)      17.5626 (2.19)     0.0000 (1.0)           0;0  0.0569 (0.46)          1           1
test_update-update-noop[3.53.2]     16.6774 (2.08)     16.6774 (2.08)     16.6774 (2.08)     0.0000 (1.0)      16.6774 (2.08)     0.0000 (1.0)           0;0  0.0600 (0.48)          1           1
test_update-update-noop[main]        8.0349 (1.0)       8.0349 (1.0)       8.0349 (1.0)      0.0000 (1.0)       8.0349 (1.0)      0.0000 (1.0)           0;0  0.1245 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean