Sun Nov 24 01:12:06 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     97.9755 (3.96)     97.9755 (3.96)     97.9755 (3.96)     0.0000 (1.0)      97.9755 (3.96)     0.0000 (1.0)           0;0  0.0102 (0.25)          1           1
test_add_copy-add[3.10.0]     94.4019 (3.82)     94.4019 (3.82)     94.4019 (3.82)     0.0000 (1.0)      94.4019 (3.82)     0.0000 (1.0)           0;0  0.0106 (0.26)          1           1
test_add_copy-add[3.53.2]     84.2503 (3.41)     84.2503 (3.41)     84.2503 (3.41)     0.0000 (1.0)      84.2503 (3.41)     0.0000 (1.0)           0;0  0.0119 (0.29)          1           1
test_add_copy-add[main]       24.7229 (1.0)      24.7229 (1.0)      24.7229 (1.0)      0.0000 (1.0)      24.7229 (1.0)      0.0000 (1.0)           0;0  0.0404 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     34.9388 (6.97)     34.9388 (6.97)     34.9388 (6.97)     0.0000 (1.0)      34.9388 (6.97)     0.0000 (1.0)           0;0  0.0286 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     32.4402 (6.48)     32.4402 (6.48)     32.4402 (6.48)     0.0000 (1.0)      32.4402 (6.48)     0.0000 (1.0)           0;0  0.0308 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     30.7002 (6.13)     30.7002 (6.13)     30.7002 (6.13)     0.0000 (1.0)      30.7002 (6.13)     0.0000 (1.0)           0;0  0.0326 (0.16)          1           1
test_add_copy-add-noop[main]        5.0092 (1.0)       5.0092 (1.0)       5.0092 (1.0)      0.0000 (1.0)       5.0092 (1.0)      0.0000 (1.0)           0;0  0.1996 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     75.9209 (4.31)     75.9209 (4.31)     75.9209 (4.31)     0.0000 (1.0)      75.9209 (4.31)     0.0000 (1.0)           0;0  0.0132 (0.23)          1           1
test_add_hardlink-add[3.10.0]     72.9105 (4.14)     72.9105 (4.14)     72.9105 (4.14)     0.0000 (1.0)      72.9105 (4.14)     0.0000 (1.0)           0;0  0.0137 (0.24)          1           1
test_add_hardlink-add[3.53.2]     66.6246 (3.78)     66.6246 (3.78)     66.6246 (3.78)     0.0000 (1.0)      66.6246 (3.78)     0.0000 (1.0)           0;0  0.0150 (0.26)          1           1
test_add_hardlink-add[main]       17.6163 (1.0)      17.6163 (1.0)      17.6163 (1.0)      0.0000 (1.0)      17.6163 (1.0)      0.0000 (1.0)           0;0  0.0568 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     39.1809 (8.25)     39.1809 (8.25)     39.1809 (8.25)     0.0000 (1.0)      39.1809 (8.25)     0.0000 (1.0)           0;0  0.0255 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     36.7238 (7.73)     36.7238 (7.73)     36.7238 (7.73)     0.0000 (1.0)      36.7238 (7.73)     0.0000 (1.0)           0;0  0.0272 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.9390 (7.36)     34.9390 (7.36)     34.9390 (7.36)     0.0000 (1.0)      34.9390 (7.36)     0.0000 (1.0)           0;0  0.0286 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.7499 (1.0)       4.7499 (1.0)       4.7499 (1.0)      0.0000 (1.0)       4.7499 (1.0)      0.0000 (1.0)           0;0  0.2105 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     81.1805 (2.16)     81.1805 (2.16)     81.1805 (2.16)     0.0000 (1.0)      81.1805 (2.16)     0.0000 (1.0)           0;0  0.0123 (0.46)          1           1
test_add_symlink-add[3.10.0]     78.5210 (2.09)     78.5210 (2.09)     78.5210 (2.09)     0.0000 (1.0)      78.5210 (2.09)     0.0000 (1.0)           0;0  0.0127 (0.48)          1           1
test_add_symlink-add[3.53.2]     72.9815 (1.94)     72.9815 (1.94)     72.9815 (1.94)     0.0000 (1.0)      72.9815 (1.94)     0.0000 (1.0)           0;0  0.0137 (0.51)          1           1
test_add_symlink-add[main]       37.5688 (1.0)      37.5688 (1.0)      37.5688 (1.0)      0.0000 (1.0)      37.5688 (1.0)      0.0000 (1.0)           0;0  0.0266 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     52.1547 (8.58)     52.1547 (8.58)     52.1547 (8.58)     0.0000 (1.0)      52.1547 (8.58)     0.0000 (1.0)           0;0  0.0192 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.5268 (8.14)     49.5268 (8.14)     49.5268 (8.14)     0.0000 (1.0)      49.5268 (8.14)     0.0000 (1.0)           0;0  0.0202 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.2084 (7.93)     48.2084 (7.93)     48.2084 (7.93)     0.0000 (1.0)      48.2084 (7.93)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[main]        6.0813 (1.0)       6.0813 (1.0)       6.0813 (1.0)      0.0000 (1.0)       6.0813 (1.0)      0.0000 (1.0)           0;0  0.1644 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     45.6598 (2.14)     45.6598 (2.14)     45.6598 (2.14)     0.0000 (1.0)      45.6598 (2.14)     0.0000 (1.0)           0;0  0.0219 (0.47)          1           1
test_checkout_copy-checkout[3.10.0]     62.5626 (2.93)     62.5626 (2.93)     62.5626 (2.93)     0.0000 (1.0)      62.5626 (2.93)     0.0000 (1.0)           0;0  0.0160 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     29.7757 (1.39)     29.7757 (1.39)     29.7757 (1.39)     0.0000 (1.0)      29.7757 (1.39)     0.0000 (1.0)           0;0  0.0336 (0.72)          1           1
test_checkout_copy-checkout[main]       21.3658 (1.0)      21.3658 (1.0)      21.3658 (1.0)      0.0000 (1.0)      21.3658 (1.0)      0.0000 (1.0)           0;0  0.0468 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.3104 (1.74)     6.3104 (1.74)     6.3104 (1.74)     0.0000 (1.0)      6.3104 (1.74)     0.0000 (1.0)           0;0  0.1585 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.1440 (1.70)     6.1440 (1.70)     6.1440 (1.70)     0.0000 (1.0)      6.1440 (1.70)     0.0000 (1.0)           0;0  0.1628 (0.59)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7825 (1.60)     5.7825 (1.60)     5.7825 (1.60)     0.0000 (1.0)      5.7825 (1.60)     0.0000 (1.0)           0;0  0.1729 (0.63)          1           1
test_checkout_copy-checkout-noop[main]       3.6171 (1.0)      3.6171 (1.0)      3.6171 (1.0)      0.0000 (1.0)      3.6171 (1.0)      0.0000 (1.0)           0;0  0.2765 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     9.8134 (2.32)     9.8134 (2.32)     9.8134 (2.32)     0.0000 (1.0)      9.8134 (2.32)     0.0000 (1.0)           0;0  0.1019 (0.43)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.7662 (1.60)     6.7662 (1.60)     6.7662 (1.60)     0.0000 (1.0)      6.7662 (1.60)     0.0000 (1.0)           0;0  0.1478 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.6184 (1.56)     6.6184 (1.56)     6.6184 (1.56)     0.0000 (1.0)      6.6184 (1.56)     0.0000 (1.0)           0;0  0.1511 (0.64)          1           1
test_checkout_copy-checkout-update[main]       4.2328 (1.0)      4.2328 (1.0)      4.2328 (1.0)      0.0000 (1.0)      4.2328 (1.0)      0.0000 (1.0)           0;0  0.2363 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.2475 (3.16)     25.2475 (3.16)     25.2475 (3.16)     0.0000 (1.0)      25.2475 (3.16)     0.0000 (1.0)           0;0  0.0396 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.9664 (2.25)     17.9664 (2.25)     17.9664 (2.25)     0.0000 (1.0)      17.9664 (2.25)     0.0000 (1.0)           0;0  0.0557 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.3242 (2.04)     16.3242 (2.04)     16.3242 (2.04)     0.0000 (1.0)      16.3242 (2.04)     0.0000 (1.0)           0;0  0.0613 (0.49)          1           1
test_checkout_hardlink-checkout[main]        7.9971 (1.0)       7.9971 (1.0)       7.9971 (1.0)      0.0000 (1.0)       7.9971 (1.0)      0.0000 (1.0)           0;0  0.1250 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.3830 (1.71)     6.3830 (1.71)     6.3830 (1.71)     0.0000 (1.0)      6.3830 (1.71)     0.0000 (1.0)           0;0  0.1567 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.1715 (1.66)     6.1715 (1.66)     6.1715 (1.66)     0.0000 (1.0)      6.1715 (1.66)     0.0000 (1.0)           0;0  0.1620 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7094 (1.53)     5.7094 (1.53)     5.7094 (1.53)     0.0000 (1.0)      5.7094 (1.53)     0.0000 (1.0)           0;0  0.1752 (0.65)          1           1
test_checkout_hardlink-checkout-noop[main]       3.7239 (1.0)      3.7239 (1.0)      3.7239 (1.0)      0.0000 (1.0)      3.7239 (1.0)      0.0000 (1.0)           0;0  0.2685 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     9.8137 (2.20)     9.8137 (2.20)     9.8137 (2.20)     0.0000 (1.0)      9.8137 (2.20)     0.0000 (1.0)           0;0  0.1019 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.9285 (1.55)     6.9285 (1.55)     6.9285 (1.55)     0.0000 (1.0)      6.9285 (1.55)     0.0000 (1.0)           0;0  0.1443 (0.64)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.5785 (1.47)     6.5785 (1.47)     6.5785 (1.47)     0.0000 (1.0)      6.5785 (1.47)     0.0000 (1.0)           0;0  0.1520 (0.68)          1           1
test_checkout_hardlink-checkout-update[main]       4.4608 (1.0)      4.4608 (1.0)      4.4608 (1.0)      0.0000 (1.0)      4.4608 (1.0)      0.0000 (1.0)           0;0  0.2242 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.2113 (2.49)     28.2113 (2.49)     28.2113 (2.49)     0.0000 (1.0)      28.2113 (2.49)     0.0000 (1.0)           0;0  0.0354 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.3222 (1.88)     21.3222 (1.88)     21.3222 (1.88)     0.0000 (1.0)      21.3222 (1.88)     0.0000 (1.0)           0;0  0.0469 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.6032 (1.73)     19.6032 (1.73)     19.6032 (1.73)     0.0000 (1.0)      19.6032 (1.73)     0.0000 (1.0)           0;0  0.0510 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.3522 (1.0)      11.3522 (1.0)      11.3522 (1.0)      0.0000 (1.0)      11.3522 (1.0)      0.0000 (1.0)           0;0  0.0881 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.5696 (1.63)     7.5696 (1.63)     7.5696 (1.63)     0.0000 (1.0)      7.5696 (1.63)     0.0000 (1.0)           0;0  0.1321 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2341 (1.56)     7.2341 (1.56)     7.2341 (1.56)     0.0000 (1.0)      7.2341 (1.56)     0.0000 (1.0)           0;0  0.1382 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7962 (1.47)     6.7962 (1.47)     6.7962 (1.47)     0.0000 (1.0)      6.7962 (1.47)     0.0000 (1.0)           0;0  0.1471 (0.68)          1           1
test_checkout_symlink-checkout-noop[main]       4.6331 (1.0)      4.6331 (1.0)      4.6331 (1.0)      0.0000 (1.0)      4.6331 (1.0)      0.0000 (1.0)           0;0  0.2158 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.8296 (1.93)     11.8296 (1.93)     11.8296 (1.93)     0.0000 (1.0)      11.8296 (1.93)     0.0000 (1.0)           0;0  0.0845 (0.52)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6526 (1.41)      8.6526 (1.41)      8.6526 (1.41)     0.0000 (1.0)       8.6526 (1.41)     0.0000 (1.0)           0;0  0.1156 (0.71)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.5703 (1.40)      8.5703 (1.40)      8.5703 (1.40)     0.0000 (1.0)       8.5703 (1.40)     0.0000 (1.0)           0;0  0.1167 (0.72)          1           1
test_checkout_symlink-checkout-update[main]        6.1430 (1.0)       6.1430 (1.0)       6.1430 (1.0)      0.0000 (1.0)       6.1430 (1.0)      0.0000 (1.0)           0;0  0.1628 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.8422 (1.90)     4.8422 (1.90)     4.8422 (1.90)     0.0000 (1.0)      4.8422 (1.90)     0.0000 (1.0)           0;0  0.2065 (0.53)          1           1
test_data_status-data-changed[3.10.0]     4.8788 (1.91)     4.8788 (1.91)     4.8788 (1.91)     0.0000 (1.0)      4.8788 (1.91)     0.0000 (1.0)           0;0  0.2050 (0.52)          1           1
test_data_status-data-changed[3.53.2]     4.7498 (1.86)     4.7498 (1.86)     4.7498 (1.86)     0.0000 (1.0)      4.7498 (1.86)     0.0000 (1.0)           0;0  0.2105 (0.54)          1           1
test_data_status-data-changed[main]       2.5552 (1.0)      2.5552 (1.0)      2.5552 (1.0)      0.0000 (1.0)      2.5552 (1.0)      0.0000 (1.0)           0;0  0.3914 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     5.1325 (2.10)     5.1325 (2.10)     5.1325 (2.10)     0.0000 (1.0)      5.1325 (2.10)     0.0000 (1.0)           0;0  0.1948 (0.48)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0396 (2.06)     5.0396 (2.06)     5.0396 (2.06)     0.0000 (1.0)      5.0396 (2.06)     0.0000 (1.0)           0;0  0.1984 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     5.0258 (2.06)     5.0258 (2.06)     5.0258 (2.06)     0.0000 (1.0)      5.0258 (2.06)     0.0000 (1.0)           0;0  0.1990 (0.49)          1           1
test_data_status-data-changed-noop[main]       2.4405 (1.0)      2.4405 (1.0)      2.4405 (1.0)      0.0000 (1.0)      2.4405 (1.0)      0.0000 (1.0)           0;0  0.4097 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     21.4601 (3.88)     21.4601 (3.88)     21.4601 (3.88)     0.0000 (1.0)      21.4601 (3.88)     0.0000 (1.0)           0;0  0.0466 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.9633 (3.79)     20.9633 (3.79)     20.9633 (3.79)     0.0000 (1.0)      20.9633 (3.79)     0.0000 (1.0)           0;0  0.0477 (0.26)          1           1
test_data_status-data-new[3.53.2]     20.5432 (3.72)     20.5432 (3.72)     20.5432 (3.72)     0.0000 (1.0)      20.5432 (3.72)     0.0000 (1.0)           0;0  0.0487 (0.27)          1           1
test_data_status-data-new[main]        5.5265 (1.0)       5.5265 (1.0)       5.5265 (1.0)      0.0000 (1.0)       5.5265 (1.0)      0.0000 (1.0)           0;0  0.1809 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     5.1182 (2.12)     5.1182 (2.12)     5.1182 (2.12)     0.0000 (1.0)      5.1182 (2.12)     0.0000 (1.0)           0;0  0.1954 (0.47)          1           1
test_data_status-data-noop[3.10.0]     5.0597 (2.09)     5.0597 (2.09)     5.0597 (2.09)     0.0000 (1.0)      5.0597 (2.09)     0.0000 (1.0)           0;0  0.1976 (0.48)          1           1
test_data_status-data-noop[3.53.2]     5.0083 (2.07)     5.0083 (2.07)     5.0083 (2.07)     0.0000 (1.0)      5.0083 (2.07)     0.0000 (1.0)           0;0  0.1997 (0.48)          1           1
test_data_status-data-noop[main]       2.4191 (1.0)      2.4191 (1.0)      2.4191 (1.0)      0.0000 (1.0)      2.4191 (1.0)      0.0000 (1.0)           0;0  0.4134 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.9266 (1.12)     20.9266 (1.12)     20.9266 (1.12)     0.0000 (1.0)      20.9266 (1.12)     0.0000 (1.0)           0;0  0.0478 (0.89)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.6825 (1.11)     20.6825 (1.11)     20.6825 (1.11)     0.0000 (1.0)      20.6825 (1.11)     0.0000 (1.0)           0;0  0.0483 (0.90)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.5843 (1.10)     20.5843 (1.10)     20.5843 (1.10)     0.0000 (1.0)      20.5843 (1.10)     0.0000 (1.0)           0;0  0.0486 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       18.6365 (1.0)      18.6365 (1.0)      18.6365 (1.0)      0.0000 (1.0)      18.6365 (1.0)      0.0000 (1.0)           0;0  0.0537 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     21.1590 (1.14)     21.1590 (1.14)     21.1590 (1.14)     0.0000 (1.0)      21.1590 (1.14)     0.0000 (1.0)           0;0  0.0473 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     20.7446 (1.11)     20.7446 (1.11)     20.7446 (1.11)     0.0000 (1.0)      20.7446 (1.11)     0.0000 (1.0)           0;0  0.0482 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.8778 (1.12)     20.8778 (1.12)     20.8778 (1.12)     0.0000 (1.0)      20.8778 (1.12)     0.0000 (1.0)           0;0  0.0479 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.6145 (1.0)      18.6145 (1.0)      18.6145 (1.0)      0.0000 (1.0)      18.6145 (1.0)      0.0000 (1.0)           0;0  0.0537 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     37.5465 (1.73)     37.5465 (1.73)     37.5465 (1.73)     0.0000 (1.0)      37.5465 (1.73)     0.0000 (1.0)           0;0  0.0266 (0.58)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.0105 (1.70)     37.0105 (1.70)     37.0105 (1.70)     0.0000 (1.0)      37.0105 (1.70)     0.0000 (1.0)           0;0  0.0270 (0.59)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.7165 (1.69)     36.7165 (1.69)     36.7165 (1.69)     0.0000 (1.0)      36.7165 (1.69)     0.0000 (1.0)           0;0  0.0272 (0.59)          1           1
test_data_status_all_flags-data-new[main]       21.7184 (1.0)      21.7184 (1.0)      21.7184 (1.0)      0.0000 (1.0)      21.7184 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     20.4517 (1.13)     20.4517 (1.13)     20.4517 (1.13)     0.0000 (1.0)      20.4517 (1.13)     0.0000 (1.0)           0;0  0.0489 (0.88)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.0863 (1.11)     20.0863 (1.11)     20.0863 (1.11)     0.0000 (1.0)      20.0863 (1.11)     0.0000 (1.0)           0;0  0.0498 (0.90)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.7879 (1.10)     19.7879 (1.10)     19.7879 (1.10)     0.0000 (1.0)      19.7879 (1.10)     0.0000 (1.0)           0;0  0.0505 (0.91)          1           1
test_data_status_all_flags-data-noop[main]       18.0258 (1.0)      18.0258 (1.0)      18.0258 (1.0)      0.0000 (1.0)      18.0258 (1.0)      0.0000 (1.0)           0;0  0.0555 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     21.2132 (2.67)     21.2132 (2.67)     21.2132 (2.67)     0.0000 (1.0)      21.2132 (2.67)     0.0000 (1.0)           0;0  0.0471 (0.37)          1           1
test_diff-diff[3.10.0]     20.8269 (2.63)     20.8269 (2.63)     20.8269 (2.63)     0.0000 (1.0)      20.8269 (2.63)     0.0000 (1.0)           0;0  0.0480 (0.38)          1           1
test_diff-diff[3.53.2]     21.0639 (2.66)     21.0639 (2.66)     21.0639 (2.66)     0.0000 (1.0)      21.0639 (2.66)     0.0000 (1.0)           0;0  0.0475 (0.38)          1           1
test_diff-diff[main]        7.9309 (1.0)       7.9309 (1.0)       7.9309 (1.0)      0.0000 (1.0)       7.9309 (1.0)      0.0000 (1.0)           0;0  0.1261 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.9979 (1.85)     6.9979 (1.85)     6.9979 (1.85)     0.0000 (1.0)      6.9979 (1.85)     0.0000 (1.0)           0;0  0.1429 (0.54)          1           1
test_diff-diff-changed[3.10.0]     7.2705 (1.92)     7.2705 (1.92)     7.2705 (1.92)     0.0000 (1.0)      7.2705 (1.92)     0.0000 (1.0)           0;0  0.1375 (0.52)          1           1
test_diff-diff-changed[3.53.2]     6.0742 (1.61)     6.0742 (1.61)     6.0742 (1.61)     0.0000 (1.0)      6.0742 (1.61)     0.0000 (1.0)           0;0  0.1646 (0.62)          1           1
test_diff-diff-changed[main]       3.7804 (1.0)      3.7804 (1.0)      3.7804 (1.0)      0.0000 (1.0)      3.7804 (1.0)      0.0000 (1.0)           0;0  0.2645 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.1856 (1.61)     6.1856 (1.61)     6.1856 (1.61)     0.0000 (1.0)      6.1856 (1.61)     0.0000 (1.0)           0;0  0.1617 (0.62)          1           1
test_diff-diff-changed-noop[3.10.0]     6.3169 (1.64)     6.3169 (1.64)     6.3169 (1.64)     0.0000 (1.0)      6.3169 (1.64)     0.0000 (1.0)           0;0  0.1583 (0.61)          1           1
test_diff-diff-changed-noop[3.53.2]     5.8753 (1.53)     5.8753 (1.53)     5.8753 (1.53)     0.0000 (1.0)      5.8753 (1.53)     0.0000 (1.0)           0;0  0.1702 (0.66)          1           1
test_diff-diff-changed-noop[main]       3.8492 (1.0)      3.8492 (1.0)      3.8492 (1.0)      0.0000 (1.0)      3.8492 (1.0)      0.0000 (1.0)           0;0  0.2598 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     5.1212 (1.32)     5.1212 (1.32)     5.1212 (1.32)     0.0000 (1.0)      5.1212 (1.32)     0.0000 (1.0)           0;0  0.1953 (0.76)          1           1
test_diff-diff-noop[3.10.0]     5.0789 (1.31)     5.0789 (1.31)     5.0789 (1.31)     0.0000 (1.0)      5.0789 (1.31)     0.0000 (1.0)           0;0  0.1969 (0.77)          1           1
test_diff-diff-noop[3.53.2]     6.0716 (1.56)     6.0716 (1.56)     6.0716 (1.56)     0.0000 (1.0)      6.0716 (1.56)     0.0000 (1.0)           0;0  0.1647 (0.64)          1           1
test_diff-diff-noop[main]       3.8885 (1.0)      3.8885 (1.0)      3.8885 (1.0)      0.0000 (1.0)      3.8885 (1.0)      0.0000 (1.0)           0;0  0.2572 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0530 (1.0)       1.0530 (1.0)       1.0530 (1.0)      0.0000 (1.0)       1.0530 (1.0)      0.0000 (1.0)           0;0  0.9496 (1.0)           1           1
test_exp_show-exp[3.10.0]     13.8426 (13.15)    13.8426 (13.15)    13.8426 (13.15)    0.0000 (1.0)      13.8426 (13.15)    0.0000 (1.0)           0;0  0.0722 (0.08)          1           1
test_exp_show-exp[3.53.2]      8.5440 (8.11)      8.5440 (8.11)      8.5440 (8.11)     0.0000 (1.0)       8.5440 (8.11)     0.0000 (1.0)           0;0  0.1170 (0.12)          1           1
test_exp_show-exp[main]       11.6738 (11.09)    11.6738 (11.09)    11.6738 (11.09)    0.0000 (1.0)      11.6738 (11.09)    0.0000 (1.0)           0;0  0.0857 (0.09)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     69.5779 (2.85)     69.5779 (2.85)     69.5779 (2.85)     0.0000 (1.0)      69.5779 (2.85)     0.0000 (1.0)           0;0  0.0144 (0.35)          1           1
test_fetch-fetch[3.10.0]     74.2530 (3.04)     74.2530 (3.04)     74.2530 (3.04)     0.0000 (1.0)      74.2530 (3.04)     0.0000 (1.0)           0;0  0.0135 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.9376 (1.51)     36.9376 (1.51)     36.9376 (1.51)     0.0000 (1.0)      36.9376 (1.51)     0.0000 (1.0)           0;0  0.0271 (0.66)          1           1
test_fetch-fetch[main]       24.4322 (1.0)      24.4322 (1.0)      24.4322 (1.0)      0.0000 (1.0)      24.4322 (1.0)      0.0000 (1.0)           0;0  0.0409 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.1593 (1.08)     3.1593 (1.08)     3.1593 (1.08)     0.0000 (1.0)      3.1593 (1.08)     0.0000 (1.0)           0;0  0.3165 (0.92)          1           1
test_gc-gc[3.10.0]     2.9799 (1.02)     2.9799 (1.02)     2.9799 (1.02)     0.0000 (1.0)      2.9799 (1.02)     0.0000 (1.0)           0;0  0.3356 (0.98)          1           1
test_gc-gc[3.53.2]     2.9778 (1.02)     2.9778 (1.02)     2.9778 (1.02)     0.0000 (1.0)      2.9778 (1.02)     0.0000 (1.0)           0;0  0.3358 (0.98)          1           1
test_gc-gc[main]       2.9191 (1.0)      2.9191 (1.0)      2.9191 (1.0)      0.0000 (1.0)      2.9191 (1.0)      0.0000 (1.0)           0;0  0.3426 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.9752 (2.74)     137.9752 (2.74)     137.9752 (2.74)     0.0000 (1.0)      137.9752 (2.74)     0.0000 (1.0)           0;0  0.0072 (0.37)          1           1
test_get-get[3.10.0]     160.0475 (3.18)     160.0475 (3.18)     160.0475 (3.18)     0.0000 (1.0)      160.0475 (3.18)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     140.9671 (2.80)     140.9671 (2.80)     140.9671 (2.80)     0.0000 (1.0)      140.9671 (2.80)     0.0000 (1.0)           0;0  0.0071 (0.36)          1           1
test_get-get[main]        50.4011 (1.0)       50.4011 (1.0)       50.4011 (1.0)      0.0000 (1.0)       50.4011 (1.0)      0.0000 (1.0)           0;0  0.0198 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.6318 (2.76)     45.6318 (2.76)     45.6318 (2.76)     0.0000 (1.0)      45.6318 (2.76)     0.0000 (1.0)           0;0  0.0219 (0.36)          1           1
test_get_url-get-url[3.10.0]     48.9031 (2.96)     48.9031 (2.96)     48.9031 (2.96)     0.0000 (1.0)      48.9031 (2.96)     0.0000 (1.0)           0;0  0.0204 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.5227 (1.0)      16.5227 (1.0)      16.5227 (1.0)      0.0000 (1.0)      16.5227 (1.0)      0.0000 (1.0)           0;0  0.0605 (1.0)           1           1
test_get_url-get-url[main]       16.9636 (1.03)     16.9636 (1.03)     16.9636 (1.03)     0.0000 (1.0)      16.9636 (1.03)     0.0000 (1.0)           0;0  0.0589 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     122.3080 (1.01)     129.5291 (1.00)     124.0642 (1.00)     0.9619 (1.14)     123.9839 (1.02)     1.2539 (1.43)         22;1  8.0603 (1.00)        100           1
test_help---help[3.10.0]     120.5117 (1.0)      149.1981 (1.16)     124.1741 (1.00)     6.7495 (8.03)     121.8784 (1.0)      1.4649 (1.67)         9;13  8.0532 (1.00)        100           1
test_help---help[3.53.2]     122.0777 (1.01)     159.6532 (1.24)     123.8403 (1.0)      3.8282 (4.55)     123.2625 (1.01)     1.2909 (1.47)          3;4  8.0749 (1.0)         100           1
test_help---help[main]       122.9764 (1.02)     128.9269 (1.0)      124.2860 (1.00)     0.8406 (1.0)      124.1298 (1.02)     0.8790 (1.0)          23;3  8.0460 (1.00)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     232.0028 (3.02)     232.0028 (3.02)     232.0028 (3.02)     0.0000 (1.0)      232.0028 (3.02)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     254.1575 (3.31)     254.1575 (3.31)     254.1575 (3.31)     0.0000 (1.0)      254.1575 (3.31)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[main]        76.8278 (1.0)       76.8278 (1.0)       76.8278 (1.0)      0.0000 (1.0)       76.8278 (1.0)      0.0000 (1.0)           0;0  0.0130 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     171.5346 (3.45)     171.5346 (3.45)     171.5346 (3.45)     0.0000 (1.0)      171.5346 (3.45)     0.0000 (1.0)           0;0  0.0058 (0.29)          1           1
test_import_url-import-url[3.10.0]     166.5403 (3.35)     166.5403 (3.35)     166.5403 (3.35)     0.0000 (1.0)      166.5403 (3.35)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_import_url-import-url[3.53.2]     126.8875 (2.55)     126.8875 (2.55)     126.8875 (2.55)     0.0000 (1.0)      126.8875 (2.55)     0.0000 (1.0)           0;0  0.0079 (0.39)          1           1
test_import_url-import-url[main]        49.7288 (1.0)       49.7288 (1.0)       49.7288 (1.0)      0.0000 (1.0)       49.7288 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     390.5078 (1.0)      405.6657 (1.0)      397.3767 (1.00)      2.9145 (1.0)      397.3221 (1.00)     4.1679 (1.02)         33;0  2.5165 (1.00)        100           1
test_init-init[3.10.0]     403.2892 (1.03)     575.1478 (1.42)     413.4411 (1.04)     17.3714 (5.96)     410.7366 (1.04)     4.8035 (1.18)          3;7  2.4187 (0.96)        100           1
test_init-init[3.53.2]     391.4399 (1.00)     412.9495 (1.02)     397.1760 (1.0)       3.8595 (1.32)     396.5513 (1.0)      4.0665 (1.0)          29;4  2.5178 (1.0)         100           1
test_init-init[main]       392.7415 (1.01)     491.9049 (1.21)     401.6446 (1.01)     14.0715 (4.83)     398.4921 (1.00)     5.5854 (1.37)          4;6  2.4898 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     570.2858 (1.01)     570.2858 (1.01)     570.2858 (1.01)     0.0000 (1.0)      570.2858 (1.01)     0.0000 (1.0)           0;0  1.7535 (0.99)          1           1
test_list-list[3.10.0]     659.4871 (1.17)     659.4871 (1.17)     659.4871 (1.17)     0.0000 (1.0)      659.4871 (1.17)     0.0000 (1.0)           0;0  1.5163 (0.86)          1           1
test_list-list[3.53.2]     579.1114 (1.03)     579.1114 (1.03)     579.1114 (1.03)     0.0000 (1.0)      579.1114 (1.03)     0.0000 (1.0)           0;0  1.7268 (0.98)          1           1
test_list-list[main]       564.8734 (1.0)      564.8734 (1.0)      564.8734 (1.0)      0.0000 (1.0)      564.8734 (1.0)      0.0000 (1.0)           0;0  1.7703 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     425.6809 (1.03)     425.6809 (1.03)     425.6809 (1.03)     0.0000 (1.0)      425.6809 (1.03)     0.0000 (1.0)           0;0  2.3492 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     421.1358 (1.02)     421.1358 (1.02)     421.1358 (1.02)     0.0000 (1.0)      421.1358 (1.02)     0.0000 (1.0)           0;0  2.3745 (0.98)          1           1
test_list-list-dvc-only[3.53.2]     414.1412 (1.0)      414.1412 (1.0)      414.1412 (1.0)      0.0000 (1.0)      414.1412 (1.0)      0.0000 (1.0)           0;0  2.4146 (1.0)           1           1
test_list-list-dvc-only[main]       433.6363 (1.05)     433.6363 (1.05)     433.6363 (1.05)     0.0000 (1.0)      433.6363 (1.05)     0.0000 (1.0)           0;0  2.3061 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.0534 (1.06)     3.0534 (1.06)     3.0534 (1.06)     0.0000 (1.0)      3.0534 (1.06)     0.0000 (1.0)           0;0  0.3275 (0.94)          1           1
test_list-list-recursive[3.10.0]     2.8717 (1.0)      2.8717 (1.0)      2.8717 (1.0)      0.0000 (1.0)      2.8717 (1.0)      0.0000 (1.0)           0;0  0.3482 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.8768 (1.00)     2.8768 (1.00)     2.8768 (1.00)     0.0000 (1.0)      2.8768 (1.00)     0.0000 (1.0)           0;0  0.3476 (1.00)          1           1
test_list-list-recursive[main]       3.1159 (1.09)     3.1159 (1.09)     3.1159 (1.09)     0.0000 (1.0)      3.1159 (1.09)     0.0000 (1.0)           0;0  0.3209 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     421.0692 (1.02)     421.0692 (1.02)     421.0692 (1.02)     0.0000 (1.0)      421.0692 (1.02)     0.0000 (1.0)           0;0  2.3749 (0.98)          1           1
test_list-list-shallow[3.10.0]     415.6537 (1.01)     415.6537 (1.01)     415.6537 (1.01)     0.0000 (1.0)      415.6537 (1.01)     0.0000 (1.0)           0;0  2.4058 (0.99)          1           1
test_list-list-shallow[3.53.2]     415.2700 (1.01)     415.2700 (1.01)     415.2700 (1.01)     0.0000 (1.0)      415.2700 (1.01)     0.0000 (1.0)           0;0  2.4081 (0.99)          1           1
test_list-list-shallow[main]       411.1719 (1.0)      411.1719 (1.0)      411.1719 (1.0)      0.0000 (1.0)      411.1719 (1.0)      0.0000 (1.0)           0;0  2.4321 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     13.4913 (3.07)     13.4913 (3.07)     13.4913 (3.07)     0.0000 (1.0)      13.4913 (3.07)     0.0000 (1.0)           0;0  0.0741 (0.33)          1           1
test_partial_add-add[3.10.0]     13.4046 (3.05)     13.4046 (3.05)     13.4046 (3.05)     0.0000 (1.0)      13.4046 (3.05)     0.0000 (1.0)           0;0  0.0746 (0.33)          1           1
test_partial_add-add[3.53.2]     11.6860 (2.66)     11.6860 (2.66)     11.6860 (2.66)     0.0000 (1.0)      11.6860 (2.66)     0.0000 (1.0)           0;0  0.0856 (0.38)          1           1
test_partial_add-add[main]        4.3904 (1.0)       4.3904 (1.0)       4.3904 (1.0)      0.0000 (1.0)       4.3904 (1.0)      0.0000 (1.0)           0;0  0.2278 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     91.0512 (4.36)     91.0512 (4.36)     91.0512 (4.36)     0.0000 (1.0)      91.0512 (4.36)     0.0000 (1.0)           0;0  0.0110 (0.23)          1           1
test_partial_add-add-partial[3.10.0]     87.9107 (4.21)     87.9107 (4.21)     87.9107 (4.21)     0.0000 (1.0)      87.9107 (4.21)     0.0000 (1.0)           0;0  0.0114 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     78.1315 (3.74)     78.1315 (3.74)     78.1315 (3.74)     0.0000 (1.0)      78.1315 (3.74)     0.0000 (1.0)           0;0  0.0128 (0.27)          1           1
test_partial_add-add-partial[main]       20.8937 (1.0)      20.8937 (1.0)      20.8937 (1.0)      0.0000 (1.0)      20.8937 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.9414 (1.0)      5.9414 (1.0)      5.9414 (1.0)      0.0000 (1.0)      5.9414 (1.0)      0.0000 (1.0)           0;0  0.1683 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     7.0172 (1.18)     7.0172 (1.18)     7.0172 (1.18)     0.0000 (1.0)      7.0172 (1.18)     0.0000 (1.0)           0;0  0.1425 (0.85)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.8856 (1.33)     7.8856 (1.33)     7.8856 (1.33)     0.0000 (1.0)      7.8856 (1.33)     0.0000 (1.0)           0;0  0.1268 (0.75)          1           1
test_partial_add-gc-cloud-noop[main]       7.8215 (1.32)     7.8215 (1.32)     7.8215 (1.32)     0.0000 (1.0)      7.8215 (1.32)     0.0000 (1.0)           0;0  0.1279 (0.76)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.3793 (1.0)      3.3793 (1.0)      3.3793 (1.0)      0.0000 (1.0)      3.3793 (1.0)      0.0000 (1.0)           0;0  0.2959 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.2789 (1.27)     4.2789 (1.27)     4.2789 (1.27)     0.0000 (1.0)      4.2789 (1.27)     0.0000 (1.0)           0;0  0.2337 (0.79)          1           1
test_partial_add-gc-noop[3.53.2]     4.3594 (1.29)     4.3594 (1.29)     4.3594 (1.29)     0.0000 (1.0)      4.3594 (1.29)     0.0000 (1.0)           0;0  0.2294 (0.78)          1           1
test_partial_add-gc-noop[main]       4.4250 (1.31)     4.4250 (1.31)     4.4250 (1.31)     0.0000 (1.0)      4.4250 (1.31)     0.0000 (1.0)           0;0  0.2260 (0.76)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.9512 (2.17)     7.9512 (2.17)     7.9512 (2.17)     0.0000 (1.0)      7.9512 (2.17)     0.0000 (1.0)           0;0  0.1258 (0.46)          1           1
test_partial_add-push[3.10.0]     6.8554 (1.87)     6.8554 (1.87)     6.8554 (1.87)     0.0000 (1.0)      6.8554 (1.87)     0.0000 (1.0)           0;0  0.1459 (0.53)          1           1
test_partial_add-push[3.53.2]     4.0098 (1.10)     4.0098 (1.10)     4.0098 (1.10)     0.0000 (1.0)      4.0098 (1.10)     0.0000 (1.0)           0;0  0.2494 (0.91)          1           1
test_partial_add-push[main]       3.6569 (1.0)      3.6569 (1.0)      3.6569 (1.0)      0.0000 (1.0)      3.6569 (1.0)      0.0000 (1.0)           0;0  0.2735 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     46.8402 (2.22)     46.8402 (2.22)     46.8402 (2.22)     0.0000 (1.0)      46.8402 (2.22)     0.0000 (1.0)           0;0  0.0213 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     39.9504 (1.89)     39.9504 (1.89)     39.9504 (1.89)     0.0000 (1.0)      39.9504 (1.89)     0.0000 (1.0)           0;0  0.0250 (0.53)          1           1
test_partial_add-push-partial[3.53.2]     22.2497 (1.05)     22.2497 (1.05)     22.2497 (1.05)     0.0000 (1.0)      22.2497 (1.05)     0.0000 (1.0)           0;0  0.0449 (0.95)          1           1
test_partial_add-push-partial[main]       21.1120 (1.0)      21.1120 (1.0)      21.1120 (1.0)      0.0000 (1.0)      21.1120 (1.0)      0.0000 (1.0)           0;0  0.0474 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     96.2665 (3.97)     96.2665 (3.97)     96.2665 (3.97)     0.0000 (1.0)      96.2665 (3.97)     0.0000 (1.0)           0;0  0.0104 (0.25)          1           1
test_partial_remove-add[3.10.0]     91.3300 (3.77)     91.3300 (3.77)     91.3300 (3.77)     0.0000 (1.0)      91.3300 (3.77)     0.0000 (1.0)           0;0  0.0109 (0.27)          1           1
test_partial_remove-add[3.53.2]     83.1979 (3.43)     83.1979 (3.43)     83.1979 (3.43)     0.0000 (1.0)      83.1979 (3.43)     0.0000 (1.0)           0;0  0.0120 (0.29)          1           1
test_partial_remove-add[main]       24.2438 (1.0)      24.2438 (1.0)      24.2438 (1.0)      0.0000 (1.0)      24.2438 (1.0)      0.0000 (1.0)           0;0  0.0412 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     53.9293 (12.96)    53.9293 (12.96)    53.9293 (12.96)    0.0000 (1.0)      53.9293 (12.96)    0.0000 (1.0)           0;0  0.0185 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     50.8956 (12.23)    50.8956 (12.23)    50.8956 (12.23)    0.0000 (1.0)      50.8956 (12.23)    0.0000 (1.0)           0;0  0.0196 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     46.5691 (11.19)    46.5691 (11.19)    46.5691 (11.19)    0.0000 (1.0)      46.5691 (11.19)    0.0000 (1.0)           0;0  0.0215 (0.09)          1           1
test_partial_remove-add-update[main]        4.1601 (1.0)       4.1601 (1.0)       4.1601 (1.0)      0.0000 (1.0)       4.1601 (1.0)      0.0000 (1.0)           0;0  0.2404 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.4476 (1.0)      3.4476 (1.0)      3.4476 (1.0)      0.0000 (1.0)      3.4476 (1.0)      0.0000 (1.0)           0;0  0.2901 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.0458 (1.17)     4.0458 (1.17)     4.0458 (1.17)     0.0000 (1.0)      4.0458 (1.17)     0.0000 (1.0)           0;0  0.2472 (0.85)          1           1
test_partial_remove-gc[3.53.2]     4.1587 (1.21)     4.1587 (1.21)     4.1587 (1.21)     0.0000 (1.0)      4.1587 (1.21)     0.0000 (1.0)           0;0  0.2405 (0.83)          1           1
test_partial_remove-gc[main]       4.1398 (1.20)     4.1398 (1.20)     4.1398 (1.20)     0.0000 (1.0)      4.1398 (1.20)     0.0000 (1.0)           0;0  0.2416 (0.83)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.9798 (1.0)      5.9798 (1.0)      5.9798 (1.0)      0.0000 (1.0)      5.9798 (1.0)      0.0000 (1.0)           0;0  0.1672 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.8055 (1.14)     6.8055 (1.14)     6.8055 (1.14)     0.0000 (1.0)      6.8055 (1.14)     0.0000 (1.0)           0;0  0.1469 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.3394 (1.23)     7.3394 (1.23)     7.3394 (1.23)     0.0000 (1.0)      7.3394 (1.23)     0.0000 (1.0)           0;0  0.1363 (0.81)          1           1
test_partial_remove-gc-cloud[main]       7.4597 (1.25)     7.4597 (1.25)     7.4597 (1.25)     0.0000 (1.0)      7.4597 (1.25)     0.0000 (1.0)           0;0  0.1341 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.1884 (2.35)     53.1884 (2.35)     53.1884 (2.35)     0.0000 (1.0)      53.1884 (2.35)     0.0000 (1.0)           0;0  0.0188 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.0239 (2.03)     46.0239 (2.03)     46.0239 (2.03)     0.0000 (1.0)      46.0239 (2.03)     0.0000 (1.0)           0;0  0.0217 (0.49)          1           1
test_partial_remove-push[3.53.2]     24.5099 (1.08)     24.5099 (1.08)     24.5099 (1.08)     0.0000 (1.0)      24.5099 (1.08)     0.0000 (1.0)           0;0  0.0408 (0.92)          1           1
test_partial_remove-push[main]       22.6594 (1.0)      22.6594 (1.0)      22.6594 (1.0)      0.0000 (1.0)      22.6594 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.6025 (1.10)     4.6025 (1.10)     4.6025 (1.10)     0.0000 (1.0)      4.6025 (1.10)     0.0000 (1.0)           0;0  0.2173 (0.91)          1           1
test_partial_remove-push-update[3.10.0]     4.1863 (1.0)      4.1863 (1.0)      4.1863 (1.0)      0.0000 (1.0)      4.1863 (1.0)      0.0000 (1.0)           0;0  0.2389 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.6820 (1.84)     7.6820 (1.84)     7.6820 (1.84)     0.0000 (1.0)      7.6820 (1.84)     0.0000 (1.0)           0;0  0.1302 (0.54)          1           1
test_partial_remove-push-update[main]       7.5867 (1.81)     7.5867 (1.81)     7.5867 (1.81)     0.0000 (1.0)      7.5867 (1.81)     0.0000 (1.0)           0;0  0.1318 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     489.1376 (1.0)      523.7760 (1.0)      505.7255 (1.0)      14.7340 (2.14)     508.6907 (1.0)      25.3893 (2.48)          2;0  1.9774 (1.0)           5           3
test_plots-plots-diff[3.10.0]     891.9730 (1.82)     907.6173 (1.73)     900.8069 (1.78)      6.8899 (1.0)      903.1629 (1.78)     12.1171 (1.18)          1;0  1.1101 (0.56)          5           3
test_plots-plots-diff[3.53.2]     807.3001 (1.65)     826.3661 (1.58)     818.2320 (1.62)      7.3838 (1.07)     817.7137 (1.61)     10.2414 (1.0)           2;0  1.2221 (0.62)          5           3
test_plots-plots-diff[main]       815.1749 (1.67)     871.8720 (1.66)     833.8212 (1.65)     22.1481 (3.21)     824.7737 (1.62)     20.0912 (1.96)          1;0  1.1993 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       502.2700 (1.0)        512.0694 (1.0)        506.3118 (1.0)       4.2306 (1.0)        506.0276 (1.0)       7.3105 (1.81)          1;0  1.9751 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,109.7223 (2.21)     1,132.7233 (2.21)     1,121.3628 (2.21)      9.5596 (2.26)     1,117.7764 (2.21)     15.2753 (3.78)          2;0  0.8918 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       894.0794 (1.78)       907.7324 (1.77)       900.3282 (1.78)      4.8674 (1.15)       899.6814 (1.78)      4.0407 (1.0)           2;0  1.1107 (0.56)          5           3
test_plots-plots-diff-json[main]         889.8160 (1.77)       939.3962 (1.83)       913.0981 (1.80)     20.6019 (4.87)       917.2297 (1.81)     34.1707 (8.46)          2;0  1.0952 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     435.9567 (1.0)      461.7758 (1.0)      451.4684 (1.0)       9.9334 (1.26)     450.9875 (1.0)      12.4023 (1.00)          2;0  2.2150 (1.0)           5           3
test_plots-plots-show[3.10.0]     743.1957 (1.70)     778.5808 (1.69)     758.1488 (1.68)     13.7619 (1.74)     758.6738 (1.68)     19.3570 (1.57)          2;0  1.3190 (0.60)          5           3
test_plots-plots-show[3.53.2]     673.6041 (1.55)     691.7819 (1.50)     685.3752 (1.52)      7.8890 (1.0)      689.0968 (1.53)     12.3488 (1.0)           1;0  1.4591 (0.66)          5           3
test_plots-plots-show[main]       681.8112 (1.56)     751.8150 (1.63)     708.3948 (1.57)     26.7334 (3.39)     703.7060 (1.56)     31.3676 (2.54)          1;0  1.4116 (0.64)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     466.5732 (1.0)      493.5257 (1.0)      476.9976 (1.0)      10.5015 (1.38)     472.8336 (1.0)      13.4511 (1.35)          1;0  2.0964 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     875.2164 (1.88)     893.0636 (1.81)     885.9568 (1.86)      7.5965 (1.0)      888.5729 (1.88)     12.5116 (1.26)          1;0  1.1287 (0.54)          5           3
test_plots-plots-show-json[3.53.2]     717.2631 (1.54)     735.6580 (1.49)     729.6106 (1.53)      7.6400 (1.01)     733.6966 (1.55)      9.9339 (1.0)           1;0  1.3706 (0.65)          5           3
test_plots-plots-show-json[main]       729.6764 (1.56)     757.1998 (1.53)     748.6449 (1.57)     11.0817 (1.46)     752.3248 (1.59)     11.8568 (1.19)          1;0  1.3357 (0.64)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     54.5026 (2.33)     54.5026 (2.33)     54.5026 (2.33)     0.0000 (1.0)      54.5026 (2.33)     0.0000 (1.0)           0;0  0.0183 (0.43)          1           1
test_push-push[3.10.0]     46.8277 (2.00)     46.8277 (2.00)     46.8277 (2.00)     0.0000 (1.0)      46.8277 (2.00)     0.0000 (1.0)           0;0  0.0214 (0.50)          1           1
test_push-push[3.53.2]     23.9694 (1.03)     23.9694 (1.03)     23.9694 (1.03)     0.0000 (1.0)      23.9694 (1.03)     0.0000 (1.0)           0;0  0.0417 (0.98)          1           1
test_push-push[main]       23.3831 (1.0)      23.3831 (1.0)      23.3831 (1.0)      0.0000 (1.0)      23.3831 (1.0)      0.0000 (1.0)           0;0  0.0428 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     67.6834 (2.82)     67.6834 (2.82)     67.6834 (2.82)     0.0000 (1.0)      67.6834 (2.82)     0.0000 (1.0)           0;0  0.0148 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.0048 (2.95)     71.0048 (2.95)     71.0048 (2.95)     0.0000 (1.0)      71.0048 (2.95)     0.0000 (1.0)           0;0  0.0141 (0.34)          1           1
test_sharing-fetch[3.53.2]     35.8119 (1.49)     35.8119 (1.49)     35.8119 (1.49)     0.0000 (1.0)      35.8119 (1.49)     0.0000 (1.0)           0;0  0.0279 (0.67)          1           1
test_sharing-fetch[main]       24.0364 (1.0)      24.0364 (1.0)      24.0364 (1.0)      0.0000 (1.0)      24.0364 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3965 (1.0)      1.3965 (1.0)      1.3965 (1.0)      0.0000 (1.0)      1.3965 (1.0)      0.0000 (1.0)           0;0  0.7161 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7361 (2.68)     3.7361 (2.68)     3.7361 (2.68)     0.0000 (1.0)      3.7361 (2.68)     0.0000 (1.0)           0;0  0.2677 (0.37)          1           1
test_sharing-fetch-noop[3.53.2]     6.2185 (4.45)     6.2185 (4.45)     6.2185 (4.45)     0.0000 (1.0)      6.2185 (4.45)     0.0000 (1.0)           0;0  0.1608 (0.22)          1           1
test_sharing-fetch-noop[main]       6.3852 (4.57)     6.3852 (4.57)     6.3852 (4.57)     0.0000 (1.0)      6.3852 (4.57)     0.0000 (1.0)           0;0  0.1566 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.4026 (2.38)     53.4026 (2.38)     53.4026 (2.38)     0.0000 (1.0)      53.4026 (2.38)     0.0000 (1.0)           0;0  0.0187 (0.42)          1           1
test_sharing-push[3.10.0]     45.8256 (2.05)     45.8256 (2.05)     45.8256 (2.05)     0.0000 (1.0)      45.8256 (2.05)     0.0000 (1.0)           0;0  0.0218 (0.49)          1           1
test_sharing-push[3.53.2]     23.1589 (1.03)     23.1589 (1.03)     23.1589 (1.03)     0.0000 (1.0)      23.1589 (1.03)     0.0000 (1.0)           0;0  0.0432 (0.97)          1           1
test_sharing-push[main]       22.4060 (1.0)      22.4060 (1.0)      22.4060 (1.0)      0.0000 (1.0)      22.4060 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.6238 (1.15)     2.6238 (1.15)     2.6238 (1.15)     0.0000 (1.0)      2.6238 (1.15)     0.0000 (1.0)           0;0  0.3811 (0.87)          1           1
test_sharing-push-noop[3.10.0]     2.2895 (1.0)      2.2895 (1.0)      2.2895 (1.0)      0.0000 (1.0)      2.2895 (1.0)      0.0000 (1.0)           0;0  0.4368 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.6073 (2.89)     6.6073 (2.89)     6.6073 (2.89)     0.0000 (1.0)      6.6073 (2.89)     0.0000 (1.0)           0;0  0.1513 (0.35)          1           1
test_sharing-push-noop[main]       6.7465 (2.95)     6.7465 (2.95)     6.7465 (2.95)     0.0000 (1.0)      6.7465 (2.95)     0.0000 (1.0)           0;0  0.1482 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     335.4099 (1.02)     335.4099 (1.02)     335.4099 (1.02)     0.0000 (1.0)      335.4099 (1.02)     0.0000 (1.0)           0;0  0.0030 (0.98)          1           1
test_sharing_azure-fetch[main]       330.1234 (1.0)      330.1234 (1.0)      330.1234 (1.0)      0.0000 (1.0)      330.1234 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     7.3076 (1.0)      7.3076 (1.0)      7.3076 (1.0)      0.0000 (1.0)      7.3076 (1.0)      0.0000 (1.0)           0;0  0.1368 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       7.5228 (1.03)     7.5228 (1.03)     7.5228 (1.03)     0.0000 (1.0)      7.5228 (1.03)     0.0000 (1.0)           0;0  0.1329 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     334.2194 (1.0)      334.2194 (1.0)      334.2194 (1.0)      0.0000 (1.0)      334.2194 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
test_sharing_azure-push[main]       338.5158 (1.01)     338.5158 (1.01)     338.5158 (1.01)     0.0000 (1.0)      338.5158 (1.01)     0.0000 (1.0)           0;0  0.0030 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.2591 (1.00)     8.2591 (1.00)     8.2591 (1.00)     0.0000 (1.0)      8.2591 (1.00)     0.0000 (1.0)           0;0  0.1211 (1.00)          1           1
test_sharing_azure-push-noop[main]       8.2571 (1.0)      8.2571 (1.0)      8.2571 (1.0)      0.0000 (1.0)      8.2571 (1.0)      0.0000 (1.0)           0;0  0.1211 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     493.4909 (1.05)     493.4909 (1.05)     493.4909 (1.05)     0.0000 (1.0)      493.4909 (1.05)     0.0000 (1.0)           0;0  0.0020 (0.96)          1           1
test_sharing_gs-fetch[main]       471.8087 (1.0)      471.8087 (1.0)      471.8087 (1.0)      0.0000 (1.0)      471.8087 (1.0)      0.0000 (1.0)           0;0  0.0021 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.9557 (1.0)      7.9557 (1.0)      7.9557 (1.0)      0.0000 (1.0)      7.9557 (1.0)      0.0000 (1.0)           0;0  0.1257 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       8.1705 (1.03)     8.1705 (1.03)     8.1705 (1.03)     0.0000 (1.0)      8.1705 (1.03)     0.0000 (1.0)           0;0  0.1224 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     950.2962 (1.0)      950.2962 (1.0)      950.2962 (1.0)      0.0000 (1.0)      950.2962 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
test_sharing_gs-push[main]       971.7348 (1.02)     971.7348 (1.02)     971.7348 (1.02)     0.0000 (1.0)      971.7348 (1.02)     0.0000 (1.0)           0;0  0.0010 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.7633 (1.0)      7.7633 (1.0)      7.7633 (1.0)      0.0000 (1.0)      7.7633 (1.0)      0.0000 (1.0)           0;0  0.1288 (1.0)           1           1
test_sharing_gs-push-noop[main]       8.0067 (1.03)     8.0067 (1.03)     8.0067 (1.03)     0.0000 (1.0)      8.0067 (1.03)     0.0000 (1.0)           0;0  0.1249 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     245.0395 (1.04)     245.0395 (1.04)     245.0395 (1.04)     0.0000 (1.0)      245.0395 (1.04)     0.0000 (1.0)           0;0  0.0041 (0.97)          1           1
test_sharing_s3-fetch[main]       236.5726 (1.0)      236.5726 (1.0)      236.5726 (1.0)      0.0000 (1.0)      236.5726 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6873 (1.0)      6.6873 (1.0)      6.6873 (1.0)      0.0000 (1.0)      6.6873 (1.0)      0.0000 (1.0)           0;0  0.1495 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.8222 (1.02)     6.8222 (1.02)     6.8222 (1.02)     0.0000 (1.0)      6.8222 (1.02)     0.0000 (1.0)           0;0  0.1466 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     320.8091 (1.00)     320.8091 (1.00)     320.8091 (1.00)     0.0000 (1.0)      320.8091 (1.00)     0.0000 (1.0)           0;0  0.0031 (1.00)          1           1
test_sharing_s3-push[main]       319.8035 (1.0)      319.8035 (1.0)      319.8035 (1.0)      0.0000 (1.0)      319.8035 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9291 (1.0)      6.9291 (1.0)      6.9291 (1.0)      0.0000 (1.0)      6.9291 (1.0)      0.0000 (1.0)           0;0  0.1443 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.0449 (1.02)     7.0449 (1.02)     7.0449 (1.02)     0.0000 (1.0)      7.0449 (1.02)     0.0000 (1.0)           0;0  0.1419 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.6511 (3.76)     21.6511 (3.76)     21.6511 (3.76)     0.0000 (1.0)      21.6511 (3.76)     0.0000 (1.0)           0;0  0.0462 (0.27)          1           1
test_status-status[3.10.0]     21.1758 (3.68)     21.1758 (3.68)     21.1758 (3.68)     0.0000 (1.0)      21.1758 (3.68)     0.0000 (1.0)           0;0  0.0472 (0.27)          1           1
test_status-status[3.53.2]     19.1842 (3.33)     19.1842 (3.33)     19.1842 (3.33)     0.0000 (1.0)      19.1842 (3.33)     0.0000 (1.0)           0;0  0.0521 (0.30)          1           1
test_status-status[main]        5.7585 (1.0)       5.7585 (1.0)       5.7585 (1.0)      0.0000 (1.0)       5.7585 (1.0)      0.0000 (1.0)           0;0  0.1737 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.2087 (1.86)     5.2087 (1.86)     5.2087 (1.86)     0.0000 (1.0)      5.2087 (1.86)     0.0000 (1.0)           0;0  0.1920 (0.54)          1           1
test_status-status-changed[3.10.0]     5.0686 (1.81)     5.0686 (1.81)     5.0686 (1.81)     0.0000 (1.0)      5.0686 (1.81)     0.0000 (1.0)           0;0  0.1973 (0.55)          1           1
test_status-status-changed[3.53.2]     5.0542 (1.80)     5.0542 (1.80)     5.0542 (1.80)     0.0000 (1.0)      5.0542 (1.80)     0.0000 (1.0)           0;0  0.1979 (0.56)          1           1
test_status-status-changed[main]       2.8057 (1.0)      2.8057 (1.0)      2.8057 (1.0)      0.0000 (1.0)      2.8057 (1.0)      0.0000 (1.0)           0;0  0.3564 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.2369 (1.88)     5.2369 (1.88)     5.2369 (1.88)     0.0000 (1.0)      5.2369 (1.88)     0.0000 (1.0)           0;0  0.1910 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     5.0378 (1.81)     5.0378 (1.81)     5.0378 (1.81)     0.0000 (1.0)      5.0378 (1.81)     0.0000 (1.0)           0;0  0.1985 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     4.7950 (1.72)     4.7950 (1.72)     4.7950 (1.72)     0.0000 (1.0)      4.7950 (1.72)     0.0000 (1.0)           0;0  0.2086 (0.58)          1           1
test_status-status-changed-noop[main]       2.7818 (1.0)      2.7818 (1.0)      2.7818 (1.0)      0.0000 (1.0)      2.7818 (1.0)      0.0000 (1.0)           0;0  0.3595 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.3254 (1.91)     5.3254 (1.91)     5.3254 (1.91)     0.0000 (1.0)      5.3254 (1.91)     0.0000 (1.0)           0;0  0.1878 (0.52)          1           1
test_status-status-noop[3.10.0]     5.0851 (1.83)     5.0851 (1.83)     5.0851 (1.83)     0.0000 (1.0)      5.0851 (1.83)     0.0000 (1.0)           0;0  0.1967 (0.55)          1           1
test_status-status-noop[3.53.2]     4.9143 (1.77)     4.9143 (1.77)     4.9143 (1.77)     0.0000 (1.0)      4.9143 (1.77)     0.0000 (1.0)           0;0  0.2035 (0.57)          1           1
test_status-status-noop[main]       2.7819 (1.0)      2.7819 (1.0)      2.7819 (1.0)      0.0000 (1.0)      2.7819 (1.0)      0.0000 (1.0)           0;0  0.3595 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     169.9096 (3.53)     169.9096 (3.53)     169.9096 (3.53)     0.0000 (1.0)      169.9096 (3.53)     0.0000 (1.0)           0;0  0.0059 (0.28)          1           1
test_update-import-url[3.10.0]     166.7859 (3.47)     166.7859 (3.47)     166.7859 (3.47)     0.0000 (1.0)      166.7859 (3.47)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.53.2]     125.4077 (2.61)     125.4077 (2.61)     125.4077 (2.61)     0.0000 (1.0)      125.4077 (2.61)     0.0000 (1.0)           0;0  0.0080 (0.38)          1           1
test_update-import-url[main]        48.1025 (1.0)       48.1025 (1.0)       48.1025 (1.0)      0.0000 (1.0)       48.1025 (1.0)      0.0000 (1.0)           0;0  0.0208 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     150.9767 (4.10)     150.9767 (4.10)     150.9767 (4.10)     0.0000 (1.0)      150.9767 (4.10)     0.0000 (1.0)           0;0  0.0066 (0.24)          1           1
test_update-update[3.10.0]     149.1169 (4.05)     149.1169 (4.05)     149.1169 (4.05)     0.0000 (1.0)      149.1169 (4.05)     0.0000 (1.0)           0;0  0.0067 (0.25)          1           1
test_update-update[3.53.2]     113.5572 (3.08)     113.5572 (3.08)     113.5572 (3.08)     0.0000 (1.0)      113.5572 (3.08)     0.0000 (1.0)           0;0  0.0088 (0.32)          1           1
test_update-update[main]        36.8294 (1.0)       36.8294 (1.0)       36.8294 (1.0)      0.0000 (1.0)       36.8294 (1.0)      0.0000 (1.0)           0;0  0.0272 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     18.4071 (2.27)     18.4071 (2.27)     18.4071 (2.27)     0.0000 (1.0)      18.4071 (2.27)     0.0000 (1.0)           0;0  0.0543 (0.44)          1           1
test_update-update-noop[3.10.0]     17.9135 (2.21)     17.9135 (2.21)     17.9135 (2.21)     0.0000 (1.0)      17.9135 (2.21)     0.0000 (1.0)           0;0  0.0558 (0.45)          1           1
test_update-update-noop[3.53.2]     16.4873 (2.03)     16.4873 (2.03)     16.4873 (2.03)     0.0000 (1.0)      16.4873 (2.03)     0.0000 (1.0)           0;0  0.0607 (0.49)          1           1
test_update-update-noop[main]        8.1171 (1.0)       8.1171 (1.0)       8.1171 (1.0)      0.0000 (1.0)       8.1171 (1.0)      0.0000 (1.0)           0;0  0.1232 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean