Wed Mar 26 00:52:07 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.6900 (3.86)     92.6900 (3.86)     92.6900 (3.86)     0.0000 (1.0)      92.6900 (3.86)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_add_copy-add[3.10.0]     95.3734 (3.97)     95.3734 (3.97)     95.3734 (3.97)     0.0000 (1.0)      95.3734 (3.97)     0.0000 (1.0)           0;0  0.0105 (0.25)          1           1
test_add_copy-add[3.53.2]     84.7467 (3.52)     84.7467 (3.52)     84.7467 (3.52)     0.0000 (1.0)      84.7467 (3.52)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_add_copy-add[main]       24.0431 (1.0)      24.0431 (1.0)      24.0431 (1.0)      0.0000 (1.0)      24.0431 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.6719 (6.59)     31.6719 (6.59)     31.6719 (6.59)     0.0000 (1.0)      31.6719 (6.59)     0.0000 (1.0)           0;0  0.0316 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     32.2518 (6.71)     32.2518 (6.71)     32.2518 (6.71)     0.0000 (1.0)      32.2518 (6.71)     0.0000 (1.0)           0;0  0.0310 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     31.4115 (6.54)     31.4115 (6.54)     31.4115 (6.54)     0.0000 (1.0)      31.4115 (6.54)     0.0000 (1.0)           0;0  0.0318 (0.15)          1           1
test_add_copy-add-noop[main]        4.8051 (1.0)       4.8051 (1.0)       4.8051 (1.0)      0.0000 (1.0)       4.8051 (1.0)      0.0000 (1.0)           0;0  0.2081 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     72.3602 (3.94)     72.3602 (3.94)     72.3602 (3.94)     0.0000 (1.0)      72.3602 (3.94)     0.0000 (1.0)           0;0  0.0138 (0.25)          1           1
test_add_hardlink-add[3.10.0]     74.0215 (4.03)     74.0215 (4.03)     74.0215 (4.03)     0.0000 (1.0)      74.0215 (4.03)     0.0000 (1.0)           0;0  0.0135 (0.25)          1           1
test_add_hardlink-add[3.53.2]     68.3899 (3.73)     68.3899 (3.73)     68.3899 (3.73)     0.0000 (1.0)      68.3899 (3.73)     0.0000 (1.0)           0;0  0.0146 (0.27)          1           1
test_add_hardlink-add[main]       18.3532 (1.0)      18.3532 (1.0)      18.3532 (1.0)      0.0000 (1.0)      18.3532 (1.0)      0.0000 (1.0)           0;0  0.0545 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.8777 (7.55)     36.8777 (7.55)     36.8777 (7.55)     0.0000 (1.0)      36.8777 (7.55)     0.0000 (1.0)           0;0  0.0271 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.6914 (7.71)     37.6914 (7.71)     37.6914 (7.71)     0.0000 (1.0)      37.6914 (7.71)     0.0000 (1.0)           0;0  0.0265 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.4323 (7.25)     35.4323 (7.25)     35.4323 (7.25)     0.0000 (1.0)      35.4323 (7.25)     0.0000 (1.0)           0;0  0.0282 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.8864 (1.0)       4.8864 (1.0)       4.8864 (1.0)      0.0000 (1.0)       4.8864 (1.0)      0.0000 (1.0)           0;0  0.2047 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     77.6605 (2.09)     77.6605 (2.09)     77.6605 (2.09)     0.0000 (1.0)      77.6605 (2.09)     0.0000 (1.0)           0;0  0.0129 (0.48)          1           1
test_add_symlink-add[3.10.0]     78.9455 (2.13)     78.9455 (2.13)     78.9455 (2.13)     0.0000 (1.0)      78.9455 (2.13)     0.0000 (1.0)           0;0  0.0127 (0.47)          1           1
test_add_symlink-add[3.53.2]     73.9163 (1.99)     73.9163 (1.99)     73.9163 (1.99)     0.0000 (1.0)      73.9163 (1.99)     0.0000 (1.0)           0;0  0.0135 (0.50)          1           1
test_add_symlink-add[main]       37.0870 (1.0)      37.0870 (1.0)      37.0870 (1.0)      0.0000 (1.0)      37.0870 (1.0)      0.0000 (1.0)           0;0  0.0270 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     49.4173 (8.34)     49.4173 (8.34)     49.4173 (8.34)     0.0000 (1.0)      49.4173 (8.34)     0.0000 (1.0)           0;0  0.0202 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     50.6106 (8.54)     50.6106 (8.54)     50.6106 (8.54)     0.0000 (1.0)      50.6106 (8.54)     0.0000 (1.0)           0;0  0.0198 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.7380 (8.23)     48.7380 (8.23)     48.7380 (8.23)     0.0000 (1.0)      48.7380 (8.23)     0.0000 (1.0)           0;0  0.0205 (0.12)          1           1
test_add_symlink-add-noop[main]        5.9230 (1.0)       5.9230 (1.0)       5.9230 (1.0)      0.0000 (1.0)       5.9230 (1.0)      0.0000 (1.0)           0;0  0.1688 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     44.1203 (1.95)     44.1203 (1.95)     44.1203 (1.95)     0.0000 (1.0)      44.1203 (1.95)     0.0000 (1.0)           0;0  0.0227 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     62.8478 (2.77)     62.8478 (2.77)     62.8478 (2.77)     0.0000 (1.0)      62.8478 (2.77)     0.0000 (1.0)           0;0  0.0159 (0.36)          1           1
test_checkout_copy-checkout[3.53.2]     30.9055 (1.36)     30.9055 (1.36)     30.9055 (1.36)     0.0000 (1.0)      30.9055 (1.36)     0.0000 (1.0)           0;0  0.0324 (0.73)          1           1
test_checkout_copy-checkout[main]       22.6648 (1.0)      22.6648 (1.0)      22.6648 (1.0)      0.0000 (1.0)      22.6648 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.9724 (1.48)     5.9724 (1.48)     5.9724 (1.48)     0.0000 (1.0)      5.9724 (1.48)     0.0000 (1.0)           0;0  0.1674 (0.68)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.2871 (1.56)     6.2871 (1.56)     6.2871 (1.56)     0.0000 (1.0)      6.2871 (1.56)     0.0000 (1.0)           0;0  0.1591 (0.64)          1           1
test_checkout_copy-checkout-noop[3.53.2]     6.1519 (1.52)     6.1519 (1.52)     6.1519 (1.52)     0.0000 (1.0)      6.1519 (1.52)     0.0000 (1.0)           0;0  0.1626 (0.66)          1           1
test_checkout_copy-checkout-noop[main]       4.0410 (1.0)      4.0410 (1.0)      4.0410 (1.0)      0.0000 (1.0)      4.0410 (1.0)      0.0000 (1.0)           0;0  0.2475 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.9426 (1.91)     8.9426 (1.91)     8.9426 (1.91)     0.0000 (1.0)      8.9426 (1.91)     0.0000 (1.0)           0;0  0.1118 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     7.1441 (1.53)     7.1441 (1.53)     7.1441 (1.53)     0.0000 (1.0)      7.1441 (1.53)     0.0000 (1.0)           0;0  0.1400 (0.66)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.8850 (1.47)     6.8850 (1.47)     6.8850 (1.47)     0.0000 (1.0)      6.8850 (1.47)     0.0000 (1.0)           0;0  0.1452 (0.68)          1           1
test_checkout_copy-checkout-update[main]       4.6834 (1.0)      4.6834 (1.0)      4.6834 (1.0)      0.0000 (1.0)      4.6834 (1.0)      0.0000 (1.0)           0;0  0.2135 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.5466 (2.95)     25.5466 (2.95)     25.5466 (2.95)     0.0000 (1.0)      25.5466 (2.95)     0.0000 (1.0)           0;0  0.0391 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.8333 (2.17)     18.8333 (2.17)     18.8333 (2.17)     0.0000 (1.0)      18.8333 (2.17)     0.0000 (1.0)           0;0  0.0531 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.9772 (1.96)     16.9772 (1.96)     16.9772 (1.96)     0.0000 (1.0)      16.9772 (1.96)     0.0000 (1.0)           0;0  0.0589 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.6703 (1.0)       8.6703 (1.0)       8.6703 (1.0)      0.0000 (1.0)       8.6703 (1.0)      0.0000 (1.0)           0;0  0.1153 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.2615 (1.51)     6.2615 (1.51)     6.2615 (1.51)     0.0000 (1.0)      6.2615 (1.51)     0.0000 (1.0)           0;0  0.1597 (0.66)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.4328 (1.55)     6.4328 (1.55)     6.4328 (1.55)     0.0000 (1.0)      6.4328 (1.55)     0.0000 (1.0)           0;0  0.1555 (0.64)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     6.1335 (1.48)     6.1335 (1.48)     6.1335 (1.48)     0.0000 (1.0)      6.1335 (1.48)     0.0000 (1.0)           0;0  0.1630 (0.68)          1           1
test_checkout_hardlink-checkout-noop[main]       4.1430 (1.0)      4.1430 (1.0)      4.1430 (1.0)      0.0000 (1.0)      4.1430 (1.0)      0.0000 (1.0)           0;0  0.2414 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     9.2738 (1.95)     9.2738 (1.95)     9.2738 (1.95)     0.0000 (1.0)      9.2738 (1.95)     0.0000 (1.0)           0;0  0.1078 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     7.3906 (1.55)     7.3906 (1.55)     7.3906 (1.55)     0.0000 (1.0)      7.3906 (1.55)     0.0000 (1.0)           0;0  0.1353 (0.64)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     7.1858 (1.51)     7.1858 (1.51)     7.1858 (1.51)     0.0000 (1.0)      7.1858 (1.51)     0.0000 (1.0)           0;0  0.1392 (0.66)          1           1
test_checkout_hardlink-checkout-update[main]       4.7588 (1.0)      4.7588 (1.0)      4.7588 (1.0)      0.0000 (1.0)      4.7588 (1.0)      0.0000 (1.0)           0;0  0.2101 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.5856 (2.49)     28.5856 (2.49)     28.5856 (2.49)     0.0000 (1.0)      28.5856 (2.49)     0.0000 (1.0)           0;0  0.0350 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     22.1265 (1.93)     22.1265 (1.93)     22.1265 (1.93)     0.0000 (1.0)      22.1265 (1.93)     0.0000 (1.0)           0;0  0.0452 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     20.2770 (1.76)     20.2770 (1.76)     20.2770 (1.76)     0.0000 (1.0)      20.2770 (1.76)     0.0000 (1.0)           0;0  0.0493 (0.57)          1           1
test_checkout_symlink-checkout[main]       11.4903 (1.0)      11.4903 (1.0)      11.4903 (1.0)      0.0000 (1.0)      11.4903 (1.0)      0.0000 (1.0)           0;0  0.0870 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.1191 (1.48)     7.1191 (1.48)     7.1191 (1.48)     0.0000 (1.0)      7.1191 (1.48)     0.0000 (1.0)           0;0  0.1405 (0.68)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.4148 (1.54)     7.4148 (1.54)     7.4148 (1.54)     0.0000 (1.0)      7.4148 (1.54)     0.0000 (1.0)           0;0  0.1349 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.2171 (1.50)     7.2171 (1.50)     7.2171 (1.50)     0.0000 (1.0)      7.2171 (1.50)     0.0000 (1.0)           0;0  0.1386 (0.67)          1           1
test_checkout_symlink-checkout-noop[main]       4.8093 (1.0)      4.8093 (1.0)      4.8093 (1.0)      0.0000 (1.0)      4.8093 (1.0)      0.0000 (1.0)           0;0  0.2079 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.9514 (1.74)     10.9514 (1.74)     10.9514 (1.74)     0.0000 (1.0)      10.9514 (1.74)     0.0000 (1.0)           0;0  0.0913 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.0913 (1.44)      9.0913 (1.44)      9.0913 (1.44)     0.0000 (1.0)       9.0913 (1.44)     0.0000 (1.0)           0;0  0.1100 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.8932 (1.41)      8.8932 (1.41)      8.8932 (1.41)     0.0000 (1.0)       8.8932 (1.41)     0.0000 (1.0)           0;0  0.1124 (0.71)          1           1
test_checkout_symlink-checkout-update[main]        6.2950 (1.0)       6.2950 (1.0)       6.2950 (1.0)      0.0000 (1.0)       6.2950 (1.0)      0.0000 (1.0)           0;0  0.1589 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.4061 (1.71)     4.4061 (1.71)     4.4061 (1.71)     0.0000 (1.0)      4.4061 (1.71)     0.0000 (1.0)           0;0  0.2270 (0.59)          1           1
test_data_status-data-changed[3.10.0]     5.1861 (2.01)     5.1861 (2.01)     5.1861 (2.01)     0.0000 (1.0)      5.1861 (2.01)     0.0000 (1.0)           0;0  0.1928 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.8873 (1.90)     4.8873 (1.90)     4.8873 (1.90)     0.0000 (1.0)      4.8873 (1.90)     0.0000 (1.0)           0;0  0.2046 (0.53)          1           1
test_data_status-data-changed[main]       2.5781 (1.0)      2.5781 (1.0)      2.5781 (1.0)      0.0000 (1.0)      2.5781 (1.0)      0.0000 (1.0)           0;0  0.3879 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.4253 (1.68)     4.4253 (1.68)     4.4253 (1.68)     0.0000 (1.0)      4.4253 (1.68)     0.0000 (1.0)           0;0  0.2260 (0.60)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0717 (1.92)     5.0717 (1.92)     5.0717 (1.92)     0.0000 (1.0)      5.0717 (1.92)     0.0000 (1.0)           0;0  0.1972 (0.52)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8168 (1.83)     4.8168 (1.83)     4.8168 (1.83)     0.0000 (1.0)      4.8168 (1.83)     0.0000 (1.0)           0;0  0.2076 (0.55)          1           1
test_data_status-data-changed-noop[main]       2.6389 (1.0)      2.6389 (1.0)      2.6389 (1.0)      0.0000 (1.0)      2.6389 (1.0)      0.0000 (1.0)           0;0  0.3789 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.8755 (3.82)     20.8755 (3.82)     20.8755 (3.82)     0.0000 (1.0)      20.8755 (3.82)     0.0000 (1.0)           0;0  0.0479 (0.26)          1           1
test_data_status-data-new[3.10.0]     21.7994 (3.99)     21.7994 (3.99)     21.7994 (3.99)     0.0000 (1.0)      21.7994 (3.99)     0.0000 (1.0)           0;0  0.0459 (0.25)          1           1
test_data_status-data-new[3.53.2]     21.4947 (3.94)     21.4947 (3.94)     21.4947 (3.94)     0.0000 (1.0)      21.4947 (3.94)     0.0000 (1.0)           0;0  0.0465 (0.25)          1           1
test_data_status-data-new[main]        5.4608 (1.0)       5.4608 (1.0)       5.4608 (1.0)      0.0000 (1.0)       5.4608 (1.0)      0.0000 (1.0)           0;0  0.1831 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.6855 (1.74)     4.6855 (1.74)     4.6855 (1.74)     0.0000 (1.0)      4.6855 (1.74)     0.0000 (1.0)           0;0  0.2134 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.9029 (1.82)     4.9029 (1.82)     4.9029 (1.82)     0.0000 (1.0)      4.9029 (1.82)     0.0000 (1.0)           0;0  0.2040 (0.55)          1           1
test_data_status-data-noop[3.53.2]     4.8688 (1.81)     4.8688 (1.81)     4.8688 (1.81)     0.0000 (1.0)      4.8688 (1.81)     0.0000 (1.0)           0;0  0.2054 (0.55)          1           1
test_data_status-data-noop[main]       2.6962 (1.0)      2.6962 (1.0)      2.6962 (1.0)      0.0000 (1.0)      2.6962 (1.0)      0.0000 (1.0)           0;0  0.3709 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.1503 (1.08)     20.1503 (1.08)     20.1503 (1.08)     0.0000 (1.0)      20.1503 (1.08)     0.0000 (1.0)           0;0  0.0496 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.8095 (1.12)     20.8095 (1.12)     20.8095 (1.12)     0.0000 (1.0)      20.8095 (1.12)     0.0000 (1.0)           0;0  0.0481 (0.89)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.6048 (1.11)     20.6048 (1.11)     20.6048 (1.11)     0.0000 (1.0)      20.6048 (1.11)     0.0000 (1.0)           0;0  0.0485 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       18.5811 (1.0)      18.5811 (1.0)      18.5811 (1.0)      0.0000 (1.0)      18.5811 (1.0)      0.0000 (1.0)           0;0  0.0538 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.2490 (1.07)     20.2490 (1.07)     20.2490 (1.07)     0.0000 (1.0)      20.2490 (1.07)     0.0000 (1.0)           0;0  0.0494 (0.93)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.0031 (1.11)     21.0031 (1.11)     21.0031 (1.11)     0.0000 (1.0)      21.0031 (1.11)     0.0000 (1.0)           0;0  0.0476 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.7767 (1.10)     20.7767 (1.10)     20.7767 (1.10)     0.0000 (1.0)      20.7767 (1.10)     0.0000 (1.0)           0;0  0.0481 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.9179 (1.0)      18.9179 (1.0)      18.9179 (1.0)      0.0000 (1.0)      18.9179 (1.0)      0.0000 (1.0)           0;0  0.0529 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.3475 (1.71)     36.3475 (1.71)     36.3475 (1.71)     0.0000 (1.0)      36.3475 (1.71)     0.0000 (1.0)           0;0  0.0275 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     36.8887 (1.73)     36.8887 (1.73)     36.8887 (1.73)     0.0000 (1.0)      36.8887 (1.73)     0.0000 (1.0)           0;0  0.0271 (0.58)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.7620 (1.73)     36.7620 (1.73)     36.7620 (1.73)     0.0000 (1.0)      36.7620 (1.73)     0.0000 (1.0)           0;0  0.0272 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.2664 (1.0)      21.2664 (1.0)      21.2664 (1.0)      0.0000 (1.0)      21.2664 (1.0)      0.0000 (1.0)           0;0  0.0470 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.3779 (1.08)     19.3779 (1.08)     19.3779 (1.08)     0.0000 (1.0)      19.3779 (1.08)     0.0000 (1.0)           0;0  0.0516 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.1021 (1.12)     20.1021 (1.12)     20.1021 (1.12)     0.0000 (1.0)      20.1021 (1.12)     0.0000 (1.0)           0;0  0.0497 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.7432 (1.10)     19.7432 (1.10)     19.7432 (1.10)     0.0000 (1.0)      19.7432 (1.10)     0.0000 (1.0)           0;0  0.0507 (0.91)          1           1
test_data_status_all_flags-data-noop[main]       17.9092 (1.0)      17.9092 (1.0)      17.9092 (1.0)      0.0000 (1.0)      17.9092 (1.0)      0.0000 (1.0)           0;0  0.0558 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.4798 (2.58)     20.4798 (2.58)     20.4798 (2.58)     0.0000 (1.0)      20.4798 (2.58)     0.0000 (1.0)           0;0  0.0488 (0.39)          1           1
test_diff-diff[3.10.0]     21.8250 (2.75)     21.8250 (2.75)     21.8250 (2.75)     0.0000 (1.0)      21.8250 (2.75)     0.0000 (1.0)           0;0  0.0458 (0.36)          1           1
test_diff-diff[3.53.2]     22.1593 (2.79)     22.1593 (2.79)     22.1593 (2.79)     0.0000 (1.0)      22.1593 (2.79)     0.0000 (1.0)           0;0  0.0451 (0.36)          1           1
test_diff-diff[main]        7.9396 (1.0)       7.9396 (1.0)       7.9396 (1.0)      0.0000 (1.0)       7.9396 (1.0)      0.0000 (1.0)           0;0  0.1260 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.7612 (1.71)     6.7612 (1.71)     6.7612 (1.71)     0.0000 (1.0)      6.7612 (1.71)     0.0000 (1.0)           0;0  0.1479 (0.59)          1           1
test_diff-diff-changed[3.10.0]     7.5409 (1.90)     7.5409 (1.90)     7.5409 (1.90)     0.0000 (1.0)      7.5409 (1.90)     0.0000 (1.0)           0;0  0.1326 (0.53)          1           1
test_diff-diff-changed[3.53.2]     6.1823 (1.56)     6.1823 (1.56)     6.1823 (1.56)     0.0000 (1.0)      6.1823 (1.56)     0.0000 (1.0)           0;0  0.1618 (0.64)          1           1
test_diff-diff-changed[main]       3.9616 (1.0)      3.9616 (1.0)      3.9616 (1.0)      0.0000 (1.0)      3.9616 (1.0)      0.0000 (1.0)           0;0  0.2524 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.9035 (1.49)     5.9035 (1.49)     5.9035 (1.49)     0.0000 (1.0)      5.9035 (1.49)     0.0000 (1.0)           0;0  0.1694 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     6.3780 (1.61)     6.3780 (1.61)     6.3780 (1.61)     0.0000 (1.0)      6.3780 (1.61)     0.0000 (1.0)           0;0  0.1568 (0.62)          1           1
test_diff-diff-changed-noop[3.53.2]     6.1408 (1.55)     6.1408 (1.55)     6.1408 (1.55)     0.0000 (1.0)      6.1408 (1.55)     0.0000 (1.0)           0;0  0.1628 (0.65)          1           1
test_diff-diff-changed-noop[main]       3.9633 (1.0)      3.9633 (1.0)      3.9633 (1.0)      0.0000 (1.0)      3.9633 (1.0)      0.0000 (1.0)           0;0  0.2523 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.5059 (1.12)     4.5059 (1.12)     4.5059 (1.12)     0.0000 (1.0)      4.5059 (1.12)     0.0000 (1.0)           0;0  0.2219 (0.89)          1           1
test_diff-diff-noop[3.10.0]     5.0241 (1.25)     5.0241 (1.25)     5.0241 (1.25)     0.0000 (1.0)      5.0241 (1.25)     0.0000 (1.0)           0;0  0.1990 (0.80)          1           1
test_diff-diff-noop[3.53.2]     6.2082 (1.54)     6.2082 (1.54)     6.2082 (1.54)     0.0000 (1.0)      6.2082 (1.54)     0.0000 (1.0)           0;0  0.1611 (0.65)          1           1
test_diff-diff-noop[main]       4.0250 (1.0)      4.0250 (1.0)      4.0250 (1.0)      0.0000 (1.0)      4.0250 (1.0)      0.0000 (1.0)           0;0  0.2484 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0052 (1.0)       1.0052 (1.0)       1.0052 (1.0)      0.0000 (1.0)       1.0052 (1.0)      0.0000 (1.0)           0;0  0.9948 (1.0)           1           1
test_exp_show-exp[3.10.0]     17.4090 (17.32)    17.4090 (17.32)    17.4090 (17.32)    0.0000 (1.0)      17.4090 (17.32)    0.0000 (1.0)           0;0  0.0574 (0.06)          1           1
test_exp_show-exp[3.53.2]      9.5342 (9.48)      9.5342 (9.48)      9.5342 (9.48)     0.0000 (1.0)       9.5342 (9.48)     0.0000 (1.0)           0;0  0.1049 (0.11)          1           1
test_exp_show-exp[main]       12.7783 (12.71)    12.7783 (12.71)    12.7783 (12.71)    0.0000 (1.0)      12.7783 (12.71)    0.0000 (1.0)           0;0  0.0783 (0.08)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     69.1930 (2.73)     69.1930 (2.73)     69.1930 (2.73)     0.0000 (1.0)      69.1930 (2.73)     0.0000 (1.0)           0;0  0.0145 (0.37)          1           1
test_fetch-fetch[3.10.0]     75.0721 (2.97)     75.0721 (2.97)     75.0721 (2.97)     0.0000 (1.0)      75.0721 (2.97)     0.0000 (1.0)           0;0  0.0133 (0.34)          1           1
test_fetch-fetch[3.53.2]     37.6036 (1.49)     37.6036 (1.49)     37.6036 (1.49)     0.0000 (1.0)      37.6036 (1.49)     0.0000 (1.0)           0;0  0.0266 (0.67)          1           1
test_fetch-fetch[main]       25.3120 (1.0)      25.3120 (1.0)      25.3120 (1.0)      0.0000 (1.0)      25.3120 (1.0)      0.0000 (1.0)           0;0  0.0395 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9260 (1.0)      2.9260 (1.0)      2.9260 (1.0)      0.0000 (1.0)      2.9260 (1.0)      0.0000 (1.0)           0;0  0.3418 (1.0)           1           1
test_gc-gc[3.10.0]     3.0828 (1.05)     3.0828 (1.05)     3.0828 (1.05)     0.0000 (1.0)      3.0828 (1.05)     0.0000 (1.0)           0;0  0.3244 (0.95)          1           1
test_gc-gc[3.53.2]     2.9847 (1.02)     2.9847 (1.02)     2.9847 (1.02)     0.0000 (1.0)      2.9847 (1.02)     0.0000 (1.0)           0;0  0.3350 (0.98)          1           1
test_gc-gc[main]       3.0691 (1.05)     3.0691 (1.05)     3.0691 (1.05)     0.0000 (1.0)      3.0691 (1.05)     0.0000 (1.0)           0;0  0.3258 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     142.5477 (2.86)     142.5477 (2.86)     142.5477 (2.86)     0.0000 (1.0)      142.5477 (2.86)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.10.0]     166.1508 (3.33)     166.1508 (3.33)     166.1508 (3.33)     0.0000 (1.0)      166.1508 (3.33)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     144.9888 (2.90)     144.9888 (2.90)     144.9888 (2.90)     0.0000 (1.0)      144.9888 (2.90)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[main]        49.9227 (1.0)       49.9227 (1.0)       49.9227 (1.0)      0.0000 (1.0)       49.9227 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     46.0055 (2.69)     46.0055 (2.69)     46.0055 (2.69)     0.0000 (1.0)      46.0055 (2.69)     0.0000 (1.0)           0;0  0.0217 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.6477 (2.85)     48.6477 (2.85)     48.6477 (2.85)     0.0000 (1.0)      48.6477 (2.85)     0.0000 (1.0)           0;0  0.0206 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.1046 (1.00)     17.1046 (1.00)     17.1046 (1.00)     0.0000 (1.0)      17.1046 (1.00)     0.0000 (1.0)           0;0  0.0585 (1.00)          1           1
test_get_url-get-url[main]       17.0759 (1.0)      17.0759 (1.0)      17.0759 (1.0)      0.0000 (1.0)      17.0759 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     122.9875 (1.01)     173.5359 (1.33)     126.3183 (1.01)     5.1416 (3.04)     125.2461 (1.01)     2.3500 (1.81)          2;3  7.9165 (0.99)        100           1
test_help---help[3.10.0]     121.8926 (1.00)     130.7149 (1.0)      124.8882 (1.0)      1.8294 (1.08)     124.6646 (1.00)     2.3476 (1.80)         33;1  8.0072 (1.0)         100           1
test_help---help[3.53.2]     121.8776 (1.0)      157.6204 (1.21)     126.6007 (1.01)     6.9266 (4.09)     124.3153 (1.0)      2.4550 (1.89)          7;8  7.8989 (0.99)        100           1
test_help---help[main]       123.2417 (1.01)     136.8565 (1.05)     125.8446 (1.01)     1.6935 (1.0)      125.5279 (1.01)     1.3013 (1.0)          14;3  7.9463 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     232.8296 (2.99)     232.8296 (2.99)     232.8296 (2.99)     0.0000 (1.0)      232.8296 (2.99)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     261.4185 (3.36)     261.4185 (3.36)     261.4185 (3.36)     0.0000 (1.0)      261.4185 (3.36)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        77.8031 (1.0)       77.8031 (1.0)       77.8031 (1.0)      0.0000 (1.0)       77.8031 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     164.9490 (3.40)     164.9490 (3.40)     164.9490 (3.40)     0.0000 (1.0)      164.9490 (3.40)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.10.0]     168.2160 (3.47)     168.2160 (3.47)     168.2160 (3.47)     0.0000 (1.0)      168.2160 (3.47)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.2351 (2.60)     126.2351 (2.60)     126.2351 (2.60)     0.0000 (1.0)      126.2351 (2.60)     0.0000 (1.0)           0;0  0.0079 (0.38)          1           1
test_import_url-import-url[main]        48.5343 (1.0)       48.5343 (1.0)       48.5343 (1.0)      0.0000 (1.0)       48.5343 (1.0)      0.0000 (1.0)           0;0  0.0206 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     398.1526 (1.0)      449.2224 (1.00)     413.5829 (1.0)       8.4445 (1.20)     412.8080 (1.0)      10.3912 (1.07)         25;2  2.4179 (1.0)         100           1
test_init-init[3.10.0]     411.3785 (1.03)     447.6467 (1.0)      425.9896 (1.03)      7.0514 (1.0)      424.6793 (1.03)      9.7175 (1.0)          32;2  2.3475 (0.97)        100           1
test_init-init[3.53.2]     398.2119 (1.00)     449.1896 (1.00)     418.6501 (1.01)      9.2399 (1.31)     417.7781 (1.01)     13.5142 (1.39)         31;2  2.3886 (0.99)        100           1
test_init-init[main]       399.2219 (1.00)     511.8162 (1.14)     418.6429 (1.01)     17.9196 (2.54)     414.0649 (1.00)     11.4018 (1.17)          9;6  2.3887 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     583.5946 (1.09)     583.5946 (1.09)     583.5946 (1.09)     0.0000 (1.0)      583.5946 (1.09)     0.0000 (1.0)           0;0  1.7135 (0.92)          1           1
test_list-list[3.10.0]     663.1850 (1.24)     663.1850 (1.24)     663.1850 (1.24)     0.0000 (1.0)      663.1850 (1.24)     0.0000 (1.0)           0;0  1.5079 (0.81)          1           1
test_list-list[3.53.2]     568.1107 (1.06)     568.1107 (1.06)     568.1107 (1.06)     0.0000 (1.0)      568.1107 (1.06)     0.0000 (1.0)           0;0  1.7602 (0.94)          1           1
test_list-list[main]       535.7309 (1.0)      535.7309 (1.0)      535.7309 (1.0)      0.0000 (1.0)      535.7309 (1.0)      0.0000 (1.0)           0;0  1.8666 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     423.6410 (1.08)     423.6410 (1.08)     423.6410 (1.08)     0.0000 (1.0)      423.6410 (1.08)     0.0000 (1.0)           0;0  2.3605 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     478.7517 (1.22)     478.7517 (1.22)     478.7517 (1.22)     0.0000 (1.0)      478.7517 (1.22)     0.0000 (1.0)           0;0  2.0888 (0.82)          1           1
test_list-list-dvc-only[3.53.2]     392.3440 (1.0)      392.3440 (1.0)      392.3440 (1.0)      0.0000 (1.0)      392.3440 (1.0)      0.0000 (1.0)           0;0  2.5488 (1.0)           1           1
test_list-list-dvc-only[main]       396.9083 (1.01)     396.9083 (1.01)     396.9083 (1.01)     0.0000 (1.0)      396.9083 (1.01)     0.0000 (1.0)           0;0  2.5195 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7295 (1.0)      2.7295 (1.0)      2.7295 (1.0)      0.0000 (1.0)      2.7295 (1.0)      0.0000 (1.0)           0;0  0.3664 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7863 (1.02)     2.7863 (1.02)     2.7863 (1.02)     0.0000 (1.0)      2.7863 (1.02)     0.0000 (1.0)           0;0  0.3589 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.8802 (1.06)     2.8802 (1.06)     2.8802 (1.06)     0.0000 (1.0)      2.8802 (1.06)     0.0000 (1.0)           0;0  0.3472 (0.95)          1           1
test_list-list-recursive[main]       3.1063 (1.14)     3.1063 (1.14)     3.1063 (1.14)     0.0000 (1.0)      3.1063 (1.14)     0.0000 (1.0)           0;0  0.3219 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     415.1229 (1.06)     415.1229 (1.06)     415.1229 (1.06)     0.0000 (1.0)      415.1229 (1.06)     0.0000 (1.0)           0;0  2.4089 (0.95)          1           1
test_list-list-shallow[3.10.0]     411.0367 (1.05)     411.0367 (1.05)     411.0367 (1.05)     0.0000 (1.0)      411.0367 (1.05)     0.0000 (1.0)           0;0  2.4329 (0.95)          1           1
test_list-list-shallow[3.53.2]     392.3537 (1.0)      392.3537 (1.0)      392.3537 (1.0)      0.0000 (1.0)      392.3537 (1.0)      0.0000 (1.0)           0;0  2.5487 (1.0)           1           1
test_list-list-shallow[main]       409.3903 (1.04)     409.3903 (1.04)     409.3903 (1.04)     0.0000 (1.0)      409.3903 (1.04)     0.0000 (1.0)           0;0  2.4427 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     80.1284 (3.90)     80.1284 (3.90)     80.1284 (3.90)     0.0000 (1.0)      80.1284 (3.90)     0.0000 (1.0)           0;0  0.0125 (0.26)          1           1
test_partial_add-add[3.10.0]     78.3002 (3.81)     78.3002 (3.81)     78.3002 (3.81)     0.0000 (1.0)      78.3002 (3.81)     0.0000 (1.0)           0;0  0.0128 (0.26)          1           1
test_partial_add-add[3.53.2]     69.9733 (3.40)     69.9733 (3.40)     69.9733 (3.40)     0.0000 (1.0)      69.9733 (3.40)     0.0000 (1.0)           0;0  0.0143 (0.29)          1           1
test_partial_add-add[main]       20.5540 (1.0)      20.5540 (1.0)      20.5540 (1.0)      0.0000 (1.0)      20.5540 (1.0)      0.0000 (1.0)           0;0  0.0487 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     65.0309 (8.06)     65.0309 (8.06)     65.0309 (8.06)     0.0000 (1.0)      65.0309 (8.06)     0.0000 (1.0)           0;0  0.0154 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     65.4865 (8.12)     65.4865 (8.12)     65.4865 (8.12)     0.0000 (1.0)      65.4865 (8.12)     0.0000 (1.0)           0;0  0.0153 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     58.2698 (7.22)     58.2698 (7.22)     58.2698 (7.22)     0.0000 (1.0)      58.2698 (7.22)     0.0000 (1.0)           0;0  0.0172 (0.14)          1           1
test_partial_add-add-partial[main]        8.0689 (1.0)       8.0689 (1.0)       8.0689 (1.0)      0.0000 (1.0)       8.0689 (1.0)      0.0000 (1.0)           0;0  0.1239 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.2023 (1.0)      5.2023 (1.0)      5.2023 (1.0)      0.0000 (1.0)      5.2023 (1.0)      0.0000 (1.0)           0;0  0.1922 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.7968 (1.31)     6.7968 (1.31)     6.7968 (1.31)     0.0000 (1.0)      6.7968 (1.31)     0.0000 (1.0)           0;0  0.1471 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.7013 (1.48)     7.7013 (1.48)     7.7013 (1.48)     0.0000 (1.0)      7.7013 (1.48)     0.0000 (1.0)           0;0  0.1298 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       7.8287 (1.50)     7.8287 (1.50)     7.8287 (1.50)     0.0000 (1.0)      7.8287 (1.50)     0.0000 (1.0)           0;0  0.1277 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.8316 (1.0)      2.8316 (1.0)      2.8316 (1.0)      0.0000 (1.0)      2.8316 (1.0)      0.0000 (1.0)           0;0  0.3532 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.3568 (1.54)     4.3568 (1.54)     4.3568 (1.54)     0.0000 (1.0)      4.3568 (1.54)     0.0000 (1.0)           0;0  0.2295 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     4.2270 (1.49)     4.2270 (1.49)     4.2270 (1.49)     0.0000 (1.0)      4.2270 (1.49)     0.0000 (1.0)           0;0  0.2366 (0.67)          1           1
test_partial_add-gc-noop[main]       4.2791 (1.51)     4.2791 (1.51)     4.2791 (1.51)     0.0000 (1.0)      4.2791 (1.51)     0.0000 (1.0)           0;0  0.2337 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.5641 (2.35)     44.5641 (2.35)     44.5641 (2.35)     0.0000 (1.0)      44.5641 (2.35)     0.0000 (1.0)           0;0  0.0224 (0.42)          1           1
test_partial_add-push[3.10.0]     39.3169 (2.08)     39.3169 (2.08)     39.3169 (2.08)     0.0000 (1.0)      39.3169 (2.08)     0.0000 (1.0)           0;0  0.0254 (0.48)          1           1
test_partial_add-push[3.53.2]     19.6186 (1.04)     19.6186 (1.04)     19.6186 (1.04)     0.0000 (1.0)      19.6186 (1.04)     0.0000 (1.0)           0;0  0.0510 (0.96)          1           1
test_partial_add-push[main]       18.9274 (1.0)      18.9274 (1.0)      18.9274 (1.0)      0.0000 (1.0)      18.9274 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.6463 (1.11)     11.6463 (1.11)     11.6463 (1.11)     0.0000 (1.0)      11.6463 (1.11)     0.0000 (1.0)           0;0  0.0859 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.8158 (1.03)     10.8158 (1.03)     10.8158 (1.03)     0.0000 (1.0)      10.8158 (1.03)     0.0000 (1.0)           0;0  0.0925 (0.97)          1           1
test_partial_add-push-partial[3.53.2]     10.6154 (1.01)     10.6154 (1.01)     10.6154 (1.01)     0.0000 (1.0)      10.6154 (1.01)     0.0000 (1.0)           0;0  0.0942 (0.99)          1           1
test_partial_add-push-partial[main]       10.4628 (1.0)      10.4628 (1.0)      10.4628 (1.0)      0.0000 (1.0)      10.4628 (1.0)      0.0000 (1.0)           0;0  0.0956 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     90.4952 (3.80)     90.4952 (3.80)     90.4952 (3.80)     0.0000 (1.0)      90.4952 (3.80)     0.0000 (1.0)           0;0  0.0111 (0.26)          1           1
test_partial_remove-add[3.10.0]     92.3880 (3.88)     92.3880 (3.88)     92.3880 (3.88)     0.0000 (1.0)      92.3880 (3.88)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.53.2]     82.3536 (3.46)     82.3536 (3.46)     82.3536 (3.46)     0.0000 (1.0)      82.3536 (3.46)     0.0000 (1.0)           0;0  0.0121 (0.29)          1           1
test_partial_remove-add[main]       23.8054 (1.0)      23.8054 (1.0)      23.8054 (1.0)      0.0000 (1.0)      23.8054 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.8342 (8.48)     8.8342 (8.48)     8.8342 (8.48)     0.0000 (1.0)      8.8342 (8.48)     0.0000 (1.0)           0;0  0.1132 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.8451 (8.49)     8.8451 (8.49)     8.8451 (8.49)     0.0000 (1.0)      8.8451 (8.49)     0.0000 (1.0)           0;0  0.1131 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     8.2420 (7.91)     8.2420 (7.91)     8.2420 (7.91)     0.0000 (1.0)      8.2420 (7.91)     0.0000 (1.0)           0;0  0.1213 (0.13)          1           1
test_partial_remove-add-update[main]       1.0416 (1.0)      1.0416 (1.0)      1.0416 (1.0)      0.0000 (1.0)      1.0416 (1.0)      0.0000 (1.0)           0;0  0.9601 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.5526 (1.0)      3.5526 (1.0)      3.5526 (1.0)      0.0000 (1.0)      3.5526 (1.0)      0.0000 (1.0)           0;0  0.2815 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.0139 (1.13)     4.0139 (1.13)     4.0139 (1.13)     0.0000 (1.0)      4.0139 (1.13)     0.0000 (1.0)           0;0  0.2491 (0.89)          1           1
test_partial_remove-gc[3.53.2]     3.9785 (1.12)     3.9785 (1.12)     3.9785 (1.12)     0.0000 (1.0)      3.9785 (1.12)     0.0000 (1.0)           0;0  0.2514 (0.89)          1           1
test_partial_remove-gc[main]       4.1253 (1.16)     4.1253 (1.16)     4.1253 (1.16)     0.0000 (1.0)      4.1253 (1.16)     0.0000 (1.0)           0;0  0.2424 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.2611 (1.0)      5.2611 (1.0)      5.2611 (1.0)      0.0000 (1.0)      5.2611 (1.0)      0.0000 (1.0)           0;0  0.1901 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.6311 (1.07)     5.6311 (1.07)     5.6311 (1.07)     0.0000 (1.0)      5.6311 (1.07)     0.0000 (1.0)           0;0  0.1776 (0.93)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.6464 (1.07)     5.6464 (1.07)     5.6464 (1.07)     0.0000 (1.0)      5.6464 (1.07)     0.0000 (1.0)           0;0  0.1771 (0.93)          1           1
test_partial_remove-gc-cloud[main]       5.5520 (1.06)     5.5520 (1.06)     5.5520 (1.06)     0.0000 (1.0)      5.5520 (1.06)     0.0000 (1.0)           0;0  0.1801 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.0391 (2.29)     52.0391 (2.29)     52.0391 (2.29)     0.0000 (1.0)      52.0391 (2.29)     0.0000 (1.0)           0;0  0.0192 (0.44)          1           1
test_partial_remove-push[3.10.0]     45.3058 (2.00)     45.3058 (2.00)     45.3058 (2.00)     0.0000 (1.0)      45.3058 (2.00)     0.0000 (1.0)           0;0  0.0221 (0.50)          1           1
test_partial_remove-push[3.53.2]     23.1479 (1.02)     23.1479 (1.02)     23.1479 (1.02)     0.0000 (1.0)      23.1479 (1.02)     0.0000 (1.0)           0;0  0.0432 (0.98)          1           1
test_partial_remove-push[main]       22.6846 (1.0)      22.6846 (1.0)      22.6846 (1.0)      0.0000 (1.0)      22.6846 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8059 (1.0)      1.8059 (1.0)      1.8059 (1.0)      0.0000 (1.0)      1.8059 (1.0)      0.0000 (1.0)           0;0  0.5537 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8197 (1.01)     1.8197 (1.01)     1.8197 (1.01)     0.0000 (1.0)      1.8197 (1.01)     0.0000 (1.0)           0;0  0.5496 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.5372 (1.40)     2.5372 (1.40)     2.5372 (1.40)     0.0000 (1.0)      2.5372 (1.40)     0.0000 (1.0)           0;0  0.3941 (0.71)          1           1
test_partial_remove-push-update[main]       2.7154 (1.50)     2.7154 (1.50)     2.7154 (1.50)     0.0000 (1.0)      2.7154 (1.50)     0.0000 (1.0)           0;0  0.3683 (0.67)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     461.5237 (1.0)      469.6642 (1.0)      466.3636 (1.0)      2.9697 (1.13)     466.9568 (1.0)       2.4591 (1.0)           2;1  2.1442 (1.0)           5           3
test_plots-plots-diff[3.10.0]     880.6685 (1.91)     893.3760 (1.90)     886.5360 (1.90)     6.0811 (2.31)     885.0484 (1.90)     11.6859 (4.75)          1;0  1.1280 (0.53)          5           3
test_plots-plots-diff[3.53.2]     813.0002 (1.76)     819.4467 (1.74)     816.3155 (1.75)     2.6354 (1.0)      816.9387 (1.75)      4.3159 (1.76)          2;0  1.2250 (0.57)          5           3
test_plots-plots-diff[main]       818.4974 (1.77)     827.2466 (1.76)     823.6821 (1.77)     3.6645 (1.39)     824.6292 (1.77)      6.0121 (2.44)          1;0  1.2141 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       473.1985 (1.0)        481.1525 (1.0)        477.3726 (1.0)      3.2235 (1.45)       478.5708 (1.0)      5.0062 (1.31)          2;0  2.0948 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,104.1020 (2.33)     1,122.9488 (2.33)     1,111.6125 (2.33)     7.3122 (3.28)     1,110.7982 (2.32)     9.8814 (2.58)          2;0  0.8996 (0.43)          5           3
test_plots-plots-diff-json[3.53.2]       886.8459 (1.87)       894.4789 (1.86)       890.8244 (1.87)     3.3143 (1.49)       890.0977 (1.86)     5.8302 (1.52)          2;0  1.1226 (0.54)          5           3
test_plots-plots-diff-json[main]         890.8776 (1.88)       895.7501 (1.86)       893.3018 (1.87)     2.2304 (1.0)        894.4355 (1.87)     3.8319 (1.0)           3;0  1.1194 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     423.1275 (1.0)      435.8973 (1.0)      426.5347 (1.0)       5.3322 (1.0)      424.9907 (1.0)       4.8175 (1.0)           1;1  2.3445 (1.0)           5           3
test_plots-plots-show[3.10.0]     727.9500 (1.72)     747.2846 (1.71)     736.4843 (1.73)      7.3849 (1.38)     735.1509 (1.73)     10.2893 (2.14)          2;0  1.3578 (0.58)          5           3
test_plots-plots-show[3.53.2]     683.6433 (1.62)     698.7543 (1.60)     688.5225 (1.61)      6.0814 (1.14)     687.3037 (1.62)      7.0311 (1.46)          1;0  1.4524 (0.62)          5           3
test_plots-plots-show[main]       688.4896 (1.63)     736.1239 (1.69)     701.1231 (1.64)     20.1325 (3.78)     691.7295 (1.63)     20.4078 (4.24)          1;0  1.4263 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     434.9358 (1.0)      444.6503 (1.0)      439.0096 (1.0)      3.6545 (1.09)     438.8663 (1.0)       4.5433 (1.18)          2;0  2.2779 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     851.7415 (1.96)     872.6994 (1.96)     862.7857 (1.97)     8.2055 (2.44)     860.7118 (1.96)     11.9164 (3.09)          2;0  1.1590 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     728.9278 (1.68)     738.0339 (1.66)     732.2142 (1.67)     3.5210 (1.05)     731.9837 (1.67)      3.8553 (1.0)           1;0  1.3657 (0.60)          5           3
test_plots-plots-show-json[main]       729.4153 (1.68)     737.9126 (1.66)     733.0051 (1.67)     3.3614 (1.0)      733.6837 (1.67)      4.6728 (1.21)          2;0  1.3642 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.2284 (2.35)     53.2284 (2.35)     53.2284 (2.35)     0.0000 (1.0)      53.2284 (2.35)     0.0000 (1.0)           0;0  0.0188 (0.43)          1           1
test_push-push[3.10.0]     47.1668 (2.08)     47.1668 (2.08)     47.1668 (2.08)     0.0000 (1.0)      47.1668 (2.08)     0.0000 (1.0)           0;0  0.0212 (0.48)          1           1
test_push-push[3.53.2]     23.4078 (1.03)     23.4078 (1.03)     23.4078 (1.03)     0.0000 (1.0)      23.4078 (1.03)     0.0000 (1.0)           0;0  0.0427 (0.97)          1           1
test_push-push[main]       22.6381 (1.0)      22.6381 (1.0)      22.6381 (1.0)      0.0000 (1.0)      22.6381 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.2702 (2.76)     66.2702 (2.76)     66.2702 (2.76)     0.0000 (1.0)      66.2702 (2.76)     0.0000 (1.0)           0;0  0.0151 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.4417 (2.97)     71.4417 (2.97)     71.4417 (2.97)     0.0000 (1.0)      71.4417 (2.97)     0.0000 (1.0)           0;0  0.0140 (0.34)          1           1
test_sharing-fetch[3.53.2]     35.7773 (1.49)     35.7773 (1.49)     35.7773 (1.49)     0.0000 (1.0)      35.7773 (1.49)     0.0000 (1.0)           0;0  0.0280 (0.67)          1           1
test_sharing-fetch[main]       24.0242 (1.0)      24.0242 (1.0)      24.0242 (1.0)      0.0000 (1.0)      24.0242 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3263 (1.0)      1.3263 (1.0)      1.3263 (1.0)      0.0000 (1.0)      1.3263 (1.0)      0.0000 (1.0)           0;0  0.7540 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7091 (2.80)     3.7091 (2.80)     3.7091 (2.80)     0.0000 (1.0)      3.7091 (2.80)     0.0000 (1.0)           0;0  0.2696 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     6.0767 (4.58)     6.0767 (4.58)     6.0767 (4.58)     0.0000 (1.0)      6.0767 (4.58)     0.0000 (1.0)           0;0  0.1646 (0.22)          1           1
test_sharing-fetch-noop[main]       6.2297 (4.70)     6.2297 (4.70)     6.2297 (4.70)     0.0000 (1.0)      6.2297 (4.70)     0.0000 (1.0)           0;0  0.1605 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.2385 (2.30)     52.2385 (2.30)     52.2385 (2.30)     0.0000 (1.0)      52.2385 (2.30)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_sharing-push[3.10.0]     46.2344 (2.04)     46.2344 (2.04)     46.2344 (2.04)     0.0000 (1.0)      46.2344 (2.04)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_sharing-push[3.53.2]     23.0472 (1.02)     23.0472 (1.02)     23.0472 (1.02)     0.0000 (1.0)      23.0472 (1.02)     0.0000 (1.0)           0;0  0.0434 (0.99)          1           1
test_sharing-push[main]       22.7049 (1.0)      22.7049 (1.0)      22.7049 (1.0)      0.0000 (1.0)      22.7049 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2924 (1.01)     2.2924 (1.01)     2.2924 (1.01)     0.0000 (1.0)      2.2924 (1.01)     0.0000 (1.0)           0;0  0.4362 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.2616 (1.0)      2.2616 (1.0)      2.2616 (1.0)      0.0000 (1.0)      2.2616 (1.0)      0.0000 (1.0)           0;0  0.4422 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.2115 (2.75)     6.2115 (2.75)     6.2115 (2.75)     0.0000 (1.0)      6.2115 (2.75)     0.0000 (1.0)           0;0  0.1610 (0.36)          1           1
test_sharing-push-noop[main]       6.4762 (2.86)     6.4762 (2.86)     6.4762 (2.86)     0.0000 (1.0)      6.4762 (2.86)     0.0000 (1.0)           0;0  0.1544 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     349.0012 (1.04)     349.0012 (1.04)     349.0012 (1.04)     0.0000 (1.0)      349.0012 (1.04)     0.0000 (1.0)           0;0  0.0029 (0.96)          1           1
test_sharing_azure-fetch[main]       335.1092 (1.0)      335.1092 (1.0)      335.1092 (1.0)      0.0000 (1.0)      335.1092 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.8948 (1.0)      6.8948 (1.0)      6.8948 (1.0)      0.0000 (1.0)      6.8948 (1.0)      0.0000 (1.0)           0;0  0.1450 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.9793 (1.01)     6.9793 (1.01)     6.9793 (1.01)     0.0000 (1.0)      6.9793 (1.01)     0.0000 (1.0)           0;0  0.1433 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     348.2501 (1.0)      348.2501 (1.0)      348.2501 (1.0)      0.0000 (1.0)      348.2501 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
test_sharing_azure-push[main]       356.1312 (1.02)     356.1312 (1.02)     356.1312 (1.02)     0.0000 (1.0)      356.1312 (1.02)     0.0000 (1.0)           0;0  0.0028 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.2952 (1.0)      8.2952 (1.0)      8.2952 (1.0)      0.0000 (1.0)      8.2952 (1.0)      0.0000 (1.0)           0;0  0.1206 (1.0)           1           1
test_sharing_azure-push-noop[main]       8.3443 (1.01)     8.3443 (1.01)     8.3443 (1.01)     0.0000 (1.0)      8.3443 (1.01)     0.0000 (1.0)           0;0  0.1198 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     226.5957 (1.0)      226.5957 (1.0)      226.5957 (1.0)      0.0000 (1.0)      226.5957 (1.0)      0.0000 (1.0)           0;0  0.0044 (1.0)           1           1
test_sharing_gs-fetch[main]       235.2371 (1.04)     235.2371 (1.04)     235.2371 (1.04)     0.0000 (1.0)      235.2371 (1.04)     0.0000 (1.0)           0;0  0.0043 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.1632 (1.0)      7.1632 (1.0)      7.1632 (1.0)      0.0000 (1.0)      7.1632 (1.0)      0.0000 (1.0)           0;0  0.1396 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.4007 (1.03)     7.4007 (1.03)     7.4007 (1.03)     0.0000 (1.0)      7.4007 (1.03)     0.0000 (1.0)           0;0  0.1351 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     595.4474 (1.02)     595.4474 (1.02)     595.4474 (1.02)     0.0000 (1.0)      595.4474 (1.02)     0.0000 (1.0)           0;0  0.0017 (0.98)          1           1
test_sharing_gs-push[main]       581.8836 (1.0)      581.8836 (1.0)      581.8836 (1.0)      0.0000 (1.0)      581.8836 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8405 (1.0)      6.8405 (1.0)      6.8405 (1.0)      0.0000 (1.0)      6.8405 (1.0)      0.0000 (1.0)           0;0  0.1462 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.8790 (1.01)     6.8790 (1.01)     6.8790 (1.01)     0.0000 (1.0)      6.8790 (1.01)     0.0000 (1.0)           0;0  0.1454 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     407.1763 (1.0)      407.1763 (1.0)      407.1763 (1.0)      0.0000 (1.0)      407.1763 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
test_sharing_s3-fetch[main]       409.0742 (1.00)     409.0742 (1.00)     409.0742 (1.00)     0.0000 (1.0)      409.0742 (1.00)     0.0000 (1.0)           0;0  0.0024 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6503 (1.0)      6.6503 (1.0)      6.6503 (1.0)      0.0000 (1.0)      6.6503 (1.0)      0.0000 (1.0)           0;0  0.1504 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       7.1241 (1.07)     7.1241 (1.07)     7.1241 (1.07)     0.0000 (1.0)      7.1241 (1.07)     0.0000 (1.0)           0;0  0.1404 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     502.6110 (1.0)      502.6110 (1.0)      502.6110 (1.0)      0.0000 (1.0)      502.6110 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
test_sharing_s3-push[main]       506.8849 (1.01)     506.8849 (1.01)     506.8849 (1.01)     0.0000 (1.0)      506.8849 (1.01)     0.0000 (1.0)           0;0  0.0020 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9531 (1.0)      6.9531 (1.0)      6.9531 (1.0)      0.0000 (1.0)      6.9531 (1.0)      0.0000 (1.0)           0;0  0.1438 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.2767 (1.05)     7.2767 (1.05)     7.2767 (1.05)     0.0000 (1.0)      7.2767 (1.05)     0.0000 (1.0)           0;0  0.1374 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.2464 (3.83)     21.2464 (3.83)     21.2464 (3.83)     0.0000 (1.0)      21.2464 (3.83)     0.0000 (1.0)           0;0  0.0471 (0.26)          1           1
test_status-status[3.10.0]     21.6128 (3.90)     21.6128 (3.90)     21.6128 (3.90)     0.0000 (1.0)      21.6128 (3.90)     0.0000 (1.0)           0;0  0.0463 (0.26)          1           1
test_status-status[3.53.2]     19.6278 (3.54)     19.6278 (3.54)     19.6278 (3.54)     0.0000 (1.0)      19.6278 (3.54)     0.0000 (1.0)           0;0  0.0509 (0.28)          1           1
test_status-status[main]        5.5460 (1.0)       5.5460 (1.0)       5.5460 (1.0)      0.0000 (1.0)       5.5460 (1.0)      0.0000 (1.0)           0;0  0.1803 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9860 (1.69)     4.9860 (1.69)     4.9860 (1.69)     0.0000 (1.0)      4.9860 (1.69)     0.0000 (1.0)           0;0  0.2006 (0.59)          1           1
test_status-status-changed[3.10.0]     5.3596 (1.82)     5.3596 (1.82)     5.3596 (1.82)     0.0000 (1.0)      5.3596 (1.82)     0.0000 (1.0)           0;0  0.1866 (0.55)          1           1
test_status-status-changed[3.53.2]     5.1734 (1.75)     5.1734 (1.75)     5.1734 (1.75)     0.0000 (1.0)      5.1734 (1.75)     0.0000 (1.0)           0;0  0.1933 (0.57)          1           1
test_status-status-changed[main]       2.9517 (1.0)      2.9517 (1.0)      2.9517 (1.0)      0.0000 (1.0)      2.9517 (1.0)      0.0000 (1.0)           0;0  0.3388 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9066 (1.73)     4.9066 (1.73)     4.9066 (1.73)     0.0000 (1.0)      4.9066 (1.73)     0.0000 (1.0)           0;0  0.2038 (0.58)          1           1
test_status-status-changed-noop[3.10.0]     5.1529 (1.81)     5.1529 (1.81)     5.1529 (1.81)     0.0000 (1.0)      5.1529 (1.81)     0.0000 (1.0)           0;0  0.1941 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     4.9207 (1.73)     4.9207 (1.73)     4.9207 (1.73)     0.0000 (1.0)      4.9207 (1.73)     0.0000 (1.0)           0;0  0.2032 (0.58)          1           1
test_status-status-changed-noop[main]       2.8433 (1.0)      2.8433 (1.0)      2.8433 (1.0)      0.0000 (1.0)      2.8433 (1.0)      0.0000 (1.0)           0;0  0.3517 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8702 (1.74)     4.8702 (1.74)     4.8702 (1.74)     0.0000 (1.0)      4.8702 (1.74)     0.0000 (1.0)           0;0  0.2053 (0.58)          1           1
test_status-status-noop[3.10.0]     5.1945 (1.85)     5.1945 (1.85)     5.1945 (1.85)     0.0000 (1.0)      5.1945 (1.85)     0.0000 (1.0)           0;0  0.1925 (0.54)          1           1
test_status-status-noop[3.53.2]     5.0296 (1.79)     5.0296 (1.79)     5.0296 (1.79)     0.0000 (1.0)      5.0296 (1.79)     0.0000 (1.0)           0;0  0.1988 (0.56)          1           1
test_status-status-noop[main]       2.8058 (1.0)      2.8058 (1.0)      2.8058 (1.0)      0.0000 (1.0)      2.8058 (1.0)      0.0000 (1.0)           0;0  0.3564 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     169.5367 (3.45)     169.5367 (3.45)     169.5367 (3.45)     0.0000 (1.0)      169.5367 (3.45)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_update-import-url[3.10.0]     172.9153 (3.52)     172.9153 (3.52)     172.9153 (3.52)     0.0000 (1.0)      172.9153 (3.52)     0.0000 (1.0)           0;0  0.0058 (0.28)          1           1
test_update-import-url[3.53.2]     129.7450 (2.64)     129.7450 (2.64)     129.7450 (2.64)     0.0000 (1.0)      129.7450 (2.64)     0.0000 (1.0)           0;0  0.0077 (0.38)          1           1
test_update-import-url[main]        49.1003 (1.0)       49.1003 (1.0)       49.1003 (1.0)      0.0000 (1.0)       49.1003 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     148.9111 (3.94)     148.9111 (3.94)     148.9111 (3.94)     0.0000 (1.0)      148.9111 (3.94)     0.0000 (1.0)           0;0  0.0067 (0.25)          1           1
test_update-update[3.10.0]     153.4033 (4.06)     153.4033 (4.06)     153.4033 (4.06)     0.0000 (1.0)      153.4033 (4.06)     0.0000 (1.0)           0;0  0.0065 (0.25)          1           1
test_update-update[3.53.2]     118.9251 (3.14)     118.9251 (3.14)     118.9251 (3.14)     0.0000 (1.0)      118.9251 (3.14)     0.0000 (1.0)           0;0  0.0084 (0.32)          1           1
test_update-update[main]        37.8161 (1.0)       37.8161 (1.0)       37.8161 (1.0)      0.0000 (1.0)       37.8161 (1.0)      0.0000 (1.0)           0;0  0.0264 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.9581 (1.98)     16.9581 (1.98)     16.9581 (1.98)     0.0000 (1.0)      16.9581 (1.98)     0.0000 (1.0)           0;0  0.0590 (0.51)          1           1
test_update-update-noop[3.10.0]     18.2531 (2.13)     18.2531 (2.13)     18.2531 (2.13)     0.0000 (1.0)      18.2531 (2.13)     0.0000 (1.0)           0;0  0.0548 (0.47)          1           1
test_update-update-noop[3.53.2]     17.3202 (2.02)     17.3202 (2.02)     17.3202 (2.02)     0.0000 (1.0)      17.3202 (2.02)     0.0000 (1.0)           0;0  0.0577 (0.50)          1           1
test_update-update-noop[main]        8.5817 (1.0)       8.5817 (1.0)       8.5817 (1.0)      0.0000 (1.0)       8.5817 (1.0)      0.0000 (1.0)           0;0  0.1165 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean