Sat May 10 00:55:23 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.0941 (3.77)     92.0941 (3.77)     92.0941 (3.77)     0.0000 (1.0)      92.0941 (3.77)     0.0000 (1.0)           0;0  0.0109 (0.27)          1           1
test_add_copy-add[3.10.0]     93.2553 (3.82)     93.2553 (3.82)     93.2553 (3.82)     0.0000 (1.0)      93.2553 (3.82)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_add_copy-add[3.53.2]     83.1488 (3.40)     83.1488 (3.40)     83.1488 (3.40)     0.0000 (1.0)      83.1488 (3.40)     0.0000 (1.0)           0;0  0.0120 (0.29)          1           1
test_add_copy-add[main]       24.4216 (1.0)      24.4216 (1.0)      24.4216 (1.0)      0.0000 (1.0)      24.4216 (1.0)      0.0000 (1.0)           0;0  0.0409 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.9187 (6.50)     31.9187 (6.50)     31.9187 (6.50)     0.0000 (1.0)      31.9187 (6.50)     0.0000 (1.0)           0;0  0.0313 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     32.3653 (6.59)     32.3653 (6.59)     32.3653 (6.59)     0.0000 (1.0)      32.3653 (6.59)     0.0000 (1.0)           0;0  0.0309 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     30.5039 (6.21)     30.5039 (6.21)     30.5039 (6.21)     0.0000 (1.0)      30.5039 (6.21)     0.0000 (1.0)           0;0  0.0328 (0.16)          1           1
test_add_copy-add-noop[main]        4.9082 (1.0)       4.9082 (1.0)       4.9082 (1.0)      0.0000 (1.0)       4.9082 (1.0)      0.0000 (1.0)           0;0  0.2037 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     73.6701 (4.21)     73.6701 (4.21)     73.6701 (4.21)     0.0000 (1.0)      73.6701 (4.21)     0.0000 (1.0)           0;0  0.0136 (0.24)          1           1
test_add_hardlink-add[3.10.0]     74.7861 (4.28)     74.7861 (4.28)     74.7861 (4.28)     0.0000 (1.0)      74.7861 (4.28)     0.0000 (1.0)           0;0  0.0134 (0.23)          1           1
test_add_hardlink-add[3.53.2]     69.3566 (3.97)     69.3566 (3.97)     69.3566 (3.97)     0.0000 (1.0)      69.3566 (3.97)     0.0000 (1.0)           0;0  0.0144 (0.25)          1           1
test_add_hardlink-add[main]       17.4789 (1.0)      17.4789 (1.0)      17.4789 (1.0)      0.0000 (1.0)      17.4789 (1.0)      0.0000 (1.0)           0;0  0.0572 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.7878 (7.47)     36.7878 (7.47)     36.7878 (7.47)     0.0000 (1.0)      36.7878 (7.47)     0.0000 (1.0)           0;0  0.0272 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.7844 (7.67)     37.7844 (7.67)     37.7844 (7.67)     0.0000 (1.0)      37.7844 (7.67)     0.0000 (1.0)           0;0  0.0265 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.6118 (7.23)     35.6118 (7.23)     35.6118 (7.23)     0.0000 (1.0)      35.6118 (7.23)     0.0000 (1.0)           0;0  0.0281 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.9239 (1.0)       4.9239 (1.0)       4.9239 (1.0)      0.0000 (1.0)       4.9239 (1.0)      0.0000 (1.0)           0;0  0.2031 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     77.7878 (2.08)     77.7878 (2.08)     77.7878 (2.08)     0.0000 (1.0)      77.7878 (2.08)     0.0000 (1.0)           0;0  0.0129 (0.48)          1           1
test_add_symlink-add[3.10.0]     77.3273 (2.07)     77.3273 (2.07)     77.3273 (2.07)     0.0000 (1.0)      77.3273 (2.07)     0.0000 (1.0)           0;0  0.0129 (0.48)          1           1
test_add_symlink-add[3.53.2]     72.3011 (1.94)     72.3011 (1.94)     72.3011 (1.94)     0.0000 (1.0)      72.3011 (1.94)     0.0000 (1.0)           0;0  0.0138 (0.52)          1           1
test_add_symlink-add[main]       37.3319 (1.0)      37.3319 (1.0)      37.3319 (1.0)      0.0000 (1.0)      37.3319 (1.0)      0.0000 (1.0)           0;0  0.0268 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     49.6129 (8.07)     49.6129 (8.07)     49.6129 (8.07)     0.0000 (1.0)      49.6129 (8.07)     0.0000 (1.0)           0;0  0.0202 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.2453 (8.01)     49.2453 (8.01)     49.2453 (8.01)     0.0000 (1.0)      49.2453 (8.01)     0.0000 (1.0)           0;0  0.0203 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.2603 (7.85)     48.2603 (7.85)     48.2603 (7.85)     0.0000 (1.0)      48.2603 (7.85)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[main]        6.1498 (1.0)       6.1498 (1.0)       6.1498 (1.0)      0.0000 (1.0)       6.1498 (1.0)      0.0000 (1.0)           0;0  0.1626 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.8478 (2.00)     43.8478 (2.00)     43.8478 (2.00)     0.0000 (1.0)      43.8478 (2.00)     0.0000 (1.0)           0;0  0.0228 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     62.7240 (2.86)     62.7240 (2.86)     62.7240 (2.86)     0.0000 (1.0)      62.7240 (2.86)     0.0000 (1.0)           0;0  0.0159 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     30.0992 (1.37)     30.0992 (1.37)     30.0992 (1.37)     0.0000 (1.0)      30.0992 (1.37)     0.0000 (1.0)           0;0  0.0332 (0.73)          1           1
test_checkout_copy-checkout[main]       21.9374 (1.0)      21.9374 (1.0)      21.9374 (1.0)      0.0000 (1.0)      21.9374 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6949 (1.54)     5.6949 (1.54)     5.6949 (1.54)     0.0000 (1.0)      5.6949 (1.54)     0.0000 (1.0)           0;0  0.1756 (0.65)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.1203 (1.65)     6.1203 (1.65)     6.1203 (1.65)     0.0000 (1.0)      6.1203 (1.65)     0.0000 (1.0)           0;0  0.1634 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.9374 (1.60)     5.9374 (1.60)     5.9374 (1.60)     0.0000 (1.0)      5.9374 (1.60)     0.0000 (1.0)           0;0  0.1684 (0.62)          1           1
test_checkout_copy-checkout-noop[main]       3.6996 (1.0)      3.6996 (1.0)      3.6996 (1.0)      0.0000 (1.0)      3.6996 (1.0)      0.0000 (1.0)           0;0  0.2703 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6167 (2.03)     8.6167 (2.03)     8.6167 (2.03)     0.0000 (1.0)      8.6167 (2.03)     0.0000 (1.0)           0;0  0.1161 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8720 (1.62)     6.8720 (1.62)     6.8720 (1.62)     0.0000 (1.0)      6.8720 (1.62)     0.0000 (1.0)           0;0  0.1455 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.6049 (1.55)     6.6049 (1.55)     6.6049 (1.55)     0.0000 (1.0)      6.6049 (1.55)     0.0000 (1.0)           0;0  0.1514 (0.64)          1           1
test_checkout_copy-checkout-update[main]       4.2539 (1.0)      4.2539 (1.0)      4.2539 (1.0)      0.0000 (1.0)      4.2539 (1.0)      0.0000 (1.0)           0;0  0.2351 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.5143 (3.06)     24.5143 (3.06)     24.5143 (3.06)     0.0000 (1.0)      24.5143 (3.06)     0.0000 (1.0)           0;0  0.0408 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.8977 (2.23)     17.8977 (2.23)     17.8977 (2.23)     0.0000 (1.0)      17.8977 (2.23)     0.0000 (1.0)           0;0  0.0559 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2532 (2.03)     16.2532 (2.03)     16.2532 (2.03)     0.0000 (1.0)      16.2532 (2.03)     0.0000 (1.0)           0;0  0.0615 (0.49)          1           1
test_checkout_hardlink-checkout[main]        8.0124 (1.0)       8.0124 (1.0)       8.0124 (1.0)      0.0000 (1.0)       8.0124 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.9784 (1.63)     5.9784 (1.63)     5.9784 (1.63)     0.0000 (1.0)      5.9784 (1.63)     0.0000 (1.0)           0;0  0.1673 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.2529 (1.70)     6.2529 (1.70)     6.2529 (1.70)     0.0000 (1.0)      6.2529 (1.70)     0.0000 (1.0)           0;0  0.1599 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8365 (1.59)     5.8365 (1.59)     5.8365 (1.59)     0.0000 (1.0)      5.8365 (1.59)     0.0000 (1.0)           0;0  0.1713 (0.63)          1           1
test_checkout_hardlink-checkout-noop[main]       3.6748 (1.0)      3.6748 (1.0)      3.6748 (1.0)      0.0000 (1.0)      3.6748 (1.0)      0.0000 (1.0)           0;0  0.2721 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8107 (2.06)     8.8107 (2.06)     8.8107 (2.06)     0.0000 (1.0)      8.8107 (2.06)     0.0000 (1.0)           0;0  0.1135 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.9931 (1.64)     6.9931 (1.64)     6.9931 (1.64)     0.0000 (1.0)      6.9931 (1.64)     0.0000 (1.0)           0;0  0.1430 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6284 (1.55)     6.6284 (1.55)     6.6284 (1.55)     0.0000 (1.0)      6.6284 (1.55)     0.0000 (1.0)           0;0  0.1509 (0.64)          1           1
test_checkout_hardlink-checkout-update[main]       4.2718 (1.0)      4.2718 (1.0)      4.2718 (1.0)      0.0000 (1.0)      4.2718 (1.0)      0.0000 (1.0)           0;0  0.2341 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.0676 (2.42)     28.0676 (2.42)     28.0676 (2.42)     0.0000 (1.0)      28.0676 (2.42)     0.0000 (1.0)           0;0  0.0356 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     21.3265 (1.84)     21.3265 (1.84)     21.3265 (1.84)     0.0000 (1.0)      21.3265 (1.84)     0.0000 (1.0)           0;0  0.0469 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     19.8778 (1.72)     19.8778 (1.72)     19.8778 (1.72)     0.0000 (1.0)      19.8778 (1.72)     0.0000 (1.0)           0;0  0.0503 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.5851 (1.0)      11.5851 (1.0)      11.5851 (1.0)      0.0000 (1.0)      11.5851 (1.0)      0.0000 (1.0)           0;0  0.0863 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.0528 (1.48)     7.0528 (1.48)     7.0528 (1.48)     0.0000 (1.0)      7.0528 (1.48)     0.0000 (1.0)           0;0  0.1418 (0.68)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.3913 (1.55)     7.3913 (1.55)     7.3913 (1.55)     0.0000 (1.0)      7.3913 (1.55)     0.0000 (1.0)           0;0  0.1353 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.2129 (1.51)     7.2129 (1.51)     7.2129 (1.51)     0.0000 (1.0)      7.2129 (1.51)     0.0000 (1.0)           0;0  0.1386 (0.66)          1           1
test_checkout_symlink-checkout-noop[main]       4.7681 (1.0)      4.7681 (1.0)      4.7681 (1.0)      0.0000 (1.0)      4.7681 (1.0)      0.0000 (1.0)           0;0  0.2097 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.9324 (1.72)     10.9324 (1.72)     10.9324 (1.72)     0.0000 (1.0)      10.9324 (1.72)     0.0000 (1.0)           0;0  0.0915 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.1996 (1.45)      9.1996 (1.45)      9.1996 (1.45)     0.0000 (1.0)       9.1996 (1.45)     0.0000 (1.0)           0;0  0.1087 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      9.0353 (1.42)      9.0353 (1.42)      9.0353 (1.42)     0.0000 (1.0)       9.0353 (1.42)     0.0000 (1.0)           0;0  0.1107 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        6.3435 (1.0)       6.3435 (1.0)       6.3435 (1.0)      0.0000 (1.0)       6.3435 (1.0)      0.0000 (1.0)           0;0  0.1576 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.3863 (1.74)     4.3863 (1.74)     4.3863 (1.74)     0.0000 (1.0)      4.3863 (1.74)     0.0000 (1.0)           0;0  0.2280 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.8763 (1.93)     4.8763 (1.93)     4.8763 (1.93)     0.0000 (1.0)      4.8763 (1.93)     0.0000 (1.0)           0;0  0.2051 (0.52)          1           1
test_data_status-data-changed[3.53.2]     4.9176 (1.95)     4.9176 (1.95)     4.9176 (1.95)     0.0000 (1.0)      4.9176 (1.95)     0.0000 (1.0)           0;0  0.2034 (0.51)          1           1
test_data_status-data-changed[main]       2.5254 (1.0)      2.5254 (1.0)      2.5254 (1.0)      0.0000 (1.0)      2.5254 (1.0)      0.0000 (1.0)           0;0  0.3960 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.4452 (1.82)     4.4452 (1.82)     4.4452 (1.82)     0.0000 (1.0)      4.4452 (1.82)     0.0000 (1.0)           0;0  0.2250 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8525 (1.99)     4.8525 (1.99)     4.8525 (1.99)     0.0000 (1.0)      4.8525 (1.99)     0.0000 (1.0)           0;0  0.2061 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7172 (1.93)     4.7172 (1.93)     4.7172 (1.93)     0.0000 (1.0)      4.7172 (1.93)     0.0000 (1.0)           0;0  0.2120 (0.52)          1           1
test_data_status-data-changed-noop[main]       2.4392 (1.0)      2.4392 (1.0)      2.4392 (1.0)      0.0000 (1.0)      2.4392 (1.0)      0.0000 (1.0)           0;0  0.4100 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.6320 (3.98)     20.6320 (3.98)     20.6320 (3.98)     0.0000 (1.0)      20.6320 (3.98)     0.0000 (1.0)           0;0  0.0485 (0.25)          1           1
test_data_status-data-new[3.10.0]     20.9475 (4.04)     20.9475 (4.04)     20.9475 (4.04)     0.0000 (1.0)      20.9475 (4.04)     0.0000 (1.0)           0;0  0.0477 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.8783 (4.03)     20.8783 (4.03)     20.8783 (4.03)     0.0000 (1.0)      20.8783 (4.03)     0.0000 (1.0)           0;0  0.0479 (0.25)          1           1
test_data_status-data-new[main]        5.1864 (1.0)       5.1864 (1.0)       5.1864 (1.0)      0.0000 (1.0)       5.1864 (1.0)      0.0000 (1.0)           0;0  0.1928 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.4408 (1.82)     4.4408 (1.82)     4.4408 (1.82)     0.0000 (1.0)      4.4408 (1.82)     0.0000 (1.0)           0;0  0.2252 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.8973 (2.01)     4.8973 (2.01)     4.8973 (2.01)     0.0000 (1.0)      4.8973 (2.01)     0.0000 (1.0)           0;0  0.2042 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.6659 (1.92)     4.6659 (1.92)     4.6659 (1.92)     0.0000 (1.0)      4.6659 (1.92)     0.0000 (1.0)           0;0  0.2143 (0.52)          1           1
test_data_status-data-noop[main]       2.4358 (1.0)      2.4358 (1.0)      2.4358 (1.0)      0.0000 (1.0)      2.4358 (1.0)      0.0000 (1.0)           0;0  0.4105 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.7919 (1.08)     20.7919 (1.08)     20.7919 (1.08)     0.0000 (1.0)      20.7919 (1.08)     0.0000 (1.0)           0;0  0.0481 (0.93)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.7005 (1.12)     21.7005 (1.12)     21.7005 (1.12)     0.0000 (1.0)      21.7005 (1.12)     0.0000 (1.0)           0;0  0.0461 (0.89)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.1917 (1.10)     21.1917 (1.10)     21.1917 (1.10)     0.0000 (1.0)      21.1917 (1.10)     0.0000 (1.0)           0;0  0.0472 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       19.3171 (1.0)      19.3171 (1.0)      19.3171 (1.0)      0.0000 (1.0)      19.3171 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.7225 (1.08)     20.7225 (1.08)     20.7225 (1.08)     0.0000 (1.0)      20.7225 (1.08)     0.0000 (1.0)           0;0  0.0483 (0.93)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.4162 (1.12)     21.4162 (1.12)     21.4162 (1.12)     0.0000 (1.0)      21.4162 (1.12)     0.0000 (1.0)           0;0  0.0467 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.4498 (1.12)     21.4498 (1.12)     21.4498 (1.12)     0.0000 (1.0)      21.4498 (1.12)     0.0000 (1.0)           0;0  0.0466 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.2065 (1.0)      19.2065 (1.0)      19.2065 (1.0)      0.0000 (1.0)      19.2065 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.6116 (1.70)     36.6116 (1.70)     36.6116 (1.70)     0.0000 (1.0)      36.6116 (1.70)     0.0000 (1.0)           0;0  0.0273 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.5727 (1.74)     37.5727 (1.74)     37.5727 (1.74)     0.0000 (1.0)      37.5727 (1.74)     0.0000 (1.0)           0;0  0.0266 (0.57)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.3812 (1.73)     37.3812 (1.73)     37.3812 (1.73)     0.0000 (1.0)      37.3812 (1.73)     0.0000 (1.0)           0;0  0.0268 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.5719 (1.0)      21.5719 (1.0)      21.5719 (1.0)      0.0000 (1.0)      21.5719 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     20.1103 (1.09)     20.1103 (1.09)     20.1103 (1.09)     0.0000 (1.0)      20.1103 (1.09)     0.0000 (1.0)           0;0  0.0497 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.6397 (1.12)     20.6397 (1.12)     20.6397 (1.12)     0.0000 (1.0)      20.6397 (1.12)     0.0000 (1.0)           0;0  0.0485 (0.90)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.4021 (1.10)     20.4021 (1.10)     20.4021 (1.10)     0.0000 (1.0)      20.4021 (1.10)     0.0000 (1.0)           0;0  0.0490 (0.91)          1           1
test_data_status_all_flags-data-noop[main]       18.4856 (1.0)      18.4856 (1.0)      18.4856 (1.0)      0.0000 (1.0)      18.4856 (1.0)      0.0000 (1.0)           0;0  0.0541 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.5469 (2.56)     19.5469 (2.56)     19.5469 (2.56)     0.0000 (1.0)      19.5469 (2.56)     0.0000 (1.0)           0;0  0.0512 (0.39)          1           1
test_diff-diff[3.10.0]     20.2608 (2.66)     20.2608 (2.66)     20.2608 (2.66)     0.0000 (1.0)      20.2608 (2.66)     0.0000 (1.0)           0;0  0.0494 (0.38)          1           1
test_diff-diff[3.53.2]     21.1880 (2.78)     21.1880 (2.78)     21.1880 (2.78)     0.0000 (1.0)      21.1880 (2.78)     0.0000 (1.0)           0;0  0.0472 (0.36)          1           1
test_diff-diff[main]        7.6219 (1.0)       7.6219 (1.0)       7.6219 (1.0)      0.0000 (1.0)       7.6219 (1.0)      0.0000 (1.0)           0;0  0.1312 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.5992 (1.74)     6.5992 (1.74)     6.5992 (1.74)     0.0000 (1.0)      6.5992 (1.74)     0.0000 (1.0)           0;0  0.1515 (0.58)          1           1
test_diff-diff-changed[3.10.0]     7.1259 (1.88)     7.1259 (1.88)     7.1259 (1.88)     0.0000 (1.0)      7.1259 (1.88)     0.0000 (1.0)           0;0  0.1403 (0.53)          1           1
test_diff-diff-changed[3.53.2]     6.0325 (1.59)     6.0325 (1.59)     6.0325 (1.59)     0.0000 (1.0)      6.0325 (1.59)     0.0000 (1.0)           0;0  0.1658 (0.63)          1           1
test_diff-diff-changed[main]       3.7979 (1.0)      3.7979 (1.0)      3.7979 (1.0)      0.0000 (1.0)      3.7979 (1.0)      0.0000 (1.0)           0;0  0.2633 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5106 (1.45)     5.5106 (1.45)     5.5106 (1.45)     0.0000 (1.0)      5.5106 (1.45)     0.0000 (1.0)           0;0  0.1815 (0.69)          1           1
test_diff-diff-changed-noop[3.10.0]     6.1047 (1.61)     6.1047 (1.61)     6.1047 (1.61)     0.0000 (1.0)      6.1047 (1.61)     0.0000 (1.0)           0;0  0.1638 (0.62)          1           1
test_diff-diff-changed-noop[3.53.2]     6.0010 (1.58)     6.0010 (1.58)     6.0010 (1.58)     0.0000 (1.0)      6.0010 (1.58)     0.0000 (1.0)           0;0  0.1666 (0.63)          1           1
test_diff-diff-changed-noop[main]       3.8003 (1.0)      3.8003 (1.0)      3.8003 (1.0)      0.0000 (1.0)      3.8003 (1.0)      0.0000 (1.0)           0;0  0.2631 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.5632 (1.19)     4.5632 (1.19)     4.5632 (1.19)     0.0000 (1.0)      4.5632 (1.19)     0.0000 (1.0)           0;0  0.2191 (0.84)          1           1
test_diff-diff-noop[3.10.0]     4.8732 (1.27)     4.8732 (1.27)     4.8732 (1.27)     0.0000 (1.0)      4.8732 (1.27)     0.0000 (1.0)           0;0  0.2052 (0.79)          1           1
test_diff-diff-noop[3.53.2]     6.1351 (1.59)     6.1351 (1.59)     6.1351 (1.59)     0.0000 (1.0)      6.1351 (1.59)     0.0000 (1.0)           0;0  0.1630 (0.63)          1           1
test_diff-diff-noop[main]       3.8498 (1.0)      3.8498 (1.0)      3.8498 (1.0)      0.0000 (1.0)      3.8498 (1.0)      0.0000 (1.0)           0;0  0.2598 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.1704 (1.0)       1.1704 (1.0)       1.1704 (1.0)      0.0000 (1.0)       1.1704 (1.0)      0.0000 (1.0)           0;0  0.8544 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.0261 (8.57)     10.0261 (8.57)     10.0261 (8.57)     0.0000 (1.0)      10.0261 (8.57)     0.0000 (1.0)           0;0  0.0997 (0.12)          1           1
test_exp_show-exp[3.53.2]      5.0393 (4.31)      5.0393 (4.31)      5.0393 (4.31)     0.0000 (1.0)       5.0393 (4.31)     0.0000 (1.0)           0;0  0.1984 (0.23)          1           1
test_exp_show-exp[main]       10.2266 (8.74)     10.2266 (8.74)     10.2266 (8.74)     0.0000 (1.0)      10.2266 (8.74)     0.0000 (1.0)           0;0  0.0978 (0.11)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     69.7851 (2.80)     69.7851 (2.80)     69.7851 (2.80)     0.0000 (1.0)      69.7851 (2.80)     0.0000 (1.0)           0;0  0.0143 (0.36)          1           1
test_fetch-fetch[3.10.0]     75.5830 (3.03)     75.5830 (3.03)     75.5830 (3.03)     0.0000 (1.0)      75.5830 (3.03)     0.0000 (1.0)           0;0  0.0132 (0.33)          1           1
test_fetch-fetch[3.53.2]     37.9481 (1.52)     37.9481 (1.52)     37.9481 (1.52)     0.0000 (1.0)      37.9481 (1.52)     0.0000 (1.0)           0;0  0.0264 (0.66)          1           1
test_fetch-fetch[main]       24.9420 (1.0)      24.9420 (1.0)      24.9420 (1.0)      0.0000 (1.0)      24.9420 (1.0)      0.0000 (1.0)           0;0  0.0401 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.0075 (1.0)      3.0075 (1.0)      3.0075 (1.0)      0.0000 (1.0)      3.0075 (1.0)      0.0000 (1.0)           0;0  0.3325 (1.0)           1           1
test_gc-gc[3.10.0]     3.1434 (1.05)     3.1434 (1.05)     3.1434 (1.05)     0.0000 (1.0)      3.1434 (1.05)     0.0000 (1.0)           0;0  0.3181 (0.96)          1           1
test_gc-gc[3.53.2]     3.0595 (1.02)     3.0595 (1.02)     3.0595 (1.02)     0.0000 (1.0)      3.0595 (1.02)     0.0000 (1.0)           0;0  0.3269 (0.98)          1           1
test_gc-gc[main]       3.3410 (1.11)     3.3410 (1.11)     3.3410 (1.11)     0.0000 (1.0)      3.3410 (1.11)     0.0000 (1.0)           0;0  0.2993 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     139.5924 (2.77)     139.5924 (2.77)     139.5924 (2.77)     0.0000 (1.0)      139.5924 (2.77)     0.0000 (1.0)           0;0  0.0072 (0.36)          1           1
test_get-get[3.10.0]     168.5310 (3.35)     168.5310 (3.35)     168.5310 (3.35)     0.0000 (1.0)      168.5310 (3.35)     0.0000 (1.0)           0;0  0.0059 (0.30)          1           1
test_get-get[3.53.2]     144.8963 (2.88)     144.8963 (2.88)     144.8963 (2.88)     0.0000 (1.0)      144.8963 (2.88)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[main]        50.3734 (1.0)       50.3734 (1.0)       50.3734 (1.0)      0.0000 (1.0)       50.3734 (1.0)      0.0000 (1.0)           0;0  0.0199 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.9840 (2.65)     44.9840 (2.65)     44.9840 (2.65)     0.0000 (1.0)      44.9840 (2.65)     0.0000 (1.0)           0;0  0.0222 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.6592 (2.81)     47.6592 (2.81)     47.6592 (2.81)     0.0000 (1.0)      47.6592 (2.81)     0.0000 (1.0)           0;0  0.0210 (0.36)          1           1
test_get_url-get-url[3.53.2]     16.9794 (1.0)      16.9794 (1.0)      16.9794 (1.0)      0.0000 (1.0)      16.9794 (1.0)      0.0000 (1.0)           0;0  0.0589 (1.0)           1           1
test_get_url-get-url[main]       17.4099 (1.03)     17.4099 (1.03)     17.4099 (1.03)     0.0000 (1.0)      17.4099 (1.03)     0.0000 (1.0)           0;0  0.0574 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     120.9616 (1.01)     128.7585 (1.0)      122.5513 (1.00)     1.2415 (1.0)      122.3503 (1.01)     0.9951 (1.41)         17;9  8.1598 (1.00)        100           1
test_help---help[3.10.0]     119.7604 (1.0)      156.9842 (1.22)     122.3046 (1.0)      5.0011 (4.03)     120.9321 (1.0)      0.9865 (1.40)         7;15  8.1763 (1.0)         100           1
test_help---help[3.53.2]     120.9419 (1.01)     143.5794 (1.12)     123.0154 (1.01)     2.4641 (1.98)     122.6366 (1.01)     0.9038 (1.28)          2;5  8.1291 (0.99)        100           1
test_help---help[main]       121.9684 (1.02)     132.3049 (1.03)     123.3589 (1.01)     1.3295 (1.07)     123.0178 (1.02)     0.7063 (1.0)           7;6  8.1064 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     231.3803 (3.00)     231.3803 (3.00)     231.3803 (3.00)     0.0000 (1.0)      231.3803 (3.00)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     260.3658 (3.38)     260.3658 (3.38)     260.3658 (3.38)     0.0000 (1.0)      260.3658 (3.38)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        77.0277 (1.0)       77.0277 (1.0)       77.0277 (1.0)      0.0000 (1.0)       77.0277 (1.0)      0.0000 (1.0)           0;0  0.0130 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     164.7401 (3.40)     164.7401 (3.40)     164.7401 (3.40)     0.0000 (1.0)      164.7401 (3.40)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.10.0]     168.8150 (3.48)     168.8150 (3.48)     168.8150 (3.48)     0.0000 (1.0)      168.8150 (3.48)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.6032 (2.61)     126.6032 (2.61)     126.6032 (2.61)     0.0000 (1.0)      126.6032 (2.61)     0.0000 (1.0)           0;0  0.0079 (0.38)          1           1
test_import_url-import-url[main]        48.4481 (1.0)       48.4481 (1.0)       48.4481 (1.0)      0.0000 (1.0)       48.4481 (1.0)      0.0000 (1.0)           0;0  0.0206 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     390.9712 (1.02)     441.2710 (1.04)     411.1481 (1.03)      8.4933 (1.14)     411.2565 (1.04)      8.5421 (1.52)         30;4  2.4322 (0.97)        100           1
test_init-init[3.10.0]     400.9164 (1.04)     447.3440 (1.05)     419.3138 (1.05)      7.4555 (1.0)      419.3471 (1.06)      8.2089 (1.46)         27;3  2.3848 (0.95)        100           1
test_init-init[3.53.2]     387.0006 (1.01)     425.3074 (1.0)      403.1868 (1.01)      8.9100 (1.20)     404.0187 (1.02)     15.1043 (2.69)         38;0  2.4802 (0.99)        100           1
test_init-init[main]       384.5561 (1.0)      517.3082 (1.22)     397.8734 (1.0)      17.4600 (2.34)     394.9357 (1.0)       5.6050 (1.0)           4;7  2.5134 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     590.7247 (1.04)     590.7247 (1.04)     590.7247 (1.04)     0.0000 (1.0)      590.7247 (1.04)     0.0000 (1.0)           0;0  1.6928 (0.96)          1           1
test_list-list[3.10.0]     663.4194 (1.16)     663.4194 (1.16)     663.4194 (1.16)     0.0000 (1.0)      663.4194 (1.16)     0.0000 (1.0)           0;0  1.5073 (0.86)          1           1
test_list-list[3.53.2]     576.5059 (1.01)     576.5059 (1.01)     576.5059 (1.01)     0.0000 (1.0)      576.5059 (1.01)     0.0000 (1.0)           0;0  1.7346 (0.99)          1           1
test_list-list[main]       570.0238 (1.0)      570.0238 (1.0)      570.0238 (1.0)      0.0000 (1.0)      570.0238 (1.0)      0.0000 (1.0)           0;0  1.7543 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     419.3355 (1.03)     419.3355 (1.03)     419.3355 (1.03)     0.0000 (1.0)      419.3355 (1.03)     0.0000 (1.0)           0;0  2.3847 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     426.9919 (1.05)     426.9919 (1.05)     426.9919 (1.05)     0.0000 (1.0)      426.9919 (1.05)     0.0000 (1.0)           0;0  2.3420 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     407.6700 (1.0)      407.6700 (1.0)      407.6700 (1.0)      0.0000 (1.0)      407.6700 (1.0)      0.0000 (1.0)           0;0  2.4530 (1.0)           1           1
test_list-list-dvc-only[main]       415.4067 (1.02)     415.4067 (1.02)     415.4067 (1.02)     0.0000 (1.0)      415.4067 (1.02)     0.0000 (1.0)           0;0  2.4073 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7608 (1.0)      2.7608 (1.0)      2.7608 (1.0)      0.0000 (1.0)      2.7608 (1.0)      0.0000 (1.0)           0;0  0.3622 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8385 (1.03)     2.8385 (1.03)     2.8385 (1.03)     0.0000 (1.0)      2.8385 (1.03)     0.0000 (1.0)           0;0  0.3523 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.8998 (1.05)     2.8998 (1.05)     2.8998 (1.05)     0.0000 (1.0)      2.8998 (1.05)     0.0000 (1.0)           0;0  0.3449 (0.95)          1           1
test_list-list-recursive[main]       3.0810 (1.12)     3.0810 (1.12)     3.0810 (1.12)     0.0000 (1.0)      3.0810 (1.12)     0.0000 (1.0)           0;0  0.3246 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     421.4500 (1.04)     421.4500 (1.04)     421.4500 (1.04)     0.0000 (1.0)      421.4500 (1.04)     0.0000 (1.0)           0;0  2.3728 (0.96)          1           1
test_list-list-shallow[3.10.0]     422.9056 (1.04)     422.9056 (1.04)     422.9056 (1.04)     0.0000 (1.0)      422.9056 (1.04)     0.0000 (1.0)           0;0  2.3646 (0.96)          1           1
test_list-list-shallow[3.53.2]     406.6175 (1.00)     406.6175 (1.00)     406.6175 (1.00)     0.0000 (1.0)      406.6175 (1.00)     0.0000 (1.0)           0;0  2.4593 (1.00)          1           1
test_list-list-shallow[main]       406.1776 (1.0)      406.1776 (1.0)      406.1776 (1.0)      0.0000 (1.0)      406.1776 (1.0)      0.0000 (1.0)           0;0  2.4620 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.7909 (2.79)     12.7909 (2.79)     12.7909 (2.79)     0.0000 (1.0)      12.7909 (2.79)     0.0000 (1.0)           0;0  0.0782 (0.36)          1           1
test_partial_add-add[3.10.0]     13.0438 (2.84)     13.0438 (2.84)     13.0438 (2.84)     0.0000 (1.0)      13.0438 (2.84)     0.0000 (1.0)           0;0  0.0767 (0.35)          1           1
test_partial_add-add[3.53.2]     11.8956 (2.59)     11.8956 (2.59)     11.8956 (2.59)     0.0000 (1.0)      11.8956 (2.59)     0.0000 (1.0)           0;0  0.0841 (0.39)          1           1
test_partial_add-add[main]        4.5893 (1.0)       4.5893 (1.0)       4.5893 (1.0)      0.0000 (1.0)       4.5893 (1.0)      0.0000 (1.0)           0;0  0.2179 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     86.3743 (4.01)     86.3743 (4.01)     86.3743 (4.01)     0.0000 (1.0)      86.3743 (4.01)     0.0000 (1.0)           0;0  0.0116 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     86.9967 (4.03)     86.9967 (4.03)     86.9967 (4.03)     0.0000 (1.0)      86.9967 (4.03)     0.0000 (1.0)           0;0  0.0115 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     79.1218 (3.67)     79.1218 (3.67)     79.1218 (3.67)     0.0000 (1.0)      79.1218 (3.67)     0.0000 (1.0)           0;0  0.0126 (0.27)          1           1
test_partial_add-add-partial[main]       21.5621 (1.0)      21.5621 (1.0)      21.5621 (1.0)      0.0000 (1.0)      21.5621 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.3561 (1.0)      5.3561 (1.0)      5.3561 (1.0)      0.0000 (1.0)      5.3561 (1.0)      0.0000 (1.0)           0;0  0.1867 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.5876 (1.23)     6.5876 (1.23)     6.5876 (1.23)     0.0000 (1.0)      6.5876 (1.23)     0.0000 (1.0)           0;0  0.1518 (0.81)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.9745 (1.49)     7.9745 (1.49)     7.9745 (1.49)     0.0000 (1.0)      7.9745 (1.49)     0.0000 (1.0)           0;0  0.1254 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       7.9263 (1.48)     7.9263 (1.48)     7.9263 (1.48)     0.0000 (1.0)      7.9263 (1.48)     0.0000 (1.0)           0;0  0.1262 (0.68)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.9077 (1.0)      2.9077 (1.0)      2.9077 (1.0)      0.0000 (1.0)      2.9077 (1.0)      0.0000 (1.0)           0;0  0.3439 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.2446 (1.46)     4.2446 (1.46)     4.2446 (1.46)     0.0000 (1.0)      4.2446 (1.46)     0.0000 (1.0)           0;0  0.2356 (0.69)          1           1
test_partial_add-gc-noop[3.53.2]     4.3794 (1.51)     4.3794 (1.51)     4.3794 (1.51)     0.0000 (1.0)      4.3794 (1.51)     0.0000 (1.0)           0;0  0.2283 (0.66)          1           1
test_partial_add-gc-noop[main]       4.6184 (1.59)     4.6184 (1.59)     4.6184 (1.59)     0.0000 (1.0)      4.6184 (1.59)     0.0000 (1.0)           0;0  0.2165 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7730 (2.12)     7.7730 (2.12)     7.7730 (2.12)     0.0000 (1.0)      7.7730 (2.12)     0.0000 (1.0)           0;0  0.1287 (0.47)          1           1
test_partial_add-push[3.10.0]     7.0877 (1.94)     7.0877 (1.94)     7.0877 (1.94)     0.0000 (1.0)      7.0877 (1.94)     0.0000 (1.0)           0;0  0.1411 (0.52)          1           1
test_partial_add-push[3.53.2]     3.6589 (1.0)      3.6589 (1.0)      3.6589 (1.0)      0.0000 (1.0)      3.6589 (1.0)      0.0000 (1.0)           0;0  0.2733 (1.0)           1           1
test_partial_add-push[main]       3.6757 (1.00)     3.6757 (1.00)     3.6757 (1.00)     0.0000 (1.0)      3.6757 (1.00)     0.0000 (1.0)           0;0  0.2721 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.7373 (2.17)     45.7373 (2.17)     45.7373 (2.17)     0.0000 (1.0)      45.7373 (2.17)     0.0000 (1.0)           0;0  0.0219 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     40.0220 (1.89)     40.0220 (1.89)     40.0220 (1.89)     0.0000 (1.0)      40.0220 (1.89)     0.0000 (1.0)           0;0  0.0250 (0.53)          1           1
test_partial_add-push-partial[3.53.2]     21.5774 (1.02)     21.5774 (1.02)     21.5774 (1.02)     0.0000 (1.0)      21.5774 (1.02)     0.0000 (1.0)           0;0  0.0463 (0.98)          1           1
test_partial_add-push-partial[main]       21.1249 (1.0)      21.1249 (1.0)      21.1249 (1.0)      0.0000 (1.0)      21.1249 (1.0)      0.0000 (1.0)           0;0  0.0473 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     92.6101 (3.82)     92.6101 (3.82)     92.6101 (3.82)     0.0000 (1.0)      92.6101 (3.82)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.10.0]     94.5203 (3.89)     94.5203 (3.89)     94.5203 (3.89)     0.0000 (1.0)      94.5203 (3.89)     0.0000 (1.0)           0;0  0.0106 (0.26)          1           1
test_partial_remove-add[3.53.2]     83.4101 (3.44)     83.4101 (3.44)     83.4101 (3.44)     0.0000 (1.0)      83.4101 (3.44)     0.0000 (1.0)           0;0  0.0120 (0.29)          1           1
test_partial_remove-add[main]       24.2682 (1.0)      24.2682 (1.0)      24.2682 (1.0)      0.0000 (1.0)      24.2682 (1.0)      0.0000 (1.0)           0;0  0.0412 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     51.6565 (12.75)    51.6565 (12.75)    51.6565 (12.75)    0.0000 (1.0)      51.6565 (12.75)    0.0000 (1.0)           0;0  0.0194 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     52.2314 (12.90)    52.2314 (12.90)    52.2314 (12.90)    0.0000 (1.0)      52.2314 (12.90)    0.0000 (1.0)           0;0  0.0191 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     46.7789 (11.55)    46.7789 (11.55)    46.7789 (11.55)    0.0000 (1.0)      46.7789 (11.55)    0.0000 (1.0)           0;0  0.0214 (0.09)          1           1
test_partial_remove-add-update[main]        4.0500 (1.0)       4.0500 (1.0)       4.0500 (1.0)      0.0000 (1.0)       4.0500 (1.0)      0.0000 (1.0)           0;0  0.2469 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.8404 (1.0)      2.8404 (1.0)      2.8404 (1.0)      0.0000 (1.0)      2.8404 (1.0)      0.0000 (1.0)           0;0  0.3521 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.1719 (1.47)     4.1719 (1.47)     4.1719 (1.47)     0.0000 (1.0)      4.1719 (1.47)     0.0000 (1.0)           0;0  0.2397 (0.68)          1           1
test_partial_remove-gc[3.53.2]     4.1510 (1.46)     4.1510 (1.46)     4.1510 (1.46)     0.0000 (1.0)      4.1510 (1.46)     0.0000 (1.0)           0;0  0.2409 (0.68)          1           1
test_partial_remove-gc[main]       4.2347 (1.49)     4.2347 (1.49)     4.2347 (1.49)     0.0000 (1.0)      4.2347 (1.49)     0.0000 (1.0)           0;0  0.2361 (0.67)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1613 (1.0)      5.1613 (1.0)      5.1613 (1.0)      0.0000 (1.0)      5.1613 (1.0)      0.0000 (1.0)           0;0  0.1937 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.9299 (1.34)     6.9299 (1.34)     6.9299 (1.34)     0.0000 (1.0)      6.9299 (1.34)     0.0000 (1.0)           0;0  0.1443 (0.74)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.6952 (1.49)     7.6952 (1.49)     7.6952 (1.49)     0.0000 (1.0)      7.6952 (1.49)     0.0000 (1.0)           0;0  0.1300 (0.67)          1           1
test_partial_remove-gc-cloud[main]       7.5600 (1.46)     7.5600 (1.46)     7.5600 (1.46)     0.0000 (1.0)      7.5600 (1.46)     0.0000 (1.0)           0;0  0.1323 (0.68)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.1127 (2.29)     52.1127 (2.29)     52.1127 (2.29)     0.0000 (1.0)      52.1127 (2.29)     0.0000 (1.0)           0;0  0.0192 (0.44)          1           1
test_partial_remove-push[3.10.0]     46.6915 (2.05)     46.6915 (2.05)     46.6915 (2.05)     0.0000 (1.0)      46.6915 (2.05)     0.0000 (1.0)           0;0  0.0214 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.6860 (1.04)     23.6860 (1.04)     23.6860 (1.04)     0.0000 (1.0)      23.6860 (1.04)     0.0000 (1.0)           0;0  0.0422 (0.96)          1           1
test_partial_remove-push[main]       22.7593 (1.0)      22.7593 (1.0)      22.7593 (1.0)      0.0000 (1.0)      22.7593 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.0889 (1.02)     4.0889 (1.02)     4.0889 (1.02)     0.0000 (1.0)      4.0889 (1.02)     0.0000 (1.0)           0;0  0.2446 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     4.0252 (1.0)      4.0252 (1.0)      4.0252 (1.0)      0.0000 (1.0)      4.0252 (1.0)      0.0000 (1.0)           0;0  0.2484 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.3167 (1.82)     7.3167 (1.82)     7.3167 (1.82)     0.0000 (1.0)      7.3167 (1.82)     0.0000 (1.0)           0;0  0.1367 (0.55)          1           1
test_partial_remove-push-update[main]       7.2570 (1.80)     7.2570 (1.80)     7.2570 (1.80)     0.0000 (1.0)      7.2570 (1.80)     0.0000 (1.0)           0;0  0.1378 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     487.5021 (1.0)      504.8653 (1.0)      495.0291 (1.0)       6.5353 (1.0)      495.3993 (1.0)       8.2680 (1.0)           2;0  2.0201 (1.0)           5           3
test_plots-plots-diff[3.10.0]     906.9644 (1.86)     951.9229 (1.89)     918.1679 (1.85)     18.9967 (2.91)     910.5390 (1.84)     14.4284 (1.75)          1;1  1.0891 (0.54)          5           3
test_plots-plots-diff[3.53.2]     860.9866 (1.77)     878.9653 (1.74)     868.7089 (1.75)      7.5775 (1.16)     870.5732 (1.76)     12.1209 (1.47)          2;0  1.1511 (0.57)          5           3
test_plots-plots-diff[main]       862.0718 (1.77)     886.4179 (1.76)     872.7273 (1.76)     10.6409 (1.63)     867.0178 (1.75)     17.4989 (2.12)          2;0  1.1458 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       496.2579 (1.0)        501.5124 (1.0)        497.9805 (1.0)      2.0649 (1.36)       497.5977 (1.0)       2.0248 (1.0)           1;0  2.0081 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,139.1470 (2.30)     1,161.0690 (2.32)     1,151.8715 (2.31)     7.9305 (5.24)     1,152.7563 (2.32)      6.4235 (3.17)          2;1  0.8682 (0.43)          5           3
test_plots-plots-diff-json[3.53.2]       935.0569 (1.88)       954.4957 (1.90)       944.3496 (1.90)     7.4709 (4.94)       942.1722 (1.89)     10.5063 (5.19)          2;0  1.0589 (0.53)          5           3
test_plots-plots-diff-json[main]         935.1992 (1.88)       939.1762 (1.87)       937.0225 (1.88)     1.5131 (1.0)        937.0698 (1.88)      2.1176 (1.05)          2;0  1.0672 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     434.8150 (1.0)      441.5604 (1.0)      438.3445 (1.0)       2.7009 (1.18)     439.4226 (1.0)       4.0400 (1.34)          2;0  2.2813 (1.0)           5           3
test_plots-plots-show[3.10.0]     746.2970 (1.72)     751.3178 (1.70)     748.6572 (1.71)      2.2894 (1.0)      748.3791 (1.70)      4.2997 (1.42)          2;0  1.3357 (0.59)          5           3
test_plots-plots-show[3.53.2]     713.9947 (1.64)     751.8703 (1.70)     724.1830 (1.65)     15.6259 (6.83)     718.6294 (1.64)     11.6156 (3.84)          1;1  1.3809 (0.61)          5           3
test_plots-plots-show[main]       719.1327 (1.65)     727.0680 (1.65)     721.6633 (1.65)      3.1406 (1.37)     720.9944 (1.64)      3.0230 (1.0)           1;0  1.3857 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     458.1952 (1.0)      472.4564 (1.0)      462.3547 (1.0)      5.8169 (2.03)     459.7171 (1.0)      5.5733 (1.45)          1;0  2.1628 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     878.0360 (1.92)     885.8367 (1.87)     882.0336 (1.91)     2.8996 (1.01)     882.1457 (1.92)     3.8387 (1.0)           2;0  1.1337 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     759.9504 (1.66)     766.5889 (1.62)     763.3333 (1.65)     2.8617 (1.0)      762.2439 (1.66)     4.8039 (1.25)          2;0  1.3100 (0.61)          5           3
test_plots-plots-show-json[main]       770.0156 (1.68)     780.8695 (1.65)     773.1496 (1.67)     4.4355 (1.55)     771.2285 (1.68)     4.2270 (1.10)          1;0  1.2934 (0.60)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.6124 (2.28)     52.6124 (2.28)     52.6124 (2.28)     0.0000 (1.0)      52.6124 (2.28)     0.0000 (1.0)           0;0  0.0190 (0.44)          1           1
test_push-push[3.10.0]     47.0251 (2.04)     47.0251 (2.04)     47.0251 (2.04)     0.0000 (1.0)      47.0251 (2.04)     0.0000 (1.0)           0;0  0.0213 (0.49)          1           1
test_push-push[3.53.2]     23.1775 (1.00)     23.1775 (1.00)     23.1775 (1.00)     0.0000 (1.0)      23.1775 (1.00)     0.0000 (1.0)           0;0  0.0431 (1.00)          1           1
test_push-push[main]       23.0648 (1.0)      23.0648 (1.0)      23.0648 (1.0)      0.0000 (1.0)      23.0648 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     67.1714 (2.78)     67.1714 (2.78)     67.1714 (2.78)     0.0000 (1.0)      67.1714 (2.78)     0.0000 (1.0)           0;0  0.0149 (0.36)          1           1
test_sharing-fetch[3.10.0]     72.8642 (3.01)     72.8642 (3.01)     72.8642 (3.01)     0.0000 (1.0)      72.8642 (3.01)     0.0000 (1.0)           0;0  0.0137 (0.33)          1           1
test_sharing-fetch[3.53.2]     36.6538 (1.52)     36.6538 (1.52)     36.6538 (1.52)     0.0000 (1.0)      36.6538 (1.52)     0.0000 (1.0)           0;0  0.0273 (0.66)          1           1
test_sharing-fetch[main]       24.1935 (1.0)      24.1935 (1.0)      24.1935 (1.0)      0.0000 (1.0)      24.1935 (1.0)      0.0000 (1.0)           0;0  0.0413 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2978 (1.0)      1.2978 (1.0)      1.2978 (1.0)      0.0000 (1.0)      1.2978 (1.0)      0.0000 (1.0)           0;0  0.7705 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7529 (2.89)     3.7529 (2.89)     3.7529 (2.89)     0.0000 (1.0)      3.7529 (2.89)     0.0000 (1.0)           0;0  0.2665 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     6.2269 (4.80)     6.2269 (4.80)     6.2269 (4.80)     0.0000 (1.0)      6.2269 (4.80)     0.0000 (1.0)           0;0  0.1606 (0.21)          1           1
test_sharing-fetch-noop[main]       6.2259 (4.80)     6.2259 (4.80)     6.2259 (4.80)     0.0000 (1.0)      6.2259 (4.80)     0.0000 (1.0)           0;0  0.1606 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.1113 (2.32)     53.1113 (2.32)     53.1113 (2.32)     0.0000 (1.0)      53.1113 (2.32)     0.0000 (1.0)           0;0  0.0188 (0.43)          1           1
test_sharing-push[3.10.0]     47.3532 (2.07)     47.3532 (2.07)     47.3532 (2.07)     0.0000 (1.0)      47.3532 (2.07)     0.0000 (1.0)           0;0  0.0211 (0.48)          1           1
test_sharing-push[3.53.2]     23.4912 (1.03)     23.4912 (1.03)     23.4912 (1.03)     0.0000 (1.0)      23.4912 (1.03)     0.0000 (1.0)           0;0  0.0426 (0.97)          1           1
test_sharing-push[main]       22.8878 (1.0)      22.8878 (1.0)      22.8878 (1.0)      0.0000 (1.0)      22.8878 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2128 (1.0)      2.2128 (1.0)      2.2128 (1.0)      0.0000 (1.0)      2.2128 (1.0)      0.0000 (1.0)           0;0  0.4519 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2297 (1.01)     2.2297 (1.01)     2.2297 (1.01)     0.0000 (1.0)      2.2297 (1.01)     0.0000 (1.0)           0;0  0.4485 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.3804 (2.88)     6.3804 (2.88)     6.3804 (2.88)     0.0000 (1.0)      6.3804 (2.88)     0.0000 (1.0)           0;0  0.1567 (0.35)          1           1
test_sharing-push-noop[main]       6.4283 (2.91)     6.4283 (2.91)     6.4283 (2.91)     0.0000 (1.0)      6.4283 (2.91)     0.0000 (1.0)           0;0  0.1556 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     150.6903 (1.09)     150.6903 (1.09)     150.6903 (1.09)     0.0000 (1.0)      150.6903 (1.09)     0.0000 (1.0)           0;0  0.0066 (0.92)          1           1
test_sharing_azure-fetch[main]       138.4333 (1.0)      138.4333 (1.0)      138.4333 (1.0)      0.0000 (1.0)      138.4333 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.5998 (1.0)      6.5998 (1.0)      6.5998 (1.0)      0.0000 (1.0)      6.5998 (1.0)      0.0000 (1.0)           0;0  0.1515 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7326 (1.02)     6.7326 (1.02)     6.7326 (1.02)     0.0000 (1.0)      6.7326 (1.02)     0.0000 (1.0)           0;0  0.1485 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     146.4396 (1.00)     146.4396 (1.00)     146.4396 (1.00)     0.0000 (1.0)      146.4396 (1.00)     0.0000 (1.0)           0;0  0.0068 (1.00)          1           1
test_sharing_azure-push[main]       146.2819 (1.0)      146.2819 (1.0)      146.2819 (1.0)      0.0000 (1.0)      146.2819 (1.0)      0.0000 (1.0)           0;0  0.0068 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.1567 (1.0)      7.1567 (1.0)      7.1567 (1.0)      0.0000 (1.0)      7.1567 (1.0)      0.0000 (1.0)           0;0  0.1397 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.1965 (1.01)     7.1965 (1.01)     7.1965 (1.01)     0.0000 (1.0)      7.1965 (1.01)     0.0000 (1.0)           0;0  0.1390 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     326.0330 (1.03)     326.0330 (1.03)     326.0330 (1.03)     0.0000 (1.0)      326.0330 (1.03)     0.0000 (1.0)           0;0  0.0031 (0.97)          1           1
test_sharing_gs-fetch[main]       316.9252 (1.0)      316.9252 (1.0)      316.9252 (1.0)      0.0000 (1.0)      316.9252 (1.0)      0.0000 (1.0)           0;0  0.0032 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.6158 (1.0)      7.6158 (1.0)      7.6158 (1.0)      0.0000 (1.0)      7.6158 (1.0)      0.0000 (1.0)           0;0  0.1313 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.6252 (1.00)     7.6252 (1.00)     7.6252 (1.00)     0.0000 (1.0)      7.6252 (1.00)     0.0000 (1.0)           0;0  0.1311 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     675.1626 (1.00)     675.1626 (1.00)     675.1626 (1.00)     0.0000 (1.0)      675.1626 (1.00)     0.0000 (1.0)           0;0  0.0015 (1.00)          1           1
test_sharing_gs-push[main]       674.6697 (1.0)      674.6697 (1.0)      674.6697 (1.0)      0.0000 (1.0)      674.6697 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.1689 (1.0)      7.1689 (1.0)      7.1689 (1.0)      0.0000 (1.0)      7.1689 (1.0)      0.0000 (1.0)           0;0  0.1395 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.3373 (1.02)     7.3373 (1.02)     7.3373 (1.02)     0.0000 (1.0)      7.3373 (1.02)     0.0000 (1.0)           0;0  0.1363 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     444.1419 (1.00)     444.1419 (1.00)     444.1419 (1.00)     0.0000 (1.0)      444.1419 (1.00)     0.0000 (1.0)           0;0  0.0023 (1.00)          1           1
test_sharing_s3-fetch[main]       442.3028 (1.0)      442.3028 (1.0)      442.3028 (1.0)      0.0000 (1.0)      442.3028 (1.0)      0.0000 (1.0)           0;0  0.0023 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5783 (1.0)      6.5783 (1.0)      6.5783 (1.0)      0.0000 (1.0)      6.5783 (1.0)      0.0000 (1.0)           0;0  0.1520 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7340 (1.02)     6.7340 (1.02)     6.7340 (1.02)     0.0000 (1.0)      6.7340 (1.02)     0.0000 (1.0)           0;0  0.1485 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     568.7153 (1.0)      568.7153 (1.0)      568.7153 (1.0)      0.0000 (1.0)      568.7153 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
test_sharing_s3-push[main]       577.5743 (1.02)     577.5743 (1.02)     577.5743 (1.02)     0.0000 (1.0)      577.5743 (1.02)     0.0000 (1.0)           0;0  0.0017 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.0932 (1.0)      7.0932 (1.0)      7.0932 (1.0)      0.0000 (1.0)      7.0932 (1.0)      0.0000 (1.0)           0;0  0.1410 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.1144 (1.00)     7.1144 (1.00)     7.1144 (1.00)     0.0000 (1.0)      7.1144 (1.00)     0.0000 (1.0)           0;0  0.1406 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.0908 (3.74)     22.0908 (3.74)     22.0908 (3.74)     0.0000 (1.0)      22.0908 (3.74)     0.0000 (1.0)           0;0  0.0453 (0.27)          1           1
test_status-status[3.10.0]     23.1293 (3.92)     23.1293 (3.92)     23.1293 (3.92)     0.0000 (1.0)      23.1293 (3.92)     0.0000 (1.0)           0;0  0.0432 (0.26)          1           1
test_status-status[3.53.2]     20.4135 (3.46)     20.4135 (3.46)     20.4135 (3.46)     0.0000 (1.0)      20.4135 (3.46)     0.0000 (1.0)           0;0  0.0490 (0.29)          1           1
test_status-status[main]        5.8988 (1.0)       5.8988 (1.0)       5.8988 (1.0)      0.0000 (1.0)       5.8988 (1.0)      0.0000 (1.0)           0;0  0.1695 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.1388 (1.73)     5.1388 (1.73)     5.1388 (1.73)     0.0000 (1.0)      5.1388 (1.73)     0.0000 (1.0)           0;0  0.1946 (0.58)          1           1
test_status-status-changed[3.10.0]     5.4245 (1.83)     5.4245 (1.83)     5.4245 (1.83)     0.0000 (1.0)      5.4245 (1.83)     0.0000 (1.0)           0;0  0.1843 (0.55)          1           1
test_status-status-changed[3.53.2]     5.3105 (1.79)     5.3105 (1.79)     5.3105 (1.79)     0.0000 (1.0)      5.3105 (1.79)     0.0000 (1.0)           0;0  0.1883 (0.56)          1           1
test_status-status-changed[main]       2.9647 (1.0)      2.9647 (1.0)      2.9647 (1.0)      0.0000 (1.0)      2.9647 (1.0)      0.0000 (1.0)           0;0  0.3373 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0439 (1.71)     5.0439 (1.71)     5.0439 (1.71)     0.0000 (1.0)      5.0439 (1.71)     0.0000 (1.0)           0;0  0.1983 (0.58)          1           1
test_status-status-changed-noop[3.10.0]     5.4541 (1.85)     5.4541 (1.85)     5.4541 (1.85)     0.0000 (1.0)      5.4541 (1.85)     0.0000 (1.0)           0;0  0.1833 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     5.0401 (1.71)     5.0401 (1.71)     5.0401 (1.71)     0.0000 (1.0)      5.0401 (1.71)     0.0000 (1.0)           0;0  0.1984 (0.58)          1           1
test_status-status-changed-noop[main]       2.9439 (1.0)      2.9439 (1.0)      2.9439 (1.0)      0.0000 (1.0)      2.9439 (1.0)      0.0000 (1.0)           0;0  0.3397 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.2890 (1.82)     5.2890 (1.82)     5.2890 (1.82)     0.0000 (1.0)      5.2890 (1.82)     0.0000 (1.0)           0;0  0.1891 (0.55)          1           1
test_status-status-noop[3.10.0]     5.3031 (1.82)     5.3031 (1.82)     5.3031 (1.82)     0.0000 (1.0)      5.3031 (1.82)     0.0000 (1.0)           0;0  0.1886 (0.55)          1           1
test_status-status-noop[3.53.2]     5.1058 (1.75)     5.1058 (1.75)     5.1058 (1.75)     0.0000 (1.0)      5.1058 (1.75)     0.0000 (1.0)           0;0  0.1959 (0.57)          1           1
test_status-status-noop[main]       2.9096 (1.0)      2.9096 (1.0)      2.9096 (1.0)      0.0000 (1.0)      2.9096 (1.0)      0.0000 (1.0)           0;0  0.3437 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     163.1828 (3.37)     163.1828 (3.37)     163.1828 (3.37)     0.0000 (1.0)      163.1828 (3.37)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_update-import-url[3.10.0]     166.7394 (3.44)     166.7394 (3.44)     166.7394 (3.44)     0.0000 (1.0)      166.7394 (3.44)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.53.2]     124.1824 (2.56)     124.1824 (2.56)     124.1824 (2.56)     0.0000 (1.0)      124.1824 (2.56)     0.0000 (1.0)           0;0  0.0081 (0.39)          1           1
test_update-import-url[main]        48.4334 (1.0)       48.4334 (1.0)       48.4334 (1.0)      0.0000 (1.0)       48.4334 (1.0)      0.0000 (1.0)           0;0  0.0206 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     146.4172 (3.91)     146.4172 (3.91)     146.4172 (3.91)     0.0000 (1.0)      146.4172 (3.91)     0.0000 (1.0)           0;0  0.0068 (0.26)          1           1
test_update-update[3.10.0]     150.7456 (4.03)     150.7456 (4.03)     150.7456 (4.03)     0.0000 (1.0)      150.7456 (4.03)     0.0000 (1.0)           0;0  0.0066 (0.25)          1           1
test_update-update[3.53.2]     114.1829 (3.05)     114.1829 (3.05)     114.1829 (3.05)     0.0000 (1.0)      114.1829 (3.05)     0.0000 (1.0)           0;0  0.0088 (0.33)          1           1
test_update-update[main]        37.4226 (1.0)       37.4226 (1.0)       37.4226 (1.0)      0.0000 (1.0)       37.4226 (1.0)      0.0000 (1.0)           0;0  0.0267 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.1152 (2.01)     17.1152 (2.01)     17.1152 (2.01)     0.0000 (1.0)      17.1152 (2.01)     0.0000 (1.0)           0;0  0.0584 (0.50)          1           1
test_update-update-noop[3.10.0]     17.8202 (2.09)     17.8202 (2.09)     17.8202 (2.09)     0.0000 (1.0)      17.8202 (2.09)     0.0000 (1.0)           0;0  0.0561 (0.48)          1           1
test_update-update-noop[3.53.2]     17.0407 (2.00)     17.0407 (2.00)     17.0407 (2.00)     0.0000 (1.0)      17.0407 (2.00)     0.0000 (1.0)           0;0  0.0587 (0.50)          1           1
test_update-update-noop[main]        8.5235 (1.0)       8.5235 (1.0)       8.5235 (1.0)      0.0000 (1.0)       8.5235 (1.0)      0.0000 (1.0)           0;0  0.1173 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean