Thu May  8 01:04:17 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     91.0467 (3.79)     91.0467 (3.79)     91.0467 (3.79)     0.0000 (1.0)      91.0467 (3.79)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_add_copy-add[3.10.0]     92.3671 (3.84)     92.3671 (3.84)     92.3671 (3.84)     0.0000 (1.0)      92.3671 (3.84)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_add_copy-add[3.53.2]     82.5903 (3.44)     82.5903 (3.44)     82.5903 (3.44)     0.0000 (1.0)      82.5903 (3.44)     0.0000 (1.0)           0;0  0.0121 (0.29)          1           1
test_add_copy-add[main]       24.0242 (1.0)      24.0242 (1.0)      24.0242 (1.0)      0.0000 (1.0)      24.0242 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.3124 (6.43)     31.3124 (6.43)     31.3124 (6.43)     0.0000 (1.0)      31.3124 (6.43)     0.0000 (1.0)           0;0  0.0319 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     32.1186 (6.60)     32.1186 (6.60)     32.1186 (6.60)     0.0000 (1.0)      32.1186 (6.60)     0.0000 (1.0)           0;0  0.0311 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     30.5530 (6.28)     30.5530 (6.28)     30.5530 (6.28)     0.0000 (1.0)      30.5530 (6.28)     0.0000 (1.0)           0;0  0.0327 (0.16)          1           1
test_add_copy-add-noop[main]        4.8673 (1.0)       4.8673 (1.0)       4.8673 (1.0)      0.0000 (1.0)       4.8673 (1.0)      0.0000 (1.0)           0;0  0.2055 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     73.2148 (4.19)     73.2148 (4.19)     73.2148 (4.19)     0.0000 (1.0)      73.2148 (4.19)     0.0000 (1.0)           0;0  0.0137 (0.24)          1           1
test_add_hardlink-add[3.10.0]     74.6733 (4.27)     74.6733 (4.27)     74.6733 (4.27)     0.0000 (1.0)      74.6733 (4.27)     0.0000 (1.0)           0;0  0.0134 (0.23)          1           1
test_add_hardlink-add[3.53.2]     68.9042 (3.94)     68.9042 (3.94)     68.9042 (3.94)     0.0000 (1.0)      68.9042 (3.94)     0.0000 (1.0)           0;0  0.0145 (0.25)          1           1
test_add_hardlink-add[main]       17.4794 (1.0)      17.4794 (1.0)      17.4794 (1.0)      0.0000 (1.0)      17.4794 (1.0)      0.0000 (1.0)           0;0  0.0572 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     37.0496 (7.86)     37.0496 (7.86)     37.0496 (7.86)     0.0000 (1.0)      37.0496 (7.86)     0.0000 (1.0)           0;0  0.0270 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.7062 (8.00)     37.7062 (8.00)     37.7062 (8.00)     0.0000 (1.0)      37.7062 (8.00)     0.0000 (1.0)           0;0  0.0265 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     35.4325 (7.52)     35.4325 (7.52)     35.4325 (7.52)     0.0000 (1.0)      35.4325 (7.52)     0.0000 (1.0)           0;0  0.0282 (0.13)          1           1
test_add_hardlink-add-noop[main]        4.7124 (1.0)       4.7124 (1.0)       4.7124 (1.0)      0.0000 (1.0)       4.7124 (1.0)      0.0000 (1.0)           0;0  0.2122 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     78.5433 (2.08)     78.5433 (2.08)     78.5433 (2.08)     0.0000 (1.0)      78.5433 (2.08)     0.0000 (1.0)           0;0  0.0127 (0.48)          1           1
test_add_symlink-add[3.10.0]     78.6886 (2.08)     78.6886 (2.08)     78.6886 (2.08)     0.0000 (1.0)      78.6886 (2.08)     0.0000 (1.0)           0;0  0.0127 (0.48)          1           1
test_add_symlink-add[3.53.2]     72.7537 (1.93)     72.7537 (1.93)     72.7537 (1.93)     0.0000 (1.0)      72.7537 (1.93)     0.0000 (1.0)           0;0  0.0137 (0.52)          1           1
test_add_symlink-add[main]       37.7832 (1.0)      37.7832 (1.0)      37.7832 (1.0)      0.0000 (1.0)      37.7832 (1.0)      0.0000 (1.0)           0;0  0.0265 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     50.8037 (7.85)     50.8037 (7.85)     50.8037 (7.85)     0.0000 (1.0)      50.8037 (7.85)     0.0000 (1.0)           0;0  0.0197 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     51.3060 (7.93)     51.3060 (7.93)     51.3060 (7.93)     0.0000 (1.0)      51.3060 (7.93)     0.0000 (1.0)           0;0  0.0195 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     47.9871 (7.41)     47.9871 (7.41)     47.9871 (7.41)     0.0000 (1.0)      47.9871 (7.41)     0.0000 (1.0)           0;0  0.0208 (0.13)          1           1
test_add_symlink-add-noop[main]        6.4735 (1.0)       6.4735 (1.0)       6.4735 (1.0)      0.0000 (1.0)       6.4735 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.4785 (1.98)     43.4785 (1.98)     43.4785 (1.98)     0.0000 (1.0)      43.4785 (1.98)     0.0000 (1.0)           0;0  0.0230 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     62.6202 (2.86)     62.6202 (2.86)     62.6202 (2.86)     0.0000 (1.0)      62.6202 (2.86)     0.0000 (1.0)           0;0  0.0160 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.7632 (1.36)     29.7632 (1.36)     29.7632 (1.36)     0.0000 (1.0)      29.7632 (1.36)     0.0000 (1.0)           0;0  0.0336 (0.74)          1           1
test_checkout_copy-checkout[main]       21.9151 (1.0)      21.9151 (1.0)      21.9151 (1.0)      0.0000 (1.0)      21.9151 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6636 (1.53)     5.6636 (1.53)     5.6636 (1.53)     0.0000 (1.0)      5.6636 (1.53)     0.0000 (1.0)           0;0  0.1766 (0.65)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.0778 (1.64)     6.0778 (1.64)     6.0778 (1.64)     0.0000 (1.0)      6.0778 (1.64)     0.0000 (1.0)           0;0  0.1645 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8555 (1.58)     5.8555 (1.58)     5.8555 (1.58)     0.0000 (1.0)      5.8555 (1.58)     0.0000 (1.0)           0;0  0.1708 (0.63)          1           1
test_checkout_copy-checkout-noop[main]       3.7021 (1.0)      3.7021 (1.0)      3.7021 (1.0)      0.0000 (1.0)      3.7021 (1.0)      0.0000 (1.0)           0;0  0.2701 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5483 (1.95)     8.5483 (1.95)     8.5483 (1.95)     0.0000 (1.0)      8.5483 (1.95)     0.0000 (1.0)           0;0  0.1170 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8446 (1.56)     6.8446 (1.56)     6.8446 (1.56)     0.0000 (1.0)      6.8446 (1.56)     0.0000 (1.0)           0;0  0.1461 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.8009 (1.55)     6.8009 (1.55)     6.8009 (1.55)     0.0000 (1.0)      6.8009 (1.55)     0.0000 (1.0)           0;0  0.1470 (0.64)          1           1
test_checkout_copy-checkout-update[main]       4.3796 (1.0)      4.3796 (1.0)      4.3796 (1.0)      0.0000 (1.0)      4.3796 (1.0)      0.0000 (1.0)           0;0  0.2283 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.5605 (3.01)     24.5605 (3.01)     24.5605 (3.01)     0.0000 (1.0)      24.5605 (3.01)     0.0000 (1.0)           0;0  0.0407 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.0095 (2.21)     18.0095 (2.21)     18.0095 (2.21)     0.0000 (1.0)      18.0095 (2.21)     0.0000 (1.0)           0;0  0.0555 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2456 (1.99)     16.2456 (1.99)     16.2456 (1.99)     0.0000 (1.0)      16.2456 (1.99)     0.0000 (1.0)           0;0  0.0616 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.1535 (1.0)       8.1535 (1.0)       8.1535 (1.0)      0.0000 (1.0)       8.1535 (1.0)      0.0000 (1.0)           0;0  0.1226 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.8995 (1.63)     5.8995 (1.63)     5.8995 (1.63)     0.0000 (1.0)      5.8995 (1.63)     0.0000 (1.0)           0;0  0.1695 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.1598 (1.70)     6.1598 (1.70)     6.1598 (1.70)     0.0000 (1.0)      6.1598 (1.70)     0.0000 (1.0)           0;0  0.1623 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8645 (1.62)     5.8645 (1.62)     5.8645 (1.62)     0.0000 (1.0)      5.8645 (1.62)     0.0000 (1.0)           0;0  0.1705 (0.62)          1           1
test_checkout_hardlink-checkout-noop[main]       3.6143 (1.0)      3.6143 (1.0)      3.6143 (1.0)      0.0000 (1.0)      3.6143 (1.0)      0.0000 (1.0)           0;0  0.2767 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6048 (2.03)     8.6048 (2.03)     8.6048 (2.03)     0.0000 (1.0)      8.6048 (2.03)     0.0000 (1.0)           0;0  0.1162 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.8421 (1.62)     6.8421 (1.62)     6.8421 (1.62)     0.0000 (1.0)      6.8421 (1.62)     0.0000 (1.0)           0;0  0.1462 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.7413 (1.59)     6.7413 (1.59)     6.7413 (1.59)     0.0000 (1.0)      6.7413 (1.59)     0.0000 (1.0)           0;0  0.1483 (0.63)          1           1
test_checkout_hardlink-checkout-update[main]       4.2328 (1.0)      4.2328 (1.0)      4.2328 (1.0)      0.0000 (1.0)      4.2328 (1.0)      0.0000 (1.0)           0;0  0.2363 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.9962 (2.41)     26.9962 (2.41)     26.9962 (2.41)     0.0000 (1.0)      26.9962 (2.41)     0.0000 (1.0)           0;0  0.0370 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     20.8418 (1.86)     20.8418 (1.86)     20.8418 (1.86)     0.0000 (1.0)      20.8418 (1.86)     0.0000 (1.0)           0;0  0.0480 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     19.1163 (1.70)     19.1163 (1.70)     19.1163 (1.70)     0.0000 (1.0)      19.1163 (1.70)     0.0000 (1.0)           0;0  0.0523 (0.59)          1           1
test_checkout_symlink-checkout[main]       11.2245 (1.0)      11.2245 (1.0)      11.2245 (1.0)      0.0000 (1.0)      11.2245 (1.0)      0.0000 (1.0)           0;0  0.0891 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7508 (1.47)     6.7508 (1.47)     6.7508 (1.47)     0.0000 (1.0)      6.7508 (1.47)     0.0000 (1.0)           0;0  0.1481 (0.68)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.0644 (1.54)     7.0644 (1.54)     7.0644 (1.54)     0.0000 (1.0)      7.0644 (1.54)     0.0000 (1.0)           0;0  0.1416 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7359 (1.47)     6.7359 (1.47)     6.7359 (1.47)     0.0000 (1.0)      6.7359 (1.47)     0.0000 (1.0)           0;0  0.1485 (0.68)          1           1
test_checkout_symlink-checkout-noop[main]       4.5783 (1.0)      4.5783 (1.0)      4.5783 (1.0)      0.0000 (1.0)      4.5783 (1.0)      0.0000 (1.0)           0;0  0.2184 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.3413 (1.76)     10.3413 (1.76)     10.3413 (1.76)     0.0000 (1.0)      10.3413 (1.76)     0.0000 (1.0)           0;0  0.0967 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6542 (1.48)      8.6542 (1.48)      8.6542 (1.48)     0.0000 (1.0)       8.6542 (1.48)     0.0000 (1.0)           0;0  0.1156 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.6213 (1.47)      8.6213 (1.47)      8.6213 (1.47)     0.0000 (1.0)       8.6213 (1.47)     0.0000 (1.0)           0;0  0.1160 (0.68)          1           1
test_checkout_symlink-checkout-update[main]        5.8638 (1.0)       5.8638 (1.0)       5.8638 (1.0)      0.0000 (1.0)       5.8638 (1.0)      0.0000 (1.0)           0;0  0.1705 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2062 (1.77)     4.2062 (1.77)     4.2062 (1.77)     0.0000 (1.0)      4.2062 (1.77)     0.0000 (1.0)           0;0  0.2377 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.8173 (2.03)     4.8173 (2.03)     4.8173 (2.03)     0.0000 (1.0)      4.8173 (2.03)     0.0000 (1.0)           0;0  0.2076 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.7395 (2.00)     4.7395 (2.00)     4.7395 (2.00)     0.0000 (1.0)      4.7395 (2.00)     0.0000 (1.0)           0;0  0.2110 (0.50)          1           1
test_data_status-data-changed[main]       2.3701 (1.0)      2.3701 (1.0)      2.3701 (1.0)      0.0000 (1.0)      2.3701 (1.0)      0.0000 (1.0)           0;0  0.4219 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2950 (1.73)     4.2950 (1.73)     4.2950 (1.73)     0.0000 (1.0)      4.2950 (1.73)     0.0000 (1.0)           0;0  0.2328 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9631 (1.99)     4.9631 (1.99)     4.9631 (1.99)     0.0000 (1.0)      4.9631 (1.99)     0.0000 (1.0)           0;0  0.2015 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6419 (1.87)     4.6419 (1.87)     4.6419 (1.87)     0.0000 (1.0)      4.6419 (1.87)     0.0000 (1.0)           0;0  0.2154 (0.54)          1           1
test_data_status-data-changed-noop[main]       2.4882 (1.0)      2.4882 (1.0)      2.4882 (1.0)      0.0000 (1.0)      2.4882 (1.0)      0.0000 (1.0)           0;0  0.4019 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.7390 (3.84)     19.7390 (3.84)     19.7390 (3.84)     0.0000 (1.0)      19.7390 (3.84)     0.0000 (1.0)           0;0  0.0507 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.3969 (3.96)     20.3969 (3.96)     20.3969 (3.96)     0.0000 (1.0)      20.3969 (3.96)     0.0000 (1.0)           0;0  0.0490 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.8201 (3.85)     19.8201 (3.85)     19.8201 (3.85)     0.0000 (1.0)      19.8201 (3.85)     0.0000 (1.0)           0;0  0.0505 (0.26)          1           1
test_data_status-data-new[main]        5.1449 (1.0)       5.1449 (1.0)       5.1449 (1.0)      0.0000 (1.0)       5.1449 (1.0)      0.0000 (1.0)           0;0  0.1944 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2108 (1.78)     4.2108 (1.78)     4.2108 (1.78)     0.0000 (1.0)      4.2108 (1.78)     0.0000 (1.0)           0;0  0.2375 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.8482 (2.05)     4.8482 (2.05)     4.8482 (2.05)     0.0000 (1.0)      4.8482 (2.05)     0.0000 (1.0)           0;0  0.2063 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.7018 (1.99)     4.7018 (1.99)     4.7018 (1.99)     0.0000 (1.0)      4.7018 (1.99)     0.0000 (1.0)           0;0  0.2127 (0.50)          1           1
test_data_status-data-noop[main]       2.3679 (1.0)      2.3679 (1.0)      2.3679 (1.0)      0.0000 (1.0)      2.3679 (1.0)      0.0000 (1.0)           0;0  0.4223 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.6147 (1.07)     20.6147 (1.07)     20.6147 (1.07)     0.0000 (1.0)      20.6147 (1.07)     0.0000 (1.0)           0;0  0.0485 (0.94)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.2722 (1.10)     21.2722 (1.10)     21.2722 (1.10)     0.0000 (1.0)      21.2722 (1.10)     0.0000 (1.0)           0;0  0.0470 (0.91)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.2934 (1.10)     21.2934 (1.10)     21.2934 (1.10)     0.0000 (1.0)      21.2934 (1.10)     0.0000 (1.0)           0;0  0.0470 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       19.3535 (1.0)      19.3535 (1.0)      19.3535 (1.0)      0.0000 (1.0)      19.3535 (1.0)      0.0000 (1.0)           0;0  0.0517 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.7327 (1.08)     20.7327 (1.08)     20.7327 (1.08)     0.0000 (1.0)      20.7327 (1.08)     0.0000 (1.0)           0;0  0.0482 (0.93)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.3167 (1.11)     21.3167 (1.11)     21.3167 (1.11)     0.0000 (1.0)      21.3167 (1.11)     0.0000 (1.0)           0;0  0.0469 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.1997 (1.10)     21.1997 (1.10)     21.1997 (1.10)     0.0000 (1.0)      21.1997 (1.10)     0.0000 (1.0)           0;0  0.0472 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.1969 (1.0)      19.1969 (1.0)      19.1969 (1.0)      0.0000 (1.0)      19.1969 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.7995 (1.70)     36.7995 (1.70)     36.7995 (1.70)     0.0000 (1.0)      36.7995 (1.70)     0.0000 (1.0)           0;0  0.0272 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.8608 (1.75)     37.8608 (1.75)     37.8608 (1.75)     0.0000 (1.0)      37.8608 (1.75)     0.0000 (1.0)           0;0  0.0264 (0.57)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.1626 (1.72)     37.1626 (1.72)     37.1626 (1.72)     0.0000 (1.0)      37.1626 (1.72)     0.0000 (1.0)           0;0  0.0269 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.6116 (1.0)      21.6116 (1.0)      21.6116 (1.0)      0.0000 (1.0)      21.6116 (1.0)      0.0000 (1.0)           0;0  0.0463 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.7385 (1.07)     19.7385 (1.07)     19.7385 (1.07)     0.0000 (1.0)      19.7385 (1.07)     0.0000 (1.0)           0;0  0.0507 (0.93)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.6373 (1.12)     20.6373 (1.12)     20.6373 (1.12)     0.0000 (1.0)      20.6373 (1.12)     0.0000 (1.0)           0;0  0.0485 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.2980 (1.10)     20.2980 (1.10)     20.2980 (1.10)     0.0000 (1.0)      20.2980 (1.10)     0.0000 (1.0)           0;0  0.0493 (0.91)          1           1
test_data_status_all_flags-data-noop[main]       18.3927 (1.0)      18.3927 (1.0)      18.3927 (1.0)      0.0000 (1.0)      18.3927 (1.0)      0.0000 (1.0)           0;0  0.0544 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.8465 (2.60)     19.8465 (2.60)     19.8465 (2.60)     0.0000 (1.0)      19.8465 (2.60)     0.0000 (1.0)           0;0  0.0504 (0.38)          1           1
test_diff-diff[3.10.0]     20.9970 (2.75)     20.9970 (2.75)     20.9970 (2.75)     0.0000 (1.0)      20.9970 (2.75)     0.0000 (1.0)           0;0  0.0476 (0.36)          1           1
test_diff-diff[3.53.2]     21.4121 (2.81)     21.4121 (2.81)     21.4121 (2.81)     0.0000 (1.0)      21.4121 (2.81)     0.0000 (1.0)           0;0  0.0467 (0.36)          1           1
test_diff-diff[main]        7.6325 (1.0)       7.6325 (1.0)       7.6325 (1.0)      0.0000 (1.0)       7.6325 (1.0)      0.0000 (1.0)           0;0  0.1310 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.5659 (1.75)     6.5659 (1.75)     6.5659 (1.75)     0.0000 (1.0)      6.5659 (1.75)     0.0000 (1.0)           0;0  0.1523 (0.57)          1           1
test_diff-diff-changed[3.10.0]     7.1800 (1.92)     7.1800 (1.92)     7.1800 (1.92)     0.0000 (1.0)      7.1800 (1.92)     0.0000 (1.0)           0;0  0.1393 (0.52)          1           1
test_diff-diff-changed[3.53.2]     6.0777 (1.62)     6.0777 (1.62)     6.0777 (1.62)     0.0000 (1.0)      6.0777 (1.62)     0.0000 (1.0)           0;0  0.1645 (0.62)          1           1
test_diff-diff-changed[main]       3.7439 (1.0)      3.7439 (1.0)      3.7439 (1.0)      0.0000 (1.0)      3.7439 (1.0)      0.0000 (1.0)           0;0  0.2671 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.7048 (1.50)     5.7048 (1.50)     5.7048 (1.50)     0.0000 (1.0)      5.7048 (1.50)     0.0000 (1.0)           0;0  0.1753 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     6.1382 (1.61)     6.1382 (1.61)     6.1382 (1.61)     0.0000 (1.0)      6.1382 (1.61)     0.0000 (1.0)           0;0  0.1629 (0.62)          1           1
test_diff-diff-changed-noop[3.53.2]     5.9937 (1.57)     5.9937 (1.57)     5.9937 (1.57)     0.0000 (1.0)      5.9937 (1.57)     0.0000 (1.0)           0;0  0.1668 (0.63)          1           1
test_diff-diff-changed-noop[main]       3.8056 (1.0)      3.8056 (1.0)      3.8056 (1.0)      0.0000 (1.0)      3.8056 (1.0)      0.0000 (1.0)           0;0  0.2628 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.5078 (1.20)     4.5078 (1.20)     4.5078 (1.20)     0.0000 (1.0)      4.5078 (1.20)     0.0000 (1.0)           0;0  0.2218 (0.84)          1           1
test_diff-diff-noop[3.10.0]     5.2489 (1.39)     5.2489 (1.39)     5.2489 (1.39)     0.0000 (1.0)      5.2489 (1.39)     0.0000 (1.0)           0;0  0.1905 (0.72)          1           1
test_diff-diff-noop[3.53.2]     6.0030 (1.59)     6.0030 (1.59)     6.0030 (1.59)     0.0000 (1.0)      6.0030 (1.59)     0.0000 (1.0)           0;0  0.1666 (0.63)          1           1
test_diff-diff-noop[main]       3.7695 (1.0)      3.7695 (1.0)      3.7695 (1.0)      0.0000 (1.0)      3.7695 (1.0)      0.0000 (1.0)           0;0  0.2653 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        988.8211 (1.0)         988.8211 (1.0)         988.8211 (1.0)      0.0000 (1.0)         988.8211 (1.0)      0.0000 (1.0)           0;0  1.0113 (1.0)           1           1
test_exp_show-exp[3.10.0]      8,486.9734 (8.58)      8,486.9734 (8.58)      8,486.9734 (8.58)     0.0000 (1.0)       8,486.9734 (8.58)     0.0000 (1.0)           0;0  0.1178 (0.12)          1           1
test_exp_show-exp[3.53.2]      4,873.0703 (4.93)      4,873.0703 (4.93)      4,873.0703 (4.93)     0.0000 (1.0)       4,873.0703 (4.93)     0.0000 (1.0)           0;0  0.2052 (0.20)          1           1
test_exp_show-exp[main]       10,169.3138 (10.28)    10,169.3138 (10.28)    10,169.3138 (10.28)    0.0000 (1.0)      10,169.3138 (10.28)    0.0000 (1.0)           0;0  0.0983 (0.10)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     68.2125 (2.80)     68.2125 (2.80)     68.2125 (2.80)     0.0000 (1.0)      68.2125 (2.80)     0.0000 (1.0)           0;0  0.0147 (0.36)          1           1
test_fetch-fetch[3.10.0]     74.0995 (3.04)     74.0995 (3.04)     74.0995 (3.04)     0.0000 (1.0)      74.0995 (3.04)     0.0000 (1.0)           0;0  0.0135 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.8742 (1.51)     36.8742 (1.51)     36.8742 (1.51)     0.0000 (1.0)      36.8742 (1.51)     0.0000 (1.0)           0;0  0.0271 (0.66)          1           1
test_fetch-fetch[main]       24.3423 (1.0)      24.3423 (1.0)      24.3423 (1.0)      0.0000 (1.0)      24.3423 (1.0)      0.0000 (1.0)           0;0  0.0411 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9617 (1.0)      2.9617 (1.0)      2.9617 (1.0)      0.0000 (1.0)      2.9617 (1.0)      0.0000 (1.0)           0;0  0.3376 (1.0)           1           1
test_gc-gc[3.10.0]     3.0505 (1.03)     3.0505 (1.03)     3.0505 (1.03)     0.0000 (1.0)      3.0505 (1.03)     0.0000 (1.0)           0;0  0.3278 (0.97)          1           1
test_gc-gc[3.53.2]     3.0693 (1.04)     3.0693 (1.04)     3.0693 (1.04)     0.0000 (1.0)      3.0693 (1.04)     0.0000 (1.0)           0;0  0.3258 (0.96)          1           1
test_gc-gc[main]       3.1530 (1.06)     3.1530 (1.06)     3.1530 (1.06)     0.0000 (1.0)      3.1530 (1.06)     0.0000 (1.0)           0;0  0.3172 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.2237 (2.72)     137.2237 (2.72)     137.2237 (2.72)     0.0000 (1.0)      137.2237 (2.72)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     165.1723 (3.27)     165.1723 (3.27)     165.1723 (3.27)     0.0000 (1.0)      165.1723 (3.27)     0.0000 (1.0)           0;0  0.0061 (0.31)          1           1
test_get-get[3.53.2]     144.8400 (2.87)     144.8400 (2.87)     144.8400 (2.87)     0.0000 (1.0)      144.8400 (2.87)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[main]        50.4551 (1.0)       50.4551 (1.0)       50.4551 (1.0)      0.0000 (1.0)       50.4551 (1.0)      0.0000 (1.0)           0;0  0.0198 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.4066 (2.66)     45.4066 (2.66)     45.4066 (2.66)     0.0000 (1.0)      45.4066 (2.66)     0.0000 (1.0)           0;0  0.0220 (0.38)          1           1
test_get_url-get-url[3.10.0]     48.1120 (2.82)     48.1120 (2.82)     48.1120 (2.82)     0.0000 (1.0)      48.1120 (2.82)     0.0000 (1.0)           0;0  0.0208 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.1332 (1.00)     17.1332 (1.00)     17.1332 (1.00)     0.0000 (1.0)      17.1332 (1.00)     0.0000 (1.0)           0;0  0.0584 (1.00)          1           1
test_get_url-get-url[main]       17.0751 (1.0)      17.0751 (1.0)      17.0751 (1.0)      0.0000 (1.0)      17.0751 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.5864 (1.01)     141.9697 (1.09)     126.1101 (1.01)     2.4448 (1.56)     125.7755 (1.01)     1.7999 (1.0)           6;4  7.9296 (0.99)        100           1
test_help---help[3.10.0]     121.8611 (1.0)      130.4508 (1.0)      124.7201 (1.0)      1.7629 (1.12)     124.3663 (1.0)      2.1225 (1.18)         23;5  8.0180 (1.0)         100           1
test_help---help[3.53.2]     123.5988 (1.01)     131.4025 (1.01)     126.1902 (1.01)     1.5694 (1.0)      125.9283 (1.01)     2.0295 (1.13)         27;3  7.9245 (0.99)        100           1
test_help---help[main]       125.0681 (1.03)     151.2973 (1.16)     128.9428 (1.03)     5.1928 (3.31)     127.7389 (1.03)     2.7649 (1.54)          7;7  7.7554 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     234.9804 (2.99)     234.9804 (2.99)     234.9804 (2.99)     0.0000 (1.0)      234.9804 (2.99)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     262.5034 (3.34)     262.5034 (3.34)     262.5034 (3.34)     0.0000 (1.0)      262.5034 (3.34)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        78.5918 (1.0)       78.5918 (1.0)       78.5918 (1.0)      0.0000 (1.0)       78.5918 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     167.6333 (3.42)     167.6333 (3.42)     167.6333 (3.42)     0.0000 (1.0)      167.6333 (3.42)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.10.0]     169.8648 (3.47)     169.8648 (3.47)     169.8648 (3.47)     0.0000 (1.0)      169.8648 (3.47)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.3695 (2.58)     126.3695 (2.58)     126.3695 (2.58)     0.0000 (1.0)      126.3695 (2.58)     0.0000 (1.0)           0;0  0.0079 (0.39)          1           1
test_import_url-import-url[main]        48.9479 (1.0)       48.9479 (1.0)       48.9479 (1.0)      0.0000 (1.0)       48.9479 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     390.2248 (1.01)     457.4395 (1.06)     402.8347 (1.00)     10.3695 (1.72)     400.0676 (1.00)      8.5887 (1.14)         17;5  2.4824 (1.00)        100           1
test_init-init[3.10.0]     396.9644 (1.03)     432.1276 (1.0)      410.2081 (1.02)      6.0348 (1.0)      409.5629 (1.02)      7.5602 (1.0)          31;2  2.4378 (0.98)        100           1
test_init-init[3.53.2]     386.8523 (1.0)      442.3068 (1.02)     401.5310 (1.0)       9.3728 (1.55)     400.1357 (1.00)     10.8214 (1.43)         22;4  2.4905 (1.0)         100           1
test_init-init[main]       388.4979 (1.00)     625.2010 (1.45)     406.3711 (1.01)     26.7789 (4.44)     400.0045 (1.0)       9.5990 (1.27)         5;11  2.4608 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     566.5605 (1.07)     566.5605 (1.07)     566.5605 (1.07)     0.0000 (1.0)      566.5605 (1.07)     0.0000 (1.0)           0;0  1.7650 (0.93)          1           1
test_list-list[3.10.0]     646.3828 (1.22)     646.3828 (1.22)     646.3828 (1.22)     0.0000 (1.0)      646.3828 (1.22)     0.0000 (1.0)           0;0  1.5471 (0.82)          1           1
test_list-list[3.53.2]     558.7848 (1.06)     558.7848 (1.06)     558.7848 (1.06)     0.0000 (1.0)      558.7848 (1.06)     0.0000 (1.0)           0;0  1.7896 (0.95)          1           1
test_list-list[main]       529.6176 (1.0)      529.6176 (1.0)      529.6176 (1.0)      0.0000 (1.0)      529.6176 (1.0)      0.0000 (1.0)           0;0  1.8882 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     415.3735 (1.05)     415.3735 (1.05)     415.3735 (1.05)     0.0000 (1.0)      415.3735 (1.05)     0.0000 (1.0)           0;0  2.4075 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     414.5735 (1.05)     414.5735 (1.05)     414.5735 (1.05)     0.0000 (1.0)      414.5735 (1.05)     0.0000 (1.0)           0;0  2.4121 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     396.1306 (1.0)      396.1306 (1.0)      396.1306 (1.0)      0.0000 (1.0)      396.1306 (1.0)      0.0000 (1.0)           0;0  2.5244 (1.0)           1           1
test_list-list-dvc-only[main]       400.9055 (1.01)     400.9055 (1.01)     400.9055 (1.01)     0.0000 (1.0)      400.9055 (1.01)     0.0000 (1.0)           0;0  2.4944 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6723 (1.0)      2.6723 (1.0)      2.6723 (1.0)      0.0000 (1.0)      2.6723 (1.0)      0.0000 (1.0)           0;0  0.3742 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7745 (1.04)     2.7745 (1.04)     2.7745 (1.04)     0.0000 (1.0)      2.7745 (1.04)     0.0000 (1.0)           0;0  0.3604 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.8548 (1.07)     2.8548 (1.07)     2.8548 (1.07)     0.0000 (1.0)      2.8548 (1.07)     0.0000 (1.0)           0;0  0.3503 (0.94)          1           1
test_list-list-recursive[main]       2.9225 (1.09)     2.9225 (1.09)     2.9225 (1.09)     0.0000 (1.0)      2.9225 (1.09)     0.0000 (1.0)           0;0  0.3422 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     411.7125 (1.05)     411.7125 (1.05)     411.7125 (1.05)     0.0000 (1.0)      411.7125 (1.05)     0.0000 (1.0)           0;0  2.4289 (0.95)          1           1
test_list-list-shallow[3.10.0]     414.9903 (1.06)     414.9903 (1.06)     414.9903 (1.06)     0.0000 (1.0)      414.9903 (1.06)     0.0000 (1.0)           0;0  2.4097 (0.95)          1           1
test_list-list-shallow[3.53.2]     392.7368 (1.0)      392.7368 (1.0)      392.7368 (1.0)      0.0000 (1.0)      392.7368 (1.0)      0.0000 (1.0)           0;0  2.5462 (1.0)           1           1
test_list-list-shallow[main]       404.8532 (1.03)     404.8532 (1.03)     404.8532 (1.03)     0.0000 (1.0)      404.8532 (1.03)     0.0000 (1.0)           0;0  2.4700 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.9220 (2.96)     12.9220 (2.96)     12.9220 (2.96)     0.0000 (1.0)      12.9220 (2.96)     0.0000 (1.0)           0;0  0.0774 (0.34)          1           1
test_partial_add-add[3.10.0]     13.2232 (3.03)     13.2232 (3.03)     13.2232 (3.03)     0.0000 (1.0)      13.2232 (3.03)     0.0000 (1.0)           0;0  0.0756 (0.33)          1           1
test_partial_add-add[3.53.2]     11.8304 (2.71)     11.8304 (2.71)     11.8304 (2.71)     0.0000 (1.0)      11.8304 (2.71)     0.0000 (1.0)           0;0  0.0845 (0.37)          1           1
test_partial_add-add[main]        4.3628 (1.0)       4.3628 (1.0)       4.3628 (1.0)      0.0000 (1.0)       4.3628 (1.0)      0.0000 (1.0)           0;0  0.2292 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     87.6731 (4.14)     87.6731 (4.14)     87.6731 (4.14)     0.0000 (1.0)      87.6731 (4.14)     0.0000 (1.0)           0;0  0.0114 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     88.1020 (4.16)     88.1020 (4.16)     88.1020 (4.16)     0.0000 (1.0)      88.1020 (4.16)     0.0000 (1.0)           0;0  0.0114 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     80.0164 (3.78)     80.0164 (3.78)     80.0164 (3.78)     0.0000 (1.0)      80.0164 (3.78)     0.0000 (1.0)           0;0  0.0125 (0.26)          1           1
test_partial_add-add-partial[main]       21.1687 (1.0)      21.1687 (1.0)      21.1687 (1.0)      0.0000 (1.0)      21.1687 (1.0)      0.0000 (1.0)           0;0  0.0472 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.1615 (1.0)      5.1615 (1.0)      5.1615 (1.0)      0.0000 (1.0)      5.1615 (1.0)      0.0000 (1.0)           0;0  0.1937 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.9119 (1.34)     6.9119 (1.34)     6.9119 (1.34)     0.0000 (1.0)      6.9119 (1.34)     0.0000 (1.0)           0;0  0.1447 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     8.1728 (1.58)     8.1728 (1.58)     8.1728 (1.58)     0.0000 (1.0)      8.1728 (1.58)     0.0000 (1.0)           0;0  0.1224 (0.63)          1           1
test_partial_add-gc-cloud-noop[main]       7.8468 (1.52)     7.8468 (1.52)     7.8468 (1.52)     0.0000 (1.0)      7.8468 (1.52)     0.0000 (1.0)           0;0  0.1274 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.9082 (1.0)      2.9082 (1.0)      2.9082 (1.0)      0.0000 (1.0)      2.9082 (1.0)      0.0000 (1.0)           0;0  0.3439 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.4159 (1.52)     4.4159 (1.52)     4.4159 (1.52)     0.0000 (1.0)      4.4159 (1.52)     0.0000 (1.0)           0;0  0.2265 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     4.3639 (1.50)     4.3639 (1.50)     4.3639 (1.50)     0.0000 (1.0)      4.3639 (1.50)     0.0000 (1.0)           0;0  0.2292 (0.67)          1           1
test_partial_add-gc-noop[main]       4.4068 (1.52)     4.4068 (1.52)     4.4068 (1.52)     0.0000 (1.0)      4.4068 (1.52)     0.0000 (1.0)           0;0  0.2269 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.8526 (2.17)     7.8526 (2.17)     7.8526 (2.17)     0.0000 (1.0)      7.8526 (2.17)     0.0000 (1.0)           0;0  0.1273 (0.46)          1           1
test_partial_add-push[3.10.0]     7.0235 (1.94)     7.0235 (1.94)     7.0235 (1.94)     0.0000 (1.0)      7.0235 (1.94)     0.0000 (1.0)           0;0  0.1424 (0.52)          1           1
test_partial_add-push[3.53.2]     3.7532 (1.04)     3.7532 (1.04)     3.7532 (1.04)     0.0000 (1.0)      3.7532 (1.04)     0.0000 (1.0)           0;0  0.2664 (0.96)          1           1
test_partial_add-push[main]       3.6181 (1.0)      3.6181 (1.0)      3.6181 (1.0)      0.0000 (1.0)      3.6181 (1.0)      0.0000 (1.0)           0;0  0.2764 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.9508 (2.18)     45.9508 (2.18)     45.9508 (2.18)     0.0000 (1.0)      45.9508 (2.18)     0.0000 (1.0)           0;0  0.0218 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     40.7139 (1.93)     40.7139 (1.93)     40.7139 (1.93)     0.0000 (1.0)      40.7139 (1.93)     0.0000 (1.0)           0;0  0.0246 (0.52)          1           1
test_partial_add-push-partial[3.53.2]     21.3705 (1.01)     21.3705 (1.01)     21.3705 (1.01)     0.0000 (1.0)      21.3705 (1.01)     0.0000 (1.0)           0;0  0.0468 (0.99)          1           1
test_partial_add-push-partial[main]       21.0694 (1.0)      21.0694 (1.0)      21.0694 (1.0)      0.0000 (1.0)      21.0694 (1.0)      0.0000 (1.0)           0;0  0.0475 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     92.8143 (3.84)     92.8143 (3.84)     92.8143 (3.84)     0.0000 (1.0)      92.8143 (3.84)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.10.0]     92.1409 (3.81)     92.1409 (3.81)     92.1409 (3.81)     0.0000 (1.0)      92.1409 (3.81)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_partial_remove-add[3.53.2]     82.1170 (3.40)     82.1170 (3.40)     82.1170 (3.40)     0.0000 (1.0)      82.1170 (3.40)     0.0000 (1.0)           0;0  0.0122 (0.29)          1           1
test_partial_remove-add[main]       24.1594 (1.0)      24.1594 (1.0)      24.1594 (1.0)      0.0000 (1.0)      24.1594 (1.0)      0.0000 (1.0)           0;0  0.0414 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     50.8284 (12.45)    50.8284 (12.45)    50.8284 (12.45)    0.0000 (1.0)      50.8284 (12.45)    0.0000 (1.0)           0;0  0.0197 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     51.3973 (12.59)    51.3973 (12.59)    51.3973 (12.59)    0.0000 (1.0)      51.3973 (12.59)    0.0000 (1.0)           0;0  0.0195 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     46.0894 (11.29)    46.0894 (11.29)    46.0894 (11.29)    0.0000 (1.0)      46.0894 (11.29)    0.0000 (1.0)           0;0  0.0217 (0.09)          1           1
test_partial_remove-add-update[main]        4.0822 (1.0)       4.0822 (1.0)       4.0822 (1.0)      0.0000 (1.0)       4.0822 (1.0)      0.0000 (1.0)           0;0  0.2450 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.8824 (1.0)      2.8824 (1.0)      2.8824 (1.0)      0.0000 (1.0)      2.8824 (1.0)      0.0000 (1.0)           0;0  0.3469 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.1574 (1.44)     4.1574 (1.44)     4.1574 (1.44)     0.0000 (1.0)      4.1574 (1.44)     0.0000 (1.0)           0;0  0.2405 (0.69)          1           1
test_partial_remove-gc[3.53.2]     4.2558 (1.48)     4.2558 (1.48)     4.2558 (1.48)     0.0000 (1.0)      4.2558 (1.48)     0.0000 (1.0)           0;0  0.2350 (0.68)          1           1
test_partial_remove-gc[main]       4.2495 (1.47)     4.2495 (1.47)     4.2495 (1.47)     0.0000 (1.0)      4.2495 (1.47)     0.0000 (1.0)           0;0  0.2353 (0.68)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.2701 (1.0)      5.2701 (1.0)      5.2701 (1.0)      0.0000 (1.0)      5.2701 (1.0)      0.0000 (1.0)           0;0  0.1897 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.8753 (1.30)     6.8753 (1.30)     6.8753 (1.30)     0.0000 (1.0)      6.8753 (1.30)     0.0000 (1.0)           0;0  0.1454 (0.77)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.4892 (1.42)     7.4892 (1.42)     7.4892 (1.42)     0.0000 (1.0)      7.4892 (1.42)     0.0000 (1.0)           0;0  0.1335 (0.70)          1           1
test_partial_remove-gc-cloud[main]       7.5960 (1.44)     7.5960 (1.44)     7.5960 (1.44)     0.0000 (1.0)      7.5960 (1.44)     0.0000 (1.0)           0;0  0.1316 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.9975 (2.28)     51.9975 (2.28)     51.9975 (2.28)     0.0000 (1.0)      51.9975 (2.28)     0.0000 (1.0)           0;0  0.0192 (0.44)          1           1
test_partial_remove-push[3.10.0]     46.3283 (2.03)     46.3283 (2.03)     46.3283 (2.03)     0.0000 (1.0)      46.3283 (2.03)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.2550 (1.02)     23.2550 (1.02)     23.2550 (1.02)     0.0000 (1.0)      23.2550 (1.02)     0.0000 (1.0)           0;0  0.0430 (0.98)          1           1
test_partial_remove-push[main]       22.8488 (1.0)      22.8488 (1.0)      22.8488 (1.0)      0.0000 (1.0)      22.8488 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8948 (1.0)      3.8948 (1.0)      3.8948 (1.0)      0.0000 (1.0)      3.8948 (1.0)      0.0000 (1.0)           0;0  0.2568 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.9914 (1.02)     3.9914 (1.02)     3.9914 (1.02)     0.0000 (1.0)      3.9914 (1.02)     0.0000 (1.0)           0;0  0.2505 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     7.3278 (1.88)     7.3278 (1.88)     7.3278 (1.88)     0.0000 (1.0)      7.3278 (1.88)     0.0000 (1.0)           0;0  0.1365 (0.53)          1           1
test_partial_remove-push-update[main]       7.2248 (1.85)     7.2248 (1.85)     7.2248 (1.85)     0.0000 (1.0)      7.2248 (1.85)     0.0000 (1.0)           0;0  0.1384 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     453.1020 (1.0)      458.1971 (1.0)      455.4292 (1.0)      1.9972 (1.0)      455.9230 (1.0)      2.8461 (1.11)          2;0  2.1957 (1.0)           5           3
test_plots-plots-diff[3.10.0]     850.6062 (1.88)     856.6070 (1.87)     855.0882 (1.88)     2.5784 (1.29)     856.4858 (1.88)     2.5706 (1.0)           1;0  1.1695 (0.53)          5           3
test_plots-plots-diff[3.53.2]     807.8601 (1.78)     814.5150 (1.78)     810.6379 (1.78)     2.8655 (1.43)     810.4404 (1.78)     4.9586 (1.93)          1;0  1.2336 (0.56)          5           3
test_plots-plots-diff[main]       807.4583 (1.78)     819.5223 (1.79)     810.8883 (1.78)     5.0115 (2.51)     808.2633 (1.77)     5.1198 (1.99)          1;0  1.2332 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       468.6945 (1.0)        476.7498 (1.0)        471.5882 (1.0)      3.0624 (1.0)        470.7782 (1.0)      2.9507 (1.0)           1;0  2.1205 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,088.0818 (2.32)     1,098.3540 (2.30)     1,092.8017 (2.32)     3.8994 (1.27)     1,093.1318 (2.32)     5.3609 (1.82)          2;0  0.9151 (0.43)          5           3
test_plots-plots-diff-json[3.53.2]       882.8834 (1.88)       893.4160 (1.87)       886.5744 (1.88)     4.4524 (1.45)       885.1374 (1.88)     6.7861 (2.30)          1;0  1.1279 (0.53)          5           3
test_plots-plots-diff-json[main]         882.3613 (1.88)       894.3261 (1.88)       887.1381 (1.88)     4.5929 (1.50)       887.3954 (1.88)     5.6466 (1.91)          2;0  1.1272 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     408.0348 (1.0)      409.2977 (1.0)      408.6661 (1.0)      0.5918 (1.0)      408.5943 (1.0)       1.1344 (1.0)           2;0  2.4470 (1.0)           5           3
test_plots-plots-show[3.10.0]     706.2892 (1.73)     715.6943 (1.75)     709.7889 (1.74)     3.5877 (6.06)     709.2656 (1.74)      3.9669 (3.50)          1;0  1.4089 (0.58)          5           3
test_plots-plots-show[3.53.2]     679.9340 (1.67)     701.2964 (1.71)     686.5682 (1.68)     9.1376 (15.44)    681.0480 (1.67)     11.9866 (10.57)         1;0  1.4565 (0.60)          5           3
test_plots-plots-show[main]       675.8422 (1.66)     681.3766 (1.66)     678.0159 (1.66)     2.3807 (4.02)     676.9923 (1.66)      3.8917 (3.43)          1;0  1.4749 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     422.4585 (1.0)      424.2774 (1.0)      423.1365 (1.0)      0.6930 (1.0)      423.0670 (1.0)      0.7498 (1.0)           1;0  2.3633 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     836.4632 (1.98)     843.9784 (1.99)     839.1529 (1.98)     3.2733 (4.72)     837.3567 (1.98)     5.0703 (6.76)          1;0  1.1917 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     728.0714 (1.72)     740.3639 (1.74)     735.8248 (1.74)     5.0312 (7.26)     735.3888 (1.74)     6.9963 (9.33)          1;0  1.3590 (0.58)          5           3
test_plots-plots-show-json[main]       722.5319 (1.71)     730.5430 (1.72)     726.1550 (1.72)     3.6248 (5.23)     725.7389 (1.72)     6.7392 (8.99)          1;0  1.3771 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.5442 (2.31)     52.5442 (2.31)     52.5442 (2.31)     0.0000 (1.0)      52.5442 (2.31)     0.0000 (1.0)           0;0  0.0190 (0.43)          1           1
test_push-push[3.10.0]     46.8641 (2.06)     46.8641 (2.06)     46.8641 (2.06)     0.0000 (1.0)      46.8641 (2.06)     0.0000 (1.0)           0;0  0.0213 (0.49)          1           1
test_push-push[3.53.2]     23.0994 (1.01)     23.0994 (1.01)     23.0994 (1.01)     0.0000 (1.0)      23.0994 (1.01)     0.0000 (1.0)           0;0  0.0433 (0.99)          1           1
test_push-push[main]       22.7664 (1.0)      22.7664 (1.0)      22.7664 (1.0)      0.0000 (1.0)      22.7664 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     67.2945 (2.68)     67.2945 (2.68)     67.2945 (2.68)     0.0000 (1.0)      67.2945 (2.68)     0.0000 (1.0)           0;0  0.0149 (0.37)          1           1
test_sharing-fetch[3.10.0]     73.3061 (2.92)     73.3061 (2.92)     73.3061 (2.92)     0.0000 (1.0)      73.3061 (2.92)     0.0000 (1.0)           0;0  0.0136 (0.34)          1           1
test_sharing-fetch[3.53.2]     36.8191 (1.47)     36.8191 (1.47)     36.8191 (1.47)     0.0000 (1.0)      36.8191 (1.47)     0.0000 (1.0)           0;0  0.0272 (0.68)          1           1
test_sharing-fetch[main]       25.0763 (1.0)      25.0763 (1.0)      25.0763 (1.0)      0.0000 (1.0)      25.0763 (1.0)      0.0000 (1.0)           0;0  0.0399 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3008 (1.0)      1.3008 (1.0)      1.3008 (1.0)      0.0000 (1.0)      1.3008 (1.0)      0.0000 (1.0)           0;0  0.7688 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7407 (2.88)     3.7407 (2.88)     3.7407 (2.88)     0.0000 (1.0)      3.7407 (2.88)     0.0000 (1.0)           0;0  0.2673 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     6.4127 (4.93)     6.4127 (4.93)     6.4127 (4.93)     0.0000 (1.0)      6.4127 (4.93)     0.0000 (1.0)           0;0  0.1559 (0.20)          1           1
test_sharing-fetch-noop[main]       6.5860 (5.06)     6.5860 (5.06)     6.5860 (5.06)     0.0000 (1.0)      6.5860 (5.06)     0.0000 (1.0)           0;0  0.1518 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.5536 (2.26)     53.5536 (2.26)     53.5536 (2.26)     0.0000 (1.0)      53.5536 (2.26)     0.0000 (1.0)           0;0  0.0187 (0.44)          1           1
test_sharing-push[3.10.0]     47.4990 (2.00)     47.4990 (2.00)     47.4990 (2.00)     0.0000 (1.0)      47.4990 (2.00)     0.0000 (1.0)           0;0  0.0211 (0.50)          1           1
test_sharing-push[3.53.2]     24.0022 (1.01)     24.0022 (1.01)     24.0022 (1.01)     0.0000 (1.0)      24.0022 (1.01)     0.0000 (1.0)           0;0  0.0417 (0.99)          1           1
test_sharing-push[main]       23.7052 (1.0)      23.7052 (1.0)      23.7052 (1.0)      0.0000 (1.0)      23.7052 (1.0)      0.0000 (1.0)           0;0  0.0422 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.4844 (1.04)     2.4844 (1.04)     2.4844 (1.04)     0.0000 (1.0)      2.4844 (1.04)     0.0000 (1.0)           0;0  0.4025 (0.96)          1           1
test_sharing-push-noop[3.10.0]     2.3869 (1.0)      2.3869 (1.0)      2.3869 (1.0)      0.0000 (1.0)      2.3869 (1.0)      0.0000 (1.0)           0;0  0.4190 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.9237 (2.90)     6.9237 (2.90)     6.9237 (2.90)     0.0000 (1.0)      6.9237 (2.90)     0.0000 (1.0)           0;0  0.1444 (0.34)          1           1
test_sharing-push-noop[main]       6.8125 (2.85)     6.8125 (2.85)     6.8125 (2.85)     0.0000 (1.0)      6.8125 (2.85)     0.0000 (1.0)           0;0  0.1468 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     339.7132 (1.04)     339.7132 (1.04)     339.7132 (1.04)     0.0000 (1.0)      339.7132 (1.04)     0.0000 (1.0)           0;0  0.0029 (0.96)          1           1
test_sharing_azure-fetch[main]       326.9934 (1.0)      326.9934 (1.0)      326.9934 (1.0)      0.0000 (1.0)      326.9934 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.9821 (1.0)      6.9821 (1.0)      6.9821 (1.0)      0.0000 (1.0)      6.9821 (1.0)      0.0000 (1.0)           0;0  0.1432 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       7.2009 (1.03)     7.2009 (1.03)     7.2009 (1.03)     0.0000 (1.0)      7.2009 (1.03)     0.0000 (1.0)           0;0  0.1389 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     347.7546 (1.02)     347.7546 (1.02)     347.7546 (1.02)     0.0000 (1.0)      347.7546 (1.02)     0.0000 (1.0)           0;0  0.0029 (0.98)          1           1
test_sharing_azure-push[main]       341.2585 (1.0)      341.2585 (1.0)      341.2585 (1.0)      0.0000 (1.0)      341.2585 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.5921 (1.03)     8.5921 (1.03)     8.5921 (1.03)     0.0000 (1.0)      8.5921 (1.03)     0.0000 (1.0)           0;0  0.1164 (0.97)          1           1
test_sharing_azure-push-noop[main]       8.3087 (1.0)      8.3087 (1.0)      8.3087 (1.0)      0.0000 (1.0)      8.3087 (1.0)      0.0000 (1.0)           0;0  0.1204 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     418.6419 (1.05)     418.6419 (1.05)     418.6419 (1.05)     0.0000 (1.0)      418.6419 (1.05)     0.0000 (1.0)           0;0  0.0024 (0.95)          1           1
test_sharing_gs-fetch[main]       397.8245 (1.0)      397.8245 (1.0)      397.8245 (1.0)      0.0000 (1.0)      397.8245 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.7835 (1.0)      7.7835 (1.0)      7.7835 (1.0)      0.0000 (1.0)      7.7835 (1.0)      0.0000 (1.0)           0;0  0.1285 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.9182 (1.02)     7.9182 (1.02)     7.9182 (1.02)     0.0000 (1.0)      7.9182 (1.02)     0.0000 (1.0)           0;0  0.1263 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     834.3444 (1.0)      834.3444 (1.0)      834.3444 (1.0)      0.0000 (1.0)      834.3444 (1.0)      0.0000 (1.0)           0;0  0.0012 (1.0)           1           1
test_sharing_gs-push[main]       843.3278 (1.01)     843.3278 (1.01)     843.3278 (1.01)     0.0000 (1.0)      843.3278 (1.01)     0.0000 (1.0)           0;0  0.0012 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.3516 (1.00)     7.3516 (1.00)     7.3516 (1.00)     0.0000 (1.0)      7.3516 (1.00)     0.0000 (1.0)           0;0  0.1360 (1.00)          1           1
test_sharing_gs-push-noop[main]       7.3427 (1.0)      7.3427 (1.0)      7.3427 (1.0)      0.0000 (1.0)      7.3427 (1.0)      0.0000 (1.0)           0;0  0.1362 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     389.7551 (1.02)     389.7551 (1.02)     389.7551 (1.02)     0.0000 (1.0)      389.7551 (1.02)     0.0000 (1.0)           0;0  0.0026 (0.98)          1           1
test_sharing_s3-fetch[main]       380.6792 (1.0)      380.6792 (1.0)      380.6792 (1.0)      0.0000 (1.0)      380.6792 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6903 (1.0)      6.6903 (1.0)      6.6903 (1.0)      0.0000 (1.0)      6.6903 (1.0)      0.0000 (1.0)           0;0  0.1495 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.8468 (1.02)     6.8468 (1.02)     6.8468 (1.02)     0.0000 (1.0)      6.8468 (1.02)     0.0000 (1.0)           0;0  0.1461 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     484.3584 (1.0)      484.3584 (1.0)      484.3584 (1.0)      0.0000 (1.0)      484.3584 (1.0)      0.0000 (1.0)           0;0  0.0021 (1.0)           1           1
test_sharing_s3-push[main]       492.4338 (1.02)     492.4338 (1.02)     492.4338 (1.02)     0.0000 (1.0)      492.4338 (1.02)     0.0000 (1.0)           0;0  0.0020 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.1360 (1.0)      7.1360 (1.0)      7.1360 (1.0)      0.0000 (1.0)      7.1360 (1.0)      0.0000 (1.0)           0;0  0.1401 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.1846 (1.01)     7.1846 (1.01)     7.1846 (1.01)     0.0000 (1.0)      7.1846 (1.01)     0.0000 (1.0)           0;0  0.1392 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.2715 (3.91)     21.2715 (3.91)     21.2715 (3.91)     0.0000 (1.0)      21.2715 (3.91)     0.0000 (1.0)           0;0  0.0470 (0.26)          1           1
test_status-status[3.10.0]     21.4562 (3.94)     21.4562 (3.94)     21.4562 (3.94)     0.0000 (1.0)      21.4562 (3.94)     0.0000 (1.0)           0;0  0.0466 (0.25)          1           1
test_status-status[3.53.2]     19.5476 (3.59)     19.5476 (3.59)     19.5476 (3.59)     0.0000 (1.0)      19.5476 (3.59)     0.0000 (1.0)           0;0  0.0512 (0.28)          1           1
test_status-status[main]        5.4456 (1.0)       5.4456 (1.0)       5.4456 (1.0)      0.0000 (1.0)       5.4456 (1.0)      0.0000 (1.0)           0;0  0.1836 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.1103 (1.71)     5.1103 (1.71)     5.1103 (1.71)     0.0000 (1.0)      5.1103 (1.71)     0.0000 (1.0)           0;0  0.1957 (0.58)          1           1
test_status-status-changed[3.10.0]     5.3074 (1.78)     5.3074 (1.78)     5.3074 (1.78)     0.0000 (1.0)      5.3074 (1.78)     0.0000 (1.0)           0;0  0.1884 (0.56)          1           1
test_status-status-changed[3.53.2]     5.1265 (1.72)     5.1265 (1.72)     5.1265 (1.72)     0.0000 (1.0)      5.1265 (1.72)     0.0000 (1.0)           0;0  0.1951 (0.58)          1           1
test_status-status-changed[main]       2.9838 (1.0)      2.9838 (1.0)      2.9838 (1.0)      0.0000 (1.0)      2.9838 (1.0)      0.0000 (1.0)           0;0  0.3351 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9602 (1.77)     4.9602 (1.77)     4.9602 (1.77)     0.0000 (1.0)      4.9602 (1.77)     0.0000 (1.0)           0;0  0.2016 (0.56)          1           1
test_status-status-changed-noop[3.10.0]     5.1561 (1.84)     5.1561 (1.84)     5.1561 (1.84)     0.0000 (1.0)      5.1561 (1.84)     0.0000 (1.0)           0;0  0.1939 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.9982 (1.79)     4.9982 (1.79)     4.9982 (1.79)     0.0000 (1.0)      4.9982 (1.79)     0.0000 (1.0)           0;0  0.2001 (0.56)          1           1
test_status-status-changed-noop[main]       2.7959 (1.0)      2.7959 (1.0)      2.7959 (1.0)      0.0000 (1.0)      2.7959 (1.0)      0.0000 (1.0)           0;0  0.3577 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0283 (1.78)     5.0283 (1.78)     5.0283 (1.78)     0.0000 (1.0)      5.0283 (1.78)     0.0000 (1.0)           0;0  0.1989 (0.56)          1           1
test_status-status-noop[3.10.0]     5.2805 (1.87)     5.2805 (1.87)     5.2805 (1.87)     0.0000 (1.0)      5.2805 (1.87)     0.0000 (1.0)           0;0  0.1894 (0.53)          1           1
test_status-status-noop[3.53.2]     4.9985 (1.77)     4.9985 (1.77)     4.9985 (1.77)     0.0000 (1.0)      4.9985 (1.77)     0.0000 (1.0)           0;0  0.2001 (0.56)          1           1
test_status-status-noop[main]       2.8198 (1.0)      2.8198 (1.0)      2.8198 (1.0)      0.0000 (1.0)      2.8198 (1.0)      0.0000 (1.0)           0;0  0.3546 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     164.9445 (3.37)     164.9445 (3.37)     164.9445 (3.37)     0.0000 (1.0)      164.9445 (3.37)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_update-import-url[3.10.0]     170.4839 (3.48)     170.4839 (3.48)     170.4839 (3.48)     0.0000 (1.0)      170.4839 (3.48)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_update-import-url[3.53.2]     127.5833 (2.61)     127.5833 (2.61)     127.5833 (2.61)     0.0000 (1.0)      127.5833 (2.61)     0.0000 (1.0)           0;0  0.0078 (0.38)          1           1
test_update-import-url[main]        48.9442 (1.0)       48.9442 (1.0)       48.9442 (1.0)      0.0000 (1.0)       48.9442 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     145.6306 (3.89)     145.6306 (3.89)     145.6306 (3.89)     0.0000 (1.0)      145.6306 (3.89)     0.0000 (1.0)           0;0  0.0069 (0.26)          1           1
test_update-update[3.10.0]     150.6897 (4.03)     150.6897 (4.03)     150.6897 (4.03)     0.0000 (1.0)      150.6897 (4.03)     0.0000 (1.0)           0;0  0.0066 (0.25)          1           1
test_update-update[3.53.2]     116.2090 (3.11)     116.2090 (3.11)     116.2090 (3.11)     0.0000 (1.0)      116.2090 (3.11)     0.0000 (1.0)           0;0  0.0086 (0.32)          1           1
test_update-update[main]        37.4048 (1.0)       37.4048 (1.0)       37.4048 (1.0)      0.0000 (1.0)       37.4048 (1.0)      0.0000 (1.0)           0;0  0.0267 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.9346 (2.06)     16.9346 (2.06)     16.9346 (2.06)     0.0000 (1.0)      16.9346 (2.06)     0.0000 (1.0)           0;0  0.0591 (0.48)          1           1
test_update-update-noop[3.10.0]     17.9554 (2.19)     17.9554 (2.19)     17.9554 (2.19)     0.0000 (1.0)      17.9554 (2.19)     0.0000 (1.0)           0;0  0.0557 (0.46)          1           1
test_update-update-noop[3.53.2]     17.2755 (2.10)     17.2755 (2.10)     17.2755 (2.10)     0.0000 (1.0)      17.2755 (2.10)     0.0000 (1.0)           0;0  0.0579 (0.48)          1           1
test_update-update-noop[main]        8.2116 (1.0)       8.2116 (1.0)       8.2116 (1.0)      0.0000 (1.0)       8.2116 (1.0)      0.0000 (1.0)           0;0  0.1218 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean