Wed Apr  2 00:49:57 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     90.1646 (3.76)     90.1646 (3.76)     90.1646 (3.76)     0.0000 (1.0)      90.1646 (3.76)     0.0000 (1.0)           0;0  0.0111 (0.27)          1           1
test_add_copy-add[3.10.0]     91.7659 (3.82)     91.7659 (3.82)     91.7659 (3.82)     0.0000 (1.0)      91.7659 (3.82)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_add_copy-add[3.53.2]     82.6340 (3.44)     82.6340 (3.44)     82.6340 (3.44)     0.0000 (1.0)      82.6340 (3.44)     0.0000 (1.0)           0;0  0.0121 (0.29)          1           1
test_add_copy-add[main]       23.9974 (1.0)      23.9974 (1.0)      23.9974 (1.0)      0.0000 (1.0)      23.9974 (1.0)      0.0000 (1.0)           0;0  0.0417 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.0658 (6.56)     31.0658 (6.56)     31.0658 (6.56)     0.0000 (1.0)      31.0658 (6.56)     0.0000 (1.0)           0;0  0.0322 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     31.5783 (6.67)     31.5783 (6.67)     31.5783 (6.67)     0.0000 (1.0)      31.5783 (6.67)     0.0000 (1.0)           0;0  0.0317 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     30.2832 (6.40)     30.2832 (6.40)     30.2832 (6.40)     0.0000 (1.0)      30.2832 (6.40)     0.0000 (1.0)           0;0  0.0330 (0.16)          1           1
test_add_copy-add-noop[main]        4.7340 (1.0)       4.7340 (1.0)       4.7340 (1.0)      0.0000 (1.0)       4.7340 (1.0)      0.0000 (1.0)           0;0  0.2112 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     72.4153 (3.99)     72.4153 (3.99)     72.4153 (3.99)     0.0000 (1.0)      72.4153 (3.99)     0.0000 (1.0)           0;0  0.0138 (0.25)          1           1
test_add_hardlink-add[3.10.0]     73.4464 (4.05)     73.4464 (4.05)     73.4464 (4.05)     0.0000 (1.0)      73.4464 (4.05)     0.0000 (1.0)           0;0  0.0136 (0.25)          1           1
test_add_hardlink-add[3.53.2]     67.9538 (3.74)     67.9538 (3.74)     67.9538 (3.74)     0.0000 (1.0)      67.9538 (3.74)     0.0000 (1.0)           0;0  0.0147 (0.27)          1           1
test_add_hardlink-add[main]       18.1455 (1.0)      18.1455 (1.0)      18.1455 (1.0)      0.0000 (1.0)      18.1455 (1.0)      0.0000 (1.0)           0;0  0.0551 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.9088 (7.37)     36.9088 (7.37)     36.9088 (7.37)     0.0000 (1.0)      36.9088 (7.37)     0.0000 (1.0)           0;0  0.0271 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     37.7052 (7.53)     37.7052 (7.53)     37.7052 (7.53)     0.0000 (1.0)      37.7052 (7.53)     0.0000 (1.0)           0;0  0.0265 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.3994 (7.07)     35.3994 (7.07)     35.3994 (7.07)     0.0000 (1.0)      35.3994 (7.07)     0.0000 (1.0)           0;0  0.0282 (0.14)          1           1
test_add_hardlink-add-noop[main]        5.0077 (1.0)       5.0077 (1.0)       5.0077 (1.0)      0.0000 (1.0)       5.0077 (1.0)      0.0000 (1.0)           0;0  0.1997 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     78.2211 (2.14)     78.2211 (2.14)     78.2211 (2.14)     0.0000 (1.0)      78.2211 (2.14)     0.0000 (1.0)           0;0  0.0128 (0.47)          1           1
test_add_symlink-add[3.10.0]     79.3041 (2.17)     79.3041 (2.17)     79.3041 (2.17)     0.0000 (1.0)      79.3041 (2.17)     0.0000 (1.0)           0;0  0.0126 (0.46)          1           1
test_add_symlink-add[3.53.2]     73.2591 (2.00)     73.2591 (2.00)     73.2591 (2.00)     0.0000 (1.0)      73.2591 (2.00)     0.0000 (1.0)           0;0  0.0137 (0.50)          1           1
test_add_symlink-add[main]       36.5396 (1.0)      36.5396 (1.0)      36.5396 (1.0)      0.0000 (1.0)      36.5396 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     50.2853 (8.12)     50.2853 (8.12)     50.2853 (8.12)     0.0000 (1.0)      50.2853 (8.12)     0.0000 (1.0)           0;0  0.0199 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     51.3813 (8.30)     51.3813 (8.30)     51.3813 (8.30)     0.0000 (1.0)      51.3813 (8.30)     0.0000 (1.0)           0;0  0.0195 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.5686 (7.84)     48.5686 (7.84)     48.5686 (7.84)     0.0000 (1.0)      48.5686 (7.84)     0.0000 (1.0)           0;0  0.0206 (0.13)          1           1
test_add_symlink-add-noop[main]        6.1940 (1.0)       6.1940 (1.0)       6.1940 (1.0)      0.0000 (1.0)       6.1940 (1.0)      0.0000 (1.0)           0;0  0.1614 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.5028 (1.98)     42.5028 (1.98)     42.5028 (1.98)     0.0000 (1.0)      42.5028 (1.98)     0.0000 (1.0)           0;0  0.0235 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     61.3213 (2.85)     61.3213 (2.85)     61.3213 (2.85)     0.0000 (1.0)      61.3213 (2.85)     0.0000 (1.0)           0;0  0.0163 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     30.2144 (1.40)     30.2144 (1.40)     30.2144 (1.40)     0.0000 (1.0)      30.2144 (1.40)     0.0000 (1.0)           0;0  0.0331 (0.71)          1           1
test_checkout_copy-checkout[main]       21.5143 (1.0)      21.5143 (1.0)      21.5143 (1.0)      0.0000 (1.0)      21.5143 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6925 (1.57)     5.6925 (1.57)     5.6925 (1.57)     0.0000 (1.0)      5.6925 (1.57)     0.0000 (1.0)           0;0  0.1757 (0.64)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9170 (1.63)     5.9170 (1.63)     5.9170 (1.63)     0.0000 (1.0)      5.9170 (1.63)     0.0000 (1.0)           0;0  0.1690 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8046 (1.60)     5.8046 (1.60)     5.8046 (1.60)     0.0000 (1.0)      5.8046 (1.60)     0.0000 (1.0)           0;0  0.1723 (0.62)          1           1
test_checkout_copy-checkout-noop[main]       3.6248 (1.0)      3.6248 (1.0)      3.6248 (1.0)      0.0000 (1.0)      3.6248 (1.0)      0.0000 (1.0)           0;0  0.2759 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5869 (2.06)     8.5869 (2.06)     8.5869 (2.06)     0.0000 (1.0)      8.5869 (2.06)     0.0000 (1.0)           0;0  0.1165 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6587 (1.59)     6.6587 (1.59)     6.6587 (1.59)     0.0000 (1.0)      6.6587 (1.59)     0.0000 (1.0)           0;0  0.1502 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4239 (1.54)     6.4239 (1.54)     6.4239 (1.54)     0.0000 (1.0)      6.4239 (1.54)     0.0000 (1.0)           0;0  0.1557 (0.65)          1           1
test_checkout_copy-checkout-update[main]       4.1782 (1.0)      4.1782 (1.0)      4.1782 (1.0)      0.0000 (1.0)      4.1782 (1.0)      0.0000 (1.0)           0;0  0.2393 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.2771 (2.99)     24.2771 (2.99)     24.2771 (2.99)     0.0000 (1.0)      24.2771 (2.99)     0.0000 (1.0)           0;0  0.0412 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.8838 (2.20)     17.8838 (2.20)     17.8838 (2.20)     0.0000 (1.0)      17.8838 (2.20)     0.0000 (1.0)           0;0  0.0559 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2282 (2.00)     16.2282 (2.00)     16.2282 (2.00)     0.0000 (1.0)      16.2282 (2.00)     0.0000 (1.0)           0;0  0.0616 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.1160 (1.0)       8.1160 (1.0)       8.1160 (1.0)      0.0000 (1.0)       8.1160 (1.0)      0.0000 (1.0)           0;0  0.1232 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.7466 (1.55)     5.7466 (1.55)     5.7466 (1.55)     0.0000 (1.0)      5.7466 (1.55)     0.0000 (1.0)           0;0  0.1740 (0.65)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.0914 (1.64)     6.0914 (1.64)     6.0914 (1.64)     0.0000 (1.0)      6.0914 (1.64)     0.0000 (1.0)           0;0  0.1642 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7493 (1.55)     5.7493 (1.55)     5.7493 (1.55)     0.0000 (1.0)      5.7493 (1.55)     0.0000 (1.0)           0;0  0.1739 (0.65)          1           1
test_checkout_hardlink-checkout-noop[main]       3.7085 (1.0)      3.7085 (1.0)      3.7085 (1.0)      0.0000 (1.0)      3.7085 (1.0)      0.0000 (1.0)           0;0  0.2696 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8140 (2.06)     8.8140 (2.06)     8.8140 (2.06)     0.0000 (1.0)      8.8140 (2.06)     0.0000 (1.0)           0;0  0.1135 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7824 (1.59)     6.7824 (1.59)     6.7824 (1.59)     0.0000 (1.0)      6.7824 (1.59)     0.0000 (1.0)           0;0  0.1474 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6396 (1.55)     6.6396 (1.55)     6.6396 (1.55)     0.0000 (1.0)      6.6396 (1.55)     0.0000 (1.0)           0;0  0.1506 (0.64)          1           1
test_checkout_hardlink-checkout-update[main]       4.2738 (1.0)      4.2738 (1.0)      4.2738 (1.0)      0.0000 (1.0)      4.2738 (1.0)      0.0000 (1.0)           0;0  0.2340 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.5955 (2.46)     28.5955 (2.46)     28.5955 (2.46)     0.0000 (1.0)      28.5955 (2.46)     0.0000 (1.0)           0;0  0.0350 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     21.9544 (1.89)     21.9544 (1.89)     21.9544 (1.89)     0.0000 (1.0)      21.9544 (1.89)     0.0000 (1.0)           0;0  0.0455 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.8034 (1.70)     19.8034 (1.70)     19.8034 (1.70)     0.0000 (1.0)      19.8034 (1.70)     0.0000 (1.0)           0;0  0.0505 (0.59)          1           1
test_checkout_symlink-checkout[main]       11.6299 (1.0)      11.6299 (1.0)      11.6299 (1.0)      0.0000 (1.0)      11.6299 (1.0)      0.0000 (1.0)           0;0  0.0860 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.1422 (1.40)     7.1422 (1.40)     7.1422 (1.40)     0.0000 (1.0)      7.1422 (1.40)     0.0000 (1.0)           0;0  0.1400 (0.71)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.4208 (1.46)     7.4208 (1.46)     7.4208 (1.46)     0.0000 (1.0)      7.4208 (1.46)     0.0000 (1.0)           0;0  0.1348 (0.69)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.1987 (1.42)     7.1987 (1.42)     7.1987 (1.42)     0.0000 (1.0)      7.1987 (1.42)     0.0000 (1.0)           0;0  0.1389 (0.71)          1           1
test_checkout_symlink-checkout-noop[main]       5.0845 (1.0)      5.0845 (1.0)      5.0845 (1.0)      0.0000 (1.0)      5.0845 (1.0)      0.0000 (1.0)           0;0  0.1967 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.0888 (1.65)     11.0888 (1.65)     11.0888 (1.65)     0.0000 (1.0)      11.0888 (1.65)     0.0000 (1.0)           0;0  0.0902 (0.61)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.1976 (1.37)      9.1976 (1.37)      9.1976 (1.37)     0.0000 (1.0)       9.1976 (1.37)     0.0000 (1.0)           0;0  0.1087 (0.73)          1           1
test_checkout_symlink-checkout-update[3.53.2]      9.0283 (1.34)      9.0283 (1.34)      9.0283 (1.34)     0.0000 (1.0)       9.0283 (1.34)     0.0000 (1.0)           0;0  0.1108 (0.74)          1           1
test_checkout_symlink-checkout-update[main]        6.7209 (1.0)       6.7209 (1.0)       6.7209 (1.0)      0.0000 (1.0)       6.7209 (1.0)      0.0000 (1.0)           0;0  0.1488 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2774 (1.72)     4.2774 (1.72)     4.2774 (1.72)     0.0000 (1.0)      4.2774 (1.72)     0.0000 (1.0)           0;0  0.2338 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.9023 (1.98)     4.9023 (1.98)     4.9023 (1.98)     0.0000 (1.0)      4.9023 (1.98)     0.0000 (1.0)           0;0  0.2040 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.7245 (1.91)     4.7245 (1.91)     4.7245 (1.91)     0.0000 (1.0)      4.7245 (1.91)     0.0000 (1.0)           0;0  0.2117 (0.52)          1           1
test_data_status-data-changed[main]       2.4800 (1.0)      2.4800 (1.0)      2.4800 (1.0)      0.0000 (1.0)      2.4800 (1.0)      0.0000 (1.0)           0;0  0.4032 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2658 (1.79)     4.2658 (1.79)     4.2658 (1.79)     0.0000 (1.0)      4.2658 (1.79)     0.0000 (1.0)           0;0  0.2344 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7502 (1.99)     4.7502 (1.99)     4.7502 (1.99)     0.0000 (1.0)      4.7502 (1.99)     0.0000 (1.0)           0;0  0.2105 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7412 (1.99)     4.7412 (1.99)     4.7412 (1.99)     0.0000 (1.0)      4.7412 (1.99)     0.0000 (1.0)           0;0  0.2109 (0.50)          1           1
test_data_status-data-changed-noop[main]       2.3825 (1.0)      2.3825 (1.0)      2.3825 (1.0)      0.0000 (1.0)      2.3825 (1.0)      0.0000 (1.0)           0;0  0.4197 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.0175 (3.89)     20.0175 (3.89)     20.0175 (3.89)     0.0000 (1.0)      20.0175 (3.89)     0.0000 (1.0)           0;0  0.0500 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.7915 (4.04)     20.7915 (4.04)     20.7915 (4.04)     0.0000 (1.0)      20.7915 (4.04)     0.0000 (1.0)           0;0  0.0481 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.7929 (4.04)     20.7929 (4.04)     20.7929 (4.04)     0.0000 (1.0)      20.7929 (4.04)     0.0000 (1.0)           0;0  0.0481 (0.25)          1           1
test_data_status-data-new[main]        5.1517 (1.0)       5.1517 (1.0)       5.1517 (1.0)      0.0000 (1.0)       5.1517 (1.0)      0.0000 (1.0)           0;0  0.1941 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.3435 (1.79)     4.3435 (1.79)     4.3435 (1.79)     0.0000 (1.0)      4.3435 (1.79)     0.0000 (1.0)           0;0  0.2302 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.8356 (1.99)     4.8356 (1.99)     4.8356 (1.99)     0.0000 (1.0)      4.8356 (1.99)     0.0000 (1.0)           0;0  0.2068 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.6838 (1.93)     4.6838 (1.93)     4.6838 (1.93)     0.0000 (1.0)      4.6838 (1.93)     0.0000 (1.0)           0;0  0.2135 (0.52)          1           1
test_data_status-data-noop[main]       2.4291 (1.0)      2.4291 (1.0)      2.4291 (1.0)      0.0000 (1.0)      2.4291 (1.0)      0.0000 (1.0)           0;0  0.4117 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.1531 (1.09)     20.1531 (1.09)     20.1531 (1.09)     0.0000 (1.0)      20.1531 (1.09)     0.0000 (1.0)           0;0  0.0496 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.6129 (1.12)     20.6129 (1.12)     20.6129 (1.12)     0.0000 (1.0)      20.6129 (1.12)     0.0000 (1.0)           0;0  0.0485 (0.90)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.6512 (1.12)     20.6512 (1.12)     20.6512 (1.12)     0.0000 (1.0)      20.6512 (1.12)     0.0000 (1.0)           0;0  0.0484 (0.89)          1           1
test_data_status_all_flags-data-changed[main]       18.4709 (1.0)      18.4709 (1.0)      18.4709 (1.0)      0.0000 (1.0)      18.4709 (1.0)      0.0000 (1.0)           0;0  0.0541 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.1597 (1.08)     20.1597 (1.08)     20.1597 (1.08)     0.0000 (1.0)      20.1597 (1.08)     0.0000 (1.0)           0;0  0.0496 (0.93)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     20.7895 (1.11)     20.7895 (1.11)     20.7895 (1.11)     0.0000 (1.0)      20.7895 (1.11)     0.0000 (1.0)           0;0  0.0481 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.8817 (1.11)     20.8817 (1.11)     20.8817 (1.11)     0.0000 (1.0)      20.8817 (1.11)     0.0000 (1.0)           0;0  0.0479 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.7494 (1.0)      18.7494 (1.0)      18.7494 (1.0)      0.0000 (1.0)      18.7494 (1.0)      0.0000 (1.0)           0;0  0.0533 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.1124 (1.70)     36.1124 (1.70)     36.1124 (1.70)     0.0000 (1.0)      36.1124 (1.70)     0.0000 (1.0)           0;0  0.0277 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     36.9955 (1.74)     36.9955 (1.74)     36.9955 (1.74)     0.0000 (1.0)      36.9955 (1.74)     0.0000 (1.0)           0;0  0.0270 (0.57)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.6356 (1.72)     36.6356 (1.72)     36.6356 (1.72)     0.0000 (1.0)      36.6356 (1.72)     0.0000 (1.0)           0;0  0.0273 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.2483 (1.0)      21.2483 (1.0)      21.2483 (1.0)      0.0000 (1.0)      21.2483 (1.0)      0.0000 (1.0)           0;0  0.0471 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.2021 (1.07)     19.2021 (1.07)     19.2021 (1.07)     0.0000 (1.0)      19.2021 (1.07)     0.0000 (1.0)           0;0  0.0521 (0.93)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.0894 (1.12)     20.0894 (1.12)     20.0894 (1.12)     0.0000 (1.0)      20.0894 (1.12)     0.0000 (1.0)           0;0  0.0498 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.9932 (1.11)     19.9932 (1.11)     19.9932 (1.11)     0.0000 (1.0)      19.9932 (1.11)     0.0000 (1.0)           0;0  0.0500 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       17.9468 (1.0)      17.9468 (1.0)      17.9468 (1.0)      0.0000 (1.0)      17.9468 (1.0)      0.0000 (1.0)           0;0  0.0557 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.0580 (2.65)     20.0580 (2.65)     20.0580 (2.65)     0.0000 (1.0)      20.0580 (2.65)     0.0000 (1.0)           0;0  0.0499 (0.38)          1           1
test_diff-diff[3.10.0]     21.1896 (2.80)     21.1896 (2.80)     21.1896 (2.80)     0.0000 (1.0)      21.1896 (2.80)     0.0000 (1.0)           0;0  0.0472 (0.36)          1           1
test_diff-diff[3.53.2]     21.3514 (2.82)     21.3514 (2.82)     21.3514 (2.82)     0.0000 (1.0)      21.3514 (2.82)     0.0000 (1.0)           0;0  0.0468 (0.36)          1           1
test_diff-diff[main]        7.5805 (1.0)       7.5805 (1.0)       7.5805 (1.0)      0.0000 (1.0)       7.5805 (1.0)      0.0000 (1.0)           0;0  0.1319 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.5188 (1.73)     6.5188 (1.73)     6.5188 (1.73)     0.0000 (1.0)      6.5188 (1.73)     0.0000 (1.0)           0;0  0.1534 (0.58)          1           1
test_diff-diff-changed[3.10.0]     7.0372 (1.87)     7.0372 (1.87)     7.0372 (1.87)     0.0000 (1.0)      7.0372 (1.87)     0.0000 (1.0)           0;0  0.1421 (0.54)          1           1
test_diff-diff-changed[3.53.2]     5.9452 (1.58)     5.9452 (1.58)     5.9452 (1.58)     0.0000 (1.0)      5.9452 (1.58)     0.0000 (1.0)           0;0  0.1682 (0.63)          1           1
test_diff-diff-changed[main]       3.7681 (1.0)      3.7681 (1.0)      3.7681 (1.0)      0.0000 (1.0)      3.7681 (1.0)      0.0000 (1.0)           0;0  0.2654 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5027 (1.43)     5.5027 (1.43)     5.5027 (1.43)     0.0000 (1.0)      5.5027 (1.43)     0.0000 (1.0)           0;0  0.1817 (0.70)          1           1
test_diff-diff-changed-noop[3.10.0]     6.1319 (1.60)     6.1319 (1.60)     6.1319 (1.60)     0.0000 (1.0)      6.1319 (1.60)     0.0000 (1.0)           0;0  0.1631 (0.63)          1           1
test_diff-diff-changed-noop[3.53.2]     5.8413 (1.52)     5.8413 (1.52)     5.8413 (1.52)     0.0000 (1.0)      5.8413 (1.52)     0.0000 (1.0)           0;0  0.1712 (0.66)          1           1
test_diff-diff-changed-noop[main]       3.8368 (1.0)      3.8368 (1.0)      3.8368 (1.0)      0.0000 (1.0)      3.8368 (1.0)      0.0000 (1.0)           0;0  0.2606 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2675 (1.15)     4.2675 (1.15)     4.2675 (1.15)     0.0000 (1.0)      4.2675 (1.15)     0.0000 (1.0)           0;0  0.2343 (0.87)          1           1
test_diff-diff-noop[3.10.0]     4.8198 (1.30)     4.8198 (1.30)     4.8198 (1.30)     0.0000 (1.0)      4.8198 (1.30)     0.0000 (1.0)           0;0  0.2075 (0.77)          1           1
test_diff-diff-noop[3.53.2]     5.9152 (1.60)     5.9152 (1.60)     5.9152 (1.60)     0.0000 (1.0)      5.9152 (1.60)     0.0000 (1.0)           0;0  0.1691 (0.63)          1           1
test_diff-diff-noop[main]       3.6993 (1.0)      3.6993 (1.0)      3.6993 (1.0)      0.0000 (1.0)      3.6993 (1.0)      0.0000 (1.0)           0;0  0.2703 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0063 (1.0)       1.0063 (1.0)       1.0063 (1.0)      0.0000 (1.0)       1.0063 (1.0)      0.0000 (1.0)           0;0  0.9937 (1.0)           1           1
test_exp_show-exp[3.10.0]     16.0140 (15.91)    16.0140 (15.91)    16.0140 (15.91)    0.0000 (1.0)      16.0140 (15.91)    0.0000 (1.0)           0;0  0.0624 (0.06)          1           1
test_exp_show-exp[3.53.2]      9.8800 (9.82)      9.8800 (9.82)      9.8800 (9.82)     0.0000 (1.0)       9.8800 (9.82)     0.0000 (1.0)           0;0  0.1012 (0.10)          1           1
test_exp_show-exp[main]       12.8445 (12.76)    12.8445 (12.76)    12.8445 (12.76)    0.0000 (1.0)      12.8445 (12.76)    0.0000 (1.0)           0;0  0.0779 (0.08)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.0649 (2.79)     67.0649 (2.79)     67.0649 (2.79)     0.0000 (1.0)      67.0649 (2.79)     0.0000 (1.0)           0;0  0.0149 (0.36)          1           1
test_fetch-fetch[3.10.0]     72.5152 (3.01)     72.5152 (3.01)     72.5152 (3.01)     0.0000 (1.0)      72.5152 (3.01)     0.0000 (1.0)           0;0  0.0138 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.1599 (1.50)     36.1599 (1.50)     36.1599 (1.50)     0.0000 (1.0)      36.1599 (1.50)     0.0000 (1.0)           0;0  0.0277 (0.67)          1           1
test_fetch-fetch[main]       24.0634 (1.0)      24.0634 (1.0)      24.0634 (1.0)      0.0000 (1.0)      24.0634 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9906 (1.00)     2.9906 (1.00)     2.9906 (1.00)     0.0000 (1.0)      2.9906 (1.00)     0.0000 (1.0)           0;0  0.3344 (1.00)          1           1
test_gc-gc[3.10.0]     3.0849 (1.03)     3.0849 (1.03)     3.0849 (1.03)     0.0000 (1.0)      3.0849 (1.03)     0.0000 (1.0)           0;0  0.3242 (0.97)          1           1
test_gc-gc[3.53.2]     3.0051 (1.01)     3.0051 (1.01)     3.0051 (1.01)     0.0000 (1.0)      3.0051 (1.01)     0.0000 (1.0)           0;0  0.3328 (0.99)          1           1
test_gc-gc[main]       2.9810 (1.0)      2.9810 (1.0)      2.9810 (1.0)      0.0000 (1.0)      2.9810 (1.0)      0.0000 (1.0)           0;0  0.3355 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     139.0712 (2.73)     139.0712 (2.73)     139.0712 (2.73)     0.0000 (1.0)      139.0712 (2.73)     0.0000 (1.0)           0;0  0.0072 (0.37)          1           1
test_get-get[3.10.0]     170.8140 (3.36)     170.8140 (3.36)     170.8140 (3.36)     0.0000 (1.0)      170.8140 (3.36)     0.0000 (1.0)           0;0  0.0059 (0.30)          1           1
test_get-get[3.53.2]     148.3019 (2.91)     148.3019 (2.91)     148.3019 (2.91)     0.0000 (1.0)      148.3019 (2.91)     0.0000 (1.0)           0;0  0.0067 (0.34)          1           1
test_get-get[main]        50.8770 (1.0)       50.8770 (1.0)       50.8770 (1.0)      0.0000 (1.0)       50.8770 (1.0)      0.0000 (1.0)           0;0  0.0197 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.7526 (2.72)     45.7526 (2.72)     45.7526 (2.72)     0.0000 (1.0)      45.7526 (2.72)     0.0000 (1.0)           0;0  0.0219 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.5200 (2.88)     48.5200 (2.88)     48.5200 (2.88)     0.0000 (1.0)      48.5200 (2.88)     0.0000 (1.0)           0;0  0.0206 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.8801 (1.00)     16.8801 (1.00)     16.8801 (1.00)     0.0000 (1.0)      16.8801 (1.00)     0.0000 (1.0)           0;0  0.0592 (1.00)          1           1
test_get_url-get-url[main]       16.8406 (1.0)      16.8406 (1.0)      16.8406 (1.0)      0.0000 (1.0)      16.8406 (1.0)      0.0000 (1.0)           0;0  0.0594 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.2989 (1.02)     129.3881 (1.0)      126.3299 (1.02)     1.1150 (1.0)      126.1150 (1.02)     1.5332 (1.05)         35;0  7.9158 (0.98)        100           1
test_help---help[3.10.0]     122.2291 (1.0)      131.3445 (1.02)     124.0980 (1.0)      1.4425 (1.29)     123.6737 (1.0)      1.4589 (1.0)          21;5  8.0581 (1.0)         100           1
test_help---help[3.53.2]     123.9202 (1.01)     157.7532 (1.22)     127.7903 (1.03)     5.8690 (5.26)     126.0734 (1.02)     1.9384 (1.33)         8;11  7.8253 (0.97)        100           1
test_help---help[main]       125.6061 (1.03)     146.4841 (1.13)     128.1659 (1.03)     2.7376 (2.46)     127.6175 (1.03)     1.8822 (1.29)          4;3  7.8024 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     227.4812 (3.02)     227.4812 (3.02)     227.4812 (3.02)     0.0000 (1.0)      227.4812 (3.02)     0.0000 (1.0)           0;0  0.0044 (0.33)          1           1
test_import-import[3.10.0]     256.0371 (3.40)     256.0371 (3.40)     256.0371 (3.40)     0.0000 (1.0)      256.0371 (3.40)     0.0000 (1.0)           0;0  0.0039 (0.29)          1           1
test_import-import[main]        75.3643 (1.0)       75.3643 (1.0)       75.3643 (1.0)      0.0000 (1.0)       75.3643 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     164.3523 (3.39)     164.3523 (3.39)     164.3523 (3.39)     0.0000 (1.0)      164.3523 (3.39)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_import_url-import-url[3.10.0]     168.0550 (3.46)     168.0550 (3.46)     168.0550 (3.46)     0.0000 (1.0)      168.0550 (3.46)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.53.2]     127.1017 (2.62)     127.1017 (2.62)     127.1017 (2.62)     0.0000 (1.0)      127.1017 (2.62)     0.0000 (1.0)           0;0  0.0079 (0.38)          1           1
test_import_url-import-url[main]        48.5137 (1.0)       48.5137 (1.0)       48.5137 (1.0)      0.0000 (1.0)       48.5137 (1.0)      0.0000 (1.0)           0;0  0.0206 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     385.2816 (1.00)     421.5247 (1.0)      393.8402 (1.0)       5.0620 (1.03)     393.5331 (1.0)      4.5490 (1.02)         18;5  2.5391 (1.0)         100           1
test_init-init[3.10.0]     398.8480 (1.04)     421.7714 (1.00)     406.1744 (1.03)      4.8973 (1.0)      405.0966 (1.03)     4.4498 (1.0)          22;9  2.4620 (0.97)        100           1
test_init-init[3.53.2]     386.7909 (1.00)     423.6492 (1.01)     400.5994 (1.02)      7.4655 (1.52)     399.6825 (1.02)     9.9127 (2.23)         33;1  2.4963 (0.98)        100           1
test_init-init[main]       384.9239 (1.0)      500.3298 (1.19)     401.9630 (1.02)     18.2787 (3.73)     398.2540 (1.01)     7.4631 (1.68)          6;8  2.4878 (0.98)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     569.4633 (1.07)     569.4633 (1.07)     569.4633 (1.07)     0.0000 (1.0)      569.4633 (1.07)     0.0000 (1.0)           0;0  1.7560 (0.93)          1           1
test_list-list[3.10.0]     660.7608 (1.25)     660.7608 (1.25)     660.7608 (1.25)     0.0000 (1.0)      660.7608 (1.25)     0.0000 (1.0)           0;0  1.5134 (0.80)          1           1
test_list-list[3.53.2]     560.1065 (1.06)     560.1065 (1.06)     560.1065 (1.06)     0.0000 (1.0)      560.1065 (1.06)     0.0000 (1.0)           0;0  1.7854 (0.95)          1           1
test_list-list[main]       530.7054 (1.0)      530.7054 (1.0)      530.7054 (1.0)      0.0000 (1.0)      530.7054 (1.0)      0.0000 (1.0)           0;0  1.8843 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     426.1792 (1.09)     426.1792 (1.09)     426.1792 (1.09)     0.0000 (1.0)      426.1792 (1.09)     0.0000 (1.0)           0;0  2.3464 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     419.8983 (1.08)     419.8983 (1.08)     419.8983 (1.08)     0.0000 (1.0)      419.8983 (1.08)     0.0000 (1.0)           0;0  2.3815 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     389.5042 (1.0)      389.5042 (1.0)      389.5042 (1.0)      0.0000 (1.0)      389.5042 (1.0)      0.0000 (1.0)           0;0  2.5674 (1.0)           1           1
test_list-list-dvc-only[main]       393.3077 (1.01)     393.3077 (1.01)     393.3077 (1.01)     0.0000 (1.0)      393.3077 (1.01)     0.0000 (1.0)           0;0  2.5425 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7553 (1.0)      2.7553 (1.0)      2.7553 (1.0)      0.0000 (1.0)      2.7553 (1.0)      0.0000 (1.0)           0;0  0.3629 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8287 (1.03)     2.8287 (1.03)     2.8287 (1.03)     0.0000 (1.0)      2.8287 (1.03)     0.0000 (1.0)           0;0  0.3535 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.8945 (1.05)     2.8945 (1.05)     2.8945 (1.05)     0.0000 (1.0)      2.8945 (1.05)     0.0000 (1.0)           0;0  0.3455 (0.95)          1           1
test_list-list-recursive[main]       3.0249 (1.10)     3.0249 (1.10)     3.0249 (1.10)     0.0000 (1.0)      3.0249 (1.10)     0.0000 (1.0)           0;0  0.3306 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     472.9612 (1.22)     472.9612 (1.22)     472.9612 (1.22)     0.0000 (1.0)      472.9612 (1.22)     0.0000 (1.0)           0;0  2.1143 (0.82)          1           1
test_list-list-shallow[3.10.0]     406.2418 (1.04)     406.2418 (1.04)     406.2418 (1.04)     0.0000 (1.0)      406.2418 (1.04)     0.0000 (1.0)           0;0  2.4616 (0.96)          1           1
test_list-list-shallow[3.53.2]     404.7298 (1.04)     404.7298 (1.04)     404.7298 (1.04)     0.0000 (1.0)      404.7298 (1.04)     0.0000 (1.0)           0;0  2.4708 (0.96)          1           1
test_list-list-shallow[main]       389.1823 (1.0)      389.1823 (1.0)      389.1823 (1.0)      0.0000 (1.0)      389.1823 (1.0)      0.0000 (1.0)           0;0  2.5695 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     78.7515 (3.86)     78.7515 (3.86)     78.7515 (3.86)     0.0000 (1.0)      78.7515 (3.86)     0.0000 (1.0)           0;0  0.0127 (0.26)          1           1
test_partial_add-add[3.10.0]     79.8793 (3.92)     79.8793 (3.92)     79.8793 (3.92)     0.0000 (1.0)      79.8793 (3.92)     0.0000 (1.0)           0;0  0.0125 (0.26)          1           1
test_partial_add-add[3.53.2]     70.1704 (3.44)     70.1704 (3.44)     70.1704 (3.44)     0.0000 (1.0)      70.1704 (3.44)     0.0000 (1.0)           0;0  0.0143 (0.29)          1           1
test_partial_add-add[main]       20.3771 (1.0)      20.3771 (1.0)      20.3771 (1.0)      0.0000 (1.0)      20.3771 (1.0)      0.0000 (1.0)           0;0  0.0491 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     65.2504 (8.19)     65.2504 (8.19)     65.2504 (8.19)     0.0000 (1.0)      65.2504 (8.19)     0.0000 (1.0)           0;0  0.0153 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     65.0829 (8.17)     65.0829 (8.17)     65.0829 (8.17)     0.0000 (1.0)      65.0829 (8.17)     0.0000 (1.0)           0;0  0.0154 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     58.3050 (7.31)     58.3050 (7.31)     58.3050 (7.31)     0.0000 (1.0)      58.3050 (7.31)     0.0000 (1.0)           0;0  0.0172 (0.14)          1           1
test_partial_add-add-partial[main]        7.9709 (1.0)       7.9709 (1.0)       7.9709 (1.0)      0.0000 (1.0)       7.9709 (1.0)      0.0000 (1.0)           0;0  0.1255 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.2506 (1.0)      5.2506 (1.0)      5.2506 (1.0)      0.0000 (1.0)      5.2506 (1.0)      0.0000 (1.0)           0;0  0.1905 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.7053 (1.28)     6.7053 (1.28)     6.7053 (1.28)     0.0000 (1.0)      6.7053 (1.28)     0.0000 (1.0)           0;0  0.1491 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.6227 (1.45)     7.6227 (1.45)     7.6227 (1.45)     0.0000 (1.0)      7.6227 (1.45)     0.0000 (1.0)           0;0  0.1312 (0.69)          1           1
test_partial_add-gc-cloud-noop[main]       7.6539 (1.46)     7.6539 (1.46)     7.6539 (1.46)     0.0000 (1.0)      7.6539 (1.46)     0.0000 (1.0)           0;0  0.1307 (0.69)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7239 (1.0)      2.7239 (1.0)      2.7239 (1.0)      0.0000 (1.0)      2.7239 (1.0)      0.0000 (1.0)           0;0  0.3671 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.2015 (1.54)     4.2015 (1.54)     4.2015 (1.54)     0.0000 (1.0)      4.2015 (1.54)     0.0000 (1.0)           0;0  0.2380 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     4.2012 (1.54)     4.2012 (1.54)     4.2012 (1.54)     0.0000 (1.0)      4.2012 (1.54)     0.0000 (1.0)           0;0  0.2380 (0.65)          1           1
test_partial_add-gc-noop[main]       4.2441 (1.56)     4.2441 (1.56)     4.2441 (1.56)     0.0000 (1.0)      4.2441 (1.56)     0.0000 (1.0)           0;0  0.2356 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     43.9456 (2.33)     43.9456 (2.33)     43.9456 (2.33)     0.0000 (1.0)      43.9456 (2.33)     0.0000 (1.0)           0;0  0.0228 (0.43)          1           1
test_partial_add-push[3.10.0]     39.0780 (2.07)     39.0780 (2.07)     39.0780 (2.07)     0.0000 (1.0)      39.0780 (2.07)     0.0000 (1.0)           0;0  0.0256 (0.48)          1           1
test_partial_add-push[3.53.2]     19.7218 (1.05)     19.7218 (1.05)     19.7218 (1.05)     0.0000 (1.0)      19.7218 (1.05)     0.0000 (1.0)           0;0  0.0507 (0.96)          1           1
test_partial_add-push[main]       18.8508 (1.0)      18.8508 (1.0)      18.8508 (1.0)      0.0000 (1.0)      18.8508 (1.0)      0.0000 (1.0)           0;0  0.0530 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.2933 (1.10)     11.2933 (1.10)     11.2933 (1.10)     0.0000 (1.0)      11.2933 (1.10)     0.0000 (1.0)           0;0  0.0885 (0.91)          1           1
test_partial_add-push-partial[3.10.0]     10.3996 (1.01)     10.3996 (1.01)     10.3996 (1.01)     0.0000 (1.0)      10.3996 (1.01)     0.0000 (1.0)           0;0  0.0962 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.6068 (1.03)     10.6068 (1.03)     10.6068 (1.03)     0.0000 (1.0)      10.6068 (1.03)     0.0000 (1.0)           0;0  0.0943 (0.97)          1           1
test_partial_add-push-partial[main]       10.2930 (1.0)      10.2930 (1.0)      10.2930 (1.0)      0.0000 (1.0)      10.2930 (1.0)      0.0000 (1.0)           0;0  0.0972 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     90.8218 (3.79)     90.8218 (3.79)     90.8218 (3.79)     0.0000 (1.0)      90.8218 (3.79)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_partial_remove-add[3.10.0]     91.8500 (3.84)     91.8500 (3.84)     91.8500 (3.84)     0.0000 (1.0)      91.8500 (3.84)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_partial_remove-add[3.53.2]     82.4749 (3.44)     82.4749 (3.44)     82.4749 (3.44)     0.0000 (1.0)      82.4749 (3.44)     0.0000 (1.0)           0;0  0.0121 (0.29)          1           1
test_partial_remove-add[main]       23.9501 (1.0)      23.9501 (1.0)      23.9501 (1.0)      0.0000 (1.0)      23.9501 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.9029 (8.55)     8.9029 (8.55)     8.9029 (8.55)     0.0000 (1.0)      8.9029 (8.55)     0.0000 (1.0)           0;0  0.1123 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     9.0086 (8.65)     9.0086 (8.65)     9.0086 (8.65)     0.0000 (1.0)      9.0086 (8.65)     0.0000 (1.0)           0;0  0.1110 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     8.0998 (7.78)     8.0998 (7.78)     8.0998 (7.78)     0.0000 (1.0)      8.0998 (7.78)     0.0000 (1.0)           0;0  0.1235 (0.13)          1           1
test_partial_remove-add-update[main]       1.0411 (1.0)      1.0411 (1.0)      1.0411 (1.0)      0.0000 (1.0)      1.0411 (1.0)      0.0000 (1.0)           0;0  0.9606 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.5937 (1.0)      3.5937 (1.0)      3.5937 (1.0)      0.0000 (1.0)      3.5937 (1.0)      0.0000 (1.0)           0;0  0.2783 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.9415 (1.10)     3.9415 (1.10)     3.9415 (1.10)     0.0000 (1.0)      3.9415 (1.10)     0.0000 (1.0)           0;0  0.2537 (0.91)          1           1
test_partial_remove-gc[3.53.2]     4.1290 (1.15)     4.1290 (1.15)     4.1290 (1.15)     0.0000 (1.0)      4.1290 (1.15)     0.0000 (1.0)           0;0  0.2422 (0.87)          1           1
test_partial_remove-gc[main]       4.0623 (1.13)     4.0623 (1.13)     4.0623 (1.13)     0.0000 (1.0)      4.0623 (1.13)     0.0000 (1.0)           0;0  0.2462 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1615 (1.0)      5.1615 (1.0)      5.1615 (1.0)      0.0000 (1.0)      5.1615 (1.0)      0.0000 (1.0)           0;0  0.1937 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.4504 (1.06)     5.4504 (1.06)     5.4504 (1.06)     0.0000 (1.0)      5.4504 (1.06)     0.0000 (1.0)           0;0  0.1835 (0.95)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.7306 (1.11)     5.7306 (1.11)     5.7306 (1.11)     0.0000 (1.0)      5.7306 (1.11)     0.0000 (1.0)           0;0  0.1745 (0.90)          1           1
test_partial_remove-gc-cloud[main]       5.2484 (1.02)     5.2484 (1.02)     5.2484 (1.02)     0.0000 (1.0)      5.2484 (1.02)     0.0000 (1.0)           0;0  0.1905 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.2447 (2.25)     51.2447 (2.25)     51.2447 (2.25)     0.0000 (1.0)      51.2447 (2.25)     0.0000 (1.0)           0;0  0.0195 (0.44)          1           1
test_partial_remove-push[3.10.0]     46.1747 (2.03)     46.1747 (2.03)     46.1747 (2.03)     0.0000 (1.0)      46.1747 (2.03)     0.0000 (1.0)           0;0  0.0217 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.2795 (1.02)     23.2795 (1.02)     23.2795 (1.02)     0.0000 (1.0)      23.2795 (1.02)     0.0000 (1.0)           0;0  0.0430 (0.98)          1           1
test_partial_remove-push[main]       22.7439 (1.0)      22.7439 (1.0)      22.7439 (1.0)      0.0000 (1.0)      22.7439 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8307 (1.00)     1.8307 (1.00)     1.8307 (1.00)     0.0000 (1.0)      1.8307 (1.00)     0.0000 (1.0)           0;0  0.5462 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     1.8243 (1.0)      1.8243 (1.0)      1.8243 (1.0)      0.0000 (1.0)      1.8243 (1.0)      0.0000 (1.0)           0;0  0.5482 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5131 (1.38)     2.5131 (1.38)     2.5131 (1.38)     0.0000 (1.0)      2.5131 (1.38)     0.0000 (1.0)           0;0  0.3979 (0.73)          1           1
test_partial_remove-push-update[main]       2.6771 (1.47)     2.6771 (1.47)     2.6771 (1.47)     0.0000 (1.0)      2.6771 (1.47)     0.0000 (1.0)           0;0  0.3735 (0.68)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     456.5305 (1.0)      460.3824 (1.0)      457.7570 (1.0)      1.5686 (1.0)      457.2251 (1.0)      1.9035 (1.0)           1;0  2.1846 (1.0)           5           3
test_plots-plots-diff[3.10.0]     859.7098 (1.88)     873.5640 (1.90)     864.5974 (1.89)     6.0370 (3.85)     860.8050 (1.88)     8.9821 (4.72)          1;0  1.1566 (0.53)          5           3
test_plots-plots-diff[3.53.2]     808.3652 (1.77)     817.8199 (1.78)     812.4015 (1.77)     3.4612 (2.21)     811.5687 (1.77)     3.6294 (1.91)          2;0  1.2309 (0.56)          5           3
test_plots-plots-diff[main]       813.0752 (1.78)     819.0316 (1.78)     815.7298 (1.78)     2.2837 (1.46)     816.1203 (1.78)     3.0702 (1.61)          2;0  1.2259 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       468.4451 (1.0)        473.8002 (1.0)        471.9095 (1.0)      2.0999 (1.0)        472.7065 (1.0)      2.4634 (1.0)           1;0  2.1191 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,083.0331 (2.31)     1,091.6819 (2.30)     1,085.3927 (2.30)     3.5892 (1.71)     1,084.3311 (2.29)     3.3097 (1.34)          1;1  0.9213 (0.43)          5           3
test_plots-plots-diff-json[3.53.2]       886.2664 (1.89)       903.3450 (1.91)       890.7302 (1.89)     7.1756 (3.42)       888.3419 (1.88)     6.5424 (2.66)          1;1  1.1227 (0.53)          5           3
test_plots-plots-diff-json[main]         886.8282 (1.89)       894.0810 (1.89)       889.4234 (1.88)     2.9330 (1.40)       889.1808 (1.88)     4.0045 (1.63)          1;0  1.1243 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     408.7860 (1.0)      410.8064 (1.0)      409.4949 (1.0)       0.8312 (1.0)      409.1541 (1.0)       1.1679 (1.0)           1;0  2.4420 (1.0)           5           3
test_plots-plots-show[3.10.0]     704.3501 (1.72)     721.0817 (1.76)     712.5389 (1.74)      7.2508 (8.72)     709.5431 (1.73)     12.2466 (10.49)         2;0  1.4034 (0.57)          5           3
test_plots-plots-show[3.53.2]     679.8905 (1.66)     683.3678 (1.66)     682.0058 (1.67)      1.4695 (1.77)     682.3222 (1.67)      2.4110 (2.06)          1;0  1.4663 (0.60)          5           3
test_plots-plots-show[main]       681.9061 (1.67)     723.3185 (1.76)     694.4454 (1.70)     17.4161 (20.95)    685.6204 (1.68)     21.7924 (18.66)         1;0  1.4400 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     425.0408 (1.0)      428.5317 (1.0)      426.1978 (1.0)      1.4802 (1.0)      425.4536 (1.0)      2.0966 (1.24)          1;0  2.3463 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     826.3472 (1.94)     832.4455 (1.94)     828.4477 (1.94)     2.3248 (1.57)     827.7882 (1.95)     1.6850 (1.0)           1;1  1.2071 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     724.5878 (1.70)     730.7946 (1.71)     727.3345 (1.71)     2.7174 (1.84)     726.1468 (1.71)     4.6436 (2.76)          2;0  1.3749 (0.59)          5           3
test_plots-plots-show-json[main]       721.8783 (1.70)     729.6206 (1.70)     724.8882 (1.70)     3.2394 (2.19)     723.1470 (1.70)     4.8381 (2.87)          1;0  1.3795 (0.59)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.2575 (2.31)     52.2575 (2.31)     52.2575 (2.31)     0.0000 (1.0)      52.2575 (2.31)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_push-push[3.10.0]     46.7835 (2.07)     46.7835 (2.07)     46.7835 (2.07)     0.0000 (1.0)      46.7835 (2.07)     0.0000 (1.0)           0;0  0.0214 (0.48)          1           1
test_push-push[3.53.2]     23.7892 (1.05)     23.7892 (1.05)     23.7892 (1.05)     0.0000 (1.0)      23.7892 (1.05)     0.0000 (1.0)           0;0  0.0420 (0.95)          1           1
test_push-push[main]       22.6326 (1.0)      22.6326 (1.0)      22.6326 (1.0)      0.0000 (1.0)      22.6326 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.7188 (2.67)     66.7188 (2.67)     66.7188 (2.67)     0.0000 (1.0)      66.7188 (2.67)     0.0000 (1.0)           0;0  0.0150 (0.38)          1           1
test_sharing-fetch[3.10.0]     72.1867 (2.88)     72.1867 (2.88)     72.1867 (2.88)     0.0000 (1.0)      72.1867 (2.88)     0.0000 (1.0)           0;0  0.0139 (0.35)          1           1
test_sharing-fetch[3.53.2]     36.4517 (1.46)     36.4517 (1.46)     36.4517 (1.46)     0.0000 (1.0)      36.4517 (1.46)     0.0000 (1.0)           0;0  0.0274 (0.69)          1           1
test_sharing-fetch[main]       25.0337 (1.0)      25.0337 (1.0)      25.0337 (1.0)      0.0000 (1.0)      25.0337 (1.0)      0.0000 (1.0)           0;0  0.0399 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3384 (1.0)      1.3384 (1.0)      1.3384 (1.0)      0.0000 (1.0)      1.3384 (1.0)      0.0000 (1.0)           0;0  0.7472 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6557 (2.73)     3.6557 (2.73)     3.6557 (2.73)     0.0000 (1.0)      3.6557 (2.73)     0.0000 (1.0)           0;0  0.2735 (0.37)          1           1
test_sharing-fetch-noop[3.53.2]     6.4390 (4.81)     6.4390 (4.81)     6.4390 (4.81)     0.0000 (1.0)      6.4390 (4.81)     0.0000 (1.0)           0;0  0.1553 (0.21)          1           1
test_sharing-fetch-noop[main]       6.5651 (4.91)     6.5651 (4.91)     6.5651 (4.91)     0.0000 (1.0)      6.5651 (4.91)     0.0000 (1.0)           0;0  0.1523 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.0908 (2.30)     53.0908 (2.30)     53.0908 (2.30)     0.0000 (1.0)      53.0908 (2.30)     0.0000 (1.0)           0;0  0.0188 (0.43)          1           1
test_sharing-push[3.10.0]     46.7135 (2.02)     46.7135 (2.02)     46.7135 (2.02)     0.0000 (1.0)      46.7135 (2.02)     0.0000 (1.0)           0;0  0.0214 (0.49)          1           1
test_sharing-push[3.53.2]     23.6913 (1.03)     23.6913 (1.03)     23.6913 (1.03)     0.0000 (1.0)      23.6913 (1.03)     0.0000 (1.0)           0;0  0.0422 (0.97)          1           1
test_sharing-push[main]       23.0744 (1.0)      23.0744 (1.0)      23.0744 (1.0)      0.0000 (1.0)      23.0744 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.3136 (1.0)      2.3136 (1.0)      2.3136 (1.0)      0.0000 (1.0)      2.3136 (1.0)      0.0000 (1.0)           0;0  0.4322 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.3263 (1.01)     2.3263 (1.01)     2.3263 (1.01)     0.0000 (1.0)      2.3263 (1.01)     0.0000 (1.0)           0;0  0.4299 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.5421 (2.83)     6.5421 (2.83)     6.5421 (2.83)     0.0000 (1.0)      6.5421 (2.83)     0.0000 (1.0)           0;0  0.1529 (0.35)          1           1
test_sharing-push-noop[main]       6.8191 (2.95)     6.8191 (2.95)     6.8191 (2.95)     0.0000 (1.0)      6.8191 (2.95)     0.0000 (1.0)           0;0  0.1466 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     159.6225 (1.08)     159.6225 (1.08)     159.6225 (1.08)     0.0000 (1.0)      159.6225 (1.08)     0.0000 (1.0)           0;0  0.0063 (0.92)          1           1
test_sharing_azure-fetch[main]       147.6312 (1.0)      147.6312 (1.0)      147.6312 (1.0)      0.0000 (1.0)      147.6312 (1.0)      0.0000 (1.0)           0;0  0.0068 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.7738 (1.0)      6.7738 (1.0)      6.7738 (1.0)      0.0000 (1.0)      6.7738 (1.0)      0.0000 (1.0)           0;0  0.1476 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.8354 (1.01)     6.8354 (1.01)     6.8354 (1.01)     0.0000 (1.0)      6.8354 (1.01)     0.0000 (1.0)           0;0  0.1463 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     154.0228 (1.0)      154.0228 (1.0)      154.0228 (1.0)      0.0000 (1.0)      154.0228 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
test_sharing_azure-push[main]       156.7470 (1.02)     156.7470 (1.02)     156.7470 (1.02)     0.0000 (1.0)      156.7470 (1.02)     0.0000 (1.0)           0;0  0.0064 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.4581 (1.01)     7.4581 (1.01)     7.4581 (1.01)     0.0000 (1.0)      7.4581 (1.01)     0.0000 (1.0)           0;0  0.1341 (0.99)          1           1
test_sharing_azure-push-noop[main]       7.4200 (1.0)      7.4200 (1.0)      7.4200 (1.0)      0.0000 (1.0)      7.4200 (1.0)      0.0000 (1.0)           0;0  0.1348 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     241.9886 (1.04)     241.9886 (1.04)     241.9886 (1.04)     0.0000 (1.0)      241.9886 (1.04)     0.0000 (1.0)           0;0  0.0041 (0.97)          1           1
test_sharing_gs-fetch[main]       233.5514 (1.0)      233.5514 (1.0)      233.5514 (1.0)      0.0000 (1.0)      233.5514 (1.0)      0.0000 (1.0)           0;0  0.0043 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.4896 (1.0)      7.4896 (1.0)      7.4896 (1.0)      0.0000 (1.0)      7.4896 (1.0)      0.0000 (1.0)           0;0  0.1335 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.5281 (1.01)     7.5281 (1.01)     7.5281 (1.01)     0.0000 (1.0)      7.5281 (1.01)     0.0000 (1.0)           0;0  0.1328 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     608.2632 (1.0)      608.2632 (1.0)      608.2632 (1.0)      0.0000 (1.0)      608.2632 (1.0)      0.0000 (1.0)           0;0  0.0016 (1.0)           1           1
test_sharing_gs-push[main]       612.6721 (1.01)     612.6721 (1.01)     612.6721 (1.01)     0.0000 (1.0)      612.6721 (1.01)     0.0000 (1.0)           0;0  0.0016 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8292 (1.0)      6.8292 (1.0)      6.8292 (1.0)      0.0000 (1.0)      6.8292 (1.0)      0.0000 (1.0)           0;0  0.1464 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.9304 (1.01)     6.9304 (1.01)     6.9304 (1.01)     0.0000 (1.0)      6.9304 (1.01)     0.0000 (1.0)           0;0  0.1443 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     264.8785 (1.00)     264.8785 (1.00)     264.8785 (1.00)     0.0000 (1.0)      264.8785 (1.00)     0.0000 (1.0)           0;0  0.0038 (1.00)          1           1
test_sharing_s3-fetch[main]       264.0327 (1.0)      264.0327 (1.0)      264.0327 (1.0)      0.0000 (1.0)      264.0327 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6244 (1.0)      6.6244 (1.0)      6.6244 (1.0)      0.0000 (1.0)      6.6244 (1.0)      0.0000 (1.0)           0;0  0.1510 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7213 (1.01)     6.7213 (1.01)     6.7213 (1.01)     0.0000 (1.0)      6.7213 (1.01)     0.0000 (1.0)           0;0  0.1488 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     314.2187 (1.0)      314.2187 (1.0)      314.2187 (1.0)      0.0000 (1.0)      314.2187 (1.0)      0.0000 (1.0)           0;0  0.0032 (1.0)           1           1
test_sharing_s3-push[main]       316.8484 (1.01)     316.8484 (1.01)     316.8484 (1.01)     0.0000 (1.0)      316.8484 (1.01)     0.0000 (1.0)           0;0  0.0032 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.0337 (1.00)     7.0337 (1.00)     7.0337 (1.00)     0.0000 (1.0)      7.0337 (1.00)     0.0000 (1.0)           0;0  0.1422 (1.00)          1           1
test_sharing_s3-push-noop[main]       7.0085 (1.0)      7.0085 (1.0)      7.0085 (1.0)      0.0000 (1.0)      7.0085 (1.0)      0.0000 (1.0)           0;0  0.1427 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.6749 (3.72)     20.6749 (3.72)     20.6749 (3.72)     0.0000 (1.0)      20.6749 (3.72)     0.0000 (1.0)           0;0  0.0484 (0.27)          1           1
test_status-status[3.10.0]     21.2112 (3.82)     21.2112 (3.82)     21.2112 (3.82)     0.0000 (1.0)      21.2112 (3.82)     0.0000 (1.0)           0;0  0.0471 (0.26)          1           1
test_status-status[3.53.2]     19.4807 (3.51)     19.4807 (3.51)     19.4807 (3.51)     0.0000 (1.0)      19.4807 (3.51)     0.0000 (1.0)           0;0  0.0513 (0.28)          1           1
test_status-status[main]        5.5512 (1.0)       5.5512 (1.0)       5.5512 (1.0)      0.0000 (1.0)       5.5512 (1.0)      0.0000 (1.0)           0;0  0.1801 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8897 (1.67)     4.8897 (1.67)     4.8897 (1.67)     0.0000 (1.0)      4.8897 (1.67)     0.0000 (1.0)           0;0  0.2045 (0.60)          1           1
test_status-status-changed[3.10.0]     5.2372 (1.78)     5.2372 (1.78)     5.2372 (1.78)     0.0000 (1.0)      5.2372 (1.78)     0.0000 (1.0)           0;0  0.1909 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0221 (1.71)     5.0221 (1.71)     5.0221 (1.71)     0.0000 (1.0)      5.0221 (1.71)     0.0000 (1.0)           0;0  0.1991 (0.58)          1           1
test_status-status-changed[main]       2.9343 (1.0)      2.9343 (1.0)      2.9343 (1.0)      0.0000 (1.0)      2.9343 (1.0)      0.0000 (1.0)           0;0  0.3408 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9193 (1.74)     4.9193 (1.74)     4.9193 (1.74)     0.0000 (1.0)      4.9193 (1.74)     0.0000 (1.0)           0;0  0.2033 (0.57)          1           1
test_status-status-changed-noop[3.10.0]     5.1040 (1.81)     5.1040 (1.81)     5.1040 (1.81)     0.0000 (1.0)      5.1040 (1.81)     0.0000 (1.0)           0;0  0.1959 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     4.8700 (1.73)     4.8700 (1.73)     4.8700 (1.73)     0.0000 (1.0)      4.8700 (1.73)     0.0000 (1.0)           0;0  0.2053 (0.58)          1           1
test_status-status-changed-noop[main]       2.8227 (1.0)      2.8227 (1.0)      2.8227 (1.0)      0.0000 (1.0)      2.8227 (1.0)      0.0000 (1.0)           0;0  0.3543 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9650 (1.76)     4.9650 (1.76)     4.9650 (1.76)     0.0000 (1.0)      4.9650 (1.76)     0.0000 (1.0)           0;0  0.2014 (0.57)          1           1
test_status-status-noop[3.10.0]     5.2038 (1.85)     5.2038 (1.85)     5.2038 (1.85)     0.0000 (1.0)      5.2038 (1.85)     0.0000 (1.0)           0;0  0.1922 (0.54)          1           1
test_status-status-noop[3.53.2]     4.8836 (1.73)     4.8836 (1.73)     4.8836 (1.73)     0.0000 (1.0)      4.8836 (1.73)     0.0000 (1.0)           0;0  0.2048 (0.58)          1           1
test_status-status-noop[main]       2.8202 (1.0)      2.8202 (1.0)      2.8202 (1.0)      0.0000 (1.0)      2.8202 (1.0)      0.0000 (1.0)           0;0  0.3546 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     164.2579 (3.41)     164.2579 (3.41)     164.2579 (3.41)     0.0000 (1.0)      164.2579 (3.41)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.10.0]     169.7015 (3.52)     169.7015 (3.52)     169.7015 (3.52)     0.0000 (1.0)      169.7015 (3.52)     0.0000 (1.0)           0;0  0.0059 (0.28)          1           1
test_update-import-url[3.53.2]     128.2789 (2.66)     128.2789 (2.66)     128.2789 (2.66)     0.0000 (1.0)      128.2789 (2.66)     0.0000 (1.0)           0;0  0.0078 (0.38)          1           1
test_update-import-url[main]        48.2148 (1.0)       48.2148 (1.0)       48.2148 (1.0)      0.0000 (1.0)       48.2148 (1.0)      0.0000 (1.0)           0;0  0.0207 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     146.1895 (3.87)     146.1895 (3.87)     146.1895 (3.87)     0.0000 (1.0)      146.1895 (3.87)     0.0000 (1.0)           0;0  0.0068 (0.26)          1           1
test_update-update[3.10.0]     149.7030 (3.97)     149.7030 (3.97)     149.7030 (3.97)     0.0000 (1.0)      149.7030 (3.97)     0.0000 (1.0)           0;0  0.0067 (0.25)          1           1
test_update-update[3.53.2]     115.1647 (3.05)     115.1647 (3.05)     115.1647 (3.05)     0.0000 (1.0)      115.1647 (3.05)     0.0000 (1.0)           0;0  0.0087 (0.33)          1           1
test_update-update[main]        37.7336 (1.0)       37.7336 (1.0)       37.7336 (1.0)      0.0000 (1.0)       37.7336 (1.0)      0.0000 (1.0)           0;0  0.0265 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.6408 (1.96)     16.6408 (1.96)     16.6408 (1.96)     0.0000 (1.0)      16.6408 (1.96)     0.0000 (1.0)           0;0  0.0601 (0.51)          1           1
test_update-update-noop[3.10.0]     17.8332 (2.10)     17.8332 (2.10)     17.8332 (2.10)     0.0000 (1.0)      17.8332 (2.10)     0.0000 (1.0)           0;0  0.0561 (0.48)          1           1
test_update-update-noop[3.53.2]     17.3459 (2.05)     17.3459 (2.05)     17.3459 (2.05)     0.0000 (1.0)      17.3459 (2.05)     0.0000 (1.0)           0;0  0.0577 (0.49)          1           1
test_update-update-noop[main]        8.4729 (1.0)       8.4729 (1.0)       8.4729 (1.0)      0.0000 (1.0)       8.4729 (1.0)      0.0000 (1.0)           0;0  0.1180 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean