Wed Mar 12 00:50:39 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     90.4272 (3.73)     90.4272 (3.73)     90.4272 (3.73)     0.0000 (1.0)      90.4272 (3.73)     0.0000 (1.0)           0;0  0.0111 (0.27)          1           1
test_add_copy-add[3.10.0]     91.5015 (3.77)     91.5015 (3.77)     91.5015 (3.77)     0.0000 (1.0)      91.5015 (3.77)     0.0000 (1.0)           0;0  0.0109 (0.27)          1           1
test_add_copy-add[3.53.2]     83.2087 (3.43)     83.2087 (3.43)     83.2087 (3.43)     0.0000 (1.0)      83.2087 (3.43)     0.0000 (1.0)           0;0  0.0120 (0.29)          1           1
test_add_copy-add[main]       24.2711 (1.0)      24.2711 (1.0)      24.2711 (1.0)      0.0000 (1.0)      24.2711 (1.0)      0.0000 (1.0)           0;0  0.0412 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.2423 (6.36)     31.2423 (6.36)     31.2423 (6.36)     0.0000 (1.0)      31.2423 (6.36)     0.0000 (1.0)           0;0  0.0320 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     31.6553 (6.44)     31.6553 (6.44)     31.6553 (6.44)     0.0000 (1.0)      31.6553 (6.44)     0.0000 (1.0)           0;0  0.0316 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     29.7236 (6.05)     29.7236 (6.05)     29.7236 (6.05)     0.0000 (1.0)      29.7236 (6.05)     0.0000 (1.0)           0;0  0.0336 (0.17)          1           1
test_add_copy-add-noop[main]        4.9134 (1.0)       4.9134 (1.0)       4.9134 (1.0)      0.0000 (1.0)       4.9134 (1.0)      0.0000 (1.0)           0;0  0.2035 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     72.5572 (4.01)     72.5572 (4.01)     72.5572 (4.01)     0.0000 (1.0)      72.5572 (4.01)     0.0000 (1.0)           0;0  0.0138 (0.25)          1           1
test_add_hardlink-add[3.10.0]     73.5654 (4.07)     73.5654 (4.07)     73.5654 (4.07)     0.0000 (1.0)      73.5654 (4.07)     0.0000 (1.0)           0;0  0.0136 (0.25)          1           1
test_add_hardlink-add[3.53.2]     67.8729 (3.75)     67.8729 (3.75)     67.8729 (3.75)     0.0000 (1.0)      67.8729 (3.75)     0.0000 (1.0)           0;0  0.0147 (0.27)          1           1
test_add_hardlink-add[main]       18.0971 (1.0)      18.0971 (1.0)      18.0971 (1.0)      0.0000 (1.0)      18.0971 (1.0)      0.0000 (1.0)           0;0  0.0553 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.6299 (7.40)     36.6299 (7.40)     36.6299 (7.40)     0.0000 (1.0)      36.6299 (7.40)     0.0000 (1.0)           0;0  0.0273 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     37.3805 (7.55)     37.3805 (7.55)     37.3805 (7.55)     0.0000 (1.0)      37.3805 (7.55)     0.0000 (1.0)           0;0  0.0268 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.2162 (7.11)     35.2162 (7.11)     35.2162 (7.11)     0.0000 (1.0)      35.2162 (7.11)     0.0000 (1.0)           0;0  0.0284 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.9528 (1.0)       4.9528 (1.0)       4.9528 (1.0)      0.0000 (1.0)       4.9528 (1.0)      0.0000 (1.0)           0;0  0.2019 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     77.5714 (2.09)     77.5714 (2.09)     77.5714 (2.09)     0.0000 (1.0)      77.5714 (2.09)     0.0000 (1.0)           0;0  0.0129 (0.48)          1           1
test_add_symlink-add[3.10.0]     79.6236 (2.15)     79.6236 (2.15)     79.6236 (2.15)     0.0000 (1.0)      79.6236 (2.15)     0.0000 (1.0)           0;0  0.0126 (0.47)          1           1
test_add_symlink-add[3.53.2]     73.4320 (1.98)     73.4320 (1.98)     73.4320 (1.98)     0.0000 (1.0)      73.4320 (1.98)     0.0000 (1.0)           0;0  0.0136 (0.50)          1           1
test_add_symlink-add[main]       37.0495 (1.0)      37.0495 (1.0)      37.0495 (1.0)      0.0000 (1.0)      37.0495 (1.0)      0.0000 (1.0)           0;0  0.0270 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     49.8653 (7.99)     49.8653 (7.99)     49.8653 (7.99)     0.0000 (1.0)      49.8653 (7.99)     0.0000 (1.0)           0;0  0.0201 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     51.1238 (8.19)     51.1238 (8.19)     51.1238 (8.19)     0.0000 (1.0)      51.1238 (8.19)     0.0000 (1.0)           0;0  0.0196 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.8067 (7.66)     47.8067 (7.66)     47.8067 (7.66)     0.0000 (1.0)      47.8067 (7.66)     0.0000 (1.0)           0;0  0.0209 (0.13)          1           1
test_add_symlink-add-noop[main]        6.2444 (1.0)       6.2444 (1.0)       6.2444 (1.0)      0.0000 (1.0)       6.2444 (1.0)      0.0000 (1.0)           0;0  0.1601 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.4509 (1.96)     42.4509 (1.96)     42.4509 (1.96)     0.0000 (1.0)      42.4509 (1.96)     0.0000 (1.0)           0;0  0.0236 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     60.3623 (2.79)     60.3623 (2.79)     60.3623 (2.79)     0.0000 (1.0)      60.3623 (2.79)     0.0000 (1.0)           0;0  0.0166 (0.36)          1           1
test_checkout_copy-checkout[3.53.2]     29.5520 (1.36)     29.5520 (1.36)     29.5520 (1.36)     0.0000 (1.0)      29.5520 (1.36)     0.0000 (1.0)           0;0  0.0338 (0.73)          1           1
test_checkout_copy-checkout[main]       21.6528 (1.0)      21.6528 (1.0)      21.6528 (1.0)      0.0000 (1.0)      21.6528 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.7319 (1.59)     5.7319 (1.59)     5.7319 (1.59)     0.0000 (1.0)      5.7319 (1.59)     0.0000 (1.0)           0;0  0.1745 (0.63)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9992 (1.67)     5.9992 (1.67)     5.9992 (1.67)     0.0000 (1.0)      5.9992 (1.67)     0.0000 (1.0)           0;0  0.1667 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6497 (1.57)     5.6497 (1.57)     5.6497 (1.57)     0.0000 (1.0)      5.6497 (1.57)     0.0000 (1.0)           0;0  0.1770 (0.64)          1           1
test_checkout_copy-checkout-noop[main]       3.5938 (1.0)      3.5938 (1.0)      3.5938 (1.0)      0.0000 (1.0)      3.5938 (1.0)      0.0000 (1.0)           0;0  0.2783 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6301 (2.03)     8.6301 (2.03)     8.6301 (2.03)     0.0000 (1.0)      8.6301 (2.03)     0.0000 (1.0)           0;0  0.1159 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6834 (1.57)     6.6834 (1.57)     6.6834 (1.57)     0.0000 (1.0)      6.6834 (1.57)     0.0000 (1.0)           0;0  0.1496 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5379 (1.54)     6.5379 (1.54)     6.5379 (1.54)     0.0000 (1.0)      6.5379 (1.54)     0.0000 (1.0)           0;0  0.1530 (0.65)          1           1
test_checkout_copy-checkout-update[main]       4.2529 (1.0)      4.2529 (1.0)      4.2529 (1.0)      0.0000 (1.0)      4.2529 (1.0)      0.0000 (1.0)           0;0  0.2351 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.0393 (2.95)     24.0393 (2.95)     24.0393 (2.95)     0.0000 (1.0)      24.0393 (2.95)     0.0000 (1.0)           0;0  0.0416 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.8229 (2.19)     17.8229 (2.19)     17.8229 (2.19)     0.0000 (1.0)      17.8229 (2.19)     0.0000 (1.0)           0;0  0.0561 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.4248 (2.01)     16.4248 (2.01)     16.4248 (2.01)     0.0000 (1.0)      16.4248 (2.01)     0.0000 (1.0)           0;0  0.0609 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.1528 (1.0)       8.1528 (1.0)       8.1528 (1.0)      0.0000 (1.0)       8.1528 (1.0)      0.0000 (1.0)           0;0  0.1227 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.7869 (1.62)     5.7869 (1.62)     5.7869 (1.62)     0.0000 (1.0)      5.7869 (1.62)     0.0000 (1.0)           0;0  0.1728 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.9963 (1.68)     5.9963 (1.68)     5.9963 (1.68)     0.0000 (1.0)      5.9963 (1.68)     0.0000 (1.0)           0;0  0.1668 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6981 (1.60)     5.6981 (1.60)     5.6981 (1.60)     0.0000 (1.0)      5.6981 (1.60)     0.0000 (1.0)           0;0  0.1755 (0.63)          1           1
test_checkout_hardlink-checkout-noop[main]       3.5638 (1.0)      3.5638 (1.0)      3.5638 (1.0)      0.0000 (1.0)      3.5638 (1.0)      0.0000 (1.0)           0;0  0.2806 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6939 (2.07)     8.6939 (2.07)     8.6939 (2.07)     0.0000 (1.0)      8.6939 (2.07)     0.0000 (1.0)           0;0  0.1150 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7848 (1.62)     6.7848 (1.62)     6.7848 (1.62)     0.0000 (1.0)      6.7848 (1.62)     0.0000 (1.0)           0;0  0.1474 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4958 (1.55)     6.4958 (1.55)     6.4958 (1.55)     0.0000 (1.0)      6.4958 (1.55)     0.0000 (1.0)           0;0  0.1539 (0.65)          1           1
test_checkout_hardlink-checkout-update[main]       4.2005 (1.0)      4.2005 (1.0)      4.2005 (1.0)      0.0000 (1.0)      4.2005 (1.0)      0.0000 (1.0)           0;0  0.2381 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.1652 (2.38)     27.1652 (2.38)     27.1652 (2.38)     0.0000 (1.0)      27.1652 (2.38)     0.0000 (1.0)           0;0  0.0368 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     21.1135 (1.85)     21.1135 (1.85)     21.1135 (1.85)     0.0000 (1.0)      21.1135 (1.85)     0.0000 (1.0)           0;0  0.0474 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     19.7913 (1.73)     19.7913 (1.73)     19.7913 (1.73)     0.0000 (1.0)      19.7913 (1.73)     0.0000 (1.0)           0;0  0.0505 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.4079 (1.0)      11.4079 (1.0)      11.4079 (1.0)      0.0000 (1.0)      11.4079 (1.0)      0.0000 (1.0)           0;0  0.0877 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8896 (1.50)     6.8896 (1.50)     6.8896 (1.50)     0.0000 (1.0)      6.8896 (1.50)     0.0000 (1.0)           0;0  0.1451 (0.67)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.1758 (1.56)     7.1758 (1.56)     7.1758 (1.56)     0.0000 (1.0)      7.1758 (1.56)     0.0000 (1.0)           0;0  0.1394 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.8568 (1.49)     6.8568 (1.49)     6.8568 (1.49)     0.0000 (1.0)      6.8568 (1.49)     0.0000 (1.0)           0;0  0.1458 (0.67)          1           1
test_checkout_symlink-checkout-noop[main]       4.6017 (1.0)      4.6017 (1.0)      4.6017 (1.0)      0.0000 (1.0)      4.6017 (1.0)      0.0000 (1.0)           0;0  0.2173 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.7187 (1.77)     10.7187 (1.77)     10.7187 (1.77)     0.0000 (1.0)      10.7187 (1.77)     0.0000 (1.0)           0;0  0.0933 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.8329 (1.46)      8.8329 (1.46)      8.8329 (1.46)     0.0000 (1.0)       8.8329 (1.46)     0.0000 (1.0)           0;0  0.1132 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.6249 (1.42)      8.6249 (1.42)      8.6249 (1.42)     0.0000 (1.0)       8.6249 (1.42)     0.0000 (1.0)           0;0  0.1159 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        6.0580 (1.0)       6.0580 (1.0)       6.0580 (1.0)      0.0000 (1.0)       6.0580 (1.0)      0.0000 (1.0)           0;0  0.1651 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1579 (1.63)     4.1579 (1.63)     4.1579 (1.63)     0.0000 (1.0)      4.1579 (1.63)     0.0000 (1.0)           0;0  0.2405 (0.61)          1           1
test_data_status-data-changed[3.10.0]     4.9430 (1.94)     4.9430 (1.94)     4.9430 (1.94)     0.0000 (1.0)      4.9430 (1.94)     0.0000 (1.0)           0;0  0.2023 (0.52)          1           1
test_data_status-data-changed[3.53.2]     4.6613 (1.83)     4.6613 (1.83)     4.6613 (1.83)     0.0000 (1.0)      4.6613 (1.83)     0.0000 (1.0)           0;0  0.2145 (0.55)          1           1
test_data_status-data-changed[main]       2.5535 (1.0)      2.5535 (1.0)      2.5535 (1.0)      0.0000 (1.0)      2.5535 (1.0)      0.0000 (1.0)           0;0  0.3916 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2893 (1.74)     4.2893 (1.74)     4.2893 (1.74)     0.0000 (1.0)      4.2893 (1.74)     0.0000 (1.0)           0;0  0.2331 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9044 (1.99)     4.9044 (1.99)     4.9044 (1.99)     0.0000 (1.0)      4.9044 (1.99)     0.0000 (1.0)           0;0  0.2039 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7439 (1.93)     4.7439 (1.93)     4.7439 (1.93)     0.0000 (1.0)      4.7439 (1.93)     0.0000 (1.0)           0;0  0.2108 (0.52)          1           1
test_data_status-data-changed-noop[main]       2.4629 (1.0)      2.4629 (1.0)      2.4629 (1.0)      0.0000 (1.0)      2.4629 (1.0)      0.0000 (1.0)           0;0  0.4060 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.9750 (3.81)     19.9750 (3.81)     19.9750 (3.81)     0.0000 (1.0)      19.9750 (3.81)     0.0000 (1.0)           0;0  0.0501 (0.26)          1           1
test_data_status-data-new[3.10.0]     21.0847 (4.02)     21.0847 (4.02)     21.0847 (4.02)     0.0000 (1.0)      21.0847 (4.02)     0.0000 (1.0)           0;0  0.0474 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.5998 (3.93)     20.5998 (3.93)     20.5998 (3.93)     0.0000 (1.0)      20.5998 (3.93)     0.0000 (1.0)           0;0  0.0485 (0.25)          1           1
test_data_status-data-new[main]        5.2460 (1.0)       5.2460 (1.0)       5.2460 (1.0)      0.0000 (1.0)       5.2460 (1.0)      0.0000 (1.0)           0;0  0.1906 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.4158 (1.80)     4.4158 (1.80)     4.4158 (1.80)     0.0000 (1.0)      4.4158 (1.80)     0.0000 (1.0)           0;0  0.2265 (0.55)          1           1
test_data_status-data-noop[3.10.0]     5.0060 (2.04)     5.0060 (2.04)     5.0060 (2.04)     0.0000 (1.0)      5.0060 (2.04)     0.0000 (1.0)           0;0  0.1998 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.8607 (1.99)     4.8607 (1.99)     4.8607 (1.99)     0.0000 (1.0)      4.8607 (1.99)     0.0000 (1.0)           0;0  0.2057 (0.50)          1           1
test_data_status-data-noop[main]       2.4482 (1.0)      2.4482 (1.0)      2.4482 (1.0)      0.0000 (1.0)      2.4482 (1.0)      0.0000 (1.0)           0;0  0.4085 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.1905 (1.08)     20.1905 (1.08)     20.1905 (1.08)     0.0000 (1.0)      20.1905 (1.08)     0.0000 (1.0)           0;0  0.0495 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.7294 (1.11)     20.7294 (1.11)     20.7294 (1.11)     0.0000 (1.0)      20.7294 (1.11)     0.0000 (1.0)           0;0  0.0482 (0.90)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.7678 (1.11)     20.7678 (1.11)     20.7678 (1.11)     0.0000 (1.0)      20.7678 (1.11)     0.0000 (1.0)           0;0  0.0482 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       18.6694 (1.0)      18.6694 (1.0)      18.6694 (1.0)      0.0000 (1.0)      18.6694 (1.0)      0.0000 (1.0)           0;0  0.0536 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.2911 (1.09)     20.2911 (1.09)     20.2911 (1.09)     0.0000 (1.0)      20.2911 (1.09)     0.0000 (1.0)           0;0  0.0493 (0.92)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     20.7951 (1.12)     20.7951 (1.12)     20.7951 (1.12)     0.0000 (1.0)      20.7951 (1.12)     0.0000 (1.0)           0;0  0.0481 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.6840 (1.11)     20.6840 (1.11)     20.6840 (1.11)     0.0000 (1.0)      20.6840 (1.11)     0.0000 (1.0)           0;0  0.0483 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.6189 (1.0)      18.6189 (1.0)      18.6189 (1.0)      0.0000 (1.0)      18.6189 (1.0)      0.0000 (1.0)           0;0  0.0537 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.3146 (1.71)     36.3146 (1.71)     36.3146 (1.71)     0.0000 (1.0)      36.3146 (1.71)     0.0000 (1.0)           0;0  0.0275 (0.58)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.4413 (1.77)     37.4413 (1.77)     37.4413 (1.77)     0.0000 (1.0)      37.4413 (1.77)     0.0000 (1.0)           0;0  0.0267 (0.57)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.6707 (1.73)     36.6707 (1.73)     36.6707 (1.73)     0.0000 (1.0)      36.6707 (1.73)     0.0000 (1.0)           0;0  0.0273 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.2129 (1.0)      21.2129 (1.0)      21.2129 (1.0)      0.0000 (1.0)      21.2129 (1.0)      0.0000 (1.0)           0;0  0.0471 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.3614 (1.08)     19.3614 (1.08)     19.3614 (1.08)     0.0000 (1.0)      19.3614 (1.08)     0.0000 (1.0)           0;0  0.0516 (0.93)          1           1
test_data_status_all_flags-data-noop[3.10.0]     19.8041 (1.10)     19.8041 (1.10)     19.8041 (1.10)     0.0000 (1.0)      19.8041 (1.10)     0.0000 (1.0)           0;0  0.0505 (0.91)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.8878 (1.11)     19.8878 (1.11)     19.8878 (1.11)     0.0000 (1.0)      19.8878 (1.11)     0.0000 (1.0)           0;0  0.0503 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       17.9783 (1.0)      17.9783 (1.0)      17.9783 (1.0)      0.0000 (1.0)      17.9783 (1.0)      0.0000 (1.0)           0;0  0.0556 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.2970 (2.74)     20.2970 (2.74)     20.2970 (2.74)     0.0000 (1.0)      20.2970 (2.74)     0.0000 (1.0)           0;0  0.0493 (0.37)          1           1
test_diff-diff[3.10.0]     20.6027 (2.78)     20.6027 (2.78)     20.6027 (2.78)     0.0000 (1.0)      20.6027 (2.78)     0.0000 (1.0)           0;0  0.0485 (0.36)          1           1
test_diff-diff[3.53.2]     21.2017 (2.86)     21.2017 (2.86)     21.2017 (2.86)     0.0000 (1.0)      21.2017 (2.86)     0.0000 (1.0)           0;0  0.0472 (0.35)          1           1
test_diff-diff[main]        7.4157 (1.0)       7.4157 (1.0)       7.4157 (1.0)      0.0000 (1.0)       7.4157 (1.0)      0.0000 (1.0)           0;0  0.1348 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2781 (1.70)     6.2781 (1.70)     6.2781 (1.70)     0.0000 (1.0)      6.2781 (1.70)     0.0000 (1.0)           0;0  0.1593 (0.59)          1           1
test_diff-diff-changed[3.10.0]     7.0377 (1.90)     7.0377 (1.90)     7.0377 (1.90)     0.0000 (1.0)      7.0377 (1.90)     0.0000 (1.0)           0;0  0.1421 (0.53)          1           1
test_diff-diff-changed[3.53.2]     5.8950 (1.59)     5.8950 (1.59)     5.8950 (1.59)     0.0000 (1.0)      5.8950 (1.59)     0.0000 (1.0)           0;0  0.1696 (0.63)          1           1
test_diff-diff-changed[main]       3.7005 (1.0)      3.7005 (1.0)      3.7005 (1.0)      0.0000 (1.0)      3.7005 (1.0)      0.0000 (1.0)           0;0  0.2702 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5347 (1.51)     5.5347 (1.51)     5.5347 (1.51)     0.0000 (1.0)      5.5347 (1.51)     0.0000 (1.0)           0;0  0.1807 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9728 (1.63)     5.9728 (1.63)     5.9728 (1.63)     0.0000 (1.0)      5.9728 (1.63)     0.0000 (1.0)           0;0  0.1674 (0.61)          1           1
test_diff-diff-changed-noop[3.53.2]     5.8430 (1.60)     5.8430 (1.60)     5.8430 (1.60)     0.0000 (1.0)      5.8430 (1.60)     0.0000 (1.0)           0;0  0.1711 (0.63)          1           1
test_diff-diff-changed-noop[main]       3.6564 (1.0)      3.6564 (1.0)      3.6564 (1.0)      0.0000 (1.0)      3.6564 (1.0)      0.0000 (1.0)           0;0  0.2735 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2112 (1.15)     4.2112 (1.15)     4.2112 (1.15)     0.0000 (1.0)      4.2112 (1.15)     0.0000 (1.0)           0;0  0.2375 (0.87)          1           1
test_diff-diff-noop[3.10.0]     4.8267 (1.31)     4.8267 (1.31)     4.8267 (1.31)     0.0000 (1.0)      4.8267 (1.31)     0.0000 (1.0)           0;0  0.2072 (0.76)          1           1
test_diff-diff-noop[3.53.2]     5.8608 (1.60)     5.8608 (1.60)     5.8608 (1.60)     0.0000 (1.0)      5.8608 (1.60)     0.0000 (1.0)           0;0  0.1706 (0.63)          1           1
test_diff-diff-noop[main]       3.6732 (1.0)      3.6732 (1.0)      3.6732 (1.0)      0.0000 (1.0)      3.6732 (1.0)      0.0000 (1.0)           0;0  0.2722 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0032 (1.0)       1.0032 (1.0)       1.0032 (1.0)      0.0000 (1.0)       1.0032 (1.0)      0.0000 (1.0)           0;0  0.9968 (1.0)           1           1
test_exp_show-exp[3.10.0]     15.8012 (15.75)    15.8012 (15.75)    15.8012 (15.75)    0.0000 (1.0)      15.8012 (15.75)    0.0000 (1.0)           0;0  0.0633 (0.06)          1           1
test_exp_show-exp[3.53.2]     11.1916 (11.16)    11.1916 (11.16)    11.1916 (11.16)    0.0000 (1.0)      11.1916 (11.16)    0.0000 (1.0)           0;0  0.0894 (0.09)          1           1
test_exp_show-exp[main]       12.3402 (12.30)    12.3402 (12.30)    12.3402 (12.30)    0.0000 (1.0)      12.3402 (12.30)    0.0000 (1.0)           0;0  0.0810 (0.08)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.7895 (2.75)     67.7895 (2.75)     67.7895 (2.75)     0.0000 (1.0)      67.7895 (2.75)     0.0000 (1.0)           0;0  0.0148 (0.36)          1           1
test_fetch-fetch[3.10.0]     74.3488 (3.01)     74.3488 (3.01)     74.3488 (3.01)     0.0000 (1.0)      74.3488 (3.01)     0.0000 (1.0)           0;0  0.0135 (0.33)          1           1
test_fetch-fetch[3.53.2]     37.3032 (1.51)     37.3032 (1.51)     37.3032 (1.51)     0.0000 (1.0)      37.3032 (1.51)     0.0000 (1.0)           0;0  0.0268 (0.66)          1           1
test_fetch-fetch[main]       24.6889 (1.0)      24.6889 (1.0)      24.6889 (1.0)      0.0000 (1.0)      24.6889 (1.0)      0.0000 (1.0)           0;0  0.0405 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9537 (1.01)     2.9537 (1.01)     2.9537 (1.01)     0.0000 (1.0)      2.9537 (1.01)     0.0000 (1.0)           0;0  0.3386 (0.99)          1           1
test_gc-gc[3.10.0]     3.0287 (1.04)     3.0287 (1.04)     3.0287 (1.04)     0.0000 (1.0)      3.0287 (1.04)     0.0000 (1.0)           0;0  0.3302 (0.96)          1           1
test_gc-gc[3.53.2]     3.0584 (1.05)     3.0584 (1.05)     3.0584 (1.05)     0.0000 (1.0)      3.0584 (1.05)     0.0000 (1.0)           0;0  0.3270 (0.96)          1           1
test_gc-gc[main]       2.9212 (1.0)      2.9212 (1.0)      2.9212 (1.0)      0.0000 (1.0)      2.9212 (1.0)      0.0000 (1.0)           0;0  0.3423 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     138.8282 (2.73)     138.8282 (2.73)     138.8282 (2.73)     0.0000 (1.0)      138.8282 (2.73)     0.0000 (1.0)           0;0  0.0072 (0.37)          1           1
test_get-get[3.10.0]     165.0474 (3.24)     165.0474 (3.24)     165.0474 (3.24)     0.0000 (1.0)      165.0474 (3.24)     0.0000 (1.0)           0;0  0.0061 (0.31)          1           1
test_get-get[3.53.2]     143.5421 (2.82)     143.5421 (2.82)     143.5421 (2.82)     0.0000 (1.0)      143.5421 (2.82)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[main]        50.8744 (1.0)       50.8744 (1.0)       50.8744 (1.0)      0.0000 (1.0)       50.8744 (1.0)      0.0000 (1.0)           0;0  0.0197 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.8054 (2.64)     44.8054 (2.64)     44.8054 (2.64)     0.0000 (1.0)      44.8054 (2.64)     0.0000 (1.0)           0;0  0.0223 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.4383 (2.80)     47.4383 (2.80)     47.4383 (2.80)     0.0000 (1.0)      47.4383 (2.80)     0.0000 (1.0)           0;0  0.0211 (0.36)          1           1
test_get_url-get-url[3.53.2]     16.9566 (1.0)      16.9566 (1.0)      16.9566 (1.0)      0.0000 (1.0)      16.9566 (1.0)      0.0000 (1.0)           0;0  0.0590 (1.0)           1           1
test_get_url-get-url[main]       17.2028 (1.01)     17.2028 (1.01)     17.2028 (1.01)     0.0000 (1.0)      17.2028 (1.01)     0.0000 (1.0)           0;0  0.0581 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.1142 (1.02)     131.8945 (1.01)     125.4250 (1.00)     1.6924 (1.0)      124.9801 (1.00)     1.9490 (1.0)          26;5  7.9729 (1.00)        100           1
test_help---help[3.10.0]     121.0462 (1.0)      140.4643 (1.07)     125.1921 (1.0)      2.8426 (1.68)     124.6119 (1.0)      2.4102 (1.24)         12;4  7.9877 (1.0)         100           1
test_help---help[3.53.2]     123.2605 (1.02)     159.4371 (1.22)     128.9683 (1.03)     7.6429 (4.52)     127.0366 (1.02)     3.7380 (1.92)         9;10  7.7538 (0.97)        100           1
test_help---help[main]       122.8218 (1.01)     130.7545 (1.0)      125.6351 (1.00)     1.7149 (1.01)     125.3527 (1.01)     2.3957 (1.23)         27;2  7.9596 (1.00)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     234.2398 (2.95)     234.2398 (2.95)     234.2398 (2.95)     0.0000 (1.0)      234.2398 (2.95)     0.0000 (1.0)           0;0  0.0043 (0.34)          1           1
test_import-import[3.10.0]     281.7521 (3.55)     281.7521 (3.55)     281.7521 (3.55)     0.0000 (1.0)      281.7521 (3.55)     0.0000 (1.0)           0;0  0.0035 (0.28)          1           1
test_import-import[main]        79.3287 (1.0)       79.3287 (1.0)       79.3287 (1.0)      0.0000 (1.0)       79.3287 (1.0)      0.0000 (1.0)           0;0  0.0126 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     163.6190 (3.38)     163.6190 (3.38)     163.6190 (3.38)     0.0000 (1.0)      163.6190 (3.38)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_import_url-import-url[3.10.0]     168.5557 (3.48)     168.5557 (3.48)     168.5557 (3.48)     0.0000 (1.0)      168.5557 (3.48)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     125.7975 (2.60)     125.7975 (2.60)     125.7975 (2.60)     0.0000 (1.0)      125.7975 (2.60)     0.0000 (1.0)           0;0  0.0079 (0.38)          1           1
test_import_url-import-url[main]        48.3856 (1.0)       48.3856 (1.0)       48.3856 (1.0)      0.0000 (1.0)       48.3856 (1.0)      0.0000 (1.0)           0;0  0.0207 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     385.8915 (1.00)     402.4876 (1.0)      391.1973 (1.00)      3.5808 (1.06)     390.8314 (1.00)     4.1873 (1.02)         26;5  2.5563 (1.00)        100           1
test_init-init[3.10.0]     396.9551 (1.03)     412.8444 (1.03)     404.0386 (1.04)      3.3791 (1.0)      403.7554 (1.04)     4.7424 (1.15)         29;0  2.4750 (0.97)        100           1
test_init-init[3.53.2]     384.0059 (1.0)      406.5194 (1.01)     390.3687 (1.0)       3.4878 (1.03)     389.4557 (1.0)      4.1095 (1.0)          26;2  2.5617 (1.0)         100           1
test_init-init[main]       385.9510 (1.01)     531.5537 (1.32)     397.3459 (1.02)     19.4202 (5.75)     392.1318 (1.01)     6.3170 (1.54)          7;9  2.5167 (0.98)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     569.5319 (1.07)     569.5319 (1.07)     569.5319 (1.07)     0.0000 (1.0)      569.5319 (1.07)     0.0000 (1.0)           0;0  1.7558 (0.93)          1           1
test_list-list[3.10.0]     651.6514 (1.23)     651.6514 (1.23)     651.6514 (1.23)     0.0000 (1.0)      651.6514 (1.23)     0.0000 (1.0)           0;0  1.5346 (0.81)          1           1
test_list-list[3.53.2]     559.6377 (1.06)     559.6377 (1.06)     559.6377 (1.06)     0.0000 (1.0)      559.6377 (1.06)     0.0000 (1.0)           0;0  1.7869 (0.95)          1           1
test_list-list[main]       530.1964 (1.0)      530.1964 (1.0)      530.1964 (1.0)      0.0000 (1.0)      530.1964 (1.0)      0.0000 (1.0)           0;0  1.8861 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     427.9758 (1.08)     427.9758 (1.08)     427.9758 (1.08)     0.0000 (1.0)      427.9758 (1.08)     0.0000 (1.0)           0;0  2.3366 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     416.1046 (1.05)     416.1046 (1.05)     416.1046 (1.05)     0.0000 (1.0)      416.1046 (1.05)     0.0000 (1.0)           0;0  2.4032 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     405.7082 (1.02)     405.7082 (1.02)     405.7082 (1.02)     0.0000 (1.0)      405.7082 (1.02)     0.0000 (1.0)           0;0  2.4648 (0.98)          1           1
test_list-list-dvc-only[main]       398.1093 (1.0)      398.1093 (1.0)      398.1093 (1.0)      0.0000 (1.0)      398.1093 (1.0)      0.0000 (1.0)           0;0  2.5119 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7059 (1.0)      2.7059 (1.0)      2.7059 (1.0)      0.0000 (1.0)      2.7059 (1.0)      0.0000 (1.0)           0;0  0.3696 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7675 (1.02)     2.7675 (1.02)     2.7675 (1.02)     0.0000 (1.0)      2.7675 (1.02)     0.0000 (1.0)           0;0  0.3613 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.8583 (1.06)     2.8583 (1.06)     2.8583 (1.06)     0.0000 (1.0)      2.8583 (1.06)     0.0000 (1.0)           0;0  0.3499 (0.95)          1           1
test_list-list-recursive[main]       2.9949 (1.11)     2.9949 (1.11)     2.9949 (1.11)     0.0000 (1.0)      2.9949 (1.11)     0.0000 (1.0)           0;0  0.3339 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     409.9071 (1.03)     409.9071 (1.03)     409.9071 (1.03)     0.0000 (1.0)      409.9071 (1.03)     0.0000 (1.0)           0;0  2.4396 (0.97)          1           1
test_list-list-shallow[3.10.0]     411.5330 (1.03)     411.5330 (1.03)     411.5330 (1.03)     0.0000 (1.0)      411.5330 (1.03)     0.0000 (1.0)           0;0  2.4299 (0.97)          1           1
test_list-list-shallow[3.53.2]     399.2048 (1.00)     399.2048 (1.00)     399.2048 (1.00)     0.0000 (1.0)      399.2048 (1.00)     0.0000 (1.0)           0;0  2.5050 (1.00)          1           1
test_list-list-shallow[main]       397.8788 (1.0)      397.8788 (1.0)      397.8788 (1.0)      0.0000 (1.0)      397.8788 (1.0)      0.0000 (1.0)           0;0  2.5133 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     78.2871 (3.80)     78.2871 (3.80)     78.2871 (3.80)     0.0000 (1.0)      78.2871 (3.80)     0.0000 (1.0)           0;0  0.0128 (0.26)          1           1
test_partial_add-add[3.10.0]     78.8621 (3.83)     78.8621 (3.83)     78.8621 (3.83)     0.0000 (1.0)      78.8621 (3.83)     0.0000 (1.0)           0;0  0.0127 (0.26)          1           1
test_partial_add-add[3.53.2]     71.9463 (3.49)     71.9463 (3.49)     71.9463 (3.49)     0.0000 (1.0)      71.9463 (3.49)     0.0000 (1.0)           0;0  0.0139 (0.29)          1           1
test_partial_add-add[main]       20.5991 (1.0)      20.5991 (1.0)      20.5991 (1.0)      0.0000 (1.0)      20.5991 (1.0)      0.0000 (1.0)           0;0  0.0485 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     65.1380 (8.12)     65.1380 (8.12)     65.1380 (8.12)     0.0000 (1.0)      65.1380 (8.12)     0.0000 (1.0)           0;0  0.0154 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     65.5000 (8.16)     65.5000 (8.16)     65.5000 (8.16)     0.0000 (1.0)      65.5000 (8.16)     0.0000 (1.0)           0;0  0.0153 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     59.6788 (7.44)     59.6788 (7.44)     59.6788 (7.44)     0.0000 (1.0)      59.6788 (7.44)     0.0000 (1.0)           0;0  0.0168 (0.13)          1           1
test_partial_add-add-partial[main]        8.0222 (1.0)       8.0222 (1.0)       8.0222 (1.0)      0.0000 (1.0)       8.0222 (1.0)      0.0000 (1.0)           0;0  0.1247 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.1102 (1.0)      5.1102 (1.0)      5.1102 (1.0)      0.0000 (1.0)      5.1102 (1.0)      0.0000 (1.0)           0;0  0.1957 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.8270 (1.34)     6.8270 (1.34)     6.8270 (1.34)     0.0000 (1.0)      6.8270 (1.34)     0.0000 (1.0)           0;0  0.1465 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.5859 (1.48)     7.5859 (1.48)     7.5859 (1.48)     0.0000 (1.0)      7.5859 (1.48)     0.0000 (1.0)           0;0  0.1318 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       7.7319 (1.51)     7.7319 (1.51)     7.7319 (1.51)     0.0000 (1.0)      7.7319 (1.51)     0.0000 (1.0)           0;0  0.1293 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7480 (1.0)      2.7480 (1.0)      2.7480 (1.0)      0.0000 (1.0)      2.7480 (1.0)      0.0000 (1.0)           0;0  0.3639 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.2332 (1.54)     4.2332 (1.54)     4.2332 (1.54)     0.0000 (1.0)      4.2332 (1.54)     0.0000 (1.0)           0;0  0.2362 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     4.2919 (1.56)     4.2919 (1.56)     4.2919 (1.56)     0.0000 (1.0)      4.2919 (1.56)     0.0000 (1.0)           0;0  0.2330 (0.64)          1           1
test_partial_add-gc-noop[main]       4.2316 (1.54)     4.2316 (1.54)     4.2316 (1.54)     0.0000 (1.0)      4.2316 (1.54)     0.0000 (1.0)           0;0  0.2363 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.6115 (2.31)     44.6115 (2.31)     44.6115 (2.31)     0.0000 (1.0)      44.6115 (2.31)     0.0000 (1.0)           0;0  0.0224 (0.43)          1           1
test_partial_add-push[3.10.0]     39.6721 (2.06)     39.6721 (2.06)     39.6721 (2.06)     0.0000 (1.0)      39.6721 (2.06)     0.0000 (1.0)           0;0  0.0252 (0.49)          1           1
test_partial_add-push[3.53.2]     20.0868 (1.04)     20.0868 (1.04)     20.0868 (1.04)     0.0000 (1.0)      20.0868 (1.04)     0.0000 (1.0)           0;0  0.0498 (0.96)          1           1
test_partial_add-push[main]       19.2707 (1.0)      19.2707 (1.0)      19.2707 (1.0)      0.0000 (1.0)      19.2707 (1.0)      0.0000 (1.0)           0;0  0.0519 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.6108 (1.11)     11.6108 (1.11)     11.6108 (1.11)     0.0000 (1.0)      11.6108 (1.11)     0.0000 (1.0)           0;0  0.0861 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.6408 (1.02)     10.6408 (1.02)     10.6408 (1.02)     0.0000 (1.0)      10.6408 (1.02)     0.0000 (1.0)           0;0  0.0940 (0.98)          1           1
test_partial_add-push-partial[3.53.2]     10.6506 (1.02)     10.6506 (1.02)     10.6506 (1.02)     0.0000 (1.0)      10.6506 (1.02)     0.0000 (1.0)           0;0  0.0939 (0.98)          1           1
test_partial_add-push-partial[main]       10.4511 (1.0)      10.4511 (1.0)      10.4511 (1.0)      0.0000 (1.0)      10.4511 (1.0)      0.0000 (1.0)           0;0  0.0957 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     89.8876 (3.78)     89.8876 (3.78)     89.8876 (3.78)     0.0000 (1.0)      89.8876 (3.78)     0.0000 (1.0)           0;0  0.0111 (0.26)          1           1
test_partial_remove-add[3.10.0]     90.6014 (3.81)     90.6014 (3.81)     90.6014 (3.81)     0.0000 (1.0)      90.6014 (3.81)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_partial_remove-add[3.53.2]     81.2329 (3.42)     81.2329 (3.42)     81.2329 (3.42)     0.0000 (1.0)      81.2329 (3.42)     0.0000 (1.0)           0;0  0.0123 (0.29)          1           1
test_partial_remove-add[main]       23.7608 (1.0)      23.7608 (1.0)      23.7608 (1.0)      0.0000 (1.0)      23.7608 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.6411 (8.16)     8.6411 (8.16)     8.6411 (8.16)     0.0000 (1.0)      8.6411 (8.16)     0.0000 (1.0)           0;0  0.1157 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.8319 (8.34)     8.8319 (8.34)     8.8319 (8.34)     0.0000 (1.0)      8.8319 (8.34)     0.0000 (1.0)           0;0  0.1132 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.8108 (7.38)     7.8108 (7.38)     7.8108 (7.38)     0.0000 (1.0)      7.8108 (7.38)     0.0000 (1.0)           0;0  0.1280 (0.14)          1           1
test_partial_remove-add-update[main]       1.0590 (1.0)      1.0590 (1.0)      1.0590 (1.0)      0.0000 (1.0)      1.0590 (1.0)      0.0000 (1.0)           0;0  0.9443 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.6764 (1.0)      3.6764 (1.0)      3.6764 (1.0)      0.0000 (1.0)      3.6764 (1.0)      0.0000 (1.0)           0;0  0.2720 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.1247 (1.12)     4.1247 (1.12)     4.1247 (1.12)     0.0000 (1.0)      4.1247 (1.12)     0.0000 (1.0)           0;0  0.2424 (0.89)          1           1
test_partial_remove-gc[3.53.2]     4.2556 (1.16)     4.2556 (1.16)     4.2556 (1.16)     0.0000 (1.0)      4.2556 (1.16)     0.0000 (1.0)           0;0  0.2350 (0.86)          1           1
test_partial_remove-gc[main]       3.8968 (1.06)     3.8968 (1.06)     3.8968 (1.06)     0.0000 (1.0)      3.8968 (1.06)     0.0000 (1.0)           0;0  0.2566 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1660 (1.0)      5.1660 (1.0)      5.1660 (1.0)      0.0000 (1.0)      5.1660 (1.0)      0.0000 (1.0)           0;0  0.1936 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.7684 (1.12)     5.7684 (1.12)     5.7684 (1.12)     0.0000 (1.0)      5.7684 (1.12)     0.0000 (1.0)           0;0  0.1734 (0.90)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.1961 (1.01)     5.1961 (1.01)     5.1961 (1.01)     0.0000 (1.0)      5.1961 (1.01)     0.0000 (1.0)           0;0  0.1925 (0.99)          1           1
test_partial_remove-gc-cloud[main]       5.1700 (1.00)     5.1700 (1.00)     5.1700 (1.00)     0.0000 (1.0)      5.1700 (1.00)     0.0000 (1.0)           0;0  0.1934 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.5004 (2.25)     51.5004 (2.25)     51.5004 (2.25)     0.0000 (1.0)      51.5004 (2.25)     0.0000 (1.0)           0;0  0.0194 (0.44)          1           1
test_partial_remove-push[3.10.0]     45.6227 (2.00)     45.6227 (2.00)     45.6227 (2.00)     0.0000 (1.0)      45.6227 (2.00)     0.0000 (1.0)           0;0  0.0219 (0.50)          1           1
test_partial_remove-push[3.53.2]     23.0054 (1.01)     23.0054 (1.01)     23.0054 (1.01)     0.0000 (1.0)      23.0054 (1.01)     0.0000 (1.0)           0;0  0.0435 (0.99)          1           1
test_partial_remove-push[main]       22.8617 (1.0)      22.8617 (1.0)      22.8617 (1.0)      0.0000 (1.0)      22.8617 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8154 (1.0)      1.8154 (1.0)      1.8154 (1.0)      0.0000 (1.0)      1.8154 (1.0)      0.0000 (1.0)           0;0  0.5508 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8338 (1.01)     1.8338 (1.01)     1.8338 (1.01)     0.0000 (1.0)      1.8338 (1.01)     0.0000 (1.0)           0;0  0.5453 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.4767 (1.36)     2.4767 (1.36)     2.4767 (1.36)     0.0000 (1.0)      2.4767 (1.36)     0.0000 (1.0)           0;0  0.4038 (0.73)          1           1
test_partial_remove-push-update[main]       2.6805 (1.48)     2.6805 (1.48)     2.6805 (1.48)     0.0000 (1.0)      2.6805 (1.48)     0.0000 (1.0)           0;0  0.3731 (0.68)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     466.4467 (1.0)      476.4370 (1.0)      473.5845 (1.0)       4.1419 (1.64)     475.3406 (1.0)       4.4108 (1.0)           1;0  2.1116 (1.0)           5           3
test_plots-plots-diff[3.10.0]     872.8447 (1.87)     878.3744 (1.84)     875.7161 (1.85)      2.5211 (1.0)      875.2947 (1.84)      4.6916 (1.06)          3;0  1.1419 (0.54)          5           3
test_plots-plots-diff[3.53.2]     837.1841 (1.79)     862.0680 (1.81)     842.9964 (1.78)     10.7102 (4.25)     838.1829 (1.76)      7.8936 (1.79)          1;1  1.1862 (0.56)          5           3
test_plots-plots-diff[main]       843.1979 (1.81)     868.5083 (1.82)     853.0985 (1.80)     10.4457 (4.14)     848.0555 (1.78)     15.5394 (3.52)          1;0  1.1722 (0.56)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       482.7456 (1.0)        493.0634 (1.0)        486.4672 (1.0)      4.5112 (1.37)       484.2503 (1.0)       7.1921 (1.98)          1;0  2.0556 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,095.1243 (2.27)     1,103.2912 (2.24)     1,100.6830 (2.26)     3.2931 (1.0)      1,102.2590 (2.28)      3.6325 (1.0)           1;0  0.9085 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       913.8679 (1.89)       933.6833 (1.89)       921.0284 (1.89)     7.9691 (2.42)       918.9590 (1.90)     10.9967 (3.03)          1;0  1.0857 (0.53)          5           3
test_plots-plots-diff-json[main]         906.9752 (1.88)       931.3820 (1.89)       919.2883 (1.89)     9.6818 (2.94)       918.8450 (1.90)     15.3887 (4.24)          2;0  1.0878 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     417.5574 (1.0)      420.0596 (1.0)      418.8066 (1.0)      1.0198 (1.0)      418.8946 (1.0)       1.6955 (1.0)           2;0  2.3877 (1.0)           5           3
test_plots-plots-show[3.10.0]     718.1561 (1.72)     735.3667 (1.75)     727.1527 (1.74)     7.4450 (7.30)     727.3417 (1.74)     13.3705 (7.89)          2;0  1.3752 (0.58)          5           3
test_plots-plots-show[3.53.2]     697.8670 (1.67)     705.3946 (1.68)     701.1624 (1.67)     3.2674 (3.20)     701.6568 (1.68)      5.6562 (3.34)          2;0  1.4262 (0.60)          5           3
test_plots-plots-show[main]       695.5017 (1.67)     713.4717 (1.70)     702.5930 (1.68)     7.3569 (7.21)     703.0454 (1.68)     11.0885 (6.54)          1;0  1.4233 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     457.0395 (1.0)      462.4339 (1.0)      459.3197 (1.0)      2.5622 (1.0)      458.4403 (1.0)       4.7997 (1.02)          1;0  2.1771 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     846.2778 (1.85)     860.5863 (1.86)     851.8445 (1.85)     5.2885 (2.06)     850.8561 (1.86)      4.6886 (1.0)           2;0  1.1739 (0.54)          5           3
test_plots-plots-show-json[3.53.2]     743.9034 (1.63)     752.3015 (1.63)     746.9368 (1.63)     3.6184 (1.41)     745.1492 (1.63)      5.6249 (1.20)          1;0  1.3388 (0.61)          5           3
test_plots-plots-show-json[main]       746.7152 (1.63)     761.8074 (1.65)     753.6882 (1.64)     6.2266 (2.43)     752.5993 (1.64)     10.4267 (2.22)          2;0  1.3268 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.2040 (2.32)     52.2040 (2.32)     52.2040 (2.32)     0.0000 (1.0)      52.2040 (2.32)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_push-push[3.10.0]     46.4639 (2.07)     46.4639 (2.07)     46.4639 (2.07)     0.0000 (1.0)      46.4639 (2.07)     0.0000 (1.0)           0;0  0.0215 (0.48)          1           1
test_push-push[3.53.2]     23.2405 (1.03)     23.2405 (1.03)     23.2405 (1.03)     0.0000 (1.0)      23.2405 (1.03)     0.0000 (1.0)           0;0  0.0430 (0.97)          1           1
test_push-push[main]       22.4921 (1.0)      22.4921 (1.0)      22.4921 (1.0)      0.0000 (1.0)      22.4921 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.6613 (2.72)     66.6613 (2.72)     66.6613 (2.72)     0.0000 (1.0)      66.6613 (2.72)     0.0000 (1.0)           0;0  0.0150 (0.37)          1           1
test_sharing-fetch[3.10.0]     72.8727 (2.97)     72.8727 (2.97)     72.8727 (2.97)     0.0000 (1.0)      72.8727 (2.97)     0.0000 (1.0)           0;0  0.0137 (0.34)          1           1
test_sharing-fetch[3.53.2]     35.8243 (1.46)     35.8243 (1.46)     35.8243 (1.46)     0.0000 (1.0)      35.8243 (1.46)     0.0000 (1.0)           0;0  0.0279 (0.68)          1           1
test_sharing-fetch[main]       24.5115 (1.0)      24.5115 (1.0)      24.5115 (1.0)      0.0000 (1.0)      24.5115 (1.0)      0.0000 (1.0)           0;0  0.0408 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3332 (1.0)      1.3332 (1.0)      1.3332 (1.0)      0.0000 (1.0)      1.3332 (1.0)      0.0000 (1.0)           0;0  0.7501 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6893 (2.77)     3.6893 (2.77)     3.6893 (2.77)     0.0000 (1.0)      3.6893 (2.77)     0.0000 (1.0)           0;0  0.2711 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     6.1674 (4.63)     6.1674 (4.63)     6.1674 (4.63)     0.0000 (1.0)      6.1674 (4.63)     0.0000 (1.0)           0;0  0.1621 (0.22)          1           1
test_sharing-fetch-noop[main]       6.3577 (4.77)     6.3577 (4.77)     6.3577 (4.77)     0.0000 (1.0)      6.3577 (4.77)     0.0000 (1.0)           0;0  0.1573 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.5372 (2.37)     53.5372 (2.37)     53.5372 (2.37)     0.0000 (1.0)      53.5372 (2.37)     0.0000 (1.0)           0;0  0.0187 (0.42)          1           1
test_sharing-push[3.10.0]     46.7936 (2.08)     46.7936 (2.08)     46.7936 (2.08)     0.0000 (1.0)      46.7936 (2.08)     0.0000 (1.0)           0;0  0.0214 (0.48)          1           1
test_sharing-push[3.53.2]     23.2412 (1.03)     23.2412 (1.03)     23.2412 (1.03)     0.0000 (1.0)      23.2412 (1.03)     0.0000 (1.0)           0;0  0.0430 (0.97)          1           1
test_sharing-push[main]       22.5435 (1.0)      22.5435 (1.0)      22.5435 (1.0)      0.0000 (1.0)      22.5435 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2377 (1.0)      2.2377 (1.0)      2.2377 (1.0)      0.0000 (1.0)      2.2377 (1.0)      0.0000 (1.0)           0;0  0.4469 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2968 (1.03)     2.2968 (1.03)     2.2968 (1.03)     0.0000 (1.0)      2.2968 (1.03)     0.0000 (1.0)           0;0  0.4354 (0.97)          1           1
test_sharing-push-noop[3.53.2]     6.7271 (3.01)     6.7271 (3.01)     6.7271 (3.01)     0.0000 (1.0)      6.7271 (3.01)     0.0000 (1.0)           0;0  0.1487 (0.33)          1           1
test_sharing-push-noop[main]       6.7009 (2.99)     6.7009 (2.99)     6.7009 (2.99)     0.0000 (1.0)      6.7009 (2.99)     0.0000 (1.0)           0;0  0.1492 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     159.4995 (1.09)     159.4995 (1.09)     159.4995 (1.09)     0.0000 (1.0)      159.4995 (1.09)     0.0000 (1.0)           0;0  0.0063 (0.92)          1           1
test_sharing_azure-fetch[main]       146.7397 (1.0)      146.7397 (1.0)      146.7397 (1.0)      0.0000 (1.0)      146.7397 (1.0)      0.0000 (1.0)           0;0  0.0068 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     7.0860 (1.0)      7.0860 (1.0)      7.0860 (1.0)      0.0000 (1.0)      7.0860 (1.0)      0.0000 (1.0)           0;0  0.1411 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       7.1031 (1.00)     7.1031 (1.00)     7.1031 (1.00)     0.0000 (1.0)      7.1031 (1.00)     0.0000 (1.0)           0;0  0.1408 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     155.9145 (1.0)      155.9145 (1.0)      155.9145 (1.0)      0.0000 (1.0)      155.9145 (1.0)      0.0000 (1.0)           0;0  0.0064 (1.0)           1           1
test_sharing_azure-push[main]       156.6941 (1.01)     156.6941 (1.01)     156.6941 (1.01)     0.0000 (1.0)      156.6941 (1.01)     0.0000 (1.0)           0;0  0.0064 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.4482 (1.0)      7.4482 (1.0)      7.4482 (1.0)      0.0000 (1.0)      7.4482 (1.0)      0.0000 (1.0)           0;0  0.1343 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.7225 (1.04)     7.7225 (1.04)     7.7225 (1.04)     0.0000 (1.0)      7.7225 (1.04)     0.0000 (1.0)           0;0  0.1295 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     319.1038 (1.00)     319.1038 (1.00)     319.1038 (1.00)     0.0000 (1.0)      319.1038 (1.00)     0.0000 (1.0)           0;0  0.0031 (1.00)          1           1
test_sharing_gs-fetch[main]       317.9743 (1.0)      317.9743 (1.0)      317.9743 (1.0)      0.0000 (1.0)      317.9743 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.6832 (1.0)      7.6832 (1.0)      7.6832 (1.0)      0.0000 (1.0)      7.6832 (1.0)      0.0000 (1.0)           0;0  0.1302 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.8363 (1.02)     7.8363 (1.02)     7.8363 (1.02)     0.0000 (1.0)      7.8363 (1.02)     0.0000 (1.0)           0;0  0.1276 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     564.5559 (1.0)      564.5559 (1.0)      564.5559 (1.0)      0.0000 (1.0)      564.5559 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
test_sharing_gs-push[main]       574.1686 (1.02)     574.1686 (1.02)     574.1686 (1.02)     0.0000 (1.0)      574.1686 (1.02)     0.0000 (1.0)           0;0  0.0017 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.3395 (1.0)      7.3395 (1.0)      7.3395 (1.0)      0.0000 (1.0)      7.3395 (1.0)      0.0000 (1.0)           0;0  0.1362 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.4662 (1.02)     7.4662 (1.02)     7.4662 (1.02)     0.0000 (1.0)      7.4662 (1.02)     0.0000 (1.0)           0;0  0.1339 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     252.1900 (1.0)      252.1900 (1.0)      252.1900 (1.0)      0.0000 (1.0)      252.1900 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
test_sharing_s3-fetch[main]       260.1556 (1.03)     260.1556 (1.03)     260.1556 (1.03)     0.0000 (1.0)      260.1556 (1.03)     0.0000 (1.0)           0;0  0.0038 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     8.1476 (1.0)      8.1476 (1.0)      8.1476 (1.0)      0.0000 (1.0)      8.1476 (1.0)      0.0000 (1.0)           0;0  0.1227 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       8.5401 (1.05)     8.5401 (1.05)     8.5401 (1.05)     0.0000 (1.0)      8.5401 (1.05)     0.0000 (1.0)           0;0  0.1171 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     300.0992 (1.0)      300.0992 (1.0)      300.0992 (1.0)      0.0000 (1.0)      300.0992 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
test_sharing_s3-push[main]       303.6475 (1.01)     303.6475 (1.01)     303.6475 (1.01)     0.0000 (1.0)      303.6475 (1.01)     0.0000 (1.0)           0;0  0.0033 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     8.8432 (1.05)     8.8432 (1.05)     8.8432 (1.05)     0.0000 (1.0)      8.8432 (1.05)     0.0000 (1.0)           0;0  0.1131 (0.95)          1           1
test_sharing_s3-push-noop[main]       8.4355 (1.0)      8.4355 (1.0)      8.4355 (1.0)      0.0000 (1.0)      8.4355 (1.0)      0.0000 (1.0)           0;0  0.1185 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.8927 (3.83)     20.8927 (3.83)     20.8927 (3.83)     0.0000 (1.0)      20.8927 (3.83)     0.0000 (1.0)           0;0  0.0479 (0.26)          1           1
test_status-status[3.10.0]     21.0679 (3.86)     21.0679 (3.86)     21.0679 (3.86)     0.0000 (1.0)      21.0679 (3.86)     0.0000 (1.0)           0;0  0.0475 (0.26)          1           1
test_status-status[3.53.2]     19.3860 (3.55)     19.3860 (3.55)     19.3860 (3.55)     0.0000 (1.0)      19.3860 (3.55)     0.0000 (1.0)           0;0  0.0516 (0.28)          1           1
test_status-status[main]        5.4542 (1.0)       5.4542 (1.0)       5.4542 (1.0)      0.0000 (1.0)       5.4542 (1.0)      0.0000 (1.0)           0;0  0.1833 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.0546 (1.75)     5.0546 (1.75)     5.0546 (1.75)     0.0000 (1.0)      5.0546 (1.75)     0.0000 (1.0)           0;0  0.1978 (0.57)          1           1
test_status-status-changed[3.10.0]     5.2173 (1.80)     5.2173 (1.80)     5.2173 (1.80)     0.0000 (1.0)      5.2173 (1.80)     0.0000 (1.0)           0;0  0.1917 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0618 (1.75)     5.0618 (1.75)     5.0618 (1.75)     0.0000 (1.0)      5.0618 (1.75)     0.0000 (1.0)           0;0  0.1976 (0.57)          1           1
test_status-status-changed[main]       2.8957 (1.0)      2.8957 (1.0)      2.8957 (1.0)      0.0000 (1.0)      2.8957 (1.0)      0.0000 (1.0)           0;0  0.3453 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9148 (1.76)     4.9148 (1.76)     4.9148 (1.76)     0.0000 (1.0)      4.9148 (1.76)     0.0000 (1.0)           0;0  0.2035 (0.57)          1           1
test_status-status-changed-noop[3.10.0]     5.1269 (1.84)     5.1269 (1.84)     5.1269 (1.84)     0.0000 (1.0)      5.1269 (1.84)     0.0000 (1.0)           0;0  0.1951 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.8476 (1.74)     4.8476 (1.74)     4.8476 (1.74)     0.0000 (1.0)      4.8476 (1.74)     0.0000 (1.0)           0;0  0.2063 (0.57)          1           1
test_status-status-changed-noop[main]       2.7868 (1.0)      2.7868 (1.0)      2.7868 (1.0)      0.0000 (1.0)      2.7868 (1.0)      0.0000 (1.0)           0;0  0.3588 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9843 (1.80)     4.9843 (1.80)     4.9843 (1.80)     0.0000 (1.0)      4.9843 (1.80)     0.0000 (1.0)           0;0  0.2006 (0.56)          1           1
test_status-status-noop[3.10.0]     5.2305 (1.89)     5.2305 (1.89)     5.2305 (1.89)     0.0000 (1.0)      5.2305 (1.89)     0.0000 (1.0)           0;0  0.1912 (0.53)          1           1
test_status-status-noop[3.53.2]     5.0390 (1.82)     5.0390 (1.82)     5.0390 (1.82)     0.0000 (1.0)      5.0390 (1.82)     0.0000 (1.0)           0;0  0.1985 (0.55)          1           1
test_status-status-noop[main]       2.7745 (1.0)      2.7745 (1.0)      2.7745 (1.0)      0.0000 (1.0)      2.7745 (1.0)      0.0000 (1.0)           0;0  0.3604 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     166.3616 (3.45)     166.3616 (3.45)     166.3616 (3.45)     0.0000 (1.0)      166.3616 (3.45)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.10.0]     168.4616 (3.49)     168.4616 (3.49)     168.4616 (3.49)     0.0000 (1.0)      168.4616 (3.49)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_update-import-url[3.53.2]     127.6201 (2.64)     127.6201 (2.64)     127.6201 (2.64)     0.0000 (1.0)      127.6201 (2.64)     0.0000 (1.0)           0;0  0.0078 (0.38)          1           1
test_update-import-url[main]        48.2618 (1.0)       48.2618 (1.0)       48.2618 (1.0)      0.0000 (1.0)       48.2618 (1.0)      0.0000 (1.0)           0;0  0.0207 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     144.9606 (3.90)     144.9606 (3.90)     144.9606 (3.90)     0.0000 (1.0)      144.9606 (3.90)     0.0000 (1.0)           0;0  0.0069 (0.26)          1           1
test_update-update[3.10.0]     150.3759 (4.05)     150.3759 (4.05)     150.3759 (4.05)     0.0000 (1.0)      150.3759 (4.05)     0.0000 (1.0)           0;0  0.0067 (0.25)          1           1
test_update-update[3.53.2]     114.1641 (3.07)     114.1641 (3.07)     114.1641 (3.07)     0.0000 (1.0)      114.1641 (3.07)     0.0000 (1.0)           0;0  0.0088 (0.33)          1           1
test_update-update[main]        37.1450 (1.0)       37.1450 (1.0)       37.1450 (1.0)      0.0000 (1.0)       37.1450 (1.0)      0.0000 (1.0)           0;0  0.0269 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.7456 (1.96)     16.7456 (1.96)     16.7456 (1.96)     0.0000 (1.0)      16.7456 (1.96)     0.0000 (1.0)           0;0  0.0597 (0.51)          1           1
test_update-update-noop[3.10.0]     17.6124 (2.06)     17.6124 (2.06)     17.6124 (2.06)     0.0000 (1.0)      17.6124 (2.06)     0.0000 (1.0)           0;0  0.0568 (0.48)          1           1
test_update-update-noop[3.53.2]     17.0276 (1.99)     17.0276 (1.99)     17.0276 (1.99)     0.0000 (1.0)      17.0276 (1.99)     0.0000 (1.0)           0;0  0.0587 (0.50)          1           1
test_update-update-noop[main]        8.5396 (1.0)       8.5396 (1.0)       8.5396 (1.0)      0.0000 (1.0)       8.5396 (1.0)      0.0000 (1.0)           0;0  0.1171 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean