Fri Apr 11 01:04:11 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     93.6639 (3.92)     93.6639 (3.92)     93.6639 (3.92)     0.0000 (1.0)      93.6639 (3.92)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_add_copy-add[3.10.0]     95.1482 (3.98)     95.1482 (3.98)     95.1482 (3.98)     0.0000 (1.0)      95.1482 (3.98)     0.0000 (1.0)           0;0  0.0105 (0.25)          1           1
test_add_copy-add[3.53.2]     84.7068 (3.54)     84.7068 (3.54)     84.7068 (3.54)     0.0000 (1.0)      84.7068 (3.54)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_add_copy-add[main]       23.9208 (1.0)      23.9208 (1.0)      23.9208 (1.0)      0.0000 (1.0)      23.9208 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     32.0794 (6.63)     32.0794 (6.63)     32.0794 (6.63)     0.0000 (1.0)      32.0794 (6.63)     0.0000 (1.0)           0;0  0.0312 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     32.5262 (6.72)     32.5262 (6.72)     32.5262 (6.72)     0.0000 (1.0)      32.5262 (6.72)     0.0000 (1.0)           0;0  0.0307 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     30.8833 (6.39)     30.8833 (6.39)     30.8833 (6.39)     0.0000 (1.0)      30.8833 (6.39)     0.0000 (1.0)           0;0  0.0324 (0.16)          1           1
test_add_copy-add-noop[main]        4.8367 (1.0)       4.8367 (1.0)       4.8367 (1.0)      0.0000 (1.0)       4.8367 (1.0)      0.0000 (1.0)           0;0  0.2068 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     72.2982 (4.07)     72.2982 (4.07)     72.2982 (4.07)     0.0000 (1.0)      72.2982 (4.07)     0.0000 (1.0)           0;0  0.0138 (0.25)          1           1
test_add_hardlink-add[3.10.0]     72.7820 (4.09)     72.7820 (4.09)     72.7820 (4.09)     0.0000 (1.0)      72.7820 (4.09)     0.0000 (1.0)           0;0  0.0137 (0.24)          1           1
test_add_hardlink-add[3.53.2]     67.3760 (3.79)     67.3760 (3.79)     67.3760 (3.79)     0.0000 (1.0)      67.3760 (3.79)     0.0000 (1.0)           0;0  0.0148 (0.26)          1           1
test_add_hardlink-add[main]       17.7827 (1.0)      17.7827 (1.0)      17.7827 (1.0)      0.0000 (1.0)      17.7827 (1.0)      0.0000 (1.0)           0;0  0.0562 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.5655 (7.61)     36.5655 (7.61)     36.5655 (7.61)     0.0000 (1.0)      36.5655 (7.61)     0.0000 (1.0)           0;0  0.0273 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     36.8702 (7.68)     36.8702 (7.68)     36.8702 (7.68)     0.0000 (1.0)      36.8702 (7.68)     0.0000 (1.0)           0;0  0.0271 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.3924 (7.37)     35.3924 (7.37)     35.3924 (7.37)     0.0000 (1.0)      35.3924 (7.37)     0.0000 (1.0)           0;0  0.0283 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.8027 (1.0)       4.8027 (1.0)       4.8027 (1.0)      0.0000 (1.0)       4.8027 (1.0)      0.0000 (1.0)           0;0  0.2082 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     77.6943 (2.08)     77.6943 (2.08)     77.6943 (2.08)     0.0000 (1.0)      77.6943 (2.08)     0.0000 (1.0)           0;0  0.0129 (0.48)          1           1
test_add_symlink-add[3.10.0]     79.1598 (2.12)     79.1598 (2.12)     79.1598 (2.12)     0.0000 (1.0)      79.1598 (2.12)     0.0000 (1.0)           0;0  0.0126 (0.47)          1           1
test_add_symlink-add[3.53.2]     74.0690 (1.98)     74.0690 (1.98)     74.0690 (1.98)     0.0000 (1.0)      74.0690 (1.98)     0.0000 (1.0)           0;0  0.0135 (0.50)          1           1
test_add_symlink-add[main]       37.3952 (1.0)      37.3952 (1.0)      37.3952 (1.0)      0.0000 (1.0)      37.3952 (1.0)      0.0000 (1.0)           0;0  0.0267 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     49.7949 (8.04)     49.7949 (8.04)     49.7949 (8.04)     0.0000 (1.0)      49.7949 (8.04)     0.0000 (1.0)           0;0  0.0201 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     50.5666 (8.17)     50.5666 (8.17)     50.5666 (8.17)     0.0000 (1.0)      50.5666 (8.17)     0.0000 (1.0)           0;0  0.0198 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.9958 (7.91)     48.9958 (7.91)     48.9958 (7.91)     0.0000 (1.0)      48.9958 (7.91)     0.0000 (1.0)           0;0  0.0204 (0.13)          1           1
test_add_symlink-add-noop[main]        6.1917 (1.0)       6.1917 (1.0)       6.1917 (1.0)      0.0000 (1.0)       6.1917 (1.0)      0.0000 (1.0)           0;0  0.1615 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.1937 (1.98)     43.1937 (1.98)     43.1937 (1.98)     0.0000 (1.0)      43.1937 (1.98)     0.0000 (1.0)           0;0  0.0232 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     62.0338 (2.84)     62.0338 (2.84)     62.0338 (2.84)     0.0000 (1.0)      62.0338 (2.84)     0.0000 (1.0)           0;0  0.0161 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     30.4207 (1.39)     30.4207 (1.39)     30.4207 (1.39)     0.0000 (1.0)      30.4207 (1.39)     0.0000 (1.0)           0;0  0.0329 (0.72)          1           1
test_checkout_copy-checkout[main]       21.8608 (1.0)      21.8608 (1.0)      21.8608 (1.0)      0.0000 (1.0)      21.8608 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.7099 (1.57)     5.7099 (1.57)     5.7099 (1.57)     0.0000 (1.0)      5.7099 (1.57)     0.0000 (1.0)           0;0  0.1751 (0.64)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.0814 (1.67)     6.0814 (1.67)     6.0814 (1.67)     0.0000 (1.0)      6.0814 (1.67)     0.0000 (1.0)           0;0  0.1644 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8330 (1.60)     5.8330 (1.60)     5.8330 (1.60)     0.0000 (1.0)      5.8330 (1.60)     0.0000 (1.0)           0;0  0.1714 (0.62)          1           1
test_checkout_copy-checkout-noop[main]       3.6343 (1.0)      3.6343 (1.0)      3.6343 (1.0)      0.0000 (1.0)      3.6343 (1.0)      0.0000 (1.0)           0;0  0.2752 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.7499 (2.03)     8.7499 (2.03)     8.7499 (2.03)     0.0000 (1.0)      8.7499 (2.03)     0.0000 (1.0)           0;0  0.1143 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.7652 (1.57)     6.7652 (1.57)     6.7652 (1.57)     0.0000 (1.0)      6.7652 (1.57)     0.0000 (1.0)           0;0  0.1478 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5678 (1.52)     6.5678 (1.52)     6.5678 (1.52)     0.0000 (1.0)      6.5678 (1.52)     0.0000 (1.0)           0;0  0.1523 (0.66)          1           1
test_checkout_copy-checkout-update[main]       4.3093 (1.0)      4.3093 (1.0)      4.3093 (1.0)      0.0000 (1.0)      4.3093 (1.0)      0.0000 (1.0)           0;0  0.2321 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.4245 (2.96)     24.4245 (2.96)     24.4245 (2.96)     0.0000 (1.0)      24.4245 (2.96)     0.0000 (1.0)           0;0  0.0409 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.9931 (2.18)     17.9931 (2.18)     17.9931 (2.18)     0.0000 (1.0)      17.9931 (2.18)     0.0000 (1.0)           0;0  0.0556 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.4179 (1.99)     16.4179 (1.99)     16.4179 (1.99)     0.0000 (1.0)      16.4179 (1.99)     0.0000 (1.0)           0;0  0.0609 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.2458 (1.0)       8.2458 (1.0)       8.2458 (1.0)      0.0000 (1.0)       8.2458 (1.0)      0.0000 (1.0)           0;0  0.1213 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.0150 (1.60)     6.0150 (1.60)     6.0150 (1.60)     0.0000 (1.0)      6.0150 (1.60)     0.0000 (1.0)           0;0  0.1663 (0.63)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.1727 (1.64)     6.1727 (1.64)     6.1727 (1.64)     0.0000 (1.0)      6.1727 (1.64)     0.0000 (1.0)           0;0  0.1620 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8476 (1.55)     5.8476 (1.55)     5.8476 (1.55)     0.0000 (1.0)      5.8476 (1.55)     0.0000 (1.0)           0;0  0.1710 (0.64)          1           1
test_checkout_hardlink-checkout-noop[main]       3.7606 (1.0)      3.7606 (1.0)      3.7606 (1.0)      0.0000 (1.0)      3.7606 (1.0)      0.0000 (1.0)           0;0  0.2659 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8137 (2.03)     8.8137 (2.03)     8.8137 (2.03)     0.0000 (1.0)      8.8137 (2.03)     0.0000 (1.0)           0;0  0.1135 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.8253 (1.57)     6.8253 (1.57)     6.8253 (1.57)     0.0000 (1.0)      6.8253 (1.57)     0.0000 (1.0)           0;0  0.1465 (0.64)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.7316 (1.55)     6.7316 (1.55)     6.7316 (1.55)     0.0000 (1.0)      6.7316 (1.55)     0.0000 (1.0)           0;0  0.1486 (0.65)          1           1
test_checkout_hardlink-checkout-update[main]       4.3475 (1.0)      4.3475 (1.0)      4.3475 (1.0)      0.0000 (1.0)      4.3475 (1.0)      0.0000 (1.0)           0;0  0.2300 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.1863 (2.49)     28.1863 (2.49)     28.1863 (2.49)     0.0000 (1.0)      28.1863 (2.49)     0.0000 (1.0)           0;0  0.0355 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.2561 (1.88)     21.2561 (1.88)     21.2561 (1.88)     0.0000 (1.0)      21.2561 (1.88)     0.0000 (1.0)           0;0  0.0470 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     20.3199 (1.79)     20.3199 (1.79)     20.3199 (1.79)     0.0000 (1.0)      20.3199 (1.79)     0.0000 (1.0)           0;0  0.0492 (0.56)          1           1
test_checkout_symlink-checkout[main]       11.3258 (1.0)      11.3258 (1.0)      11.3258 (1.0)      0.0000 (1.0)      11.3258 (1.0)      0.0000 (1.0)           0;0  0.0883 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8428 (1.43)     6.8428 (1.43)     6.8428 (1.43)     0.0000 (1.0)      6.8428 (1.43)     0.0000 (1.0)           0;0  0.1461 (0.70)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2717 (1.52)     7.2717 (1.52)     7.2717 (1.52)     0.0000 (1.0)      7.2717 (1.52)     0.0000 (1.0)           0;0  0.1375 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9293 (1.45)     6.9293 (1.45)     6.9293 (1.45)     0.0000 (1.0)      6.9293 (1.45)     0.0000 (1.0)           0;0  0.1443 (0.69)          1           1
test_checkout_symlink-checkout-noop[main]       4.7773 (1.0)      4.7773 (1.0)      4.7773 (1.0)      0.0000 (1.0)      4.7773 (1.0)      0.0000 (1.0)           0;0  0.2093 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.8976 (1.71)     10.8976 (1.71)     10.8976 (1.71)     0.0000 (1.0)      10.8976 (1.71)     0.0000 (1.0)           0;0  0.0918 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.9495 (1.41)      8.9495 (1.41)      8.9495 (1.41)     0.0000 (1.0)       8.9495 (1.41)     0.0000 (1.0)           0;0  0.1117 (0.71)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.7927 (1.38)      8.7927 (1.38)      8.7927 (1.38)     0.0000 (1.0)       8.7927 (1.38)     0.0000 (1.0)           0;0  0.1137 (0.72)          1           1
test_checkout_symlink-checkout-update[main]        6.3633 (1.0)       6.3633 (1.0)       6.3633 (1.0)      0.0000 (1.0)       6.3633 (1.0)      0.0000 (1.0)           0;0  0.1572 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.3068 (1.70)     4.3068 (1.70)     4.3068 (1.70)     0.0000 (1.0)      4.3068 (1.70)     0.0000 (1.0)           0;0  0.2322 (0.59)          1           1
test_data_status-data-changed[3.10.0]     5.0296 (1.99)     5.0296 (1.99)     5.0296 (1.99)     0.0000 (1.0)      5.0296 (1.99)     0.0000 (1.0)           0;0  0.1988 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.7630 (1.88)     4.7630 (1.88)     4.7630 (1.88)     0.0000 (1.0)      4.7630 (1.88)     0.0000 (1.0)           0;0  0.2100 (0.53)          1           1
test_data_status-data-changed[main]       2.5288 (1.0)      2.5288 (1.0)      2.5288 (1.0)      0.0000 (1.0)      2.5288 (1.0)      0.0000 (1.0)           0;0  0.3954 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.3268 (1.71)     4.3268 (1.71)     4.3268 (1.71)     0.0000 (1.0)      4.3268 (1.71)     0.0000 (1.0)           0;0  0.2311 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9618 (1.96)     4.9618 (1.96)     4.9618 (1.96)     0.0000 (1.0)      4.9618 (1.96)     0.0000 (1.0)           0;0  0.2015 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8209 (1.91)     4.8209 (1.91)     4.8209 (1.91)     0.0000 (1.0)      4.8209 (1.91)     0.0000 (1.0)           0;0  0.2074 (0.52)          1           1
test_data_status-data-changed-noop[main]       2.5284 (1.0)      2.5284 (1.0)      2.5284 (1.0)      0.0000 (1.0)      2.5284 (1.0)      0.0000 (1.0)           0;0  0.3955 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.5905 (3.91)     20.5905 (3.91)     20.5905 (3.91)     0.0000 (1.0)      20.5905 (3.91)     0.0000 (1.0)           0;0  0.0486 (0.26)          1           1
test_data_status-data-new[3.10.0]     21.0927 (4.01)     21.0927 (4.01)     21.0927 (4.01)     0.0000 (1.0)      21.0927 (4.01)     0.0000 (1.0)           0;0  0.0474 (0.25)          1           1
test_data_status-data-new[3.53.2]     21.1433 (4.02)     21.1433 (4.02)     21.1433 (4.02)     0.0000 (1.0)      21.1433 (4.02)     0.0000 (1.0)           0;0  0.0473 (0.25)          1           1
test_data_status-data-new[main]        5.2635 (1.0)       5.2635 (1.0)       5.2635 (1.0)      0.0000 (1.0)       5.2635 (1.0)      0.0000 (1.0)           0;0  0.1900 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.5310 (1.78)     4.5310 (1.78)     4.5310 (1.78)     0.0000 (1.0)      4.5310 (1.78)     0.0000 (1.0)           0;0  0.2207 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.9466 (1.94)     4.9466 (1.94)     4.9466 (1.94)     0.0000 (1.0)      4.9466 (1.94)     0.0000 (1.0)           0;0  0.2022 (0.52)          1           1
test_data_status-data-noop[3.53.2]     4.9680 (1.95)     4.9680 (1.95)     4.9680 (1.95)     0.0000 (1.0)      4.9680 (1.95)     0.0000 (1.0)           0;0  0.2013 (0.51)          1           1
test_data_status-data-noop[main]       2.5501 (1.0)      2.5501 (1.0)      2.5501 (1.0)      0.0000 (1.0)      2.5501 (1.0)      0.0000 (1.0)           0;0  0.3921 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.7850 (1.09)     20.7850 (1.09)     20.7850 (1.09)     0.0000 (1.0)      20.7850 (1.09)     0.0000 (1.0)           0;0  0.0481 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.4306 (1.12)     21.4306 (1.12)     21.4306 (1.12)     0.0000 (1.0)      21.4306 (1.12)     0.0000 (1.0)           0;0  0.0467 (0.89)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.2434 (1.11)     21.2434 (1.11)     21.2434 (1.11)     0.0000 (1.0)      21.2434 (1.11)     0.0000 (1.0)           0;0  0.0471 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       19.1240 (1.0)      19.1240 (1.0)      19.1240 (1.0)      0.0000 (1.0)      19.1240 (1.0)      0.0000 (1.0)           0;0  0.0523 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.7898 (1.08)     20.7898 (1.08)     20.7898 (1.08)     0.0000 (1.0)      20.7898 (1.08)     0.0000 (1.0)           0;0  0.0481 (0.92)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.3577 (1.11)     21.3577 (1.11)     21.3577 (1.11)     0.0000 (1.0)      21.3577 (1.11)     0.0000 (1.0)           0;0  0.0468 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.2563 (1.11)     21.2563 (1.11)     21.2563 (1.11)     0.0000 (1.0)      21.2563 (1.11)     0.0000 (1.0)           0;0  0.0470 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.2114 (1.0)      19.2114 (1.0)      19.2114 (1.0)      0.0000 (1.0)      19.2114 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.8968 (1.70)     36.8968 (1.70)     36.8968 (1.70)     0.0000 (1.0)      36.8968 (1.70)     0.0000 (1.0)           0;0  0.0271 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.9071 (1.75)     37.9071 (1.75)     37.9071 (1.75)     0.0000 (1.0)      37.9071 (1.75)     0.0000 (1.0)           0;0  0.0264 (0.57)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.5536 (1.73)     37.5536 (1.73)     37.5536 (1.73)     0.0000 (1.0)      37.5536 (1.73)     0.0000 (1.0)           0;0  0.0266 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.6483 (1.0)      21.6483 (1.0)      21.6483 (1.0)      0.0000 (1.0)      21.6483 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.9172 (1.10)     19.9172 (1.10)     19.9172 (1.10)     0.0000 (1.0)      19.9172 (1.10)     0.0000 (1.0)           0;0  0.0502 (0.91)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.4224 (1.12)     20.4224 (1.12)     20.4224 (1.12)     0.0000 (1.0)      20.4224 (1.12)     0.0000 (1.0)           0;0  0.0490 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.2270 (1.11)     20.2270 (1.11)     20.2270 (1.11)     0.0000 (1.0)      20.2270 (1.11)     0.0000 (1.0)           0;0  0.0494 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       18.1741 (1.0)      18.1741 (1.0)      18.1741 (1.0)      0.0000 (1.0)      18.1741 (1.0)      0.0000 (1.0)           0;0  0.0550 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.6851 (2.67)     20.6851 (2.67)     20.6851 (2.67)     0.0000 (1.0)      20.6851 (2.67)     0.0000 (1.0)           0;0  0.0483 (0.37)          1           1
test_diff-diff[3.10.0]     21.7867 (2.82)     21.7867 (2.82)     21.7867 (2.82)     0.0000 (1.0)      21.7867 (2.82)     0.0000 (1.0)           0;0  0.0459 (0.36)          1           1
test_diff-diff[3.53.2]     22.1776 (2.87)     22.1776 (2.87)     22.1776 (2.87)     0.0000 (1.0)      22.1776 (2.87)     0.0000 (1.0)           0;0  0.0451 (0.35)          1           1
test_diff-diff[main]        7.7355 (1.0)       7.7355 (1.0)       7.7355 (1.0)      0.0000 (1.0)       7.7355 (1.0)      0.0000 (1.0)           0;0  0.1293 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.7816 (1.70)     6.7816 (1.70)     6.7816 (1.70)     0.0000 (1.0)      6.7816 (1.70)     0.0000 (1.0)           0;0  0.1475 (0.59)          1           1
test_diff-diff-changed[3.10.0]     7.3017 (1.83)     7.3017 (1.83)     7.3017 (1.83)     0.0000 (1.0)      7.3017 (1.83)     0.0000 (1.0)           0;0  0.1370 (0.55)          1           1
test_diff-diff-changed[3.53.2]     6.1822 (1.55)     6.1822 (1.55)     6.1822 (1.55)     0.0000 (1.0)      6.1822 (1.55)     0.0000 (1.0)           0;0  0.1618 (0.65)          1           1
test_diff-diff-changed[main]       3.9969 (1.0)      3.9969 (1.0)      3.9969 (1.0)      0.0000 (1.0)      3.9969 (1.0)      0.0000 (1.0)           0;0  0.2502 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.9380 (1.50)     5.9380 (1.50)     5.9380 (1.50)     0.0000 (1.0)      5.9380 (1.50)     0.0000 (1.0)           0;0  0.1684 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     6.1167 (1.54)     6.1167 (1.54)     6.1167 (1.54)     0.0000 (1.0)      6.1167 (1.54)     0.0000 (1.0)           0;0  0.1635 (0.65)          1           1
test_diff-diff-changed-noop[3.53.2]     6.0268 (1.52)     6.0268 (1.52)     6.0268 (1.52)     0.0000 (1.0)      6.0268 (1.52)     0.0000 (1.0)           0;0  0.1659 (0.66)          1           1
test_diff-diff-changed-noop[main]       3.9619 (1.0)      3.9619 (1.0)      3.9619 (1.0)      0.0000 (1.0)      3.9619 (1.0)      0.0000 (1.0)           0;0  0.2524 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.5440 (1.17)     4.5440 (1.17)     4.5440 (1.17)     0.0000 (1.0)      4.5440 (1.17)     0.0000 (1.0)           0;0  0.2201 (0.86)          1           1
test_diff-diff-noop[3.10.0]     4.9298 (1.27)     4.9298 (1.27)     4.9298 (1.27)     0.0000 (1.0)      4.9298 (1.27)     0.0000 (1.0)           0;0  0.2028 (0.79)          1           1
test_diff-diff-noop[3.53.2]     6.0784 (1.56)     6.0784 (1.56)     6.0784 (1.56)     0.0000 (1.0)      6.0784 (1.56)     0.0000 (1.0)           0;0  0.1645 (0.64)          1           1
test_diff-diff-noop[main]       3.8863 (1.0)      3.8863 (1.0)      3.8863 (1.0)      0.0000 (1.0)      3.8863 (1.0)      0.0000 (1.0)           0;0  0.2573 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       978.8406 (1.0)        978.8406 (1.0)        978.8406 (1.0)      0.0000 (1.0)        978.8406 (1.0)      0.0000 (1.0)           0;0  1.0216 (1.0)           1           1
test_exp_show-exp[3.10.0]     5,146.6195 (5.26)     5,146.6195 (5.26)     5,146.6195 (5.26)     0.0000 (1.0)      5,146.6195 (5.26)     0.0000 (1.0)           0;0  0.1943 (0.19)          1           1
test_exp_show-exp[3.53.2]     3,946.6325 (4.03)     3,946.6325 (4.03)     3,946.6325 (4.03)     0.0000 (1.0)      3,946.6325 (4.03)     0.0000 (1.0)           0;0  0.2534 (0.25)          1           1
test_exp_show-exp[main]       7,243.7061 (7.40)     7,243.7061 (7.40)     7,243.7061 (7.40)     0.0000 (1.0)      7,243.7061 (7.40)     0.0000 (1.0)           0;0  0.1381 (0.14)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.4160 (2.81)     67.4160 (2.81)     67.4160 (2.81)     0.0000 (1.0)      67.4160 (2.81)     0.0000 (1.0)           0;0  0.0148 (0.36)          1           1
test_fetch-fetch[3.10.0]     72.4762 (3.02)     72.4762 (3.02)     72.4762 (3.02)     0.0000 (1.0)      72.4762 (3.02)     0.0000 (1.0)           0;0  0.0138 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.4355 (1.52)     36.4355 (1.52)     36.4355 (1.52)     0.0000 (1.0)      36.4355 (1.52)     0.0000 (1.0)           0;0  0.0274 (0.66)          1           1
test_fetch-fetch[main]       23.9962 (1.0)      23.9962 (1.0)      23.9962 (1.0)      0.0000 (1.0)      23.9962 (1.0)      0.0000 (1.0)           0;0  0.0417 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9925 (1.02)     2.9925 (1.02)     2.9925 (1.02)     0.0000 (1.0)      2.9925 (1.02)     0.0000 (1.0)           0;0  0.3342 (0.99)          1           1
test_gc-gc[3.10.0]     3.0701 (1.04)     3.0701 (1.04)     3.0701 (1.04)     0.0000 (1.0)      3.0701 (1.04)     0.0000 (1.0)           0;0  0.3257 (0.96)          1           1
test_gc-gc[3.53.2]     3.0927 (1.05)     3.0927 (1.05)     3.0927 (1.05)     0.0000 (1.0)      3.0927 (1.05)     0.0000 (1.0)           0;0  0.3233 (0.95)          1           1
test_gc-gc[main]       2.9480 (1.0)      2.9480 (1.0)      2.9480 (1.0)      0.0000 (1.0)      2.9480 (1.0)      0.0000 (1.0)           0;0  0.3392 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     133.7893 (2.72)     133.7893 (2.72)     133.7893 (2.72)     0.0000 (1.0)      133.7893 (2.72)     0.0000 (1.0)           0;0  0.0075 (0.37)          1           1
test_get-get[3.10.0]     161.7992 (3.29)     161.7992 (3.29)     161.7992 (3.29)     0.0000 (1.0)      161.7992 (3.29)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_get-get[3.53.2]     140.5734 (2.85)     140.5734 (2.85)     140.5734 (2.85)     0.0000 (1.0)      140.5734 (2.85)     0.0000 (1.0)           0;0  0.0071 (0.35)          1           1
test_get-get[main]        49.2517 (1.0)       49.2517 (1.0)       49.2517 (1.0)      0.0000 (1.0)       49.2517 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     42.4767 (2.73)     42.4767 (2.73)     42.4767 (2.73)     0.0000 (1.0)      42.4767 (2.73)     0.0000 (1.0)           0;0  0.0235 (0.37)          1           1
test_get_url-get-url[3.10.0]     44.8928 (2.88)     44.8928 (2.88)     44.8928 (2.88)     0.0000 (1.0)      44.8928 (2.88)     0.0000 (1.0)           0;0  0.0223 (0.35)          1           1
test_get_url-get-url[3.53.2]     15.9193 (1.02)     15.9193 (1.02)     15.9193 (1.02)     0.0000 (1.0)      15.9193 (1.02)     0.0000 (1.0)           0;0  0.0628 (0.98)          1           1
test_get_url-get-url[main]       15.5748 (1.0)      15.5748 (1.0)      15.5748 (1.0)      0.0000 (1.0)      15.5748 (1.0)      0.0000 (1.0)           0;0  0.0642 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     121.2089 (1.01)     128.2355 (1.0)      124.8597 (1.02)     1.5981 (1.16)     124.7237 (1.03)     2.1960 (2.02)         34;0  8.0090 (0.98)        100           1
test_help---help[3.10.0]     119.7075 (1.0)      130.1592 (1.02)     122.0454 (1.0)      1.8588 (1.34)     121.5121 (1.0)      1.8321 (1.69)         25;8  8.1937 (1.0)         100           1
test_help---help[3.53.2]     120.9408 (1.01)     161.9875 (1.26)     124.6764 (1.02)     6.6321 (4.79)     122.8116 (1.01)     1.3591 (1.25)         7;12  8.0208 (0.98)        100           1
test_help---help[main]       121.7951 (1.02)     130.6765 (1.02)     123.5961 (1.01)     1.3834 (1.0)      123.3863 (1.02)     1.0849 (1.0)          19;7  8.0909 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     236.2489 (3.03)     236.2489 (3.03)     236.2489 (3.03)     0.0000 (1.0)      236.2489 (3.03)     0.0000 (1.0)           0;0  0.0042 (0.33)          1           1
test_import-import[3.10.0]     261.8073 (3.36)     261.8073 (3.36)     261.8073 (3.36)     0.0000 (1.0)      261.8073 (3.36)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        77.9747 (1.0)       77.9747 (1.0)       77.9747 (1.0)      0.0000 (1.0)       77.9747 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     164.6417 (3.37)     164.6417 (3.37)     164.6417 (3.37)     0.0000 (1.0)      164.6417 (3.37)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_import_url-import-url[3.10.0]     168.8764 (3.45)     168.8764 (3.45)     168.8764 (3.45)     0.0000 (1.0)      168.8764 (3.45)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     127.3663 (2.60)     127.3663 (2.60)     127.3663 (2.60)     0.0000 (1.0)      127.3663 (2.60)     0.0000 (1.0)           0;0  0.0079 (0.38)          1           1
test_import_url-import-url[main]        48.9204 (1.0)       48.9204 (1.0)       48.9204 (1.0)      0.0000 (1.0)       48.9204 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     384.2284 (1.01)     411.0962 (1.00)     392.7786 (1.00)      4.9096 (1.05)     391.8355 (1.01)     5.7081 (1.13)         25;5  2.5460 (1.00)        100           1
test_init-init[3.10.0]     397.4829 (1.04)     420.3079 (1.03)     404.5594 (1.03)      4.6769 (1.0)      403.6306 (1.04)     5.0540 (1.0)          28;5  2.4718 (0.97)        100           1
test_init-init[3.53.2]     382.1984 (1.0)      409.0871 (1.0)      391.1711 (1.0)       4.9742 (1.06)     389.8744 (1.0)      5.6918 (1.13)         28;4  2.5564 (1.0)         100           1
test_init-init[main]       386.0755 (1.01)     485.4966 (1.19)     395.9486 (1.01)     15.4405 (3.30)     392.3065 (1.01)     5.7071 (1.13)          4;6  2.5256 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     581.8578 (1.11)     581.8578 (1.11)     581.8578 (1.11)     0.0000 (1.0)      581.8578 (1.11)     0.0000 (1.0)           0;0  1.7186 (0.90)          1           1
test_list-list[3.10.0]     672.0118 (1.28)     672.0118 (1.28)     672.0118 (1.28)     0.0000 (1.0)      672.0118 (1.28)     0.0000 (1.0)           0;0  1.4881 (0.78)          1           1
test_list-list[3.53.2]     577.7454 (1.10)     577.7454 (1.10)     577.7454 (1.10)     0.0000 (1.0)      577.7454 (1.10)     0.0000 (1.0)           0;0  1.7309 (0.91)          1           1
test_list-list[main]       524.8269 (1.0)      524.8269 (1.0)      524.8269 (1.0)      0.0000 (1.0)      524.8269 (1.0)      0.0000 (1.0)           0;0  1.9054 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     418.9162 (1.08)     418.9162 (1.08)     418.9162 (1.08)     0.0000 (1.0)      418.9162 (1.08)     0.0000 (1.0)           0;0  2.3871 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     410.4407 (1.05)     410.4407 (1.05)     410.4407 (1.05)     0.0000 (1.0)      410.4407 (1.05)     0.0000 (1.0)           0;0  2.4364 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     408.7790 (1.05)     408.7790 (1.05)     408.7790 (1.05)     0.0000 (1.0)      408.7790 (1.05)     0.0000 (1.0)           0;0  2.4463 (0.95)          1           1
test_list-list-dvc-only[main]       389.3697 (1.0)      389.3697 (1.0)      389.3697 (1.0)      0.0000 (1.0)      389.3697 (1.0)      0.0000 (1.0)           0;0  2.5683 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7067 (1.0)      2.7067 (1.0)      2.7067 (1.0)      0.0000 (1.0)      2.7067 (1.0)      0.0000 (1.0)           0;0  0.3694 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7649 (1.02)     2.7649 (1.02)     2.7649 (1.02)     0.0000 (1.0)      2.7649 (1.02)     0.0000 (1.0)           0;0  0.3617 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.9301 (1.08)     2.9301 (1.08)     2.9301 (1.08)     0.0000 (1.0)      2.9301 (1.08)     0.0000 (1.0)           0;0  0.3413 (0.92)          1           1
test_list-list-recursive[main]       2.9914 (1.11)     2.9914 (1.11)     2.9914 (1.11)     0.0000 (1.0)      2.9914 (1.11)     0.0000 (1.0)           0;0  0.3343 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     425.9875 (1.08)     425.9875 (1.08)     425.9875 (1.08)     0.0000 (1.0)      425.9875 (1.08)     0.0000 (1.0)           0;0  2.3475 (0.93)          1           1
test_list-list-shallow[3.10.0]     407.1735 (1.03)     407.1735 (1.03)     407.1735 (1.03)     0.0000 (1.0)      407.1735 (1.03)     0.0000 (1.0)           0;0  2.4560 (0.97)          1           1
test_list-list-shallow[3.53.2]     403.5359 (1.02)     403.5359 (1.02)     403.5359 (1.02)     0.0000 (1.0)      403.5359 (1.02)     0.0000 (1.0)           0;0  2.4781 (0.98)          1           1
test_list-list-shallow[main]       395.9724 (1.0)      395.9724 (1.0)      395.9724 (1.0)      0.0000 (1.0)      395.9724 (1.0)      0.0000 (1.0)           0;0  2.5254 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     78.6904 (3.77)     78.6904 (3.77)     78.6904 (3.77)     0.0000 (1.0)      78.6904 (3.77)     0.0000 (1.0)           0;0  0.0127 (0.27)          1           1
test_partial_add-add[3.10.0]     78.6085 (3.77)     78.6085 (3.77)     78.6085 (3.77)     0.0000 (1.0)      78.6085 (3.77)     0.0000 (1.0)           0;0  0.0127 (0.27)          1           1
test_partial_add-add[3.53.2]     70.8783 (3.40)     70.8783 (3.40)     70.8783 (3.40)     0.0000 (1.0)      70.8783 (3.40)     0.0000 (1.0)           0;0  0.0141 (0.29)          1           1
test_partial_add-add[main]       20.8636 (1.0)      20.8636 (1.0)      20.8636 (1.0)      0.0000 (1.0)      20.8636 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     65.0447 (8.13)     65.0447 (8.13)     65.0447 (8.13)     0.0000 (1.0)      65.0447 (8.13)     0.0000 (1.0)           0;0  0.0154 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     65.3862 (8.18)     65.3862 (8.18)     65.3862 (8.18)     0.0000 (1.0)      65.3862 (8.18)     0.0000 (1.0)           0;0  0.0153 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     58.6933 (7.34)     58.6933 (7.34)     58.6933 (7.34)     0.0000 (1.0)      58.6933 (7.34)     0.0000 (1.0)           0;0  0.0170 (0.14)          1           1
test_partial_add-add-partial[main]        7.9973 (1.0)       7.9973 (1.0)       7.9973 (1.0)      0.0000 (1.0)       7.9973 (1.0)      0.0000 (1.0)           0;0  0.1250 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.2191 (1.0)      5.2191 (1.0)      5.2191 (1.0)      0.0000 (1.0)      5.2191 (1.0)      0.0000 (1.0)           0;0  0.1916 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.6821 (1.28)     6.6821 (1.28)     6.6821 (1.28)     0.0000 (1.0)      6.6821 (1.28)     0.0000 (1.0)           0;0  0.1497 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.6096 (1.46)     7.6096 (1.46)     7.6096 (1.46)     0.0000 (1.0)      7.6096 (1.46)     0.0000 (1.0)           0;0  0.1314 (0.69)          1           1
test_partial_add-gc-cloud-noop[main]       7.7149 (1.48)     7.7149 (1.48)     7.7149 (1.48)     0.0000 (1.0)      7.7149 (1.48)     0.0000 (1.0)           0;0  0.1296 (0.68)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7701 (1.0)      2.7701 (1.0)      2.7701 (1.0)      0.0000 (1.0)      2.7701 (1.0)      0.0000 (1.0)           0;0  0.3610 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.2577 (1.54)     4.2577 (1.54)     4.2577 (1.54)     0.0000 (1.0)      4.2577 (1.54)     0.0000 (1.0)           0;0  0.2349 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     4.2325 (1.53)     4.2325 (1.53)     4.2325 (1.53)     0.0000 (1.0)      4.2325 (1.53)     0.0000 (1.0)           0;0  0.2363 (0.65)          1           1
test_partial_add-gc-noop[main]       4.2534 (1.54)     4.2534 (1.54)     4.2534 (1.54)     0.0000 (1.0)      4.2534 (1.54)     0.0000 (1.0)           0;0  0.2351 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.1603 (2.34)     45.1603 (2.34)     45.1603 (2.34)     0.0000 (1.0)      45.1603 (2.34)     0.0000 (1.0)           0;0  0.0221 (0.43)          1           1
test_partial_add-push[3.10.0]     39.8909 (2.07)     39.8909 (2.07)     39.8909 (2.07)     0.0000 (1.0)      39.8909 (2.07)     0.0000 (1.0)           0;0  0.0251 (0.48)          1           1
test_partial_add-push[3.53.2]     20.1108 (1.04)     20.1108 (1.04)     20.1108 (1.04)     0.0000 (1.0)      20.1108 (1.04)     0.0000 (1.0)           0;0  0.0497 (0.96)          1           1
test_partial_add-push[main]       19.2712 (1.0)      19.2712 (1.0)      19.2712 (1.0)      0.0000 (1.0)      19.2712 (1.0)      0.0000 (1.0)           0;0  0.0519 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.6073 (1.12)     11.6073 (1.12)     11.6073 (1.12)     0.0000 (1.0)      11.6073 (1.12)     0.0000 (1.0)           0;0  0.0862 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.5234 (1.01)     10.5234 (1.01)     10.5234 (1.01)     0.0000 (1.0)      10.5234 (1.01)     0.0000 (1.0)           0;0  0.0950 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.9305 (1.05)     10.9305 (1.05)     10.9305 (1.05)     0.0000 (1.0)      10.9305 (1.05)     0.0000 (1.0)           0;0  0.0915 (0.95)          1           1
test_partial_add-push-partial[main]       10.3894 (1.0)      10.3894 (1.0)      10.3894 (1.0)      0.0000 (1.0)      10.3894 (1.0)      0.0000 (1.0)           0;0  0.0963 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     94.8045 (3.84)     94.8045 (3.84)     94.8045 (3.84)     0.0000 (1.0)      94.8045 (3.84)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_partial_remove-add[3.10.0]     95.7772 (3.88)     95.7772 (3.88)     95.7772 (3.88)     0.0000 (1.0)      95.7772 (3.88)     0.0000 (1.0)           0;0  0.0104 (0.26)          1           1
test_partial_remove-add[3.53.2]     85.5090 (3.47)     85.5090 (3.47)     85.5090 (3.47)     0.0000 (1.0)      85.5090 (3.47)     0.0000 (1.0)           0;0  0.0117 (0.29)          1           1
test_partial_remove-add[main]       24.6707 (1.0)      24.6707 (1.0)      24.6707 (1.0)      0.0000 (1.0)      24.6707 (1.0)      0.0000 (1.0)           0;0  0.0405 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.9964 (7.88)     8.9964 (7.88)     8.9964 (7.88)     0.0000 (1.0)      8.9964 (7.88)     0.0000 (1.0)           0;0  0.1112 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     9.6080 (8.41)     9.6080 (8.41)     9.6080 (8.41)     0.0000 (1.0)      9.6080 (8.41)     0.0000 (1.0)           0;0  0.1041 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     8.1125 (7.10)     8.1125 (7.10)     8.1125 (7.10)     0.0000 (1.0)      8.1125 (7.10)     0.0000 (1.0)           0;0  0.1233 (0.14)          1           1
test_partial_remove-add-update[main]       1.1419 (1.0)      1.1419 (1.0)      1.1419 (1.0)      0.0000 (1.0)      1.1419 (1.0)      0.0000 (1.0)           0;0  0.8757 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.6818 (1.0)      3.6818 (1.0)      3.6818 (1.0)      0.0000 (1.0)      3.6818 (1.0)      0.0000 (1.0)           0;0  0.2716 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.9822 (1.08)     3.9822 (1.08)     3.9822 (1.08)     0.0000 (1.0)      3.9822 (1.08)     0.0000 (1.0)           0;0  0.2511 (0.92)          1           1
test_partial_remove-gc[3.53.2]     4.1236 (1.12)     4.1236 (1.12)     4.1236 (1.12)     0.0000 (1.0)      4.1236 (1.12)     0.0000 (1.0)           0;0  0.2425 (0.89)          1           1
test_partial_remove-gc[main]       4.0992 (1.11)     4.0992 (1.11)     4.0992 (1.11)     0.0000 (1.0)      4.0992 (1.11)     0.0000 (1.0)           0;0  0.2440 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.5414 (1.0)      5.5414 (1.0)      5.5414 (1.0)      0.0000 (1.0)      5.5414 (1.0)      0.0000 (1.0)           0;0  0.1805 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.8707 (1.06)     5.8707 (1.06)     5.8707 (1.06)     0.0000 (1.0)      5.8707 (1.06)     0.0000 (1.0)           0;0  0.1703 (0.94)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.8328 (1.05)     5.8328 (1.05)     5.8328 (1.05)     0.0000 (1.0)      5.8328 (1.05)     0.0000 (1.0)           0;0  0.1714 (0.95)          1           1
test_partial_remove-gc-cloud[main]       5.6546 (1.02)     5.6546 (1.02)     5.6546 (1.02)     0.0000 (1.0)      5.6546 (1.02)     0.0000 (1.0)           0;0  0.1768 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.8347 (2.31)     52.8347 (2.31)     52.8347 (2.31)     0.0000 (1.0)      52.8347 (2.31)     0.0000 (1.0)           0;0  0.0189 (0.43)          1           1
test_partial_remove-push[3.10.0]     47.2816 (2.07)     47.2816 (2.07)     47.2816 (2.07)     0.0000 (1.0)      47.2816 (2.07)     0.0000 (1.0)           0;0  0.0211 (0.48)          1           1
test_partial_remove-push[3.53.2]     24.0929 (1.05)     24.0929 (1.05)     24.0929 (1.05)     0.0000 (1.0)      24.0929 (1.05)     0.0000 (1.0)           0;0  0.0415 (0.95)          1           1
test_partial_remove-push[main]       22.8847 (1.0)      22.8847 (1.0)      22.8847 (1.0)      0.0000 (1.0)      22.8847 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8715 (1.0)      1.8715 (1.0)      1.8715 (1.0)      0.0000 (1.0)      1.8715 (1.0)      0.0000 (1.0)           0;0  0.5343 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8755 (1.00)     1.8755 (1.00)     1.8755 (1.00)     0.0000 (1.0)      1.8755 (1.00)     0.0000 (1.0)           0;0  0.5332 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.5755 (1.38)     2.5755 (1.38)     2.5755 (1.38)     0.0000 (1.0)      2.5755 (1.38)     0.0000 (1.0)           0;0  0.3883 (0.73)          1           1
test_partial_remove-push-update[main]       2.7977 (1.49)     2.7977 (1.49)     2.7977 (1.49)     0.0000 (1.0)      2.7977 (1.49)     0.0000 (1.0)           0;0  0.3574 (0.67)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     465.5175 (1.0)      515.7640 (1.0)      485.8774 (1.0)      19.6040 (2.12)     479.8405 (1.0)      27.0656 (2.38)          2;0  2.0581 (1.0)           5           3
test_plots-plots-diff[3.10.0]     888.2794 (1.91)     932.2295 (1.81)     909.9490 (1.87)     17.6196 (1.91)     905.0551 (1.89)     27.5107 (2.41)          2;0  1.0990 (0.53)          5           3
test_plots-plots-diff[3.53.2]     855.5493 (1.84)     879.7844 (1.71)     869.8597 (1.79)      9.2298 (1.0)      869.3655 (1.81)     11.3958 (1.0)           2;0  1.1496 (0.56)          5           3
test_plots-plots-diff[main]       855.5968 (1.84)     919.0060 (1.78)     883.5722 (1.82)     32.0270 (3.47)     864.4352 (1.80)     58.6786 (5.15)          2;0  1.1318 (0.55)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       528.8415 (1.0)        540.6484 (1.0)        534.2679 (1.0)       4.2740 (1.0)        533.9131 (1.0)       4.6640 (1.0)           2;0  1.8717 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,096.1349 (2.07)     1,182.3293 (2.19)     1,133.9745 (2.12)     39.1482 (9.16)     1,111.0659 (2.08)     66.0294 (14.16)         1;0  0.8819 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]       941.5780 (1.78)       981.3433 (1.82)       968.8462 (1.81)     15.9557 (3.73)       975.5099 (1.83)     16.7601 (3.59)          1;0  1.0322 (0.55)          5           3
test_plots-plots-diff-json[main]         958.1651 (1.81)       974.8302 (1.80)       966.4091 (1.81)      7.4218 (1.74)       969.1585 (1.82)     13.0158 (2.79)          2;0  1.0348 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     463.7635 (1.0)      479.6394 (1.0)      469.8496 (1.0)       6.0135 (1.0)      469.2909 (1.0)       6.6755 (1.0)           2;0  2.1283 (1.0)           5           3
test_plots-plots-show[3.10.0]     731.9483 (1.58)     774.2407 (1.61)     754.5965 (1.61)     16.2247 (2.70)     753.3885 (1.61)     23.2920 (3.49)          2;0  1.3252 (0.62)          5           3
test_plots-plots-show[3.53.2]     729.3722 (1.57)     748.7749 (1.56)     736.5567 (1.57)      7.7029 (1.28)     733.3886 (1.56)     10.1179 (1.52)          1;0  1.3577 (0.64)          5           3
test_plots-plots-show[main]       706.8954 (1.52)     745.3377 (1.55)     717.3035 (1.53)     16.0648 (2.67)     709.7127 (1.51)     15.4292 (2.31)          1;0  1.3941 (0.66)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     438.0989 (1.0)      499.6094 (1.0)      467.5197 (1.0)      26.4308 (4.42)     467.9980 (1.0)      47.0883 (5.06)          2;0  2.1389 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     887.5015 (2.03)     920.9780 (1.84)     905.6690 (1.94)     12.5208 (2.10)     907.5636 (1.94)     16.4889 (1.77)          2;0  1.1042 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     774.3197 (1.77)     804.5571 (1.61)     794.7214 (1.70)     12.2016 (2.04)     799.9232 (1.71)     14.3591 (1.54)          1;0  1.2583 (0.59)          5           3
test_plots-plots-show-json[main]       741.6240 (1.69)     756.2539 (1.51)     750.3050 (1.60)      5.9744 (1.0)      750.3131 (1.60)      9.3015 (1.0)           1;0  1.3328 (0.62)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.4441 (2.35)     52.4441 (2.35)     52.4441 (2.35)     0.0000 (1.0)      52.4441 (2.35)     0.0000 (1.0)           0;0  0.0191 (0.42)          1           1
test_push-push[3.10.0]     46.4191 (2.08)     46.4191 (2.08)     46.4191 (2.08)     0.0000 (1.0)      46.4191 (2.08)     0.0000 (1.0)           0;0  0.0215 (0.48)          1           1
test_push-push[3.53.2]     23.0004 (1.03)     23.0004 (1.03)     23.0004 (1.03)     0.0000 (1.0)      23.0004 (1.03)     0.0000 (1.0)           0;0  0.0435 (0.97)          1           1
test_push-push[main]       22.2728 (1.0)      22.2728 (1.0)      22.2728 (1.0)      0.0000 (1.0)      22.2728 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.8108 (2.75)     65.8108 (2.75)     65.8108 (2.75)     0.0000 (1.0)      65.8108 (2.75)     0.0000 (1.0)           0;0  0.0152 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.0544 (2.97)     71.0544 (2.97)     71.0544 (2.97)     0.0000 (1.0)      71.0544 (2.97)     0.0000 (1.0)           0;0  0.0141 (0.34)          1           1
test_sharing-fetch[3.53.2]     35.6815 (1.49)     35.6815 (1.49)     35.6815 (1.49)     0.0000 (1.0)      35.6815 (1.49)     0.0000 (1.0)           0;0  0.0280 (0.67)          1           1
test_sharing-fetch[main]       23.9391 (1.0)      23.9391 (1.0)      23.9391 (1.0)      0.0000 (1.0)      23.9391 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2734 (1.0)      1.2734 (1.0)      1.2734 (1.0)      0.0000 (1.0)      1.2734 (1.0)      0.0000 (1.0)           0;0  0.7853 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6467 (2.86)     3.6467 (2.86)     3.6467 (2.86)     0.0000 (1.0)      3.6467 (2.86)     0.0000 (1.0)           0;0  0.2742 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     6.0263 (4.73)     6.0263 (4.73)     6.0263 (4.73)     0.0000 (1.0)      6.0263 (4.73)     0.0000 (1.0)           0;0  0.1659 (0.21)          1           1
test_sharing-fetch-noop[main]       6.1742 (4.85)     6.1742 (4.85)     6.1742 (4.85)     0.0000 (1.0)      6.1742 (4.85)     0.0000 (1.0)           0;0  0.1620 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.2303 (2.33)     52.2303 (2.33)     52.2303 (2.33)     0.0000 (1.0)      52.2303 (2.33)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_sharing-push[3.10.0]     46.2614 (2.07)     46.2614 (2.07)     46.2614 (2.07)     0.0000 (1.0)      46.2614 (2.07)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_sharing-push[3.53.2]     23.1688 (1.04)     23.1688 (1.04)     23.1688 (1.04)     0.0000 (1.0)      23.1688 (1.04)     0.0000 (1.0)           0;0  0.0432 (0.97)          1           1
test_sharing-push[main]       22.3811 (1.0)      22.3811 (1.0)      22.3811 (1.0)      0.0000 (1.0)      22.3811 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2214 (1.03)     2.2214 (1.03)     2.2214 (1.03)     0.0000 (1.0)      2.2214 (1.03)     0.0000 (1.0)           0;0  0.4502 (0.97)          1           1
test_sharing-push-noop[3.10.0]     2.1647 (1.0)      2.1647 (1.0)      2.1647 (1.0)      0.0000 (1.0)      2.1647 (1.0)      0.0000 (1.0)           0;0  0.4620 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.3326 (2.93)     6.3326 (2.93)     6.3326 (2.93)     0.0000 (1.0)      6.3326 (2.93)     0.0000 (1.0)           0;0  0.1579 (0.34)          1           1
test_sharing-push-noop[main]       6.3719 (2.94)     6.3719 (2.94)     6.3719 (2.94)     0.0000 (1.0)      6.3719 (2.94)     0.0000 (1.0)           0;0  0.1569 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     268.7133 (1.03)     268.7133 (1.03)     268.7133 (1.03)     0.0000 (1.0)      268.7133 (1.03)     0.0000 (1.0)           0;0  0.0037 (0.97)          1           1
test_sharing_azure-fetch[main]       261.7355 (1.0)      261.7355 (1.0)      261.7355 (1.0)      0.0000 (1.0)      261.7355 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.6913 (1.0)      6.6913 (1.0)      6.6913 (1.0)      0.0000 (1.0)      6.6913 (1.0)      0.0000 (1.0)           0;0  0.1494 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.8258 (1.02)     6.8258 (1.02)     6.8258 (1.02)     0.0000 (1.0)      6.8258 (1.02)     0.0000 (1.0)           0;0  0.1465 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     275.7096 (1.0)      275.7096 (1.0)      275.7096 (1.0)      0.0000 (1.0)      275.7096 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
test_sharing_azure-push[main]       289.2796 (1.05)     289.2796 (1.05)     289.2796 (1.05)     0.0000 (1.0)      289.2796 (1.05)     0.0000 (1.0)           0;0  0.0035 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.9588 (1.0)      7.9588 (1.0)      7.9588 (1.0)      0.0000 (1.0)      7.9588 (1.0)      0.0000 (1.0)           0;0  0.1256 (1.0)           1           1
test_sharing_azure-push-noop[main]       8.0424 (1.01)     8.0424 (1.01)     8.0424 (1.01)     0.0000 (1.0)      8.0424 (1.01)     0.0000 (1.0)           0;0  0.1243 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     396.5375 (1.0)      396.5375 (1.0)      396.5375 (1.0)      0.0000 (1.0)      396.5375 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
test_sharing_gs-fetch[main]       399.5373 (1.01)     399.5373 (1.01)     399.5373 (1.01)     0.0000 (1.0)      399.5373 (1.01)     0.0000 (1.0)           0;0  0.0025 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.9670 (1.00)     7.9670 (1.00)     7.9670 (1.00)     0.0000 (1.0)      7.9670 (1.00)     0.0000 (1.0)           0;0  0.1255 (1.00)          1           1
test_sharing_gs-fetch-noop[main]       7.9355 (1.0)      7.9355 (1.0)      7.9355 (1.0)      0.0000 (1.0)      7.9355 (1.0)      0.0000 (1.0)           0;0  0.1260 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     859.8230 (1.0)      859.8230 (1.0)      859.8230 (1.0)      0.0000 (1.0)      859.8230 (1.0)      0.0000 (1.0)           0;0  0.0012 (1.0)           1           1
test_sharing_gs-push[main]       861.7798 (1.00)     861.7798 (1.00)     861.7798 (1.00)     0.0000 (1.0)      861.7798 (1.00)     0.0000 (1.0)           0;0  0.0012 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.3668 (1.0)      7.3668 (1.0)      7.3668 (1.0)      0.0000 (1.0)      7.3668 (1.0)      0.0000 (1.0)           0;0  0.1357 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.7380 (1.05)     7.7380 (1.05)     7.7380 (1.05)     0.0000 (1.0)      7.7380 (1.05)     0.0000 (1.0)           0;0  0.1292 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     297.2432 (1.03)     297.2432 (1.03)     297.2432 (1.03)     0.0000 (1.0)      297.2432 (1.03)     0.0000 (1.0)           0;0  0.0034 (0.97)          1           1
test_sharing_s3-fetch[main]       288.7693 (1.0)      288.7693 (1.0)      288.7693 (1.0)      0.0000 (1.0)      288.7693 (1.0)      0.0000 (1.0)           0;0  0.0035 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6874 (1.0)      6.6874 (1.0)      6.6874 (1.0)      0.0000 (1.0)      6.6874 (1.0)      0.0000 (1.0)           0;0  0.1495 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7803 (1.01)     6.7803 (1.01)     6.7803 (1.01)     0.0000 (1.0)      6.7803 (1.01)     0.0000 (1.0)           0;0  0.1475 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     340.2657 (1.0)      340.2657 (1.0)      340.2657 (1.0)      0.0000 (1.0)      340.2657 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
test_sharing_s3-push[main]       348.5410 (1.02)     348.5410 (1.02)     348.5410 (1.02)     0.0000 (1.0)      348.5410 (1.02)     0.0000 (1.0)           0;0  0.0029 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9764 (1.0)      6.9764 (1.0)      6.9764 (1.0)      0.0000 (1.0)      6.9764 (1.0)      0.0000 (1.0)           0;0  0.1433 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.0608 (1.01)     7.0608 (1.01)     7.0608 (1.01)     0.0000 (1.0)      7.0608 (1.01)     0.0000 (1.0)           0;0  0.1416 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.8622 (3.73)     20.8622 (3.73)     20.8622 (3.73)     0.0000 (1.0)      20.8622 (3.73)     0.0000 (1.0)           0;0  0.0479 (0.27)          1           1
test_status-status[3.10.0]     21.4130 (3.83)     21.4130 (3.83)     21.4130 (3.83)     0.0000 (1.0)      21.4130 (3.83)     0.0000 (1.0)           0;0  0.0467 (0.26)          1           1
test_status-status[3.53.2]     19.4041 (3.47)     19.4041 (3.47)     19.4041 (3.47)     0.0000 (1.0)      19.4041 (3.47)     0.0000 (1.0)           0;0  0.0515 (0.29)          1           1
test_status-status[main]        5.5913 (1.0)       5.5913 (1.0)       5.5913 (1.0)      0.0000 (1.0)       5.5913 (1.0)      0.0000 (1.0)           0;0  0.1789 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9187 (1.69)     4.9187 (1.69)     4.9187 (1.69)     0.0000 (1.0)      4.9187 (1.69)     0.0000 (1.0)           0;0  0.2033 (0.59)          1           1
test_status-status-changed[3.10.0]     5.2507 (1.80)     5.2507 (1.80)     5.2507 (1.80)     0.0000 (1.0)      5.2507 (1.80)     0.0000 (1.0)           0;0  0.1904 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0683 (1.74)     5.0683 (1.74)     5.0683 (1.74)     0.0000 (1.0)      5.0683 (1.74)     0.0000 (1.0)           0;0  0.1973 (0.57)          1           1
test_status-status-changed[main]       2.9143 (1.0)      2.9143 (1.0)      2.9143 (1.0)      0.0000 (1.0)      2.9143 (1.0)      0.0000 (1.0)           0;0  0.3431 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0228 (1.78)     5.0228 (1.78)     5.0228 (1.78)     0.0000 (1.0)      5.0228 (1.78)     0.0000 (1.0)           0;0  0.1991 (0.56)          1           1
test_status-status-changed-noop[3.10.0]     5.1488 (1.83)     5.1488 (1.83)     5.1488 (1.83)     0.0000 (1.0)      5.1488 (1.83)     0.0000 (1.0)           0;0  0.1942 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     4.9168 (1.74)     4.9168 (1.74)     4.9168 (1.74)     0.0000 (1.0)      4.9168 (1.74)     0.0000 (1.0)           0;0  0.2034 (0.57)          1           1
test_status-status-changed-noop[main]       2.8206 (1.0)      2.8206 (1.0)      2.8206 (1.0)      0.0000 (1.0)      2.8206 (1.0)      0.0000 (1.0)           0;0  0.3545 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8508 (1.73)     4.8508 (1.73)     4.8508 (1.73)     0.0000 (1.0)      4.8508 (1.73)     0.0000 (1.0)           0;0  0.2061 (0.58)          1           1
test_status-status-noop[3.10.0]     5.1827 (1.85)     5.1827 (1.85)     5.1827 (1.85)     0.0000 (1.0)      5.1827 (1.85)     0.0000 (1.0)           0;0  0.1930 (0.54)          1           1
test_status-status-noop[3.53.2]     4.9792 (1.77)     4.9792 (1.77)     4.9792 (1.77)     0.0000 (1.0)      4.9792 (1.77)     0.0000 (1.0)           0;0  0.2008 (0.56)          1           1
test_status-status-noop[main]       2.8090 (1.0)      2.8090 (1.0)      2.8090 (1.0)      0.0000 (1.0)      2.8090 (1.0)      0.0000 (1.0)           0;0  0.3560 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     163.3821 (3.33)     163.3821 (3.33)     163.3821 (3.33)     0.0000 (1.0)      163.3821 (3.33)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_update-import-url[3.10.0]     168.4851 (3.44)     168.4851 (3.44)     168.4851 (3.44)     0.0000 (1.0)      168.4851 (3.44)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_update-import-url[3.53.2]     127.0303 (2.59)     127.0303 (2.59)     127.0303 (2.59)     0.0000 (1.0)      127.0303 (2.59)     0.0000 (1.0)           0;0  0.0079 (0.39)          1           1
test_update-import-url[main]        49.0168 (1.0)       49.0168 (1.0)       49.0168 (1.0)      0.0000 (1.0)       49.0168 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     144.4709 (3.74)     144.4709 (3.74)     144.4709 (3.74)     0.0000 (1.0)      144.4709 (3.74)     0.0000 (1.0)           0;0  0.0069 (0.27)          1           1
test_update-update[3.10.0]     149.4540 (3.87)     149.4540 (3.87)     149.4540 (3.87)     0.0000 (1.0)      149.4540 (3.87)     0.0000 (1.0)           0;0  0.0067 (0.26)          1           1
test_update-update[3.53.2]     116.6852 (3.02)     116.6852 (3.02)     116.6852 (3.02)     0.0000 (1.0)      116.6852 (3.02)     0.0000 (1.0)           0;0  0.0086 (0.33)          1           1
test_update-update[main]        38.6453 (1.0)       38.6453 (1.0)       38.6453 (1.0)      0.0000 (1.0)       38.6453 (1.0)      0.0000 (1.0)           0;0  0.0259 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.6265 (1.91)     16.6265 (1.91)     16.6265 (1.91)     0.0000 (1.0)      16.6265 (1.91)     0.0000 (1.0)           0;0  0.0601 (0.52)          1           1
test_update-update-noop[3.10.0]     17.7030 (2.03)     17.7030 (2.03)     17.7030 (2.03)     0.0000 (1.0)      17.7030 (2.03)     0.0000 (1.0)           0;0  0.0565 (0.49)          1           1
test_update-update-noop[3.53.2]     17.2055 (1.97)     17.2055 (1.97)     17.2055 (1.97)     0.0000 (1.0)      17.2055 (1.97)     0.0000 (1.0)           0;0  0.0581 (0.51)          1           1
test_update-update-noop[main]        8.7151 (1.0)       8.7151 (1.0)       8.7151 (1.0)      0.0000 (1.0)       8.7151 (1.0)      0.0000 (1.0)           0;0  0.1147 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean