Sun Jan 19 01:03:14 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     93.5880 (3.71)     93.5880 (3.71)     93.5880 (3.71)     0.0000 (1.0)      93.5880 (3.71)     0.0000 (1.0)           0;0  0.0107 (0.27)          1           1
test_add_copy-add[3.10.0]     96.4651 (3.82)     96.4651 (3.82)     96.4651 (3.82)     0.0000 (1.0)      96.4651 (3.82)     0.0000 (1.0)           0;0  0.0104 (0.26)          1           1
test_add_copy-add[3.53.2]     86.0166 (3.41)     86.0166 (3.41)     86.0166 (3.41)     0.0000 (1.0)      86.0166 (3.41)     0.0000 (1.0)           0;0  0.0116 (0.29)          1           1
test_add_copy-add[main]       25.2507 (1.0)      25.2507 (1.0)      25.2507 (1.0)      0.0000 (1.0)      25.2507 (1.0)      0.0000 (1.0)           0;0  0.0396 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     32.7424 (6.07)     32.7424 (6.07)     32.7424 (6.07)     0.0000 (1.0)      32.7424 (6.07)     0.0000 (1.0)           0;0  0.0305 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     32.7832 (6.07)     32.7832 (6.07)     32.7832 (6.07)     0.0000 (1.0)      32.7832 (6.07)     0.0000 (1.0)           0;0  0.0305 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     31.6624 (5.87)     31.6624 (5.87)     31.6624 (5.87)     0.0000 (1.0)      31.6624 (5.87)     0.0000 (1.0)           0;0  0.0316 (0.17)          1           1
test_add_copy-add-noop[main]        5.3971 (1.0)       5.3971 (1.0)       5.3971 (1.0)      0.0000 (1.0)       5.3971 (1.0)      0.0000 (1.0)           0;0  0.1853 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     73.0263 (4.10)     73.0263 (4.10)     73.0263 (4.10)     0.0000 (1.0)      73.0263 (4.10)     0.0000 (1.0)           0;0  0.0137 (0.24)          1           1
test_add_hardlink-add[3.10.0]     75.1146 (4.22)     75.1146 (4.22)     75.1146 (4.22)     0.0000 (1.0)      75.1146 (4.22)     0.0000 (1.0)           0;0  0.0133 (0.24)          1           1
test_add_hardlink-add[3.53.2]     69.0764 (3.88)     69.0764 (3.88)     69.0764 (3.88)     0.0000 (1.0)      69.0764 (3.88)     0.0000 (1.0)           0;0  0.0145 (0.26)          1           1
test_add_hardlink-add[main]       17.8131 (1.0)      17.8131 (1.0)      17.8131 (1.0)      0.0000 (1.0)      17.8131 (1.0)      0.0000 (1.0)           0;0  0.0561 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     37.0950 (7.63)     37.0950 (7.63)     37.0950 (7.63)     0.0000 (1.0)      37.0950 (7.63)     0.0000 (1.0)           0;0  0.0270 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.4414 (7.70)     37.4414 (7.70)     37.4414 (7.70)     0.0000 (1.0)      37.4414 (7.70)     0.0000 (1.0)           0;0  0.0267 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.4199 (7.29)     35.4199 (7.29)     35.4199 (7.29)     0.0000 (1.0)      35.4199 (7.29)     0.0000 (1.0)           0;0  0.0282 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.8615 (1.0)       4.8615 (1.0)       4.8615 (1.0)      0.0000 (1.0)       4.8615 (1.0)      0.0000 (1.0)           0;0  0.2057 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     76.6759 (2.14)     76.6759 (2.14)     76.6759 (2.14)     0.0000 (1.0)      76.6759 (2.14)     0.0000 (1.0)           0;0  0.0130 (0.47)          1           1
test_add_symlink-add[3.10.0]     76.8631 (2.15)     76.8631 (2.15)     76.8631 (2.15)     0.0000 (1.0)      76.8631 (2.15)     0.0000 (1.0)           0;0  0.0130 (0.47)          1           1
test_add_symlink-add[3.53.2]     71.1030 (1.99)     71.1030 (1.99)     71.1030 (1.99)     0.0000 (1.0)      71.1030 (1.99)     0.0000 (1.0)           0;0  0.0141 (0.50)          1           1
test_add_symlink-add[main]       35.7500 (1.0)      35.7500 (1.0)      35.7500 (1.0)      0.0000 (1.0)      35.7500 (1.0)      0.0000 (1.0)           0;0  0.0280 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.5714 (8.00)     47.5714 (8.00)     47.5714 (8.00)     0.0000 (1.0)      47.5714 (8.00)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.1127 (8.26)     49.1127 (8.26)     49.1127 (8.26)     0.0000 (1.0)      49.1127 (8.26)     0.0000 (1.0)           0;0  0.0204 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.7674 (8.04)     47.7674 (8.04)     47.7674 (8.04)     0.0000 (1.0)      47.7674 (8.04)     0.0000 (1.0)           0;0  0.0209 (0.12)          1           1
test_add_symlink-add-noop[main]        5.9433 (1.0)       5.9433 (1.0)       5.9433 (1.0)      0.0000 (1.0)       5.9433 (1.0)      0.0000 (1.0)           0;0  0.1683 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.3197 (1.93)     42.3197 (1.93)     42.3197 (1.93)     0.0000 (1.0)      42.3197 (1.93)     0.0000 (1.0)           0;0  0.0236 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     61.2411 (2.79)     61.2411 (2.79)     61.2411 (2.79)     0.0000 (1.0)      61.2411 (2.79)     0.0000 (1.0)           0;0  0.0163 (0.36)          1           1
test_checkout_copy-checkout[3.53.2]     29.6317 (1.35)     29.6317 (1.35)     29.6317 (1.35)     0.0000 (1.0)      29.6317 (1.35)     0.0000 (1.0)           0;0  0.0337 (0.74)          1           1
test_checkout_copy-checkout[main]       21.9828 (1.0)      21.9828 (1.0)      21.9828 (1.0)      0.0000 (1.0)      21.9828 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.7071 (1.55)     5.7071 (1.55)     5.7071 (1.55)     0.0000 (1.0)      5.7071 (1.55)     0.0000 (1.0)           0;0  0.1752 (0.64)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.1085 (1.66)     6.1085 (1.66)     6.1085 (1.66)     0.0000 (1.0)      6.1085 (1.66)     0.0000 (1.0)           0;0  0.1637 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.9351 (1.61)     5.9351 (1.61)     5.9351 (1.61)     0.0000 (1.0)      5.9351 (1.61)     0.0000 (1.0)           0;0  0.1685 (0.62)          1           1
test_checkout_copy-checkout-noop[main]       3.6751 (1.0)      3.6751 (1.0)      3.6751 (1.0)      0.0000 (1.0)      3.6751 (1.0)      0.0000 (1.0)           0;0  0.2721 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6910 (2.04)     8.6910 (2.04)     8.6910 (2.04)     0.0000 (1.0)      8.6910 (2.04)     0.0000 (1.0)           0;0  0.1151 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.7307 (1.58)     6.7307 (1.58)     6.7307 (1.58)     0.0000 (1.0)      6.7307 (1.58)     0.0000 (1.0)           0;0  0.1486 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.6022 (1.55)     6.6022 (1.55)     6.6022 (1.55)     0.0000 (1.0)      6.6022 (1.55)     0.0000 (1.0)           0;0  0.1515 (0.64)          1           1
test_checkout_copy-checkout-update[main]       4.2531 (1.0)      4.2531 (1.0)      4.2531 (1.0)      0.0000 (1.0)      4.2531 (1.0)      0.0000 (1.0)           0;0  0.2351 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.4349 (2.95)     24.4349 (2.95)     24.4349 (2.95)     0.0000 (1.0)      24.4349 (2.95)     0.0000 (1.0)           0;0  0.0409 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.1295 (2.19)     18.1295 (2.19)     18.1295 (2.19)     0.0000 (1.0)      18.1295 (2.19)     0.0000 (1.0)           0;0  0.0552 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.7071 (2.02)     16.7071 (2.02)     16.7071 (2.02)     0.0000 (1.0)      16.7071 (2.02)     0.0000 (1.0)           0;0  0.0599 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.2730 (1.0)       8.2730 (1.0)       8.2730 (1.0)      0.0000 (1.0)       8.2730 (1.0)      0.0000 (1.0)           0;0  0.1209 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.8651 (1.55)     5.8651 (1.55)     5.8651 (1.55)     0.0000 (1.0)      5.8651 (1.55)     0.0000 (1.0)           0;0  0.1705 (0.64)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.1270 (1.62)     6.1270 (1.62)     6.1270 (1.62)     0.0000 (1.0)      6.1270 (1.62)     0.0000 (1.0)           0;0  0.1632 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.9697 (1.58)     5.9697 (1.58)     5.9697 (1.58)     0.0000 (1.0)      5.9697 (1.58)     0.0000 (1.0)           0;0  0.1675 (0.63)          1           1
test_checkout_hardlink-checkout-noop[main]       3.7743 (1.0)      3.7743 (1.0)      3.7743 (1.0)      0.0000 (1.0)      3.7743 (1.0)      0.0000 (1.0)           0;0  0.2649 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8602 (2.05)     8.8602 (2.05)     8.8602 (2.05)     0.0000 (1.0)      8.8602 (2.05)     0.0000 (1.0)           0;0  0.1129 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.9502 (1.61)     6.9502 (1.61)     6.9502 (1.61)     0.0000 (1.0)      6.9502 (1.61)     0.0000 (1.0)           0;0  0.1439 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.9393 (1.61)     6.9393 (1.61)     6.9393 (1.61)     0.0000 (1.0)      6.9393 (1.61)     0.0000 (1.0)           0;0  0.1441 (0.62)          1           1
test_checkout_hardlink-checkout-update[main]       4.3151 (1.0)      4.3151 (1.0)      4.3151 (1.0)      0.0000 (1.0)      4.3151 (1.0)      0.0000 (1.0)           0;0  0.2317 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.8585 (2.51)     28.8585 (2.51)     28.8585 (2.51)     0.0000 (1.0)      28.8585 (2.51)     0.0000 (1.0)           0;0  0.0347 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.6719 (1.89)     21.6719 (1.89)     21.6719 (1.89)     0.0000 (1.0)      21.6719 (1.89)     0.0000 (1.0)           0;0  0.0461 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     20.0080 (1.74)     20.0080 (1.74)     20.0080 (1.74)     0.0000 (1.0)      20.0080 (1.74)     0.0000 (1.0)           0;0  0.0500 (0.57)          1           1
test_checkout_symlink-checkout[main]       11.4849 (1.0)      11.4849 (1.0)      11.4849 (1.0)      0.0000 (1.0)      11.4849 (1.0)      0.0000 (1.0)           0;0  0.0871 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.2188 (1.53)     7.2188 (1.53)     7.2188 (1.53)     0.0000 (1.0)      7.2188 (1.53)     0.0000 (1.0)           0;0  0.1385 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.5095 (1.60)     7.5095 (1.60)     7.5095 (1.60)     0.0000 (1.0)      7.5095 (1.60)     0.0000 (1.0)           0;0  0.1332 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.2267 (1.54)     7.2267 (1.54)     7.2267 (1.54)     0.0000 (1.0)      7.2267 (1.54)     0.0000 (1.0)           0;0  0.1384 (0.65)          1           1
test_checkout_symlink-checkout-noop[main]       4.7043 (1.0)      4.7043 (1.0)      4.7043 (1.0)      0.0000 (1.0)      4.7043 (1.0)      0.0000 (1.0)           0;0  0.2126 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.2126 (1.81)     11.2126 (1.81)     11.2126 (1.81)     0.0000 (1.0)      11.2126 (1.81)     0.0000 (1.0)           0;0  0.0892 (0.55)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.3017 (1.50)      9.3017 (1.50)      9.3017 (1.50)     0.0000 (1.0)       9.3017 (1.50)     0.0000 (1.0)           0;0  0.1075 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]      9.0135 (1.46)      9.0135 (1.46)      9.0135 (1.46)     0.0000 (1.0)       9.0135 (1.46)     0.0000 (1.0)           0;0  0.1109 (0.69)          1           1
test_checkout_symlink-checkout-update[main]        6.1811 (1.0)       6.1811 (1.0)       6.1811 (1.0)      0.0000 (1.0)       6.1811 (1.0)      0.0000 (1.0)           0;0  0.1618 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.3903 (1.83)     4.3903 (1.83)     4.3903 (1.83)     0.0000 (1.0)      4.3903 (1.83)     0.0000 (1.0)           0;0  0.2278 (0.55)          1           1
test_data_status-data-changed[3.10.0]     4.8721 (2.03)     4.8721 (2.03)     4.8721 (2.03)     0.0000 (1.0)      4.8721 (2.03)     0.0000 (1.0)           0;0  0.2053 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.7304 (1.97)     4.7304 (1.97)     4.7304 (1.97)     0.0000 (1.0)      4.7304 (1.97)     0.0000 (1.0)           0;0  0.2114 (0.51)          1           1
test_data_status-data-changed[main]       2.4037 (1.0)      2.4037 (1.0)      2.4037 (1.0)      0.0000 (1.0)      2.4037 (1.0)      0.0000 (1.0)           0;0  0.4160 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.3386 (1.79)     4.3386 (1.79)     4.3386 (1.79)     0.0000 (1.0)      4.3386 (1.79)     0.0000 (1.0)           0;0  0.2305 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9147 (2.03)     4.9147 (2.03)     4.9147 (2.03)     0.0000 (1.0)      4.9147 (2.03)     0.0000 (1.0)           0;0  0.2035 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7039 (1.94)     4.7039 (1.94)     4.7039 (1.94)     0.0000 (1.0)      4.7039 (1.94)     0.0000 (1.0)           0;0  0.2126 (0.51)          1           1
test_data_status-data-changed-noop[main]       2.4188 (1.0)      2.4188 (1.0)      2.4188 (1.0)      0.0000 (1.0)      2.4188 (1.0)      0.0000 (1.0)           0;0  0.4134 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.5089 (4.06)     20.5089 (4.06)     20.5089 (4.06)     0.0000 (1.0)      20.5089 (4.06)     0.0000 (1.0)           0;0  0.0488 (0.25)          1           1
test_data_status-data-new[3.10.0]     21.1519 (4.19)     21.1519 (4.19)     21.1519 (4.19)     0.0000 (1.0)      21.1519 (4.19)     0.0000 (1.0)           0;0  0.0473 (0.24)          1           1
test_data_status-data-new[3.53.2]     21.0476 (4.17)     21.0476 (4.17)     21.0476 (4.17)     0.0000 (1.0)      21.0476 (4.17)     0.0000 (1.0)           0;0  0.0475 (0.24)          1           1
test_data_status-data-new[main]        5.0481 (1.0)       5.0481 (1.0)       5.0481 (1.0)      0.0000 (1.0)       5.0481 (1.0)      0.0000 (1.0)           0;0  0.1981 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.4900 (1.86)     4.4900 (1.86)     4.4900 (1.86)     0.0000 (1.0)      4.4900 (1.86)     0.0000 (1.0)           0;0  0.2227 (0.54)          1           1
test_data_status-data-noop[3.10.0]     4.9378 (2.04)     4.9378 (2.04)     4.9378 (2.04)     0.0000 (1.0)      4.9378 (2.04)     0.0000 (1.0)           0;0  0.2025 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.7574 (1.97)     4.7574 (1.97)     4.7574 (1.97)     0.0000 (1.0)      4.7574 (1.97)     0.0000 (1.0)           0;0  0.2102 (0.51)          1           1
test_data_status-data-noop[main]       2.4204 (1.0)      2.4204 (1.0)      2.4204 (1.0)      0.0000 (1.0)      2.4204 (1.0)      0.0000 (1.0)           0;0  0.4132 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.5157 (1.09)     20.5157 (1.09)     20.5157 (1.09)     0.0000 (1.0)      20.5157 (1.09)     0.0000 (1.0)           0;0  0.0487 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.0642 (1.12)     21.0642 (1.12)     21.0642 (1.12)     0.0000 (1.0)      21.0642 (1.12)     0.0000 (1.0)           0;0  0.0475 (0.90)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.9992 (1.11)     20.9992 (1.11)     20.9992 (1.11)     0.0000 (1.0)      20.9992 (1.11)     0.0000 (1.0)           0;0  0.0476 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       18.8679 (1.0)      18.8679 (1.0)      18.8679 (1.0)      0.0000 (1.0)      18.8679 (1.0)      0.0000 (1.0)           0;0  0.0530 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.4155 (1.06)     20.4155 (1.06)     20.4155 (1.06)     0.0000 (1.0)      20.4155 (1.06)     0.0000 (1.0)           0;0  0.0490 (0.94)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.2486 (1.10)     21.2486 (1.10)     21.2486 (1.10)     0.0000 (1.0)      21.2486 (1.10)     0.0000 (1.0)           0;0  0.0471 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.0019 (1.09)     21.0019 (1.09)     21.0019 (1.09)     0.0000 (1.0)      21.0019 (1.09)     0.0000 (1.0)           0;0  0.0476 (0.92)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.2507 (1.0)      19.2507 (1.0)      19.2507 (1.0)      0.0000 (1.0)      19.2507 (1.0)      0.0000 (1.0)           0;0  0.0519 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.3236 (1.70)     36.3236 (1.70)     36.3236 (1.70)     0.0000 (1.0)      36.3236 (1.70)     0.0000 (1.0)           0;0  0.0275 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     36.7826 (1.72)     36.7826 (1.72)     36.7826 (1.72)     0.0000 (1.0)      36.7826 (1.72)     0.0000 (1.0)           0;0  0.0272 (0.58)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.8809 (1.72)     36.8809 (1.72)     36.8809 (1.72)     0.0000 (1.0)      36.8809 (1.72)     0.0000 (1.0)           0;0  0.0271 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.3879 (1.0)      21.3879 (1.0)      21.3879 (1.0)      0.0000 (1.0)      21.3879 (1.0)      0.0000 (1.0)           0;0  0.0468 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.6515 (1.09)     19.6515 (1.09)     19.6515 (1.09)     0.0000 (1.0)      19.6515 (1.09)     0.0000 (1.0)           0;0  0.0509 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.4087 (1.13)     20.4087 (1.13)     20.4087 (1.13)     0.0000 (1.0)      20.4087 (1.13)     0.0000 (1.0)           0;0  0.0490 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.1935 (1.11)     20.1935 (1.11)     20.1935 (1.11)     0.0000 (1.0)      20.1935 (1.11)     0.0000 (1.0)           0;0  0.0495 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       18.1120 (1.0)      18.1120 (1.0)      18.1120 (1.0)      0.0000 (1.0)      18.1120 (1.0)      0.0000 (1.0)           0;0  0.0552 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.0567 (2.66)     20.0567 (2.66)     20.0567 (2.66)     0.0000 (1.0)      20.0567 (2.66)     0.0000 (1.0)           0;0  0.0499 (0.38)          1           1
test_diff-diff[3.10.0]     21.0917 (2.80)     21.0917 (2.80)     21.0917 (2.80)     0.0000 (1.0)      21.0917 (2.80)     0.0000 (1.0)           0;0  0.0474 (0.36)          1           1
test_diff-diff[3.53.2]     21.0614 (2.80)     21.0614 (2.80)     21.0614 (2.80)     0.0000 (1.0)      21.0614 (2.80)     0.0000 (1.0)           0;0  0.0475 (0.36)          1           1
test_diff-diff[main]        7.5269 (1.0)       7.5269 (1.0)       7.5269 (1.0)      0.0000 (1.0)       7.5269 (1.0)      0.0000 (1.0)           0;0  0.1329 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.5921 (1.77)     6.5921 (1.77)     6.5921 (1.77)     0.0000 (1.0)      6.5921 (1.77)     0.0000 (1.0)           0;0  0.1517 (0.56)          1           1
test_diff-diff-changed[3.10.0]     7.0790 (1.90)     7.0790 (1.90)     7.0790 (1.90)     0.0000 (1.0)      7.0790 (1.90)     0.0000 (1.0)           0;0  0.1413 (0.53)          1           1
test_diff-diff-changed[3.53.2]     6.0039 (1.61)     6.0039 (1.61)     6.0039 (1.61)     0.0000 (1.0)      6.0039 (1.61)     0.0000 (1.0)           0;0  0.1666 (0.62)          1           1
test_diff-diff-changed[main]       3.7177 (1.0)      3.7177 (1.0)      3.7177 (1.0)      0.0000 (1.0)      3.7177 (1.0)      0.0000 (1.0)           0;0  0.2690 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5929 (1.50)     5.5929 (1.50)     5.5929 (1.50)     0.0000 (1.0)      5.5929 (1.50)     0.0000 (1.0)           0;0  0.1788 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0998 (1.64)     6.0998 (1.64)     6.0998 (1.64)     0.0000 (1.0)      6.0998 (1.64)     0.0000 (1.0)           0;0  0.1639 (0.61)          1           1
test_diff-diff-changed-noop[3.53.2]     5.9673 (1.60)     5.9673 (1.60)     5.9673 (1.60)     0.0000 (1.0)      5.9673 (1.60)     0.0000 (1.0)           0;0  0.1676 (0.62)          1           1
test_diff-diff-changed-noop[main]       3.7266 (1.0)      3.7266 (1.0)      3.7266 (1.0)      0.0000 (1.0)      3.7266 (1.0)      0.0000 (1.0)           0;0  0.2683 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3696 (1.18)     4.3696 (1.18)     4.3696 (1.18)     0.0000 (1.0)      4.3696 (1.18)     0.0000 (1.0)           0;0  0.2289 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.9864 (1.35)     4.9864 (1.35)     4.9864 (1.35)     0.0000 (1.0)      4.9864 (1.35)     0.0000 (1.0)           0;0  0.2005 (0.74)          1           1
test_diff-diff-noop[3.53.2]     6.1359 (1.66)     6.1359 (1.66)     6.1359 (1.66)     0.0000 (1.0)      6.1359 (1.66)     0.0000 (1.0)           0;0  0.1630 (0.60)          1           1
test_diff-diff-noop[main]       3.7064 (1.0)      3.7064 (1.0)      3.7064 (1.0)      0.0000 (1.0)      3.7064 (1.0)      0.0000 (1.0)           0;0  0.2698 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0062 (1.0)       1.0062 (1.0)       1.0062 (1.0)      0.0000 (1.0)       1.0062 (1.0)      0.0000 (1.0)           0;0  0.9938 (1.0)           1           1
test_exp_show-exp[3.10.0]     13.6015 (13.52)    13.6015 (13.52)    13.6015 (13.52)    0.0000 (1.0)      13.6015 (13.52)    0.0000 (1.0)           0;0  0.0735 (0.07)          1           1
test_exp_show-exp[3.53.2]      8.9136 (8.86)      8.9136 (8.86)      8.9136 (8.86)     0.0000 (1.0)       8.9136 (8.86)     0.0000 (1.0)           0;0  0.1122 (0.11)          1           1
test_exp_show-exp[main]       11.5147 (11.44)    11.5147 (11.44)    11.5147 (11.44)    0.0000 (1.0)      11.5147 (11.44)    0.0000 (1.0)           0;0  0.0868 (0.09)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     68.0588 (2.80)     68.0588 (2.80)     68.0588 (2.80)     0.0000 (1.0)      68.0588 (2.80)     0.0000 (1.0)           0;0  0.0147 (0.36)          1           1
test_fetch-fetch[3.10.0]     73.2060 (3.02)     73.2060 (3.02)     73.2060 (3.02)     0.0000 (1.0)      73.2060 (3.02)     0.0000 (1.0)           0;0  0.0137 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.7847 (1.52)     36.7847 (1.52)     36.7847 (1.52)     0.0000 (1.0)      36.7847 (1.52)     0.0000 (1.0)           0;0  0.0272 (0.66)          1           1
test_fetch-fetch[main]       24.2733 (1.0)      24.2733 (1.0)      24.2733 (1.0)      0.0000 (1.0)      24.2733 (1.0)      0.0000 (1.0)           0;0  0.0412 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.0742 (1.02)     3.0742 (1.02)     3.0742 (1.02)     0.0000 (1.0)      3.0742 (1.02)     0.0000 (1.0)           0;0  0.3253 (0.98)          1           1
test_gc-gc[3.10.0]     3.1503 (1.04)     3.1503 (1.04)     3.1503 (1.04)     0.0000 (1.0)      3.1503 (1.04)     0.0000 (1.0)           0;0  0.3174 (0.96)          1           1
test_gc-gc[3.53.2]     3.1081 (1.03)     3.1081 (1.03)     3.1081 (1.03)     0.0000 (1.0)      3.1081 (1.03)     0.0000 (1.0)           0;0  0.3217 (0.97)          1           1
test_gc-gc[main]       3.0222 (1.0)      3.0222 (1.0)      3.0222 (1.0)      0.0000 (1.0)      3.0222 (1.0)      0.0000 (1.0)           0;0  0.3309 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.9416 (2.72)     134.9416 (2.72)     134.9416 (2.72)     0.0000 (1.0)      134.9416 (2.72)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     165.6884 (3.34)     165.6884 (3.34)     165.6884 (3.34)     0.0000 (1.0)      165.6884 (3.34)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     142.1736 (2.87)     142.1736 (2.87)     142.1736 (2.87)     0.0000 (1.0)      142.1736 (2.87)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[main]        49.5693 (1.0)       49.5693 (1.0)       49.5693 (1.0)      0.0000 (1.0)       49.5693 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.1114 (2.65)     45.1114 (2.65)     45.1114 (2.65)     0.0000 (1.0)      45.1114 (2.65)     0.0000 (1.0)           0;0  0.0222 (0.38)          1           1
test_get_url-get-url[3.10.0]     48.0610 (2.82)     48.0610 (2.82)     48.0610 (2.82)     0.0000 (1.0)      48.0610 (2.82)     0.0000 (1.0)           0;0  0.0208 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.0950 (1.00)     17.0950 (1.00)     17.0950 (1.00)     0.0000 (1.0)      17.0950 (1.00)     0.0000 (1.0)           0;0  0.0585 (1.00)          1           1
test_get_url-get-url[main]       17.0286 (1.0)      17.0286 (1.0)      17.0286 (1.0)      0.0000 (1.0)      17.0286 (1.0)      0.0000 (1.0)           0;0  0.0587 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.6581 (1.03)     132.4487 (1.02)     128.4975 (1.03)     1.4274 (1.92)     128.3877 (1.03)     1.5980 (2.23)         27;5  7.7823 (0.97)        100           1
test_help---help[3.10.0]     122.4058 (1.0)      131.3201 (1.02)     125.1448 (1.0)      2.1296 (2.86)     124.6172 (1.0)      3.3334 (4.65)         33;0  7.9907 (1.0)         100           1
test_help---help[3.53.2]     123.9788 (1.01)     129.2185 (1.0)      125.2281 (1.00)     0.7437 (1.0)      125.1166 (1.00)     0.7167 (1.0)          22;4  7.9854 (1.00)        100           1
test_help---help[main]       124.6832 (1.02)     166.4828 (1.29)     128.4827 (1.03)     6.0323 (8.11)     126.4975 (1.02)     1.8923 (2.64)         8;12  7.7832 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     232.1859 (2.98)     232.1859 (2.98)     232.1859 (2.98)     0.0000 (1.0)      232.1859 (2.98)     0.0000 (1.0)           0;0  0.0043 (0.34)          1           1
test_import-import[3.10.0]     262.5273 (3.37)     262.5273 (3.37)     262.5273 (3.37)     0.0000 (1.0)      262.5273 (3.37)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        77.9067 (1.0)       77.9067 (1.0)       77.9067 (1.0)      0.0000 (1.0)       77.9067 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     163.2295 (3.37)     163.2295 (3.37)     163.2295 (3.37)     0.0000 (1.0)      163.2295 (3.37)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_import_url-import-url[3.10.0]     168.1434 (3.47)     168.1434 (3.47)     168.1434 (3.47)     0.0000 (1.0)      168.1434 (3.47)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     123.8264 (2.55)     123.8264 (2.55)     123.8264 (2.55)     0.0000 (1.0)      123.8264 (2.55)     0.0000 (1.0)           0;0  0.0081 (0.39)          1           1
test_import_url-import-url[main]        48.4791 (1.0)       48.4791 (1.0)       48.4791 (1.0)      0.0000 (1.0)       48.4791 (1.0)      0.0000 (1.0)           0;0  0.0206 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     397.1610 (1.0)      450.0130 (1.0)      421.6447 (1.0)      11.3724 (1.15)     420.7069 (1.0)      14.8162 (1.21)         31;0  2.3717 (1.0)         100           1
test_init-init[3.10.0]     423.4223 (1.07)     496.3910 (1.10)     443.0384 (1.05)      9.9322 (1.0)      441.8476 (1.05)     12.2686 (1.0)          27;1  2.2571 (0.95)        100           1
test_init-init[3.53.2]     404.9497 (1.02)     482.2545 (1.07)     428.7770 (1.02)     13.7035 (1.38)     428.2724 (1.02)     18.4755 (1.51)         33;2  2.3322 (0.98)        100           1
test_init-init[main]       409.9787 (1.03)     641.4656 (1.43)     442.5187 (1.05)     30.8791 (3.11)     437.3499 (1.04)     16.2678 (1.33)          9;7  2.2598 (0.95)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     576.9360 (1.07)     576.9360 (1.07)     576.9360 (1.07)     0.0000 (1.0)      576.9360 (1.07)     0.0000 (1.0)           0;0  1.7333 (0.93)          1           1
test_list-list[3.10.0]     719.2824 (1.34)     719.2824 (1.34)     719.2824 (1.34)     0.0000 (1.0)      719.2824 (1.34)     0.0000 (1.0)           0;0  1.3903 (0.75)          1           1
test_list-list[3.53.2]     597.0225 (1.11)     597.0225 (1.11)     597.0225 (1.11)     0.0000 (1.0)      597.0225 (1.11)     0.0000 (1.0)           0;0  1.6750 (0.90)          1           1
test_list-list[main]       536.7586 (1.0)      536.7586 (1.0)      536.7586 (1.0)      0.0000 (1.0)      536.7586 (1.0)      0.0000 (1.0)           0;0  1.8630 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     422.3391 (1.06)     422.3391 (1.06)     422.3391 (1.06)     0.0000 (1.0)      422.3391 (1.06)     0.0000 (1.0)           0;0  2.3678 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     415.0481 (1.04)     415.0481 (1.04)     415.0481 (1.04)     0.0000 (1.0)      415.0481 (1.04)     0.0000 (1.0)           0;0  2.4094 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     399.4941 (1.0)      399.4941 (1.0)      399.4941 (1.0)      0.0000 (1.0)      399.4941 (1.0)      0.0000 (1.0)           0;0  2.5032 (1.0)           1           1
test_list-list-dvc-only[main]       401.4999 (1.01)     401.4999 (1.01)     401.4999 (1.01)     0.0000 (1.0)      401.4999 (1.01)     0.0000 (1.0)           0;0  2.4907 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7608 (1.0)      2.7608 (1.0)      2.7608 (1.0)      0.0000 (1.0)      2.7608 (1.0)      0.0000 (1.0)           0;0  0.3622 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8303 (1.03)     2.8303 (1.03)     2.8303 (1.03)     0.0000 (1.0)      2.8303 (1.03)     0.0000 (1.0)           0;0  0.3533 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.8510 (1.03)     2.8510 (1.03)     2.8510 (1.03)     0.0000 (1.0)      2.8510 (1.03)     0.0000 (1.0)           0;0  0.3507 (0.97)          1           1
test_list-list-recursive[main]       3.0251 (1.10)     3.0251 (1.10)     3.0251 (1.10)     0.0000 (1.0)      3.0251 (1.10)     0.0000 (1.0)           0;0  0.3306 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     431.0292 (1.07)     431.0292 (1.07)     431.0292 (1.07)     0.0000 (1.0)      431.0292 (1.07)     0.0000 (1.0)           0;0  2.3200 (0.93)          1           1
test_list-list-shallow[3.10.0]     427.5527 (1.06)     427.5527 (1.06)     427.5527 (1.06)     0.0000 (1.0)      427.5527 (1.06)     0.0000 (1.0)           0;0  2.3389 (0.94)          1           1
test_list-list-shallow[3.53.2]     401.9398 (1.0)      401.9398 (1.0)      401.9398 (1.0)      0.0000 (1.0)      401.9398 (1.0)      0.0000 (1.0)           0;0  2.4879 (1.0)           1           1
test_list-list-shallow[main]       404.8811 (1.01)     404.8811 (1.01)     404.8811 (1.01)     0.0000 (1.0)      404.8811 (1.01)     0.0000 (1.0)           0;0  2.4699 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     79.2243 (3.83)     79.2243 (3.83)     79.2243 (3.83)     0.0000 (1.0)      79.2243 (3.83)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add[3.10.0]     78.6567 (3.81)     78.6567 (3.81)     78.6567 (3.81)     0.0000 (1.0)      78.6567 (3.81)     0.0000 (1.0)           0;0  0.0127 (0.26)          1           1
test_partial_add-add[3.53.2]     71.0566 (3.44)     71.0566 (3.44)     71.0566 (3.44)     0.0000 (1.0)      71.0566 (3.44)     0.0000 (1.0)           0;0  0.0141 (0.29)          1           1
test_partial_add-add[main]       20.6593 (1.0)      20.6593 (1.0)      20.6593 (1.0)      0.0000 (1.0)      20.6593 (1.0)      0.0000 (1.0)           0;0  0.0484 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     65.1180 (8.14)     65.1180 (8.14)     65.1180 (8.14)     0.0000 (1.0)      65.1180 (8.14)     0.0000 (1.0)           0;0  0.0154 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     65.2388 (8.15)     65.2388 (8.15)     65.2388 (8.15)     0.0000 (1.0)      65.2388 (8.15)     0.0000 (1.0)           0;0  0.0153 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     58.9191 (7.36)     58.9191 (7.36)     58.9191 (7.36)     0.0000 (1.0)      58.9191 (7.36)     0.0000 (1.0)           0;0  0.0170 (0.14)          1           1
test_partial_add-add-partial[main]        8.0002 (1.0)       8.0002 (1.0)       8.0002 (1.0)      0.0000 (1.0)       8.0002 (1.0)      0.0000 (1.0)           0;0  0.1250 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.1369 (1.0)      5.1369 (1.0)      5.1369 (1.0)      0.0000 (1.0)      5.1369 (1.0)      0.0000 (1.0)           0;0  0.1947 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.9243 (1.35)     6.9243 (1.35)     6.9243 (1.35)     0.0000 (1.0)      6.9243 (1.35)     0.0000 (1.0)           0;0  0.1444 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     8.0069 (1.56)     8.0069 (1.56)     8.0069 (1.56)     0.0000 (1.0)      8.0069 (1.56)     0.0000 (1.0)           0;0  0.1249 (0.64)          1           1
test_partial_add-gc-cloud-noop[main]       7.7941 (1.52)     7.7941 (1.52)     7.7941 (1.52)     0.0000 (1.0)      7.7941 (1.52)     0.0000 (1.0)           0;0  0.1283 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.8697 (1.0)      2.8697 (1.0)      2.8697 (1.0)      0.0000 (1.0)      2.8697 (1.0)      0.0000 (1.0)           0;0  0.3485 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.3090 (1.50)     4.3090 (1.50)     4.3090 (1.50)     0.0000 (1.0)      4.3090 (1.50)     0.0000 (1.0)           0;0  0.2321 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     4.3988 (1.53)     4.3988 (1.53)     4.3988 (1.53)     0.0000 (1.0)      4.3988 (1.53)     0.0000 (1.0)           0;0  0.2273 (0.65)          1           1
test_partial_add-gc-noop[main]       4.3726 (1.52)     4.3726 (1.52)     4.3726 (1.52)     0.0000 (1.0)      4.3726 (1.52)     0.0000 (1.0)           0;0  0.2287 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.1886 (2.32)     45.1886 (2.32)     45.1886 (2.32)     0.0000 (1.0)      45.1886 (2.32)     0.0000 (1.0)           0;0  0.0221 (0.43)          1           1
test_partial_add-push[3.10.0]     39.7358 (2.04)     39.7358 (2.04)     39.7358 (2.04)     0.0000 (1.0)      39.7358 (2.04)     0.0000 (1.0)           0;0  0.0252 (0.49)          1           1
test_partial_add-push[3.53.2]     19.8411 (1.02)     19.8411 (1.02)     19.8411 (1.02)     0.0000 (1.0)      19.8411 (1.02)     0.0000 (1.0)           0;0  0.0504 (0.98)          1           1
test_partial_add-push[main]       19.4691 (1.0)      19.4691 (1.0)      19.4691 (1.0)      0.0000 (1.0)      19.4691 (1.0)      0.0000 (1.0)           0;0  0.0514 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.4475 (1.09)     11.4475 (1.09)     11.4475 (1.09)     0.0000 (1.0)      11.4475 (1.09)     0.0000 (1.0)           0;0  0.0874 (0.91)          1           1
test_partial_add-push-partial[3.10.0]     10.6064 (1.01)     10.6064 (1.01)     10.6064 (1.01)     0.0000 (1.0)      10.6064 (1.01)     0.0000 (1.0)           0;0  0.0943 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.7424 (1.03)     10.7424 (1.03)     10.7424 (1.03)     0.0000 (1.0)      10.7424 (1.03)     0.0000 (1.0)           0;0  0.0931 (0.97)          1           1
test_partial_add-push-partial[main]       10.4560 (1.0)      10.4560 (1.0)      10.4560 (1.0)      0.0000 (1.0)      10.4560 (1.0)      0.0000 (1.0)           0;0  0.0956 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     93.1734 (3.83)     93.1734 (3.83)     93.1734 (3.83)     0.0000 (1.0)      93.1734 (3.83)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_partial_remove-add[3.10.0]     94.0402 (3.86)     94.0402 (3.86)     94.0402 (3.86)     0.0000 (1.0)      94.0402 (3.86)     0.0000 (1.0)           0;0  0.0106 (0.26)          1           1
test_partial_remove-add[3.53.2]     84.0149 (3.45)     84.0149 (3.45)     84.0149 (3.45)     0.0000 (1.0)      84.0149 (3.45)     0.0000 (1.0)           0;0  0.0119 (0.29)          1           1
test_partial_remove-add[main]       24.3525 (1.0)      24.3525 (1.0)      24.3525 (1.0)      0.0000 (1.0)      24.3525 (1.0)      0.0000 (1.0)           0;0  0.0411 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.2805 (8.14)     9.2805 (8.14)     9.2805 (8.14)     0.0000 (1.0)      9.2805 (8.14)     0.0000 (1.0)           0;0  0.1078 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     9.4153 (8.26)     9.4153 (8.26)     9.4153 (8.26)     0.0000 (1.0)      9.4153 (8.26)     0.0000 (1.0)           0;0  0.1062 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     8.2622 (7.25)     8.2622 (7.25)     8.2622 (7.25)     0.0000 (1.0)      8.2622 (7.25)     0.0000 (1.0)           0;0  0.1210 (0.14)          1           1
test_partial_remove-add-update[main]       1.1403 (1.0)      1.1403 (1.0)      1.1403 (1.0)      0.0000 (1.0)      1.1403 (1.0)      0.0000 (1.0)           0;0  0.8770 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.7386 (1.0)      3.7386 (1.0)      3.7386 (1.0)      0.0000 (1.0)      3.7386 (1.0)      0.0000 (1.0)           0;0  0.2675 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.2047 (1.12)     4.2047 (1.12)     4.2047 (1.12)     0.0000 (1.0)      4.2047 (1.12)     0.0000 (1.0)           0;0  0.2378 (0.89)          1           1
test_partial_remove-gc[3.53.2]     3.8571 (1.03)     3.8571 (1.03)     3.8571 (1.03)     0.0000 (1.0)      3.8571 (1.03)     0.0000 (1.0)           0;0  0.2593 (0.97)          1           1
test_partial_remove-gc[main]       4.2237 (1.13)     4.2237 (1.13)     4.2237 (1.13)     0.0000 (1.0)      4.2237 (1.13)     0.0000 (1.0)           0;0  0.2368 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1962 (1.0)      5.1962 (1.0)      5.1962 (1.0)      0.0000 (1.0)      5.1962 (1.0)      0.0000 (1.0)           0;0  0.1924 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.6880 (1.09)     5.6880 (1.09)     5.6880 (1.09)     0.0000 (1.0)      5.6880 (1.09)     0.0000 (1.0)           0;0  0.1758 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.6378 (1.08)     5.6378 (1.08)     5.6378 (1.08)     0.0000 (1.0)      5.6378 (1.08)     0.0000 (1.0)           0;0  0.1774 (0.92)          1           1
test_partial_remove-gc-cloud[main]       5.4579 (1.05)     5.4579 (1.05)     5.4579 (1.05)     0.0000 (1.0)      5.4579 (1.05)     0.0000 (1.0)           0;0  0.1832 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.2072 (2.30)     53.2072 (2.30)     53.2072 (2.30)     0.0000 (1.0)      53.2072 (2.30)     0.0000 (1.0)           0;0  0.0188 (0.43)          1           1
test_partial_remove-push[3.10.0]     47.0408 (2.04)     47.0408 (2.04)     47.0408 (2.04)     0.0000 (1.0)      47.0408 (2.04)     0.0000 (1.0)           0;0  0.0213 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.7902 (1.03)     23.7902 (1.03)     23.7902 (1.03)     0.0000 (1.0)      23.7902 (1.03)     0.0000 (1.0)           0;0  0.0420 (0.97)          1           1
test_partial_remove-push[main]       23.1154 (1.0)      23.1154 (1.0)      23.1154 (1.0)      0.0000 (1.0)      23.1154 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8363 (1.0)      1.8363 (1.0)      1.8363 (1.0)      0.0000 (1.0)      1.8363 (1.0)      0.0000 (1.0)           0;0  0.5446 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8837 (1.03)     1.8837 (1.03)     1.8837 (1.03)     0.0000 (1.0)      1.8837 (1.03)     0.0000 (1.0)           0;0  0.5309 (0.97)          1           1
test_partial_remove-push-update[3.53.2]     2.6106 (1.42)     2.6106 (1.42)     2.6106 (1.42)     0.0000 (1.0)      2.6106 (1.42)     0.0000 (1.0)           0;0  0.3830 (0.70)          1           1
test_partial_remove-push-update[main]       2.6370 (1.44)     2.6370 (1.44)     2.6370 (1.44)     0.0000 (1.0)      2.6370 (1.44)     0.0000 (1.0)           0;0  0.3792 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     463.4951 (1.0)      468.8417 (1.0)      466.5569 (1.0)      2.3221 (1.43)     467.1561 (1.0)      4.0612 (1.63)          1;0  2.1434 (1.0)           5           3
test_plots-plots-diff[3.10.0]     866.8164 (1.87)     875.9767 (1.87)     871.7110 (1.87)     3.9154 (2.42)     872.8266 (1.87)     6.7658 (2.72)          2;0  1.1472 (0.54)          5           3
test_plots-plots-diff[3.53.2]     823.3898 (1.78)     827.4058 (1.76)     825.3335 (1.77)     1.6183 (1.0)      824.7524 (1.77)     2.4901 (1.0)           2;0  1.2116 (0.57)          5           3
test_plots-plots-diff[main]       826.9775 (1.78)     833.8175 (1.78)     830.1465 (1.78)     2.9025 (1.79)     831.2178 (1.78)     4.6708 (1.88)          2;0  1.2046 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       479.8742 (1.0)        487.4967 (1.0)        485.1888 (1.0)      3.2476 (1.94)       486.9028 (1.0)      4.2397 (2.12)          1;0  2.0611 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,101.5199 (2.30)     1,108.8262 (2.27)     1,104.5436 (2.28)     3.5030 (2.09)     1,102.3105 (2.26)     6.0878 (3.05)          1;0  0.9054 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       897.9018 (1.87)       902.0265 (1.85)       900.7054 (1.86)     1.6771 (1.0)        901.4372 (1.85)     1.9962 (1.0)           1;0  1.1102 (0.54)          5           3
test_plots-plots-diff-json[main]         901.3559 (1.88)       908.3541 (1.86)       904.0604 (1.86)     2.7810 (1.66)       902.9668 (1.85)     3.8350 (1.92)          1;0  1.1061 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     416.7371 (1.0)      419.9640 (1.0)      418.3736 (1.0)       1.1981 (1.0)      418.4920 (1.0)       1.5701 (1.0)           2;0  2.3902 (1.0)           5           3
test_plots-plots-show[3.10.0]     718.9595 (1.73)     725.8914 (1.73)     722.7173 (1.73)      2.7262 (2.28)     723.3454 (1.73)      4.1369 (2.63)          2;0  1.3837 (0.58)          5           3
test_plots-plots-show[3.53.2]     693.1583 (1.66)     699.1886 (1.66)     695.8557 (1.66)      2.5406 (2.12)     695.7855 (1.66)      4.3675 (2.78)          2;0  1.4371 (0.60)          5           3
test_plots-plots-show[main]       694.0200 (1.67)     737.9249 (1.76)     705.6809 (1.69)     18.2462 (15.23)    697.9497 (1.67)     14.8994 (9.49)          1;1  1.4171 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     431.3942 (1.0)      439.6144 (1.0)      434.8020 (1.0)      3.3849 (1.99)     433.6647 (1.0)      5.3636 (2.05)          2;0  2.2999 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     847.5629 (1.96)     863.3624 (1.96)     851.5904 (1.96)     6.6999 (3.94)     848.2397 (1.96)     6.0378 (2.31)          1;1  1.1743 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     740.8313 (1.72)     745.0078 (1.69)     743.1648 (1.71)     1.7019 (1.0)      743.8855 (1.72)     2.6168 (1.0)           2;0  1.3456 (0.59)          5           3
test_plots-plots-show-json[main]       741.4115 (1.72)     746.9828 (1.70)     743.8293 (1.71)     2.4673 (1.45)     742.8618 (1.71)     4.3162 (1.65)          1;0  1.3444 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.1774 (2.33)     52.1774 (2.33)     52.1774 (2.33)     0.0000 (1.0)      52.1774 (2.33)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_push-push[3.10.0]     46.6349 (2.09)     46.6349 (2.09)     46.6349 (2.09)     0.0000 (1.0)      46.6349 (2.09)     0.0000 (1.0)           0;0  0.0214 (0.48)          1           1
test_push-push[3.53.2]     23.7358 (1.06)     23.7358 (1.06)     23.7358 (1.06)     0.0000 (1.0)      23.7358 (1.06)     0.0000 (1.0)           0;0  0.0421 (0.94)          1           1
test_push-push[main]       22.3507 (1.0)      22.3507 (1.0)      22.3507 (1.0)      0.0000 (1.0)      22.3507 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.4785 (2.67)     66.4785 (2.67)     66.4785 (2.67)     0.0000 (1.0)      66.4785 (2.67)     0.0000 (1.0)           0;0  0.0150 (0.37)          1           1
test_sharing-fetch[3.10.0]     71.3786 (2.87)     71.3786 (2.87)     71.3786 (2.87)     0.0000 (1.0)      71.3786 (2.87)     0.0000 (1.0)           0;0  0.0140 (0.35)          1           1
test_sharing-fetch[3.53.2]     36.5236 (1.47)     36.5236 (1.47)     36.5236 (1.47)     0.0000 (1.0)      36.5236 (1.47)     0.0000 (1.0)           0;0  0.0274 (0.68)          1           1
test_sharing-fetch[main]       24.8938 (1.0)      24.8938 (1.0)      24.8938 (1.0)      0.0000 (1.0)      24.8938 (1.0)      0.0000 (1.0)           0;0  0.0402 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2769 (1.0)      1.2769 (1.0)      1.2769 (1.0)      0.0000 (1.0)      1.2769 (1.0)      0.0000 (1.0)           0;0  0.7832 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6774 (2.88)     3.6774 (2.88)     3.6774 (2.88)     0.0000 (1.0)      3.6774 (2.88)     0.0000 (1.0)           0;0  0.2719 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     6.2755 (4.91)     6.2755 (4.91)     6.2755 (4.91)     0.0000 (1.0)      6.2755 (4.91)     0.0000 (1.0)           0;0  0.1593 (0.20)          1           1
test_sharing-fetch-noop[main]       6.4906 (5.08)     6.4906 (5.08)     6.4906 (5.08)     0.0000 (1.0)      6.4906 (5.08)     0.0000 (1.0)           0;0  0.1541 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.0764 (2.28)     53.0764 (2.28)     53.0764 (2.28)     0.0000 (1.0)      53.0764 (2.28)     0.0000 (1.0)           0;0  0.0188 (0.44)          1           1
test_sharing-push[3.10.0]     46.6977 (2.01)     46.6977 (2.01)     46.6977 (2.01)     0.0000 (1.0)      46.6977 (2.01)     0.0000 (1.0)           0;0  0.0214 (0.50)          1           1
test_sharing-push[3.53.2]     24.3146 (1.04)     24.3146 (1.04)     24.3146 (1.04)     0.0000 (1.0)      24.3146 (1.04)     0.0000 (1.0)           0;0  0.0411 (0.96)          1           1
test_sharing-push[main]       23.2830 (1.0)      23.2830 (1.0)      23.2830 (1.0)      0.0000 (1.0)      23.2830 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2957 (1.0)      2.2957 (1.0)      2.2957 (1.0)      0.0000 (1.0)      2.2957 (1.0)      0.0000 (1.0)           0;0  0.4356 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.3029 (1.00)     2.3029 (1.00)     2.3029 (1.00)     0.0000 (1.0)      2.3029 (1.00)     0.0000 (1.0)           0;0  0.4342 (1.00)          1           1
test_sharing-push-noop[3.53.2]     6.5629 (2.86)     6.5629 (2.86)     6.5629 (2.86)     0.0000 (1.0)      6.5629 (2.86)     0.0000 (1.0)           0;0  0.1524 (0.35)          1           1
test_sharing-push-noop[main]       6.4856 (2.83)     6.4856 (2.83)     6.4856 (2.83)     0.0000 (1.0)      6.4856 (2.83)     0.0000 (1.0)           0;0  0.1542 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     152.9207 (1.07)     152.9207 (1.07)     152.9207 (1.07)     0.0000 (1.0)      152.9207 (1.07)     0.0000 (1.0)           0;0  0.0065 (0.93)          1           1
test_sharing_azure-fetch[main]       142.7620 (1.0)      142.7620 (1.0)      142.7620 (1.0)      0.0000 (1.0)      142.7620 (1.0)      0.0000 (1.0)           0;0  0.0070 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.8088 (1.0)      6.8088 (1.0)      6.8088 (1.0)      0.0000 (1.0)      6.8088 (1.0)      0.0000 (1.0)           0;0  0.1469 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       7.0564 (1.04)     7.0564 (1.04)     7.0564 (1.04)     0.0000 (1.0)      7.0564 (1.04)     0.0000 (1.0)           0;0  0.1417 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     150.1393 (1.0)      150.1393 (1.0)      150.1393 (1.0)      0.0000 (1.0)      150.1393 (1.0)      0.0000 (1.0)           0;0  0.0067 (1.0)           1           1
test_sharing_azure-push[main]       151.9681 (1.01)     151.9681 (1.01)     151.9681 (1.01)     0.0000 (1.0)      151.9681 (1.01)     0.0000 (1.0)           0;0  0.0066 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.4563 (1.00)     7.4563 (1.00)     7.4563 (1.00)     0.0000 (1.0)      7.4563 (1.00)     0.0000 (1.0)           0;0  0.1341 (1.00)          1           1
test_sharing_azure-push-noop[main]       7.4474 (1.0)      7.4474 (1.0)      7.4474 (1.0)      0.0000 (1.0)      7.4474 (1.0)      0.0000 (1.0)           0;0  0.1343 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     391.7614 (1.02)     391.7614 (1.02)     391.7614 (1.02)     0.0000 (1.0)      391.7614 (1.02)     0.0000 (1.0)           0;0  0.0026 (0.98)          1           1
test_sharing_gs-fetch[main]       383.9643 (1.0)      383.9643 (1.0)      383.9643 (1.0)      0.0000 (1.0)      383.9643 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     8.2080 (1.0)      8.2080 (1.0)      8.2080 (1.0)      0.0000 (1.0)      8.2080 (1.0)      0.0000 (1.0)           0;0  0.1218 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       8.2457 (1.00)     8.2457 (1.00)     8.2457 (1.00)     0.0000 (1.0)      8.2457 (1.00)     0.0000 (1.0)           0;0  0.1213 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     861.0514 (1.0)      861.0514 (1.0)      861.0514 (1.0)      0.0000 (1.0)      861.0514 (1.0)      0.0000 (1.0)           0;0  0.0012 (1.0)           1           1
test_sharing_gs-push[main]       875.1247 (1.02)     875.1247 (1.02)     875.1247 (1.02)     0.0000 (1.0)      875.1247 (1.02)     0.0000 (1.0)           0;0  0.0011 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.7570 (1.04)     7.7570 (1.04)     7.7570 (1.04)     0.0000 (1.0)      7.7570 (1.04)     0.0000 (1.0)           0;0  0.1289 (0.96)          1           1
test_sharing_gs-push-noop[main]       7.4305 (1.0)      7.4305 (1.0)      7.4305 (1.0)      0.0000 (1.0)      7.4305 (1.0)      0.0000 (1.0)           0;0  0.1346 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     239.8553 (1.04)     239.8553 (1.04)     239.8553 (1.04)     0.0000 (1.0)      239.8553 (1.04)     0.0000 (1.0)           0;0  0.0042 (0.96)          1           1
test_sharing_s3-fetch[main]       230.1837 (1.0)      230.1837 (1.0)      230.1837 (1.0)      0.0000 (1.0)      230.1837 (1.0)      0.0000 (1.0)           0;0  0.0043 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6534 (1.0)      6.6534 (1.0)      6.6534 (1.0)      0.0000 (1.0)      6.6534 (1.0)      0.0000 (1.0)           0;0  0.1503 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.8179 (1.02)     6.8179 (1.02)     6.8179 (1.02)     0.0000 (1.0)      6.8179 (1.02)     0.0000 (1.0)           0;0  0.1467 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     321.1348 (1.01)     321.1348 (1.01)     321.1348 (1.01)     0.0000 (1.0)      321.1348 (1.01)     0.0000 (1.0)           0;0  0.0031 (0.99)          1           1
test_sharing_s3-push[main]       318.2483 (1.0)      318.2483 (1.0)      318.2483 (1.0)      0.0000 (1.0)      318.2483 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9167 (1.0)      6.9167 (1.0)      6.9167 (1.0)      0.0000 (1.0)      6.9167 (1.0)      0.0000 (1.0)           0;0  0.1446 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.9901 (1.01)     6.9901 (1.01)     6.9901 (1.01)     0.0000 (1.0)      6.9901 (1.01)     0.0000 (1.0)           0;0  0.1431 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.0960 (3.75)     21.0960 (3.75)     21.0960 (3.75)     0.0000 (1.0)      21.0960 (3.75)     0.0000 (1.0)           0;0  0.0474 (0.27)          1           1
test_status-status[3.10.0]     21.1330 (3.75)     21.1330 (3.75)     21.1330 (3.75)     0.0000 (1.0)      21.1330 (3.75)     0.0000 (1.0)           0;0  0.0473 (0.27)          1           1
test_status-status[3.53.2]     19.5067 (3.46)     19.5067 (3.46)     19.5067 (3.46)     0.0000 (1.0)      19.5067 (3.46)     0.0000 (1.0)           0;0  0.0513 (0.29)          1           1
test_status-status[main]        5.6306 (1.0)       5.6306 (1.0)       5.6306 (1.0)      0.0000 (1.0)       5.6306 (1.0)      0.0000 (1.0)           0;0  0.1776 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9843 (1.70)     4.9843 (1.70)     4.9843 (1.70)     0.0000 (1.0)      4.9843 (1.70)     0.0000 (1.0)           0;0  0.2006 (0.59)          1           1
test_status-status-changed[3.10.0]     5.2359 (1.79)     5.2359 (1.79)     5.2359 (1.79)     0.0000 (1.0)      5.2359 (1.79)     0.0000 (1.0)           0;0  0.1910 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0753 (1.73)     5.0753 (1.73)     5.0753 (1.73)     0.0000 (1.0)      5.0753 (1.73)     0.0000 (1.0)           0;0  0.1970 (0.58)          1           1
test_status-status-changed[main]       2.9258 (1.0)      2.9258 (1.0)      2.9258 (1.0)      0.0000 (1.0)      2.9258 (1.0)      0.0000 (1.0)           0;0  0.3418 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0528 (1.76)     5.0528 (1.76)     5.0528 (1.76)     0.0000 (1.0)      5.0528 (1.76)     0.0000 (1.0)           0;0  0.1979 (0.57)          1           1
test_status-status-changed-noop[3.10.0]     5.1454 (1.79)     5.1454 (1.79)     5.1454 (1.79)     0.0000 (1.0)      5.1454 (1.79)     0.0000 (1.0)           0;0  0.1943 (0.56)          1           1
test_status-status-changed-noop[3.53.2]     4.9566 (1.73)     4.9566 (1.73)     4.9566 (1.73)     0.0000 (1.0)      4.9566 (1.73)     0.0000 (1.0)           0;0  0.2018 (0.58)          1           1
test_status-status-changed-noop[main]       2.8701 (1.0)      2.8701 (1.0)      2.8701 (1.0)      0.0000 (1.0)      2.8701 (1.0)      0.0000 (1.0)           0;0  0.3484 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9891 (1.73)     4.9891 (1.73)     4.9891 (1.73)     0.0000 (1.0)      4.9891 (1.73)     0.0000 (1.0)           0;0  0.2004 (0.58)          1           1
test_status-status-noop[3.10.0]     5.2221 (1.82)     5.2221 (1.82)     5.2221 (1.82)     0.0000 (1.0)      5.2221 (1.82)     0.0000 (1.0)           0;0  0.1915 (0.55)          1           1
test_status-status-noop[3.53.2]     5.0687 (1.76)     5.0687 (1.76)     5.0687 (1.76)     0.0000 (1.0)      5.0687 (1.76)     0.0000 (1.0)           0;0  0.1973 (0.57)          1           1
test_status-status-noop[main]       2.8768 (1.0)      2.8768 (1.0)      2.8768 (1.0)      0.0000 (1.0)      2.8768 (1.0)      0.0000 (1.0)           0;0  0.3476 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     167.0709 (3.35)     167.0709 (3.35)     167.0709 (3.35)     0.0000 (1.0)      167.0709 (3.35)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_update-import-url[3.10.0]     171.2014 (3.43)     171.2014 (3.43)     171.2014 (3.43)     0.0000 (1.0)      171.2014 (3.43)     0.0000 (1.0)           0;0  0.0058 (0.29)          1           1
test_update-import-url[3.53.2]     128.4378 (2.57)     128.4378 (2.57)     128.4378 (2.57)     0.0000 (1.0)      128.4378 (2.57)     0.0000 (1.0)           0;0  0.0078 (0.39)          1           1
test_update-import-url[main]        49.9093 (1.0)       49.9093 (1.0)       49.9093 (1.0)      0.0000 (1.0)       49.9093 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     147.6334 (3.79)     147.6334 (3.79)     147.6334 (3.79)     0.0000 (1.0)      147.6334 (3.79)     0.0000 (1.0)           0;0  0.0068 (0.26)          1           1
test_update-update[3.10.0]     153.1108 (3.93)     153.1108 (3.93)     153.1108 (3.93)     0.0000 (1.0)      153.1108 (3.93)     0.0000 (1.0)           0;0  0.0065 (0.25)          1           1
test_update-update[3.53.2]     117.4814 (3.01)     117.4814 (3.01)     117.4814 (3.01)     0.0000 (1.0)      117.4814 (3.01)     0.0000 (1.0)           0;0  0.0085 (0.33)          1           1
test_update-update[main]        38.9656 (1.0)       38.9656 (1.0)       38.9656 (1.0)      0.0000 (1.0)       38.9656 (1.0)      0.0000 (1.0)           0;0  0.0257 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.0882 (1.92)     17.0882 (1.92)     17.0882 (1.92)     0.0000 (1.0)      17.0882 (1.92)     0.0000 (1.0)           0;0  0.0585 (0.52)          1           1
test_update-update-noop[3.10.0]     18.3103 (2.05)     18.3103 (2.05)     18.3103 (2.05)     0.0000 (1.0)      18.3103 (2.05)     0.0000 (1.0)           0;0  0.0546 (0.49)          1           1
test_update-update-noop[3.53.2]     17.5667 (1.97)     17.5667 (1.97)     17.5667 (1.97)     0.0000 (1.0)      17.5667 (1.97)     0.0000 (1.0)           0;0  0.0569 (0.51)          1           1
test_update-update-noop[main]        8.9220 (1.0)       8.9220 (1.0)       8.9220 (1.0)      0.0000 (1.0)       8.9220 (1.0)      0.0000 (1.0)           0;0  0.1121 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean