Mon Jun  9 00:41:11 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     91.1988 (3.83)     91.1988 (3.83)     91.1988 (3.83)     0.0000 (1.0)      91.1988 (3.83)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_add_copy-add[3.10.0]     92.0161 (3.87)     92.0161 (3.87)     92.0161 (3.87)     0.0000 (1.0)      92.0161 (3.87)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_add_copy-add[3.53.2]     82.9004 (3.48)     82.9004 (3.48)     82.9004 (3.48)     0.0000 (1.0)      82.9004 (3.48)     0.0000 (1.0)           0;0  0.0121 (0.29)          1           1
test_add_copy-add[main]       23.7984 (1.0)      23.7984 (1.0)      23.7984 (1.0)      0.0000 (1.0)      23.7984 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.8432 (6.91)     30.8432 (6.91)     30.8432 (6.91)     0.0000 (1.0)      30.8432 (6.91)     0.0000 (1.0)           0;0  0.0324 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     31.8289 (7.13)     31.8289 (7.13)     31.8289 (7.13)     0.0000 (1.0)      31.8289 (7.13)     0.0000 (1.0)           0;0  0.0314 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     29.9620 (6.72)     29.9620 (6.72)     29.9620 (6.72)     0.0000 (1.0)      29.9620 (6.72)     0.0000 (1.0)           0;0  0.0334 (0.15)          1           1
test_add_copy-add-noop[main]        4.4610 (1.0)       4.4610 (1.0)       4.4610 (1.0)      0.0000 (1.0)       4.4610 (1.0)      0.0000 (1.0)           0;0  0.2242 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     73.2928 (4.29)     73.2928 (4.29)     73.2928 (4.29)     0.0000 (1.0)      73.2928 (4.29)     0.0000 (1.0)           0;0  0.0136 (0.23)          1           1
test_add_hardlink-add[3.10.0]     74.3013 (4.35)     74.3013 (4.35)     74.3013 (4.35)     0.0000 (1.0)      74.3013 (4.35)     0.0000 (1.0)           0;0  0.0135 (0.23)          1           1
test_add_hardlink-add[3.53.2]     69.5113 (4.07)     69.5113 (4.07)     69.5113 (4.07)     0.0000 (1.0)      69.5113 (4.07)     0.0000 (1.0)           0;0  0.0144 (0.25)          1           1
test_add_hardlink-add[main]       17.0669 (1.0)      17.0669 (1.0)      17.0669 (1.0)      0.0000 (1.0)      17.0669 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.5273 (8.20)     36.5273 (8.20)     36.5273 (8.20)     0.0000 (1.0)      36.5273 (8.20)     0.0000 (1.0)           0;0  0.0274 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     37.2629 (8.37)     37.2629 (8.37)     37.2629 (8.37)     0.0000 (1.0)      37.2629 (8.37)     0.0000 (1.0)           0;0  0.0268 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     35.3958 (7.95)     35.3958 (7.95)     35.3958 (7.95)     0.0000 (1.0)      35.3958 (7.95)     0.0000 (1.0)           0;0  0.0283 (0.13)          1           1
test_add_hardlink-add-noop[main]        4.4534 (1.0)       4.4534 (1.0)       4.4534 (1.0)      0.0000 (1.0)       4.4534 (1.0)      0.0000 (1.0)           0;0  0.2245 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     77.0872 (2.13)     77.0872 (2.13)     77.0872 (2.13)     0.0000 (1.0)      77.0872 (2.13)     0.0000 (1.0)           0;0  0.0130 (0.47)          1           1
test_add_symlink-add[3.10.0]     77.7961 (2.15)     77.7961 (2.15)     77.7961 (2.15)     0.0000 (1.0)      77.7961 (2.15)     0.0000 (1.0)           0;0  0.0129 (0.47)          1           1
test_add_symlink-add[3.53.2]     70.6966 (1.95)     70.6966 (1.95)     70.6966 (1.95)     0.0000 (1.0)      70.6966 (1.95)     0.0000 (1.0)           0;0  0.0141 (0.51)          1           1
test_add_symlink-add[main]       36.2008 (1.0)      36.2008 (1.0)      36.2008 (1.0)      0.0000 (1.0)      36.2008 (1.0)      0.0000 (1.0)           0;0  0.0276 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     50.4140 (8.85)     50.4140 (8.85)     50.4140 (8.85)     0.0000 (1.0)      50.4140 (8.85)     0.0000 (1.0)           0;0  0.0198 (0.11)          1           1
test_add_symlink-add-noop[3.10.0]     51.0193 (8.96)     51.0193 (8.96)     51.0193 (8.96)     0.0000 (1.0)      51.0193 (8.96)     0.0000 (1.0)           0;0  0.0196 (0.11)          1           1
test_add_symlink-add-noop[3.53.2]     47.3695 (8.32)     47.3695 (8.32)     47.3695 (8.32)     0.0000 (1.0)      47.3695 (8.32)     0.0000 (1.0)           0;0  0.0211 (0.12)          1           1
test_add_symlink-add-noop[main]        5.6939 (1.0)       5.6939 (1.0)       5.6939 (1.0)      0.0000 (1.0)       5.6939 (1.0)      0.0000 (1.0)           0;0  0.1756 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.6793 (2.02)     43.6793 (2.02)     43.6793 (2.02)     0.0000 (1.0)      43.6793 (2.02)     0.0000 (1.0)           0;0  0.0229 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     61.7654 (2.86)     61.7654 (2.86)     61.7654 (2.86)     0.0000 (1.0)      61.7654 (2.86)     0.0000 (1.0)           0;0  0.0162 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     30.0755 (1.39)     30.0755 (1.39)     30.0755 (1.39)     0.0000 (1.0)      30.0755 (1.39)     0.0000 (1.0)           0;0  0.0332 (0.72)          1           1
test_checkout_copy-checkout[main]       21.6244 (1.0)      21.6244 (1.0)      21.6244 (1.0)      0.0000 (1.0)      21.6244 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4466 (1.68)     5.4466 (1.68)     5.4466 (1.68)     0.0000 (1.0)      5.4466 (1.68)     0.0000 (1.0)           0;0  0.1836 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7813 (1.79)     5.7813 (1.79)     5.7813 (1.79)     0.0000 (1.0)      5.7813 (1.79)     0.0000 (1.0)           0;0  0.1730 (0.56)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5771 (1.72)     5.5771 (1.72)     5.5771 (1.72)     0.0000 (1.0)      5.5771 (1.72)     0.0000 (1.0)           0;0  0.1793 (0.58)          1           1
test_checkout_copy-checkout-noop[main]       3.2364 (1.0)      3.2364 (1.0)      3.2364 (1.0)      0.0000 (1.0)      3.2364 (1.0)      0.0000 (1.0)           0;0  0.3090 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6731 (2.22)     8.6731 (2.22)     8.6731 (2.22)     0.0000 (1.0)      8.6731 (2.22)     0.0000 (1.0)           0;0  0.1153 (0.45)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4572 (1.65)     6.4572 (1.65)     6.4572 (1.65)     0.0000 (1.0)      6.4572 (1.65)     0.0000 (1.0)           0;0  0.1549 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3270 (1.62)     6.3270 (1.62)     6.3270 (1.62)     0.0000 (1.0)      6.3270 (1.62)     0.0000 (1.0)           0;0  0.1581 (0.62)          1           1
test_checkout_copy-checkout-update[main]       3.9019 (1.0)      3.9019 (1.0)      3.9019 (1.0)      0.0000 (1.0)      3.9019 (1.0)      0.0000 (1.0)           0;0  0.2563 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.0088 (3.11)     24.0088 (3.11)     24.0088 (3.11)     0.0000 (1.0)      24.0088 (3.11)     0.0000 (1.0)           0;0  0.0417 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.0296 (2.34)     18.0296 (2.34)     18.0296 (2.34)     0.0000 (1.0)      18.0296 (2.34)     0.0000 (1.0)           0;0  0.0555 (0.43)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2385 (2.11)     16.2385 (2.11)     16.2385 (2.11)     0.0000 (1.0)      16.2385 (2.11)     0.0000 (1.0)           0;0  0.0616 (0.47)          1           1
test_checkout_hardlink-checkout[main]        7.7121 (1.0)       7.7121 (1.0)       7.7121 (1.0)      0.0000 (1.0)       7.7121 (1.0)      0.0000 (1.0)           0;0  0.1297 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4983 (1.67)     5.4983 (1.67)     5.4983 (1.67)     0.0000 (1.0)      5.4983 (1.67)     0.0000 (1.0)           0;0  0.1819 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.0625 (1.84)     6.0625 (1.84)     6.0625 (1.84)     0.0000 (1.0)      6.0625 (1.84)     0.0000 (1.0)           0;0  0.1649 (0.54)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6587 (1.72)     5.6587 (1.72)     5.6587 (1.72)     0.0000 (1.0)      5.6587 (1.72)     0.0000 (1.0)           0;0  0.1767 (0.58)          1           1
test_checkout_hardlink-checkout-noop[main]       3.2889 (1.0)      3.2889 (1.0)      3.2889 (1.0)      0.0000 (1.0)      3.2889 (1.0)      0.0000 (1.0)           0;0  0.3041 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7431 (2.20)     8.7431 (2.20)     8.7431 (2.20)     0.0000 (1.0)      8.7431 (2.20)     0.0000 (1.0)           0;0  0.1144 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7958 (1.71)     6.7958 (1.71)     6.7958 (1.71)     0.0000 (1.0)      6.7958 (1.71)     0.0000 (1.0)           0;0  0.1471 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4718 (1.63)     6.4718 (1.63)     6.4718 (1.63)     0.0000 (1.0)      6.4718 (1.63)     0.0000 (1.0)           0;0  0.1545 (0.61)          1           1
test_checkout_hardlink-checkout-update[main]       3.9796 (1.0)      3.9796 (1.0)      3.9796 (1.0)      0.0000 (1.0)      3.9796 (1.0)      0.0000 (1.0)           0;0  0.2513 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.7436 (2.42)     27.7436 (2.42)     27.7436 (2.42)     0.0000 (1.0)      27.7436 (2.42)     0.0000 (1.0)           0;0  0.0360 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     21.5169 (1.88)     21.5169 (1.88)     21.5169 (1.88)     0.0000 (1.0)      21.5169 (1.88)     0.0000 (1.0)           0;0  0.0465 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     18.8675 (1.65)     18.8675 (1.65)     18.8675 (1.65)     0.0000 (1.0)      18.8675 (1.65)     0.0000 (1.0)           0;0  0.0530 (0.61)          1           1
test_checkout_symlink-checkout[main]       11.4672 (1.0)      11.4672 (1.0)      11.4672 (1.0)      0.0000 (1.0)      11.4672 (1.0)      0.0000 (1.0)           0;0  0.0872 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6316 (1.54)     6.6316 (1.54)     6.6316 (1.54)     0.0000 (1.0)      6.6316 (1.54)     0.0000 (1.0)           0;0  0.1508 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7958 (1.58)     6.7958 (1.58)     6.7958 (1.58)     0.0000 (1.0)      6.7958 (1.58)     0.0000 (1.0)           0;0  0.1471 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6126 (1.54)     6.6126 (1.54)     6.6126 (1.54)     0.0000 (1.0)      6.6126 (1.54)     0.0000 (1.0)           0;0  0.1512 (0.65)          1           1
test_checkout_symlink-checkout-noop[main]       4.2990 (1.0)      4.2990 (1.0)      4.2990 (1.0)      0.0000 (1.0)      4.2990 (1.0)      0.0000 (1.0)           0;0  0.2326 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6759 (1.84)     10.6759 (1.84)     10.6759 (1.84)     0.0000 (1.0)      10.6759 (1.84)     0.0000 (1.0)           0;0  0.0937 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6855 (1.50)      8.6855 (1.50)      8.6855 (1.50)     0.0000 (1.0)       8.6855 (1.50)     0.0000 (1.0)           0;0  0.1151 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.4259 (1.45)      8.4259 (1.45)      8.4259 (1.45)     0.0000 (1.0)       8.4259 (1.45)     0.0000 (1.0)           0;0  0.1187 (0.69)          1           1
test_checkout_symlink-checkout-update[main]        5.7949 (1.0)       5.7949 (1.0)       5.7949 (1.0)      0.0000 (1.0)       5.7949 (1.0)      0.0000 (1.0)           0;0  0.1726 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0174 (1.77)     4.0174 (1.77)     4.0174 (1.77)     0.0000 (1.0)      4.0174 (1.77)     0.0000 (1.0)           0;0  0.2489 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.4820 (1.98)     4.4820 (1.98)     4.4820 (1.98)     0.0000 (1.0)      4.4820 (1.98)     0.0000 (1.0)           0;0  0.2231 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.3708 (1.93)     4.3708 (1.93)     4.3708 (1.93)     0.0000 (1.0)      4.3708 (1.93)     0.0000 (1.0)           0;0  0.2288 (0.52)          1           1
test_data_status-data-changed[main]       2.2635 (1.0)      2.2635 (1.0)      2.2635 (1.0)      0.0000 (1.0)      2.2635 (1.0)      0.0000 (1.0)           0;0  0.4418 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9810 (1.72)     3.9810 (1.72)     3.9810 (1.72)     0.0000 (1.0)      3.9810 (1.72)     0.0000 (1.0)           0;0  0.2512 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7412 (2.05)     4.7412 (2.05)     4.7412 (2.05)     0.0000 (1.0)      4.7412 (2.05)     0.0000 (1.0)           0;0  0.2109 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5382 (1.97)     4.5382 (1.97)     4.5382 (1.97)     0.0000 (1.0)      4.5382 (1.97)     0.0000 (1.0)           0;0  0.2204 (0.51)          1           1
test_data_status-data-changed-noop[main]       2.3093 (1.0)      2.3093 (1.0)      2.3093 (1.0)      0.0000 (1.0)      2.3093 (1.0)      0.0000 (1.0)           0;0  0.4330 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.2755 (3.80)     19.2755 (3.80)     19.2755 (3.80)     0.0000 (1.0)      19.2755 (3.80)     0.0000 (1.0)           0;0  0.0519 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.1216 (3.96)     20.1216 (3.96)     20.1216 (3.96)     0.0000 (1.0)      20.1216 (3.96)     0.0000 (1.0)           0;0  0.0497 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.8085 (3.90)     19.8085 (3.90)     19.8085 (3.90)     0.0000 (1.0)      19.8085 (3.90)     0.0000 (1.0)           0;0  0.0505 (0.26)          1           1
test_data_status-data-new[main]        5.0770 (1.0)       5.0770 (1.0)       5.0770 (1.0)      0.0000 (1.0)       5.0770 (1.0)      0.0000 (1.0)           0;0  0.1970 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0031 (1.73)     4.0031 (1.73)     4.0031 (1.73)     0.0000 (1.0)      4.0031 (1.73)     0.0000 (1.0)           0;0  0.2498 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.5760 (1.97)     4.5760 (1.97)     4.5760 (1.97)     0.0000 (1.0)      4.5760 (1.97)     0.0000 (1.0)           0;0  0.2185 (0.51)          1           1
test_data_status-data-noop[3.53.2]     4.5295 (1.95)     4.5295 (1.95)     4.5295 (1.95)     0.0000 (1.0)      4.5295 (1.95)     0.0000 (1.0)           0;0  0.2208 (0.51)          1           1
test_data_status-data-noop[main]       2.3206 (1.0)      2.3206 (1.0)      2.3206 (1.0)      0.0000 (1.0)      2.3206 (1.0)      0.0000 (1.0)           0;0  0.4309 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     15.8031 (1.12)     15.8031 (1.12)     15.8031 (1.12)     0.0000 (1.0)      15.8031 (1.12)     0.0000 (1.0)           0;0  0.0633 (0.89)          1           1
test_data_status_all_flags-data-changed[3.10.0]     16.2647 (1.15)     16.2647 (1.15)     16.2647 (1.15)     0.0000 (1.0)      16.2647 (1.15)     0.0000 (1.0)           0;0  0.0615 (0.87)          1           1
test_data_status_all_flags-data-changed[3.53.2]     16.2378 (1.15)     16.2378 (1.15)     16.2378 (1.15)     0.0000 (1.0)      16.2378 (1.15)     0.0000 (1.0)           0;0  0.0616 (0.87)          1           1
test_data_status_all_flags-data-changed[main]       14.1316 (1.0)      14.1316 (1.0)      14.1316 (1.0)      0.0000 (1.0)      14.1316 (1.0)      0.0000 (1.0)           0;0  0.0708 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     15.6672 (1.12)     15.6672 (1.12)     15.6672 (1.12)     0.0000 (1.0)      15.6672 (1.12)     0.0000 (1.0)           0;0  0.0638 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     16.2715 (1.16)     16.2715 (1.16)     16.2715 (1.16)     0.0000 (1.0)      16.2715 (1.16)     0.0000 (1.0)           0;0  0.0615 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     16.1966 (1.16)     16.1966 (1.16)     16.1966 (1.16)     0.0000 (1.0)      16.1966 (1.16)     0.0000 (1.0)           0;0  0.0617 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[main]       13.9958 (1.0)      13.9958 (1.0)      13.9958 (1.0)      0.0000 (1.0)      13.9958 (1.0)      0.0000 (1.0)           0;0  0.0715 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     31.2504 (1.87)     31.2504 (1.87)     31.2504 (1.87)     0.0000 (1.0)      31.2504 (1.87)     0.0000 (1.0)           0;0  0.0320 (0.54)          1           1
test_data_status_all_flags-data-new[3.10.0]     32.1522 (1.92)     32.1522 (1.92)     32.1522 (1.92)     0.0000 (1.0)      32.1522 (1.92)     0.0000 (1.0)           0;0  0.0311 (0.52)          1           1
test_data_status_all_flags-data-new[3.53.2]     31.9792 (1.91)     31.9792 (1.91)     31.9792 (1.91)     0.0000 (1.0)      31.9792 (1.91)     0.0000 (1.0)           0;0  0.0313 (0.52)          1           1
test_data_status_all_flags-data-new[main]       16.7216 (1.0)      16.7216 (1.0)      16.7216 (1.0)      0.0000 (1.0)      16.7216 (1.0)      0.0000 (1.0)           0;0  0.0598 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     14.8721 (1.10)     14.8721 (1.10)     14.8721 (1.10)     0.0000 (1.0)      14.8721 (1.10)     0.0000 (1.0)           0;0  0.0672 (0.91)          1           1
test_data_status_all_flags-data-noop[3.10.0]     15.6526 (1.16)     15.6526 (1.16)     15.6526 (1.16)     0.0000 (1.0)      15.6526 (1.16)     0.0000 (1.0)           0;0  0.0639 (0.86)          1           1
test_data_status_all_flags-data-noop[3.53.2]     15.3881 (1.14)     15.3881 (1.14)     15.3881 (1.14)     0.0000 (1.0)      15.3881 (1.14)     0.0000 (1.0)           0;0  0.0650 (0.88)          1           1
test_data_status_all_flags-data-noop[main]       13.4975 (1.0)      13.4975 (1.0)      13.4975 (1.0)      0.0000 (1.0)      13.4975 (1.0)      0.0000 (1.0)           0;0  0.0741 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.6991 (2.73)     19.6991 (2.73)     19.6991 (2.73)     0.0000 (1.0)      19.6991 (2.73)     0.0000 (1.0)           0;0  0.0508 (0.37)          1           1
test_diff-diff[3.10.0]     20.6507 (2.86)     20.6507 (2.86)     20.6507 (2.86)     0.0000 (1.0)      20.6507 (2.86)     0.0000 (1.0)           0;0  0.0484 (0.35)          1           1
test_diff-diff[3.53.2]     20.6727 (2.87)     20.6727 (2.87)     20.6727 (2.87)     0.0000 (1.0)      20.6727 (2.87)     0.0000 (1.0)           0;0  0.0484 (0.35)          1           1
test_diff-diff[main]        7.2148 (1.0)       7.2148 (1.0)       7.2148 (1.0)      0.0000 (1.0)       7.2148 (1.0)      0.0000 (1.0)           0;0  0.1386 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1402 (1.75)     6.1402 (1.75)     6.1402 (1.75)     0.0000 (1.0)      6.1402 (1.75)     0.0000 (1.0)           0;0  0.1629 (0.57)          1           1
test_diff-diff-changed[3.10.0]     6.8356 (1.95)     6.8356 (1.95)     6.8356 (1.95)     0.0000 (1.0)      6.8356 (1.95)     0.0000 (1.0)           0;0  0.1463 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.5337 (1.58)     5.5337 (1.58)     5.5337 (1.58)     0.0000 (1.0)      5.5337 (1.58)     0.0000 (1.0)           0;0  0.1807 (0.63)          1           1
test_diff-diff-changed[main]       3.5040 (1.0)      3.5040 (1.0)      3.5040 (1.0)      0.0000 (1.0)      3.5040 (1.0)      0.0000 (1.0)           0;0  0.2854 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2539 (1.52)     5.2539 (1.52)     5.2539 (1.52)     0.0000 (1.0)      5.2539 (1.52)     0.0000 (1.0)           0;0  0.1903 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9759 (1.73)     5.9759 (1.73)     5.9759 (1.73)     0.0000 (1.0)      5.9759 (1.73)     0.0000 (1.0)           0;0  0.1673 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5627 (1.61)     5.5627 (1.61)     5.5627 (1.61)     0.0000 (1.0)      5.5627 (1.61)     0.0000 (1.0)           0;0  0.1798 (0.62)          1           1
test_diff-diff-changed-noop[main]       3.4554 (1.0)      3.4554 (1.0)      3.4554 (1.0)      0.0000 (1.0)      3.4554 (1.0)      0.0000 (1.0)           0;0  0.2894 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2279 (1.20)     4.2279 (1.20)     4.2279 (1.20)     0.0000 (1.0)      4.2279 (1.20)     0.0000 (1.0)           0;0  0.2365 (0.83)          1           1
test_diff-diff-noop[3.10.0]     4.7042 (1.33)     4.7042 (1.33)     4.7042 (1.33)     0.0000 (1.0)      4.7042 (1.33)     0.0000 (1.0)           0;0  0.2126 (0.75)          1           1
test_diff-diff-noop[3.53.2]     5.5353 (1.57)     5.5353 (1.57)     5.5353 (1.57)     0.0000 (1.0)      5.5353 (1.57)     0.0000 (1.0)           0;0  0.1807 (0.64)          1           1
test_diff-diff-noop[main]       3.5297 (1.0)      3.5297 (1.0)      3.5297 (1.0)      0.0000 (1.0)      3.5297 (1.0)      0.0000 (1.0)           0;0  0.2833 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        994.5411 (1.0)         994.5411 (1.0)         994.5411 (1.0)      0.0000 (1.0)         994.5411 (1.0)      0.0000 (1.0)           0;0  1.0055 (1.0)           1           1
test_exp_show-exp[3.10.0]     14,238.2518 (14.32)    14,238.2518 (14.32)    14,238.2518 (14.32)    0.0000 (1.0)      14,238.2518 (14.32)    0.0000 (1.0)           0;0  0.0702 (0.07)          1           1
test_exp_show-exp[3.53.2]      9,125.2922 (9.18)      9,125.2922 (9.18)      9,125.2922 (9.18)     0.0000 (1.0)       9,125.2922 (9.18)     0.0000 (1.0)           0;0  0.1096 (0.11)          1           1
test_exp_show-exp[main]       13,745.3055 (13.82)    13,745.3055 (13.82)    13,745.3055 (13.82)    0.0000 (1.0)      13,745.3055 (13.82)    0.0000 (1.0)           0;0  0.0728 (0.07)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.2492 (2.89)     67.2492 (2.89)     67.2492 (2.89)     0.0000 (1.0)      67.2492 (2.89)     0.0000 (1.0)           0;0  0.0149 (0.35)          1           1
test_fetch-fetch[3.10.0]     72.2168 (3.11)     72.2168 (3.11)     72.2168 (3.11)     0.0000 (1.0)      72.2168 (3.11)     0.0000 (1.0)           0;0  0.0138 (0.32)          1           1
test_fetch-fetch[3.53.2]     35.6330 (1.53)     35.6330 (1.53)     35.6330 (1.53)     0.0000 (1.0)      35.6330 (1.53)     0.0000 (1.0)           0;0  0.0281 (0.65)          1           1
test_fetch-fetch[main]       23.2354 (1.0)      23.2354 (1.0)      23.2354 (1.0)      0.0000 (1.0)      23.2354 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7963 (1.01)     2.7963 (1.01)     2.7963 (1.01)     0.0000 (1.0)      2.7963 (1.01)     0.0000 (1.0)           0;0  0.3576 (0.99)          1           1
test_gc-gc[3.10.0]     2.9461 (1.06)     2.9461 (1.06)     2.9461 (1.06)     0.0000 (1.0)      2.9461 (1.06)     0.0000 (1.0)           0;0  0.3394 (0.94)          1           1
test_gc-gc[3.53.2]     2.8631 (1.03)     2.8631 (1.03)     2.8631 (1.03)     0.0000 (1.0)      2.8631 (1.03)     0.0000 (1.0)           0;0  0.3493 (0.97)          1           1
test_gc-gc[main]       2.7764 (1.0)      2.7764 (1.0)      2.7764 (1.0)      0.0000 (1.0)      2.7764 (1.0)      0.0000 (1.0)           0;0  0.3602 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     128.5086 (2.68)     128.5086 (2.68)     128.5086 (2.68)     0.0000 (1.0)      128.5086 (2.68)     0.0000 (1.0)           0;0  0.0078 (0.37)          1           1
test_get-get[3.10.0]     155.9440 (3.26)     155.9440 (3.26)     155.9440 (3.26)     0.0000 (1.0)      155.9440 (3.26)     0.0000 (1.0)           0;0  0.0064 (0.31)          1           1
test_get-get[3.53.2]     136.1451 (2.84)     136.1451 (2.84)     136.1451 (2.84)     0.0000 (1.0)      136.1451 (2.84)     0.0000 (1.0)           0;0  0.0073 (0.35)          1           1
test_get-get[main]        47.8926 (1.0)       47.8926 (1.0)       47.8926 (1.0)      0.0000 (1.0)       47.8926 (1.0)      0.0000 (1.0)           0;0  0.0209 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.9811 (2.68)     44.9811 (2.68)     44.9811 (2.68)     0.0000 (1.0)      44.9811 (2.68)     0.0000 (1.0)           0;0  0.0222 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.7702 (2.84)     47.7702 (2.84)     47.7702 (2.84)     0.0000 (1.0)      47.7702 (2.84)     0.0000 (1.0)           0;0  0.0209 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.9011 (1.01)     16.9011 (1.01)     16.9011 (1.01)     0.0000 (1.0)      16.9011 (1.01)     0.0000 (1.0)           0;0  0.0592 (0.99)          1           1
test_get_url-get-url[main]       16.8062 (1.0)      16.8062 (1.0)      16.8062 (1.0)      0.0000 (1.0)      16.8062 (1.0)      0.0000 (1.0)           0;0  0.0595 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.5382 (1.02)     133.6904 (1.0)      129.0397 (1.00)     1.1871 (1.0)      128.7987 (1.01)     1.1291 (1.0)          20;4  7.7496 (1.00)        100           1
test_help---help[3.10.0]     125.5933 (1.0)      149.0022 (1.11)     128.5225 (1.0)      3.1547 (2.66)     127.6065 (1.0)      1.9563 (1.73)          8;8  7.7807 (1.0)         100           1
test_help---help[3.53.2]     127.4644 (1.01)     164.4628 (1.23)     131.1627 (1.02)     4.2776 (3.60)     130.1162 (1.02)     2.4745 (2.19)          8;8  7.6241 (0.98)        100           1
test_help---help[main]       128.5078 (1.02)     147.7584 (1.11)     130.8837 (1.02)     2.8801 (2.43)     129.9951 (1.02)     1.4444 (1.28)         9;11  7.6404 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     232.9097 (3.00)     232.9097 (3.00)     232.9097 (3.00)     0.0000 (1.0)      232.9097 (3.00)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     264.8905 (3.41)     264.8905 (3.41)     264.8905 (3.41)     0.0000 (1.0)      264.8905 (3.41)     0.0000 (1.0)           0;0  0.0038 (0.29)          1           1
test_import-import[main]        77.6404 (1.0)       77.6404 (1.0)       77.6404 (1.0)      0.0000 (1.0)       77.6404 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     160.1501 (3.43)     160.1501 (3.43)     160.1501 (3.43)     0.0000 (1.0)      160.1501 (3.43)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_import_url-import-url[3.10.0]     163.1907 (3.49)     163.1907 (3.49)     163.1907 (3.49)     0.0000 (1.0)      163.1907 (3.49)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.53.2]     121.7925 (2.61)     121.7925 (2.61)     121.7925 (2.61)     0.0000 (1.0)      121.7925 (2.61)     0.0000 (1.0)           0;0  0.0082 (0.38)          1           1
test_import_url-import-url[main]        46.7504 (1.0)       46.7504 (1.0)       46.7504 (1.0)      0.0000 (1.0)       46.7504 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     411.6896 (1.02)     442.2534 (1.01)     422.2410 (1.02)      6.7605 (1.03)     420.8868 (1.02)     8.3023 (1.09)         29;3  2.3683 (0.98)        100           1
test_init-init[3.10.0]     422.9232 (1.05)     458.7589 (1.05)     437.4631 (1.05)      6.5367 (1.0)      437.0788 (1.06)     8.9579 (1.18)         30;1  2.2859 (0.95)        100           1
test_init-init[3.53.2]     403.0064 (1.0)      438.8681 (1.0)      419.1157 (1.01)      6.7655 (1.04)     418.5920 (1.01)     7.9348 (1.04)         29;3  2.3860 (0.99)        100           1
test_init-init[main]       404.4374 (1.00)     519.3196 (1.18)     415.5647 (1.0)      15.7003 (2.40)     412.6885 (1.0)      7.6127 (1.0)           4;4  2.4064 (1.0)         100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     553.6613 (1.01)     553.6613 (1.01)     553.6613 (1.01)     0.0000 (1.0)      553.6613 (1.01)     0.0000 (1.0)           0;0  1.8062 (0.99)          1           1
test_list-list[3.10.0]     653.2063 (1.19)     653.2063 (1.19)     653.2063 (1.19)     0.0000 (1.0)      653.2063 (1.19)     0.0000 (1.0)           0;0  1.5309 (0.84)          1           1
test_list-list[3.53.2]     548.5311 (1.0)      548.5311 (1.0)      548.5311 (1.0)      0.0000 (1.0)      548.5311 (1.0)      0.0000 (1.0)           0;0  1.8231 (1.0)           1           1
test_list-list[main]       550.0586 (1.00)     550.0586 (1.00)     550.0586 (1.00)     0.0000 (1.0)      550.0586 (1.00)     0.0000 (1.0)           0;0  1.8180 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     419.8745 (1.10)     419.8745 (1.10)     419.8745 (1.10)     0.0000 (1.0)      419.8745 (1.10)     0.0000 (1.0)           0;0  2.3817 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     413.4968 (1.08)     413.4968 (1.08)     413.4968 (1.08)     0.0000 (1.0)      413.4968 (1.08)     0.0000 (1.0)           0;0  2.4184 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     383.3367 (1.0)      383.3367 (1.0)      383.3367 (1.0)      0.0000 (1.0)      383.3367 (1.0)      0.0000 (1.0)           0;0  2.6087 (1.0)           1           1
test_list-list-dvc-only[main]       396.4341 (1.03)     396.4341 (1.03)     396.4341 (1.03)     0.0000 (1.0)      396.4341 (1.03)     0.0000 (1.0)           0;0  2.5225 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7532 (1.06)     2.7532 (1.06)     2.7532 (1.06)     0.0000 (1.0)      2.7532 (1.06)     0.0000 (1.0)           0;0  0.3632 (0.95)          1           1
test_list-list-recursive[3.10.0]     2.6664 (1.02)     2.6664 (1.02)     2.6664 (1.02)     0.0000 (1.0)      2.6664 (1.02)     0.0000 (1.0)           0;0  0.3750 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.6373 (1.01)     2.6373 (1.01)     2.6373 (1.01)     0.0000 (1.0)      2.6373 (1.01)     0.0000 (1.0)           0;0  0.3792 (0.99)          1           1
test_list-list-recursive[main]       2.6063 (1.0)      2.6063 (1.0)      2.6063 (1.0)      0.0000 (1.0)      2.6063 (1.0)      0.0000 (1.0)           0;0  0.3837 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     423.2294 (1.09)     423.2294 (1.09)     423.2294 (1.09)     0.0000 (1.0)      423.2294 (1.09)     0.0000 (1.0)           0;0  2.3628 (0.91)          1           1
test_list-list-shallow[3.10.0]     404.4174 (1.05)     404.4174 (1.05)     404.4174 (1.05)     0.0000 (1.0)      404.4174 (1.05)     0.0000 (1.0)           0;0  2.4727 (0.96)          1           1
test_list-list-shallow[3.53.2]     387.0858 (1.00)     387.0858 (1.00)     387.0858 (1.00)     0.0000 (1.0)      387.0858 (1.00)     0.0000 (1.0)           0;0  2.5834 (1.00)          1           1
test_list-list-shallow[main]       386.5370 (1.0)      386.5370 (1.0)      386.5370 (1.0)      0.0000 (1.0)      386.5370 (1.0)      0.0000 (1.0)           0;0  2.5871 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.9864 (2.94)     12.9864 (2.94)     12.9864 (2.94)     0.0000 (1.0)      12.9864 (2.94)     0.0000 (1.0)           0;0  0.0770 (0.34)          1           1
test_partial_add-add[3.10.0]     13.1994 (2.99)     13.1994 (2.99)     13.1994 (2.99)     0.0000 (1.0)      13.1994 (2.99)     0.0000 (1.0)           0;0  0.0758 (0.33)          1           1
test_partial_add-add[3.53.2]     11.7628 (2.66)     11.7628 (2.66)     11.7628 (2.66)     0.0000 (1.0)      11.7628 (2.66)     0.0000 (1.0)           0;0  0.0850 (0.38)          1           1
test_partial_add-add[main]        4.4183 (1.0)       4.4183 (1.0)       4.4183 (1.0)      0.0000 (1.0)       4.4183 (1.0)      0.0000 (1.0)           0;0  0.2263 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     87.1437 (4.17)     87.1437 (4.17)     87.1437 (4.17)     0.0000 (1.0)      87.1437 (4.17)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     88.5070 (4.24)     88.5070 (4.24)     88.5070 (4.24)     0.0000 (1.0)      88.5070 (4.24)     0.0000 (1.0)           0;0  0.0113 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     79.7822 (3.82)     79.7822 (3.82)     79.7822 (3.82)     0.0000 (1.0)      79.7822 (3.82)     0.0000 (1.0)           0;0  0.0125 (0.26)          1           1
test_partial_add-add-partial[main]       20.8985 (1.0)      20.8985 (1.0)      20.8985 (1.0)      0.0000 (1.0)      20.8985 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.8146 (1.0)      4.8146 (1.0)      4.8146 (1.0)      0.0000 (1.0)      4.8146 (1.0)      0.0000 (1.0)           0;0  0.2077 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.0987 (1.27)     6.0987 (1.27)     6.0987 (1.27)     0.0000 (1.0)      6.0987 (1.27)     0.0000 (1.0)           0;0  0.1640 (0.79)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1799 (1.49)     7.1799 (1.49)     7.1799 (1.49)     0.0000 (1.0)      7.1799 (1.49)     0.0000 (1.0)           0;0  0.1393 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       7.0258 (1.46)     7.0258 (1.46)     7.0258 (1.46)     0.0000 (1.0)      7.0258 (1.46)     0.0000 (1.0)           0;0  0.1423 (0.69)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5884 (1.0)      2.5884 (1.0)      2.5884 (1.0)      0.0000 (1.0)      2.5884 (1.0)      0.0000 (1.0)           0;0  0.3863 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8062 (1.47)     3.8062 (1.47)     3.8062 (1.47)     0.0000 (1.0)      3.8062 (1.47)     0.0000 (1.0)           0;0  0.2627 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.7684 (1.46)     3.7684 (1.46)     3.7684 (1.46)     0.0000 (1.0)      3.7684 (1.46)     0.0000 (1.0)           0;0  0.2654 (0.69)          1           1
test_partial_add-gc-noop[main]       3.8710 (1.50)     3.8710 (1.50)     3.8710 (1.50)     0.0000 (1.0)      3.8710 (1.50)     0.0000 (1.0)           0;0  0.2583 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7926 (2.05)     7.7926 (2.05)     7.7926 (2.05)     0.0000 (1.0)      7.7926 (2.05)     0.0000 (1.0)           0;0  0.1283 (0.49)          1           1
test_partial_add-push[3.10.0]     6.9538 (1.83)     6.9538 (1.83)     6.9538 (1.83)     0.0000 (1.0)      6.9538 (1.83)     0.0000 (1.0)           0;0  0.1438 (0.55)          1           1
test_partial_add-push[3.53.2]     3.7994 (1.0)      3.7994 (1.0)      3.7994 (1.0)      0.0000 (1.0)      3.7994 (1.0)      0.0000 (1.0)           0;0  0.2632 (1.0)           1           1
test_partial_add-push[main]       3.8268 (1.01)     3.8268 (1.01)     3.8268 (1.01)     0.0000 (1.0)      3.8268 (1.01)     0.0000 (1.0)           0;0  0.2613 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     46.0689 (2.19)     46.0689 (2.19)     46.0689 (2.19)     0.0000 (1.0)      46.0689 (2.19)     0.0000 (1.0)           0;0  0.0217 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     40.7922 (1.94)     40.7922 (1.94)     40.7922 (1.94)     0.0000 (1.0)      40.7922 (1.94)     0.0000 (1.0)           0;0  0.0245 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.2840 (1.01)     21.2840 (1.01)     21.2840 (1.01)     0.0000 (1.0)      21.2840 (1.01)     0.0000 (1.0)           0;0  0.0470 (0.99)          1           1
test_partial_add-push-partial[main]       21.0029 (1.0)      21.0029 (1.0)      21.0029 (1.0)      0.0000 (1.0)      21.0029 (1.0)      0.0000 (1.0)           0;0  0.0476 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     92.9494 (3.92)     92.9494 (3.92)     92.9494 (3.92)     0.0000 (1.0)      92.9494 (3.92)     0.0000 (1.0)           0;0  0.0108 (0.25)          1           1
test_partial_remove-add[3.10.0]     91.5236 (3.86)     91.5236 (3.86)     91.5236 (3.86)     0.0000 (1.0)      91.5236 (3.86)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_partial_remove-add[3.53.2]     82.7510 (3.49)     82.7510 (3.49)     82.7510 (3.49)     0.0000 (1.0)      82.7510 (3.49)     0.0000 (1.0)           0;0  0.0121 (0.29)          1           1
test_partial_remove-add[main]       23.6865 (1.0)      23.6865 (1.0)      23.6865 (1.0)      0.0000 (1.0)      23.6865 (1.0)      0.0000 (1.0)           0;0  0.0422 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     50.8371 (13.63)    50.8371 (13.63)    50.8371 (13.63)    0.0000 (1.0)      50.8371 (13.63)    0.0000 (1.0)           0;0  0.0197 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     50.9844 (13.67)    50.9844 (13.67)    50.9844 (13.67)    0.0000 (1.0)      50.9844 (13.67)    0.0000 (1.0)           0;0  0.0196 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     46.5385 (12.48)    46.5385 (12.48)    46.5385 (12.48)    0.0000 (1.0)      46.5385 (12.48)    0.0000 (1.0)           0;0  0.0215 (0.08)          1           1
test_partial_remove-add-update[main]        3.7298 (1.0)       3.7298 (1.0)       3.7298 (1.0)      0.0000 (1.0)       3.7298 (1.0)      0.0000 (1.0)           0;0  0.2681 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5138 (1.0)      2.5138 (1.0)      2.5138 (1.0)      0.0000 (1.0)      2.5138 (1.0)      0.0000 (1.0)           0;0  0.3978 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6031 (1.43)     3.6031 (1.43)     3.6031 (1.43)     0.0000 (1.0)      3.6031 (1.43)     0.0000 (1.0)           0;0  0.2775 (0.70)          1           1
test_partial_remove-gc[3.53.2]     3.6658 (1.46)     3.6658 (1.46)     3.6658 (1.46)     0.0000 (1.0)      3.6658 (1.46)     0.0000 (1.0)           0;0  0.2728 (0.69)          1           1
test_partial_remove-gc[main]       3.5932 (1.43)     3.5932 (1.43)     3.5932 (1.43)     0.0000 (1.0)      3.5932 (1.43)     0.0000 (1.0)           0;0  0.2783 (0.70)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1014 (1.0)      5.1014 (1.0)      5.1014 (1.0)      0.0000 (1.0)      5.1014 (1.0)      0.0000 (1.0)           0;0  0.1960 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.2830 (1.23)     6.2830 (1.23)     6.2830 (1.23)     0.0000 (1.0)      6.2830 (1.23)     0.0000 (1.0)           0;0  0.1592 (0.81)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8526 (1.34)     6.8526 (1.34)     6.8526 (1.34)     0.0000 (1.0)      6.8526 (1.34)     0.0000 (1.0)           0;0  0.1459 (0.74)          1           1
test_partial_remove-gc-cloud[main]       6.8166 (1.34)     6.8166 (1.34)     6.8166 (1.34)     0.0000 (1.0)      6.8166 (1.34)     0.0000 (1.0)           0;0  0.1467 (0.75)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.0364 (2.32)     52.0364 (2.32)     52.0364 (2.32)     0.0000 (1.0)      52.0364 (2.32)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.1682 (2.06)     46.1682 (2.06)     46.1682 (2.06)     0.0000 (1.0)      46.1682 (2.06)     0.0000 (1.0)           0;0  0.0217 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.0808 (1.03)     23.0808 (1.03)     23.0808 (1.03)     0.0000 (1.0)      23.0808 (1.03)     0.0000 (1.0)           0;0  0.0433 (0.97)          1           1
test_partial_remove-push[main]       22.4136 (1.0)      22.4136 (1.0)      22.4136 (1.0)      0.0000 (1.0)      22.4136 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.7775 (1.0)      3.7775 (1.0)      3.7775 (1.0)      0.0000 (1.0)      3.7775 (1.0)      0.0000 (1.0)           0;0  0.2647 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.9222 (1.04)     3.9222 (1.04)     3.9222 (1.04)     0.0000 (1.0)      3.9222 (1.04)     0.0000 (1.0)           0;0  0.2550 (0.96)          1           1
test_partial_remove-push-update[3.53.2]     7.2018 (1.91)     7.2018 (1.91)     7.2018 (1.91)     0.0000 (1.0)      7.2018 (1.91)     0.0000 (1.0)           0;0  0.1389 (0.52)          1           1
test_partial_remove-push-update[main]       7.2150 (1.91)     7.2150 (1.91)     7.2150 (1.91)     0.0000 (1.0)      7.2150 (1.91)     0.0000 (1.0)           0;0  0.1386 (0.52)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     485.3980 (1.0)      487.6406 (1.0)      486.4757 (1.0)      0.9263 (1.0)      486.2589 (1.0)      1.5433 (1.0)           2;0  2.0556 (1.0)           5           3
test_plots-plots-diff[3.10.0]     878.2143 (1.81)     893.1634 (1.83)     884.0539 (1.82)     6.2332 (6.73)     882.0496 (1.81)     9.8769 (6.40)          1;0  1.1312 (0.55)          5           3
test_plots-plots-diff[3.53.2]     806.1364 (1.66)     813.8538 (1.67)     810.0887 (1.67)     3.1644 (3.42)     808.9633 (1.66)     4.9533 (3.21)          2;0  1.2344 (0.60)          5           3
test_plots-plots-diff[main]       801.3554 (1.65)     809.6449 (1.66)     804.8587 (1.65)     3.4594 (3.73)     805.7195 (1.66)     5.3676 (3.48)          2;0  1.2425 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       502.7658 (1.0)        506.0960 (1.0)        504.2557 (1.0)      1.3850 (1.0)        503.8429 (1.0)       2.2924 (1.0)           2;0  1.9831 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,109.7657 (2.21)     1,126.3290 (2.23)     1,116.5823 (2.21)     8.6709 (6.26)     1,110.5954 (2.20)     15.6996 (6.85)          2;0  0.8956 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       875.6868 (1.74)       882.2782 (1.74)       878.7697 (1.74)     2.5575 (1.85)       878.0044 (1.74)      3.6896 (1.61)          2;0  1.1380 (0.57)          5           3
test_plots-plots-diff-json[main]         874.9979 (1.74)       885.6691 (1.75)       880.7042 (1.75)     3.9429 (2.85)       880.5278 (1.75)      4.9235 (2.15)          2;0  1.1355 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     402.1339 (1.0)      408.2247 (1.0)      405.4862 (1.0)       2.3800 (1.0)      405.3037 (1.0)       3.5266 (1.20)          2;0  2.4662 (1.0)           5           3
test_plots-plots-show[3.10.0]     711.2723 (1.77)     717.5502 (1.76)     715.0269 (1.76)      2.3833 (1.00)     715.6852 (1.77)      2.9356 (1.0)           2;0  1.3985 (0.57)          5           3
test_plots-plots-show[3.53.2]     682.0574 (1.70)     691.4998 (1.69)     686.5513 (1.69)      3.4782 (1.46)     686.7167 (1.69)      4.3420 (1.48)          2;0  1.4566 (0.59)          5           3
test_plots-plots-show[main]       685.8878 (1.71)     779.6814 (1.91)     705.8352 (1.74)     41.3072 (17.36)    688.6226 (1.70)     25.7662 (8.78)          1;1  1.4168 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     416.2439 (1.0)      422.5450 (1.0)      419.5409 (1.0)      2.6950 (1.0)      420.2804 (1.0)      4.6695 (1.13)          2;0  2.3836 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     836.6110 (2.01)     846.1963 (2.00)     843.3151 (2.01)     4.0137 (1.49)     845.3243 (2.01)     4.8867 (1.18)          1;0  1.1858 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     729.6751 (1.75)     740.2355 (1.75)     733.0154 (1.75)     4.4947 (1.67)     730.5725 (1.74)     6.0807 (1.47)          1;0  1.3642 (0.57)          5           3
test_plots-plots-show-json[main]       731.4004 (1.76)     738.7035 (1.75)     735.1473 (1.75)     2.8624 (1.06)     734.2885 (1.75)     4.1494 (1.0)           2;0  1.3603 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.3146 (2.34)     52.3146 (2.34)     52.3146 (2.34)     0.0000 (1.0)      52.3146 (2.34)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_push-push[3.10.0]     47.8213 (2.14)     47.8213 (2.14)     47.8213 (2.14)     0.0000 (1.0)      47.8213 (2.14)     0.0000 (1.0)           0;0  0.0209 (0.47)          1           1
test_push-push[3.53.2]     22.7187 (1.02)     22.7187 (1.02)     22.7187 (1.02)     0.0000 (1.0)      22.7187 (1.02)     0.0000 (1.0)           0;0  0.0440 (0.98)          1           1
test_push-push[main]       22.3606 (1.0)      22.3606 (1.0)      22.3606 (1.0)      0.0000 (1.0)      22.3606 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.6639 (2.79)     65.6639 (2.79)     65.6639 (2.79)     0.0000 (1.0)      65.6639 (2.79)     0.0000 (1.0)           0;0  0.0152 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.9900 (3.01)     70.9900 (3.01)     70.9900 (3.01)     0.0000 (1.0)      70.9900 (3.01)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.4094 (1.50)     35.4094 (1.50)     35.4094 (1.50)     0.0000 (1.0)      35.4094 (1.50)     0.0000 (1.0)           0;0  0.0282 (0.67)          1           1
test_sharing-fetch[main]       23.5496 (1.0)      23.5496 (1.0)      23.5496 (1.0)      0.0000 (1.0)      23.5496 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2058 (1.0)      1.2058 (1.0)      1.2058 (1.0)      0.0000 (1.0)      1.2058 (1.0)      0.0000 (1.0)           0;0  0.8293 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5849 (2.97)     3.5849 (2.97)     3.5849 (2.97)     0.0000 (1.0)      3.5849 (2.97)     0.0000 (1.0)           0;0  0.2790 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6790 (4.71)     5.6790 (4.71)     5.6790 (4.71)     0.0000 (1.0)      5.6790 (4.71)     0.0000 (1.0)           0;0  0.1761 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8445 (4.85)     5.8445 (4.85)     5.8445 (4.85)     0.0000 (1.0)      5.8445 (4.85)     0.0000 (1.0)           0;0  0.1711 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.8696 (2.29)     51.8696 (2.29)     51.8696 (2.29)     0.0000 (1.0)      51.8696 (2.29)     0.0000 (1.0)           0;0  0.0193 (0.44)          1           1
test_sharing-push[3.10.0]     46.4364 (2.05)     46.4364 (2.05)     46.4364 (2.05)     0.0000 (1.0)      46.4364 (2.05)     0.0000 (1.0)           0;0  0.0215 (0.49)          1           1
test_sharing-push[3.53.2]     23.3384 (1.03)     23.3384 (1.03)     23.3384 (1.03)     0.0000 (1.0)      23.3384 (1.03)     0.0000 (1.0)           0;0  0.0428 (0.97)          1           1
test_sharing-push[main]       22.6809 (1.0)      22.6809 (1.0)      22.6809 (1.0)      0.0000 (1.0)      22.6809 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0435 (1.02)     2.0435 (1.02)     2.0435 (1.02)     0.0000 (1.0)      2.0435 (1.02)     0.0000 (1.0)           0;0  0.4894 (0.98)          1           1
test_sharing-push-noop[3.10.0]     2.0108 (1.0)      2.0108 (1.0)      2.0108 (1.0)      0.0000 (1.0)      2.0108 (1.0)      0.0000 (1.0)           0;0  0.4973 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0138 (2.99)     6.0138 (2.99)     6.0138 (2.99)     0.0000 (1.0)      6.0138 (2.99)     0.0000 (1.0)           0;0  0.1663 (0.33)          1           1
test_sharing-push-noop[main]       6.1956 (3.08)     6.1956 (3.08)     6.1956 (3.08)     0.0000 (1.0)      6.1956 (3.08)     0.0000 (1.0)           0;0  0.1614 (0.32)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.7555 (3.89)     20.7555 (3.89)     20.7555 (3.89)     0.0000 (1.0)      20.7555 (3.89)     0.0000 (1.0)           0;0  0.0482 (0.26)          1           1
test_status-status[3.10.0]     21.0998 (3.95)     21.0998 (3.95)     21.0998 (3.95)     0.0000 (1.0)      21.0998 (3.95)     0.0000 (1.0)           0;0  0.0474 (0.25)          1           1
test_status-status[3.53.2]     19.0286 (3.56)     19.0286 (3.56)     19.0286 (3.56)     0.0000 (1.0)      19.0286 (3.56)     0.0000 (1.0)           0;0  0.0526 (0.28)          1           1
test_status-status[main]        5.3394 (1.0)       5.3394 (1.0)       5.3394 (1.0)      0.0000 (1.0)       5.3394 (1.0)      0.0000 (1.0)           0;0  0.1873 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.5905 (1.72)     4.5905 (1.72)     4.5905 (1.72)     0.0000 (1.0)      4.5905 (1.72)     0.0000 (1.0)           0;0  0.2178 (0.58)          1           1
test_status-status-changed[3.10.0]     5.0181 (1.88)     5.0181 (1.88)     5.0181 (1.88)     0.0000 (1.0)      5.0181 (1.88)     0.0000 (1.0)           0;0  0.1993 (0.53)          1           1
test_status-status-changed[3.53.2]     4.7020 (1.76)     4.7020 (1.76)     4.7020 (1.76)     0.0000 (1.0)      4.7020 (1.76)     0.0000 (1.0)           0;0  0.2127 (0.57)          1           1
test_status-status-changed[main]       2.6705 (1.0)      2.6705 (1.0)      2.6705 (1.0)      0.0000 (1.0)      2.6705 (1.0)      0.0000 (1.0)           0;0  0.3745 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.5152 (1.77)     4.5152 (1.77)     4.5152 (1.77)     0.0000 (1.0)      4.5152 (1.77)     0.0000 (1.0)           0;0  0.2215 (0.56)          1           1
test_status-status-changed-noop[3.10.0]     4.8588 (1.91)     4.8588 (1.91)     4.8588 (1.91)     0.0000 (1.0)      4.8588 (1.91)     0.0000 (1.0)           0;0  0.2058 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.6760 (1.84)     4.6760 (1.84)     4.6760 (1.84)     0.0000 (1.0)      4.6760 (1.84)     0.0000 (1.0)           0;0  0.2139 (0.54)          1           1
test_status-status-changed-noop[main]       2.5460 (1.0)      2.5460 (1.0)      2.5460 (1.0)      0.0000 (1.0)      2.5460 (1.0)      0.0000 (1.0)           0;0  0.3928 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7297 (1.83)     4.7297 (1.83)     4.7297 (1.83)     0.0000 (1.0)      4.7297 (1.83)     0.0000 (1.0)           0;0  0.2114 (0.55)          1           1
test_status-status-noop[3.10.0]     4.8174 (1.87)     4.8174 (1.87)     4.8174 (1.87)     0.0000 (1.0)      4.8174 (1.87)     0.0000 (1.0)           0;0  0.2076 (0.54)          1           1
test_status-status-noop[3.53.2]     4.6784 (1.81)     4.6784 (1.81)     4.6784 (1.81)     0.0000 (1.0)      4.6784 (1.81)     0.0000 (1.0)           0;0  0.2137 (0.55)          1           1
test_status-status-noop[main]       2.5798 (1.0)      2.5798 (1.0)      2.5798 (1.0)      0.0000 (1.0)      2.5798 (1.0)      0.0000 (1.0)           0;0  0.3876 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     161.9748 (3.42)     161.9748 (3.42)     161.9748 (3.42)     0.0000 (1.0)      161.9748 (3.42)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.10.0]     165.6128 (3.50)     165.6128 (3.50)     165.6128 (3.50)     0.0000 (1.0)      165.6128 (3.50)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.53.2]     124.4315 (2.63)     124.4315 (2.63)     124.4315 (2.63)     0.0000 (1.0)      124.4315 (2.63)     0.0000 (1.0)           0;0  0.0080 (0.38)          1           1
test_update-import-url[main]        47.3042 (1.0)       47.3042 (1.0)       47.3042 (1.0)      0.0000 (1.0)       47.3042 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     143.0504 (4.01)     143.0504 (4.01)     143.0504 (4.01)     0.0000 (1.0)      143.0504 (4.01)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.10.0]     146.5187 (4.11)     146.5187 (4.11)     146.5187 (4.11)     0.0000 (1.0)      146.5187 (4.11)     0.0000 (1.0)           0;0  0.0068 (0.24)          1           1
test_update-update[3.53.2]     113.0372 (3.17)     113.0372 (3.17)     113.0372 (3.17)     0.0000 (1.0)      113.0372 (3.17)     0.0000 (1.0)           0;0  0.0088 (0.32)          1           1
test_update-update[main]        35.6722 (1.0)       35.6722 (1.0)       35.6722 (1.0)      0.0000 (1.0)       35.6722 (1.0)      0.0000 (1.0)           0;0  0.0280 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.5399 (2.04)     15.5399 (2.04)     15.5399 (2.04)     0.0000 (1.0)      15.5399 (2.04)     0.0000 (1.0)           0;0  0.0644 (0.49)          1           1
test_update-update-noop[3.10.0]     16.3253 (2.14)     16.3253 (2.14)     16.3253 (2.14)     0.0000 (1.0)      16.3253 (2.14)     0.0000 (1.0)           0;0  0.0613 (0.47)          1           1
test_update-update-noop[3.53.2]     16.0952 (2.11)     16.0952 (2.11)     16.0952 (2.11)     0.0000 (1.0)      16.0952 (2.11)     0.0000 (1.0)           0;0  0.0621 (0.47)          1           1
test_update-update-noop[main]        7.6268 (1.0)       7.6268 (1.0)       7.6268 (1.0)      0.0000 (1.0)       7.6268 (1.0)      0.0000 (1.0)           0;0  0.1311 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean