Wed Jun  4 06:40:52 UTC 2025
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     3.4621 (1.69)     3.4621 (1.69)     3.4621 (1.69)     0.0000 (1.0)      3.4621 (1.69)     0.0000 (1.0)           0;0  0.2888 (0.59)          1           1
test_add_copy-add[3.10.0]     3.6023 (1.76)     3.6023 (1.76)     3.6023 (1.76)     0.0000 (1.0)      3.6023 (1.76)     0.0000 (1.0)           0;0  0.2776 (0.57)          1           1
test_add_copy-add[3.53.2]     3.1734 (1.55)     3.1734 (1.55)     3.1734 (1.55)     0.0000 (1.0)      3.1734 (1.55)     0.0000 (1.0)           0;0  0.3151 (0.65)          1           1
test_add_copy-add[main]       2.0523 (1.0)      2.0523 (1.0)      2.0523 (1.0)      0.0000 (1.0)      2.0523 (1.0)      0.0000 (1.0)           0;0  0.4873 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     1.3405 (2.13)     1.3405 (2.13)     1.3405 (2.13)     0.0000 (1.0)      1.3405 (2.13)     0.0000 (1.0)           0;0  0.7460 (0.47)          1           1
test_add_copy-add-noop[3.10.0]     1.3734 (2.19)     1.3734 (2.19)     1.3734 (2.19)     0.0000 (1.0)      1.3734 (2.19)     0.0000 (1.0)           0;0  0.7281 (0.46)          1           1
test_add_copy-add-noop[3.53.2]     1.2922 (2.06)     1.2922 (2.06)     1.2922 (2.06)     0.0000 (1.0)      1.2922 (2.06)     0.0000 (1.0)           0;0  0.7739 (0.49)          1           1
test_add_copy-add-noop[main]       0.6280 (1.0)      0.6280 (1.0)      0.6280 (1.0)      0.0000 (1.0)      0.6280 (1.0)      0.0000 (1.0)           0;0  1.5924 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     2.8263 (1.58)     2.8263 (1.58)     2.8263 (1.58)     0.0000 (1.0)      2.8263 (1.58)     0.0000 (1.0)           0;0  0.3538 (0.63)          1           1
test_add_hardlink-add[3.10.0]     2.9221 (1.63)     2.9221 (1.63)     2.9221 (1.63)     0.0000 (1.0)      2.9221 (1.63)     0.0000 (1.0)           0;0  0.3422 (0.61)          1           1
test_add_hardlink-add[3.53.2]     2.6551 (1.49)     2.6551 (1.49)     2.6551 (1.49)     0.0000 (1.0)      2.6551 (1.49)     0.0000 (1.0)           0;0  0.3766 (0.67)          1           1
test_add_hardlink-add[main]       1.7873 (1.0)      1.7873 (1.0)      1.7873 (1.0)      0.0000 (1.0)      1.7873 (1.0)      0.0000 (1.0)           0;0  0.5595 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     1.5547 (2.40)     1.5547 (2.40)     1.5547 (2.40)     0.0000 (1.0)      1.5547 (2.40)     0.0000 (1.0)           0;0  0.6432 (0.42)          1           1
test_add_hardlink-add-noop[3.10.0]     1.5607 (2.41)     1.5607 (2.41)     1.5607 (2.41)     0.0000 (1.0)      1.5607 (2.41)     0.0000 (1.0)           0;0  0.6408 (0.42)          1           1
test_add_hardlink-add-noop[3.53.2]     1.5015 (2.32)     1.5015 (2.32)     1.5015 (2.32)     0.0000 (1.0)      1.5015 (2.32)     0.0000 (1.0)           0;0  0.6660 (0.43)          1           1
test_add_hardlink-add-noop[main]       0.6485 (1.0)      0.6485 (1.0)      0.6485 (1.0)      0.0000 (1.0)      0.6485 (1.0)      0.0000 (1.0)           0;0  1.5421 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     2.9134 (1.26)     2.9134 (1.26)     2.9134 (1.26)     0.0000 (1.0)      2.9134 (1.26)     0.0000 (1.0)           0;0  0.3432 (0.79)          1           1
test_add_symlink-add[3.10.0]     3.0761 (1.33)     3.0761 (1.33)     3.0761 (1.33)     0.0000 (1.0)      3.0761 (1.33)     0.0000 (1.0)           0;0  0.3251 (0.75)          1           1
test_add_symlink-add[3.53.2]     2.7984 (1.21)     2.7984 (1.21)     2.7984 (1.21)     0.0000 (1.0)      2.7984 (1.21)     0.0000 (1.0)           0;0  0.3573 (0.82)          1           1
test_add_symlink-add[main]       2.3052 (1.0)      2.3052 (1.0)      2.3052 (1.0)      0.0000 (1.0)      2.3052 (1.0)      0.0000 (1.0)           0;0  0.4338 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     1.7315 (2.54)     1.7315 (2.54)     1.7315 (2.54)     0.0000 (1.0)      1.7315 (2.54)     0.0000 (1.0)           0;0  0.5775 (0.39)          1           1
test_add_symlink-add-noop[3.10.0]     1.8510 (2.72)     1.8510 (2.72)     1.8510 (2.72)     0.0000 (1.0)      1.8510 (2.72)     0.0000 (1.0)           0;0  0.5402 (0.37)          1           1
test_add_symlink-add-noop[3.53.2]     1.7458 (2.57)     1.7458 (2.57)     1.7458 (2.57)     0.0000 (1.0)      1.7458 (2.57)     0.0000 (1.0)           0;0  0.5728 (0.39)          1           1
test_add_symlink-add-noop[main]       0.6806 (1.0)      0.6806 (1.0)      0.6806 (1.0)      0.0000 (1.0)      0.6806 (1.0)      0.0000 (1.0)           0;0  1.4694 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     1.9961 (1.21)     1.9961 (1.21)     1.9961 (1.21)     0.0000 (1.0)      1.9961 (1.21)     0.0000 (1.0)           0;0  0.5010 (0.83)          1           1
test_checkout_copy-checkout[3.10.0]     2.7032 (1.64)     2.7032 (1.64)     2.7032 (1.64)     0.0000 (1.0)      2.7032 (1.64)     0.0000 (1.0)           0;0  0.3699 (0.61)          1           1
test_checkout_copy-checkout[3.53.2]     1.6509 (1.0)      1.6509 (1.0)      1.6509 (1.0)      0.0000 (1.0)      1.6509 (1.0)      0.0000 (1.0)           0;0  0.6057 (1.0)           1           1
test_checkout_copy-checkout[main]       1.8743 (1.14)     1.8743 (1.14)     1.8743 (1.14)     0.0000 (1.0)      1.8743 (1.14)     0.0000 (1.0)           0;0  0.5335 (0.88)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     536.2224 (1.16)     536.2224 (1.16)     536.2224 (1.16)     0.0000 (1.0)      536.2224 (1.16)     0.0000 (1.0)           0;0  1.8649 (0.87)          1           1
test_checkout_copy-checkout-noop[3.10.0]     558.5326 (1.20)     558.5326 (1.20)     558.5326 (1.20)     0.0000 (1.0)      558.5326 (1.20)     0.0000 (1.0)           0;0  1.7904 (0.83)          1           1
test_checkout_copy-checkout-noop[3.53.2]     535.5187 (1.15)     535.5187 (1.15)     535.5187 (1.15)     0.0000 (1.0)      535.5187 (1.15)     0.0000 (1.0)           0;0  1.8673 (0.87)          1           1
test_checkout_copy-checkout-noop[main]       463.9711 (1.0)      463.9711 (1.0)      463.9711 (1.0)      0.0000 (1.0)      463.9711 (1.0)      0.0000 (1.0)           0;0  2.1553 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     649.7397 (1.25)     649.7397 (1.25)     649.7397 (1.25)     0.0000 (1.0)      649.7397 (1.25)     0.0000 (1.0)           0;0  1.5391 (0.80)          1           1
test_checkout_copy-checkout-update[3.10.0]     623.3092 (1.20)     623.3092 (1.20)     623.3092 (1.20)     0.0000 (1.0)      623.3092 (1.20)     0.0000 (1.0)           0;0  1.6043 (0.83)          1           1
test_checkout_copy-checkout-update[3.53.2]     590.7539 (1.14)     590.7539 (1.14)     590.7539 (1.14)     0.0000 (1.0)      590.7539 (1.14)     0.0000 (1.0)           0;0  1.6928 (0.88)          1           1
test_checkout_copy-checkout-update[main]       518.6636 (1.0)      518.6636 (1.0)      518.6636 (1.0)      0.0000 (1.0)      518.6636 (1.0)      0.0000 (1.0)           0;0  1.9280 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     1.3154 (1.13)     1.3154 (1.13)     1.3154 (1.13)     0.0000 (1.0)      1.3154 (1.13)     0.0000 (1.0)           0;0  0.7603 (0.89)          1           1
test_checkout_hardlink-checkout[3.10.0]     1.2871 (1.11)     1.2871 (1.11)     1.2871 (1.11)     0.0000 (1.0)      1.2871 (1.11)     0.0000 (1.0)           0;0  0.7770 (0.90)          1           1
test_checkout_hardlink-checkout[3.53.2]     1.1647 (1.0)      1.1647 (1.0)      1.1647 (1.0)      0.0000 (1.0)      1.1647 (1.0)      0.0000 (1.0)           0;0  0.8586 (1.0)           1           1
test_checkout_hardlink-checkout[main]       1.3891 (1.19)     1.3891 (1.19)     1.3891 (1.19)     0.0000 (1.0)      1.3891 (1.19)     0.0000 (1.0)           0;0  0.7199 (0.84)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     542.5810 (1.15)     542.5810 (1.15)     542.5810 (1.15)     0.0000 (1.0)      542.5810 (1.15)     0.0000 (1.0)           0;0  1.8430 (0.87)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     554.6081 (1.17)     554.6081 (1.17)     554.6081 (1.17)     0.0000 (1.0)      554.6081 (1.17)     0.0000 (1.0)           0;0  1.8031 (0.85)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     537.2884 (1.13)     537.2884 (1.13)     537.2884 (1.13)     0.0000 (1.0)      537.2884 (1.13)     0.0000 (1.0)           0;0  1.8612 (0.88)          1           1
test_checkout_hardlink-checkout-noop[main]       473.5228 (1.0)      473.5228 (1.0)      473.5228 (1.0)      0.0000 (1.0)      473.5228 (1.0)      0.0000 (1.0)           0;0  2.1118 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     677.7863 (1.31)     677.7863 (1.31)     677.7863 (1.31)     0.0000 (1.0)      677.7863 (1.31)     0.0000 (1.0)           0;0  1.4754 (0.76)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     611.0332 (1.18)     611.0332 (1.18)     611.0332 (1.18)     0.0000 (1.0)      611.0332 (1.18)     0.0000 (1.0)           0;0  1.6366 (0.85)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     587.0330 (1.13)     587.0330 (1.13)     587.0330 (1.13)     0.0000 (1.0)      587.0330 (1.13)     0.0000 (1.0)           0;0  1.7035 (0.88)          1           1
test_checkout_hardlink-checkout-update[main]       517.7176 (1.0)      517.7176 (1.0)      517.7176 (1.0)      0.0000 (1.0)      517.7176 (1.0)      0.0000 (1.0)           0;0  1.9316 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     1.4830 (1.19)     1.4830 (1.19)     1.4830 (1.19)     0.0000 (1.0)      1.4830 (1.19)     0.0000 (1.0)           0;0  0.6743 (0.84)          1           1
test_checkout_symlink-checkout[3.10.0]     1.4127 (1.13)     1.4127 (1.13)     1.4127 (1.13)     0.0000 (1.0)      1.4127 (1.13)     0.0000 (1.0)           0;0  0.7078 (0.89)          1           1
test_checkout_symlink-checkout[3.53.2]     1.2510 (1.0)      1.2510 (1.0)      1.2510 (1.0)      0.0000 (1.0)      1.2510 (1.0)      0.0000 (1.0)           0;0  0.7993 (1.0)           1           1
test_checkout_symlink-checkout[main]       1.4941 (1.19)     1.4941 (1.19)     1.4941 (1.19)     0.0000 (1.0)      1.4941 (1.19)     0.0000 (1.0)           0;0  0.6693 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     574.5949 (1.13)     574.5949 (1.13)     574.5949 (1.13)     0.0000 (1.0)      574.5949 (1.13)     0.0000 (1.0)           0;0  1.7404 (0.88)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     636.1959 (1.25)     636.1959 (1.25)     636.1959 (1.25)     0.0000 (1.0)      636.1959 (1.25)     0.0000 (1.0)           0;0  1.5718 (0.80)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     582.7232 (1.15)     582.7232 (1.15)     582.7232 (1.15)     0.0000 (1.0)      582.7232 (1.15)     0.0000 (1.0)           0;0  1.7161 (0.87)          1           1
test_checkout_symlink-checkout-noop[main]       507.0454 (1.0)      507.0454 (1.0)      507.0454 (1.0)      0.0000 (1.0)      507.0454 (1.0)      0.0000 (1.0)           0;0  1.9722 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     726.0381 (1.24)     726.0381 (1.24)     726.0381 (1.24)     0.0000 (1.0)      726.0381 (1.24)     0.0000 (1.0)           0;0  1.3773 (0.81)          1           1
test_checkout_symlink-checkout-update[3.10.0]     690.0901 (1.18)     690.0901 (1.18)     690.0901 (1.18)     0.0000 (1.0)      690.0901 (1.18)     0.0000 (1.0)           0;0  1.4491 (0.85)          1           1
test_checkout_symlink-checkout-update[3.53.2]     665.6107 (1.13)     665.6107 (1.13)     665.6107 (1.13)     0.0000 (1.0)      665.6107 (1.13)     0.0000 (1.0)           0;0  1.5024 (0.88)          1           1
test_checkout_symlink-checkout-update[main]       586.9883 (1.0)      586.9883 (1.0)      586.9883 (1.0)      0.0000 (1.0)      586.9883 (1.0)      0.0000 (1.0)           0;0  1.7036 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     628.2845 (1.29)     628.2845 (1.29)     628.2845 (1.29)     0.0000 (1.0)      628.2845 (1.29)     0.0000 (1.0)           0;0  1.5916 (0.77)          1           1
test_data_status-data-changed[3.10.0]     600.7552 (1.24)     600.7552 (1.24)     600.7552 (1.24)     0.0000 (1.0)      600.7552 (1.24)     0.0000 (1.0)           0;0  1.6646 (0.81)          1           1
test_data_status-data-changed[3.53.2]     548.6540 (1.13)     548.6540 (1.13)     548.6540 (1.13)     0.0000 (1.0)      548.6540 (1.13)     0.0000 (1.0)           0;0  1.8226 (0.89)          1           1
test_data_status-data-changed[main]       486.2428 (1.0)      486.2428 (1.0)      486.2428 (1.0)      0.0000 (1.0)      486.2428 (1.0)      0.0000 (1.0)           0;0  2.0566 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     619.4753 (1.28)     619.4753 (1.28)     619.4753 (1.28)     0.0000 (1.0)      619.4753 (1.28)     0.0000 (1.0)           0;0  1.6143 (0.78)          1           1
test_data_status-data-changed-noop[3.10.0]     601.7537 (1.24)     601.7537 (1.24)     601.7537 (1.24)     0.0000 (1.0)      601.7537 (1.24)     0.0000 (1.0)           0;0  1.6618 (0.80)          1           1
test_data_status-data-changed-noop[3.53.2]     550.9653 (1.14)     550.9653 (1.14)     550.9653 (1.14)     0.0000 (1.0)      550.9653 (1.14)     0.0000 (1.0)           0;0  1.8150 (0.88)          1           1
test_data_status-data-changed-noop[main]       484.0745 (1.0)      484.0745 (1.0)      484.0745 (1.0)      0.0000 (1.0)      484.0745 (1.0)      0.0000 (1.0)           0;0  2.0658 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     1.5214 (1.68)     1.5214 (1.68)     1.5214 (1.68)     0.0000 (1.0)      1.5214 (1.68)     0.0000 (1.0)           0;0  0.6573 (0.60)          1           1
test_data_status-data-new[3.10.0]     1.5202 (1.68)     1.5202 (1.68)     1.5202 (1.68)     0.0000 (1.0)      1.5202 (1.68)     0.0000 (1.0)           0;0  0.6578 (0.60)          1           1
test_data_status-data-new[3.53.2]     1.3645 (1.50)     1.3645 (1.50)     1.3645 (1.50)     0.0000 (1.0)      1.3645 (1.50)     0.0000 (1.0)           0;0  0.7329 (0.66)          1           1
test_data_status-data-new[main]       0.9071 (1.0)      0.9071 (1.0)      0.9071 (1.0)      0.0000 (1.0)      0.9071 (1.0)      0.0000 (1.0)           0;0  1.1024 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     623.3187 (1.29)     623.3187 (1.29)     623.3187 (1.29)     0.0000 (1.0)      623.3187 (1.29)     0.0000 (1.0)           0;0  1.6043 (0.77)          1           1
test_data_status-data-noop[3.10.0]     609.7999 (1.27)     609.7999 (1.27)     609.7999 (1.27)     0.0000 (1.0)      609.7999 (1.27)     0.0000 (1.0)           0;0  1.6399 (0.79)          1           1
test_data_status-data-noop[3.53.2]     554.1077 (1.15)     554.1077 (1.15)     554.1077 (1.15)     0.0000 (1.0)      554.1077 (1.15)     0.0000 (1.0)           0;0  1.8047 (0.87)          1           1
test_data_status-data-noop[main]       481.4643 (1.0)      481.4643 (1.0)      481.4643 (1.0)      0.0000 (1.0)      481.4643 (1.0)      0.0000 (1.0)           0;0  2.0770 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     947.8251 (1.16)     947.8251 (1.16)     947.8251 (1.16)     0.0000 (1.0)      947.8251 (1.16)     0.0000 (1.0)           0;0  1.0550 (0.86)          1           1
test_data_status_all_flags-data-changed[3.10.0]     932.5530 (1.14)     932.5530 (1.14)     932.5530 (1.14)     0.0000 (1.0)      932.5530 (1.14)     0.0000 (1.0)           0;0  1.0723 (0.87)          1           1
test_data_status_all_flags-data-changed[3.53.2]     894.7420 (1.10)     894.7420 (1.10)     894.7420 (1.10)     0.0000 (1.0)      894.7420 (1.10)     0.0000 (1.0)           0;0  1.1176 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       815.0403 (1.0)      815.0403 (1.0)      815.0403 (1.0)      0.0000 (1.0)      815.0403 (1.0)      0.0000 (1.0)           0;0  1.2269 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     966.5294 (1.20)     966.5294 (1.20)     966.5294 (1.20)     0.0000 (1.0)      966.5294 (1.20)     0.0000 (1.0)           0;0  1.0346 (0.83)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     954.0775 (1.18)     954.0775 (1.18)     954.0775 (1.18)     0.0000 (1.0)      954.0775 (1.18)     0.0000 (1.0)           0;0  1.0481 (0.84)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     872.6093 (1.08)     872.6093 (1.08)     872.6093 (1.08)     0.0000 (1.0)      872.6093 (1.08)     0.0000 (1.0)           0;0  1.1460 (0.92)          1           1
test_data_status_all_flags-data-changed-noop[main]       805.1823 (1.0)      805.1823 (1.0)      805.1823 (1.0)      0.0000 (1.0)      805.1823 (1.0)      0.0000 (1.0)           0;0  1.2420 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     1.7667 (1.39)     1.7667 (1.39)     1.7667 (1.39)     0.0000 (1.0)      1.7667 (1.39)     0.0000 (1.0)           0;0  0.5660 (0.72)          1           1
test_data_status_all_flags-data-new[3.10.0]     1.8330 (1.44)     1.8330 (1.44)     1.8330 (1.44)     0.0000 (1.0)      1.8330 (1.44)     0.0000 (1.0)           0;0  0.5456 (0.69)          1           1
test_data_status_all_flags-data-new[3.53.2]     1.6596 (1.31)     1.6596 (1.31)     1.6596 (1.31)     0.0000 (1.0)      1.6596 (1.31)     0.0000 (1.0)           0;0  0.6026 (0.77)          1           1
test_data_status_all_flags-data-new[main]       1.2705 (1.0)      1.2705 (1.0)      1.2705 (1.0)      0.0000 (1.0)      1.2705 (1.0)      0.0000 (1.0)           0;0  0.7871 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     966.4216 (1.23)     966.4216 (1.23)     966.4216 (1.23)     0.0000 (1.0)      966.4216 (1.23)     0.0000 (1.0)           0;0  1.0347 (0.81)          1           1
test_data_status_all_flags-data-noop[3.10.0]     894.0057 (1.14)     894.0057 (1.14)     894.0057 (1.14)     0.0000 (1.0)      894.0057 (1.14)     0.0000 (1.0)           0;0  1.1186 (0.88)          1           1
test_data_status_all_flags-data-noop[3.53.2]     869.7879 (1.11)     869.7879 (1.11)     869.7879 (1.11)     0.0000 (1.0)      869.7879 (1.11)     0.0000 (1.0)           0;0  1.1497 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       784.7470 (1.0)      784.7470 (1.0)      784.7470 (1.0)      0.0000 (1.0)      784.7470 (1.0)      0.0000 (1.0)           0;0  1.2743 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     1.4146 (1.27)     1.4146 (1.27)     1.4146 (1.27)     0.0000 (1.0)      1.4146 (1.27)     0.0000 (1.0)           0;0  0.7069 (0.78)          1           1
test_diff-diff[3.10.0]     1.5382 (1.39)     1.5382 (1.39)     1.5382 (1.39)     0.0000 (1.0)      1.5382 (1.39)     0.0000 (1.0)           0;0  0.6501 (0.72)          1           1
test_diff-diff[3.53.2]     1.3939 (1.26)     1.3939 (1.26)     1.3939 (1.26)     0.0000 (1.0)      1.3939 (1.26)     0.0000 (1.0)           0;0  0.7174 (0.80)          1           1
test_diff-diff[main]       1.1095 (1.0)      1.1095 (1.0)      1.1095 (1.0)      0.0000 (1.0)      1.1095 (1.0)      0.0000 (1.0)           0;0  0.9013 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     697.9762 (1.23)     697.9762 (1.23)     697.9762 (1.23)     0.0000 (1.0)      697.9762 (1.23)     0.0000 (1.0)           0;0  1.4327 (0.81)          1           1
test_diff-diff-changed[3.10.0]     716.7018 (1.26)     716.7018 (1.26)     716.7018 (1.26)     0.0000 (1.0)      716.7018 (1.26)     0.0000 (1.0)           0;0  1.3953 (0.79)          1           1
test_diff-diff-changed[3.53.2]     626.4431 (1.10)     626.4431 (1.10)     626.4431 (1.10)     0.0000 (1.0)      626.4431 (1.10)     0.0000 (1.0)           0;0  1.5963 (0.91)          1           1
test_diff-diff-changed[main]       568.2836 (1.0)      568.2836 (1.0)      568.2836 (1.0)      0.0000 (1.0)      568.2836 (1.0)      0.0000 (1.0)           0;0  1.7597 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     660.3095 (1.17)     660.3095 (1.17)     660.3095 (1.17)     0.0000 (1.0)      660.3095 (1.17)     0.0000 (1.0)           0;0  1.5144 (0.86)          1           1
test_diff-diff-changed-noop[3.10.0]     683.7577 (1.21)     683.7577 (1.21)     683.7577 (1.21)     0.0000 (1.0)      683.7577 (1.21)     0.0000 (1.0)           0;0  1.4625 (0.83)          1           1
test_diff-diff-changed-noop[3.53.2]     616.9873 (1.09)     616.9873 (1.09)     616.9873 (1.09)     0.0000 (1.0)      616.9873 (1.09)     0.0000 (1.0)           0;0  1.6208 (0.92)          1           1
test_diff-diff-changed-noop[main]       565.6192 (1.0)      565.6192 (1.0)      565.6192 (1.0)      0.0000 (1.0)      565.6192 (1.0)      0.0000 (1.0)           0;0  1.7680 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     654.4796 (1.20)     654.4796 (1.20)     654.4796 (1.20)     0.0000 (1.0)      654.4796 (1.20)     0.0000 (1.0)           0;0  1.5279 (0.83)          1           1
test_diff-diff-noop[3.10.0]     653.1010 (1.20)     653.1010 (1.20)     653.1010 (1.20)     0.0000 (1.0)      653.1010 (1.20)     0.0000 (1.0)           0;0  1.5312 (0.84)          1           1
test_diff-diff-noop[3.53.2]     624.2793 (1.14)     624.2793 (1.14)     624.2793 (1.14)     0.0000 (1.0)      624.2793 (1.14)     0.0000 (1.0)           0;0  1.6018 (0.88)          1           1
test_diff-diff-noop[main]       546.2602 (1.0)      546.2602 (1.0)      546.2602 (1.0)      0.0000 (1.0)      546.2602 (1.0)      0.0000 (1.0)           0;0  1.8306 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0054 (1.0)      1.0054 (1.0)      1.0054 (1.0)      0.0000 (1.0)      1.0054 (1.0)      0.0000 (1.0)           0;0  0.9946 (1.0)           1           1
test_exp_show-exp[3.10.0]     7.1360 (7.10)     7.1360 (7.10)     7.1360 (7.10)     0.0000 (1.0)      7.1360 (7.10)     0.0000 (1.0)           0;0  0.1401 (0.14)          1           1
test_exp_show-exp[3.53.2]     3.9254 (3.90)     3.9254 (3.90)     3.9254 (3.90)     0.0000 (1.0)      3.9254 (3.90)     0.0000 (1.0)           0;0  0.2548 (0.26)          1           1
test_exp_show-exp[main]       5.3449 (5.32)     5.3449 (5.32)     5.3449 (5.32)     0.0000 (1.0)      5.3449 (5.32)     0.0000 (1.0)           0;0  0.1871 (0.19)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     2.5878 (1.76)     2.5878 (1.76)     2.5878 (1.76)     0.0000 (1.0)      2.5878 (1.76)     0.0000 (1.0)           0;0  0.3864 (0.57)          1           1
test_fetch-fetch[3.10.0]     3.0489 (2.07)     3.0489 (2.07)     3.0489 (2.07)     0.0000 (1.0)      3.0489 (2.07)     0.0000 (1.0)           0;0  0.3280 (0.48)          1           1
test_fetch-fetch[3.53.2]     1.8652 (1.27)     1.8652 (1.27)     1.8652 (1.27)     0.0000 (1.0)      1.8652 (1.27)     0.0000 (1.0)           0;0  0.5361 (0.79)          1           1
test_fetch-fetch[main]       1.4713 (1.0)      1.4713 (1.0)      1.4713 (1.0)      0.0000 (1.0)      1.4713 (1.0)      0.0000 (1.0)           0;0  0.6797 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     602.3736 (1.04)     602.3736 (1.04)     602.3736 (1.04)     0.0000 (1.0)      602.3736 (1.04)     0.0000 (1.0)           0;0  1.6601 (0.96)          1           1
test_gc-gc[3.10.0]     712.5759 (1.23)     712.5759 (1.23)     712.5759 (1.23)     0.0000 (1.0)      712.5759 (1.23)     0.0000 (1.0)           0;0  1.4034 (0.81)          1           1
test_gc-gc[3.53.2]     617.5724 (1.06)     617.5724 (1.06)     617.5724 (1.06)     0.0000 (1.0)      617.5724 (1.06)     0.0000 (1.0)           0;0  1.6192 (0.94)          1           1
test_gc-gc[main]       580.3566 (1.0)      580.3566 (1.0)      580.3566 (1.0)      0.0000 (1.0)      580.3566 (1.0)      0.0000 (1.0)           0;0  1.7231 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     4.5060 (2.06)     4.5060 (2.06)     4.5060 (2.06)     0.0000 (1.0)      4.5060 (2.06)     0.0000 (1.0)           0;0  0.2219 (0.49)          1           1
test_get-get[3.10.0]     5.4006 (2.47)     5.4006 (2.47)     5.4006 (2.47)     0.0000 (1.0)      5.4006 (2.47)     0.0000 (1.0)           0;0  0.1852 (0.40)          1           1
test_get-get[3.53.2]     4.5022 (2.06)     4.5022 (2.06)     4.5022 (2.06)     0.0000 (1.0)      4.5022 (2.06)     0.0000 (1.0)           0;0  0.2221 (0.49)          1           1
test_get-get[main]       2.1871 (1.0)      2.1871 (1.0)      2.1871 (1.0)      0.0000 (1.0)      2.1871 (1.0)      0.0000 (1.0)           0;0  0.4572 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     1.8969 (1.87)     1.8969 (1.87)     1.8969 (1.87)     0.0000 (1.0)      1.8969 (1.87)     0.0000 (1.0)           0;0  0.5272 (0.53)          1           1
test_get_url-get-url[3.10.0]     2.0463 (2.02)     2.0463 (2.02)     2.0463 (2.02)     0.0000 (1.0)      2.0463 (2.02)     0.0000 (1.0)           0;0  0.4887 (0.49)          1           1
test_get_url-get-url[3.53.2]     1.0577 (1.05)     1.0577 (1.05)     1.0577 (1.05)     0.0000 (1.0)      1.0577 (1.05)     0.0000 (1.0)           0;0  0.9455 (0.96)          1           1
test_get_url-get-url[main]       1.0118 (1.0)      1.0118 (1.0)      1.0118 (1.0)      0.0000 (1.0)      1.0118 (1.0)      0.0000 (1.0)           0;0  0.9883 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.6299 (1.01)     138.1287 (1.02)     130.1358 (1.01)     1.5794 (1.41)     129.8555 (1.01)     1.7677 (1.31)         25;3  7.6843 (0.99)        100           1
test_help---help[3.10.0]     126.7263 (1.0)      136.0226 (1.01)     129.0689 (1.0)      1.3639 (1.22)     128.9274 (1.0)      1.5527 (1.15)         25;4  7.7478 (1.0)         100           1
test_help---help[3.53.2]     129.1661 (1.02)     138.1804 (1.02)     131.4130 (1.02)     1.4412 (1.29)     131.1962 (1.02)     1.3542 (1.0)          16;5  7.6096 (0.98)        100           1
test_help---help[main]       129.8182 (1.02)     135.2516 (1.0)      131.7304 (1.02)     1.1165 (1.0)      131.5766 (1.02)     1.5158 (1.12)         28;2  7.5913 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import-import': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     7.5850 (1.99)     7.5850 (1.99)     7.5850 (1.99)     0.0000 (1.0)      7.5850 (1.99)     0.0000 (1.0)           0;0  0.1318 (0.50)          1           1
test_import-import[3.10.0]     8.5663 (2.25)     8.5663 (2.25)     8.5663 (2.25)     0.0000 (1.0)      8.5663 (2.25)     0.0000 (1.0)           0;0  0.1167 (0.44)          1           1
test_import-import[main]       3.8082 (1.0)      3.8082 (1.0)      3.8082 (1.0)      0.0000 (1.0)      3.8082 (1.0)      0.0000 (1.0)           0;0  0.2626 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     5.9065 (2.06)     5.9065 (2.06)     5.9065 (2.06)     0.0000 (1.0)      5.9065 (2.06)     0.0000 (1.0)           0;0  0.1693 (0.49)          1           1
test_import_url-import-url[3.10.0]     6.1416 (2.14)     6.1416 (2.14)     6.1416 (2.14)     0.0000 (1.0)      6.1416 (2.14)     0.0000 (1.0)           0;0  0.1628 (0.47)          1           1
test_import_url-import-url[3.53.2]     4.7133 (1.64)     4.7133 (1.64)     4.7133 (1.64)     0.0000 (1.0)      4.7133 (1.64)     0.0000 (1.0)           0;0  0.2122 (0.61)          1           1
test_import_url-import-url[main]       2.8702 (1.0)      2.8702 (1.0)      2.8702 (1.0)      0.0000 (1.0)      2.8702 (1.0)      0.0000 (1.0)           0;0  0.3484 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     389.5169 (1.01)     430.9436 (1.02)     400.2871 (1.0)       8.3753 (1.66)     398.4985 (1.0)       9.5224 (2.14)         27;4  2.4982 (1.0)         100           1
test_init-init[3.10.0]     397.4432 (1.03)     421.7566 (1.0)      405.2999 (1.01)      5.0547 (1.0)      403.8426 (1.01)      4.4462 (1.0)          25;8  2.4673 (0.99)        100           1
test_init-init[3.53.2]     384.6628 (1.0)      478.9903 (1.14)     413.9147 (1.03)     15.9948 (3.16)     413.0588 (1.04)     21.4588 (4.83)         31;1  2.4160 (0.97)        100           1
test_init-init[main]       390.4779 (1.02)     463.7055 (1.10)     415.5108 (1.04)     10.8671 (2.15)     415.5084 (1.04)     14.0350 (3.16)         32;1  2.4067 (0.96)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     570.5828 (1.06)     570.5828 (1.06)     570.5828 (1.06)     0.0000 (1.0)      570.5828 (1.06)     0.0000 (1.0)           0;0  1.7526 (0.94)          1           1
test_list-list[3.10.0]     671.4068 (1.25)     671.4068 (1.25)     671.4068 (1.25)     0.0000 (1.0)      671.4068 (1.25)     0.0000 (1.0)           0;0  1.4894 (0.80)          1           1
test_list-list[3.53.2]     546.5182 (1.02)     546.5182 (1.02)     546.5182 (1.02)     0.0000 (1.0)      546.5182 (1.02)     0.0000 (1.0)           0;0  1.8298 (0.98)          1           1
test_list-list[main]       537.0573 (1.0)      537.0573 (1.0)      537.0573 (1.0)      0.0000 (1.0)      537.0573 (1.0)      0.0000 (1.0)           0;0  1.8620 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     425.1625 (1.10)     425.1625 (1.10)     425.1625 (1.10)     0.0000 (1.0)      425.1625 (1.10)     0.0000 (1.0)           0;0  2.3520 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     425.8296 (1.10)     425.8296 (1.10)     425.8296 (1.10)     0.0000 (1.0)      425.8296 (1.10)     0.0000 (1.0)           0;0  2.3484 (0.91)          1           1
test_list-list-dvc-only[3.53.2]     387.6799 (1.0)      387.6799 (1.0)      387.6799 (1.0)      0.0000 (1.0)      387.6799 (1.0)      0.0000 (1.0)           0;0  2.5794 (1.0)           1           1
test_list-list-dvc-only[main]       392.9543 (1.01)     392.9543 (1.01)     392.9543 (1.01)     0.0000 (1.0)      392.9543 (1.01)     0.0000 (1.0)           0;0  2.5448 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     480.5026 (1.05)     480.5026 (1.05)     480.5026 (1.05)     0.0000 (1.0)      480.5026 (1.05)     0.0000 (1.0)           0;0  2.0812 (0.95)          1           1
test_list-list-recursive[3.10.0]     495.0738 (1.08)     495.0738 (1.08)     495.0738 (1.08)     0.0000 (1.0)      495.0738 (1.08)     0.0000 (1.0)           0;0  2.0199 (0.92)          1           1
test_list-list-recursive[3.53.2]     461.5206 (1.01)     461.5206 (1.01)     461.5206 (1.01)     0.0000 (1.0)      461.5206 (1.01)     0.0000 (1.0)           0;0  2.1668 (0.99)          1           1
test_list-list-recursive[main]       457.7511 (1.0)      457.7511 (1.0)      457.7511 (1.0)      0.0000 (1.0)      457.7511 (1.0)      0.0000 (1.0)           0;0  2.1846 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     421.1185 (1.07)     421.1185 (1.07)     421.1185 (1.07)     0.0000 (1.0)      421.1185 (1.07)     0.0000 (1.0)           0;0  2.3746 (0.93)          1           1
test_list-list-shallow[3.10.0]     414.7031 (1.05)     414.7031 (1.05)     414.7031 (1.05)     0.0000 (1.0)      414.7031 (1.05)     0.0000 (1.0)           0;0  2.4114 (0.95)          1           1
test_list-list-shallow[3.53.2]     395.2286 (1.01)     395.2286 (1.01)     395.2286 (1.01)     0.0000 (1.0)      395.2286 (1.01)     0.0000 (1.0)           0;0  2.5302 (0.99)          1           1
test_list-list-shallow[main]       393.1887 (1.0)      393.1887 (1.0)      393.1887 (1.0)      0.0000 (1.0)      393.1887 (1.0)      0.0000 (1.0)           0;0  2.5433 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     2.0559 (1.27)     2.0559 (1.27)     2.0559 (1.27)     0.0000 (1.0)      2.0559 (1.27)     0.0000 (1.0)           0;0  0.4864 (0.79)          1           1
test_partial_add-add[3.10.0]     2.1999 (1.35)     2.1999 (1.35)     2.1999 (1.35)     0.0000 (1.0)      2.1999 (1.35)     0.0000 (1.0)           0;0  0.4546 (0.74)          1           1
test_partial_add-add[3.53.2]     1.9369 (1.19)     1.9369 (1.19)     1.9369 (1.19)     0.0000 (1.0)      1.9369 (1.19)     0.0000 (1.0)           0;0  0.5163 (0.84)          1           1
test_partial_add-add[main]       1.6239 (1.0)      1.6239 (1.0)      1.6239 (1.0)      0.0000 (1.0)      1.6239 (1.0)      0.0000 (1.0)           0;0  0.6158 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     2.7857 (2.82)     2.7857 (2.82)     2.7857 (2.82)     0.0000 (1.0)      2.7857 (2.82)     0.0000 (1.0)           0;0  0.3590 (0.35)          1           1
test_partial_add-add-partial[3.10.0]     2.8356 (2.87)     2.8356 (2.87)     2.8356 (2.87)     0.0000 (1.0)      2.8356 (2.87)     0.0000 (1.0)           0;0  0.3527 (0.35)          1           1
test_partial_add-add-partial[3.53.2]     2.5326 (2.56)     2.5326 (2.56)     2.5326 (2.56)     0.0000 (1.0)      2.5326 (2.56)     0.0000 (1.0)           0;0  0.3949 (0.39)          1           1
test_partial_add-add-partial[main]       0.9875 (1.0)      0.9875 (1.0)      0.9875 (1.0)      0.0000 (1.0)      0.9875 (1.0)      0.0000 (1.0)           0;0  1.0127 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     515.3896 (1.0)      515.3896 (1.0)      515.3896 (1.0)      0.0000 (1.0)      515.3896 (1.0)      0.0000 (1.0)           0;0  1.9403 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     559.8523 (1.09)     559.8523 (1.09)     559.8523 (1.09)     0.0000 (1.0)      559.8523 (1.09)     0.0000 (1.0)           0;0  1.7862 (0.92)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     568.3631 (1.10)     568.3631 (1.10)     568.3631 (1.10)     0.0000 (1.0)      568.3631 (1.10)     0.0000 (1.0)           0;0  1.7594 (0.91)          1           1
test_partial_add-gc-cloud-noop[main]       573.1992 (1.11)     573.1992 (1.11)     573.1992 (1.11)     0.0000 (1.0)      573.1992 (1.11)     0.0000 (1.0)           0;0  1.7446 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     468.0584 (1.0)      468.0584 (1.0)      468.0584 (1.0)      0.0000 (1.0)      468.0584 (1.0)      0.0000 (1.0)           0;0  2.1365 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     506.9685 (1.08)     506.9685 (1.08)     506.9685 (1.08)     0.0000 (1.0)      506.9685 (1.08)     0.0000 (1.0)           0;0  1.9725 (0.92)          1           1
test_partial_add-gc-noop[3.53.2]     488.4712 (1.04)     488.4712 (1.04)     488.4712 (1.04)     0.0000 (1.0)      488.4712 (1.04)     0.0000 (1.0)           0;0  2.0472 (0.96)          1           1
test_partial_add-gc-noop[main]       491.2022 (1.05)     491.2022 (1.05)     491.2022 (1.05)     0.0000 (1.0)      491.2022 (1.05)     0.0000 (1.0)           0;0  2.0358 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     1.2739 (1.31)     1.2739 (1.31)     1.2739 (1.31)     0.0000 (1.0)      1.2739 (1.31)     0.0000 (1.0)           0;0  0.7850 (0.77)          1           1
test_partial_add-push[3.10.0]     1.1613 (1.19)     1.1613 (1.19)     1.1613 (1.19)     0.0000 (1.0)      1.1613 (1.19)     0.0000 (1.0)           0;0  0.8611 (0.84)          1           1
test_partial_add-push[3.53.2]     1.0084 (1.03)     1.0084 (1.03)     1.0084 (1.03)     0.0000 (1.0)      1.0084 (1.03)     0.0000 (1.0)           0;0  0.9917 (0.97)          1           1
test_partial_add-push[main]       0.9757 (1.0)      0.9757 (1.0)      0.9757 (1.0)      0.0000 (1.0)      0.9757 (1.0)      0.0000 (1.0)           0;0  1.0249 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     1.3110 (1.24)     1.3110 (1.24)     1.3110 (1.24)     0.0000 (1.0)      1.3110 (1.24)     0.0000 (1.0)           0;0  0.7628 (0.81)          1           1
test_partial_add-push-partial[3.10.0]     1.3248 (1.25)     1.3248 (1.25)     1.3248 (1.25)     0.0000 (1.0)      1.3248 (1.25)     0.0000 (1.0)           0;0  0.7548 (0.80)          1           1
test_partial_add-push-partial[3.53.2]     1.0762 (1.02)     1.0762 (1.02)     1.0762 (1.02)     0.0000 (1.0)      1.0762 (1.02)     0.0000 (1.0)           0;0  0.9292 (0.98)          1           1
test_partial_add-push-partial[main]       1.0575 (1.0)      1.0575 (1.0)      1.0575 (1.0)      0.0000 (1.0)      1.0575 (1.0)      0.0000 (1.0)           0;0  0.9456 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     3.5116 (1.68)     3.5116 (1.68)     3.5116 (1.68)     0.0000 (1.0)      3.5116 (1.68)     0.0000 (1.0)           0;0  0.2848 (0.59)          1           1
test_partial_remove-add[3.10.0]     3.7091 (1.78)     3.7091 (1.78)     3.7091 (1.78)     0.0000 (1.0)      3.7091 (1.78)     0.0000 (1.0)           0;0  0.2696 (0.56)          1           1
test_partial_remove-add[3.53.2]     3.2307 (1.55)     3.2307 (1.55)     3.2307 (1.55)     0.0000 (1.0)      3.2307 (1.55)     0.0000 (1.0)           0;0  0.3095 (0.65)          1           1
test_partial_remove-add[main]       2.0874 (1.0)      2.0874 (1.0)      2.0874 (1.0)      0.0000 (1.0)      2.0874 (1.0)      0.0000 (1.0)           0;0  0.4791 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     1.4432 (2.35)     1.4432 (2.35)     1.4432 (2.35)     0.0000 (1.0)      1.4432 (2.35)     0.0000 (1.0)           0;0  0.6929 (0.43)          1           1
test_partial_remove-add-update[3.10.0]     1.4403 (2.35)     1.4403 (2.35)     1.4403 (2.35)     0.0000 (1.0)      1.4403 (2.35)     0.0000 (1.0)           0;0  0.6943 (0.43)          1           1
test_partial_remove-add-update[3.53.2]     1.3069 (2.13)     1.3069 (2.13)     1.3069 (2.13)     0.0000 (1.0)      1.3069 (2.13)     0.0000 (1.0)           0;0  0.7652 (0.47)          1           1
test_partial_remove-add-update[main]       0.6138 (1.0)      0.6138 (1.0)      0.6138 (1.0)      0.0000 (1.0)      0.6138 (1.0)      0.0000 (1.0)           0;0  1.6293 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     487.7779 (1.0)      487.7779 (1.0)      487.7779 (1.0)      0.0000 (1.0)      487.7779 (1.0)      0.0000 (1.0)           0;0  2.0501 (1.0)           1           1
test_partial_remove-gc[3.10.0]     528.9837 (1.08)     528.9837 (1.08)     528.9837 (1.08)     0.0000 (1.0)      528.9837 (1.08)     0.0000 (1.0)           0;0  1.8904 (0.92)          1           1
test_partial_remove-gc[3.53.2]     526.6036 (1.08)     526.6036 (1.08)     526.6036 (1.08)     0.0000 (1.0)      526.6036 (1.08)     0.0000 (1.0)           0;0  1.8990 (0.93)          1           1
test_partial_remove-gc[main]       514.2458 (1.05)     514.2458 (1.05)     514.2458 (1.05)     0.0000 (1.0)      514.2458 (1.05)     0.0000 (1.0)           0;0  1.9446 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     546.9392 (1.0)      546.9392 (1.0)      546.9392 (1.0)      0.0000 (1.0)      546.9392 (1.0)      0.0000 (1.0)           0;0  1.8284 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     619.4832 (1.13)     619.4832 (1.13)     619.4832 (1.13)     0.0000 (1.0)      619.4832 (1.13)     0.0000 (1.0)           0;0  1.6142 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     585.2030 (1.07)     585.2030 (1.07)     585.2030 (1.07)     0.0000 (1.0)      585.2030 (1.07)     0.0000 (1.0)           0;0  1.7088 (0.93)          1           1
test_partial_remove-gc-cloud[main]       578.9557 (1.06)     578.9557 (1.06)     578.9557 (1.06)     0.0000 (1.0)      578.9557 (1.06)     0.0000 (1.0)           0;0  1.7272 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     2.1083 (1.56)     2.1083 (1.56)     2.1083 (1.56)     0.0000 (1.0)      2.1083 (1.56)     0.0000 (1.0)           0;0  0.4743 (0.64)          1           1
test_partial_remove-push[3.10.0]     1.9056 (1.41)     1.9056 (1.41)     1.9056 (1.41)     0.0000 (1.0)      1.9056 (1.41)     0.0000 (1.0)           0;0  0.5248 (0.71)          1           1
test_partial_remove-push[3.53.2]     1.4120 (1.04)     1.4120 (1.04)     1.4120 (1.04)     0.0000 (1.0)      1.4120 (1.04)     0.0000 (1.0)           0;0  0.7082 (0.96)          1           1
test_partial_remove-push[main]       1.3538 (1.0)      1.3538 (1.0)      1.3538 (1.0)      0.0000 (1.0)      1.3538 (1.0)      0.0000 (1.0)           0;0  0.7387 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     511.6722 (1.03)     511.6722 (1.03)     511.6722 (1.03)     0.0000 (1.0)      511.6722 (1.03)     0.0000 (1.0)           0;0  1.9544 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     498.0537 (1.0)      498.0537 (1.0)      498.0537 (1.0)      0.0000 (1.0)      498.0537 (1.0)      0.0000 (1.0)           0;0  2.0078 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     800.1927 (1.61)     800.1927 (1.61)     800.1927 (1.61)     0.0000 (1.0)      800.1927 (1.61)     0.0000 (1.0)           0;0  1.2497 (0.62)          1           1
test_partial_remove-push-update[main]       772.4183 (1.55)     772.4183 (1.55)     772.4183 (1.55)     0.0000 (1.0)      772.4183 (1.55)     0.0000 (1.0)           0;0  1.2946 (0.64)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     488.1548 (1.0)      493.5709 (1.0)      490.7625 (1.0)       2.3681 (2.63)     490.1625 (1.0)       4.2207 (3.20)          2;0  2.0376 (1.0)           5           3
test_plots-plots-diff[3.10.0]     881.0137 (1.80)     907.5173 (1.84)     889.8092 (1.81)     10.5256 (11.70)    886.3267 (1.81)     11.9657 (9.06)          1;0  1.1238 (0.55)          5           3
test_plots-plots-diff[3.53.2]     792.2780 (1.62)     799.3594 (1.62)     795.1824 (1.62)      2.6979 (3.00)     794.6224 (1.62)      3.5016 (2.65)          2;0  1.2576 (0.62)          5           3
test_plots-plots-diff[main]       797.8396 (1.63)     800.1606 (1.62)     799.0986 (1.63)      0.8997 (1.0)      799.0367 (1.63)      1.3208 (1.0)           2;0  1.2514 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       506.1329 (1.0)        521.8622 (1.0)        512.4722 (1.0)      6.8326 (4.49)       509.7435 (1.0)      11.4981 (5.17)          1;0  1.9513 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,100.8162 (2.17)     1,110.9775 (2.13)     1,105.6266 (2.16)     4.4919 (2.95)     1,105.1173 (2.17)      8.2203 (3.69)          2;0  0.9045 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       870.8646 (1.72)       890.1646 (1.71)       879.1431 (1.72)     7.3867 (4.85)       879.0804 (1.72)     10.0910 (4.53)          2;0  1.1375 (0.58)          5           3
test_plots-plots-diff-json[main]         870.9918 (1.72)       874.8927 (1.68)       873.1055 (1.70)     1.5233 (1.0)        872.8532 (1.71)      2.2253 (1.0)           2;0  1.1453 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     406.7596 (1.0)      426.5419 (1.0)      415.2977 (1.0)      8.2279 (4.19)     411.6234 (1.0)      12.9878 (4.37)          2;0  2.4079 (1.0)           5           3
test_plots-plots-show[3.10.0]     768.6332 (1.89)     778.9042 (1.83)     773.0061 (1.86)     3.9416 (2.01)     771.4254 (1.87)      5.1074 (1.72)          2;0  1.2937 (0.54)          5           3
test_plots-plots-show[3.53.2]     681.7282 (1.68)     686.5834 (1.61)     684.4186 (1.65)     2.0516 (1.05)     684.8936 (1.66)      3.5094 (1.18)          2;0  1.4611 (0.61)          5           3
test_plots-plots-show[main]       681.9206 (1.68)     686.7875 (1.61)     684.8187 (1.65)     1.9621 (1.0)      685.3917 (1.67)      2.9698 (1.0)           2;0  1.4602 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     420.8423 (1.0)      429.3127 (1.0)      424.6298 (1.0)       3.0256 (3.14)     424.3644 (1.0)       2.4043 (2.27)          2;0  2.3550 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     843.3790 (2.00)     893.6090 (2.08)     864.8785 (2.04)     21.4234 (22.21)    856.6474 (2.02)     35.7935 (33.82)         2;0  1.1562 (0.49)          5           3
test_plots-plots-show-json[3.53.2]     727.2228 (1.73)     729.7995 (1.70)     728.2377 (1.71)      0.9647 (1.0)      728.0285 (1.72)      1.0585 (1.0)           2;0  1.3732 (0.58)          5           3
test_plots-plots-show-json[main]       729.5326 (1.73)     733.6763 (1.71)     730.8932 (1.72)      1.8190 (1.89)     729.8857 (1.72)      2.7252 (2.57)          1;0  1.3682 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     2.1917 (1.52)     2.1917 (1.52)     2.1917 (1.52)     0.0000 (1.0)      2.1917 (1.52)     0.0000 (1.0)           0;0  0.4563 (0.66)          1           1
test_push-push[3.10.0]     2.0695 (1.43)     2.0695 (1.43)     2.0695 (1.43)     0.0000 (1.0)      2.0695 (1.43)     0.0000 (1.0)           0;0  0.4832 (0.70)          1           1
test_push-push[3.53.2]     1.5055 (1.04)     1.5055 (1.04)     1.5055 (1.04)     0.0000 (1.0)      1.5055 (1.04)     0.0000 (1.0)           0;0  0.6642 (0.96)          1           1
test_push-push[main]       1.4449 (1.0)      1.4449 (1.0)      1.4449 (1.0)      0.0000 (1.0)      1.4449 (1.0)      0.0000 (1.0)           0;0  0.6921 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     2.5996 (1.98)     2.5996 (1.98)     2.5996 (1.98)     0.0000 (1.0)      2.5996 (1.98)     0.0000 (1.0)           0;0  0.3847 (0.50)          1           1
test_sharing-fetch[3.10.0]     2.7965 (2.13)     2.7965 (2.13)     2.7965 (2.13)     0.0000 (1.0)      2.7965 (2.13)     0.0000 (1.0)           0;0  0.3576 (0.47)          1           1
test_sharing-fetch[3.53.2]     1.6535 (1.26)     1.6535 (1.26)     1.6535 (1.26)     0.0000 (1.0)      1.6535 (1.26)     0.0000 (1.0)           0;0  0.6048 (0.79)          1           1
test_sharing-fetch[main]       1.3121 (1.0)      1.3121 (1.0)      1.3121 (1.0)      0.0000 (1.0)      1.3121 (1.0)      0.0000 (1.0)           0;0  0.7621 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     424.9641 (1.0)      424.9641 (1.0)      424.9641 (1.0)      0.0000 (1.0)      424.9641 (1.0)      0.0000 (1.0)           0;0  2.3531 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     514.9839 (1.21)     514.9839 (1.21)     514.9839 (1.21)     0.0000 (1.0)      514.9839 (1.21)     0.0000 (1.0)           0;0  1.9418 (0.83)          1           1
test_sharing-fetch-noop[3.53.2]     749.0955 (1.76)     749.0955 (1.76)     749.0955 (1.76)     0.0000 (1.0)      749.0955 (1.76)     0.0000 (1.0)           0;0  1.3349 (0.57)          1           1
test_sharing-fetch-noop[main]       761.5341 (1.79)     761.5341 (1.79)     761.5341 (1.79)     0.0000 (1.0)      761.5341 (1.79)     0.0000 (1.0)           0;0  1.3131 (0.56)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     2.2083 (1.55)     2.2083 (1.55)     2.2083 (1.55)     0.0000 (1.0)      2.2083 (1.55)     0.0000 (1.0)           0;0  0.4528 (0.64)          1           1
test_sharing-push[3.10.0]     2.1241 (1.49)     2.1241 (1.49)     2.1241 (1.49)     0.0000 (1.0)      2.1241 (1.49)     0.0000 (1.0)           0;0  0.4708 (0.67)          1           1
test_sharing-push[3.53.2]     1.5053 (1.06)     1.5053 (1.06)     1.5053 (1.06)     0.0000 (1.0)      1.5053 (1.06)     0.0000 (1.0)           0;0  0.6643 (0.94)          1           1
test_sharing-push[main]       1.4223 (1.0)      1.4223 (1.0)      1.4223 (1.0)      0.0000 (1.0)      1.4223 (1.0)      0.0000 (1.0)           0;0  0.7031 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     446.0100 (1.0)      446.0100 (1.0)      446.0100 (1.0)      0.0000 (1.0)      446.0100 (1.0)      0.0000 (1.0)           0;0  2.2421 (1.0)           1           1
test_sharing-push-noop[3.10.0]     448.2788 (1.01)     448.2788 (1.01)     448.2788 (1.01)     0.0000 (1.0)      448.2788 (1.01)     0.0000 (1.0)           0;0  2.2308 (0.99)          1           1
test_sharing-push-noop[3.53.2]     767.7096 (1.72)     767.7096 (1.72)     767.7096 (1.72)     0.0000 (1.0)      767.7096 (1.72)     0.0000 (1.0)           0;0  1.3026 (0.58)          1           1
test_sharing-push-noop[main]       747.6118 (1.68)     747.6118 (1.68)     747.6118 (1.68)     0.0000 (1.0)      747.6118 (1.68)     0.0000 (1.0)           0;0  1.3376 (0.60)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     1.2945 (1.62)     1.2945 (1.62)     1.2945 (1.62)     0.0000 (1.0)      1.2945 (1.62)     0.0000 (1.0)           0;0  0.7725 (0.62)          1           1
test_status-status[3.10.0]     1.4318 (1.80)     1.4318 (1.80)     1.4318 (1.80)     0.0000 (1.0)      1.4318 (1.80)     0.0000 (1.0)           0;0  0.6984 (0.56)          1           1
test_status-status[3.53.2]     1.2587 (1.58)     1.2587 (1.58)     1.2587 (1.58)     0.0000 (1.0)      1.2587 (1.58)     0.0000 (1.0)           0;0  0.7945 (0.63)          1           1
test_status-status[main]       0.7972 (1.0)      0.7972 (1.0)      0.7972 (1.0)      0.0000 (1.0)      0.7972 (1.0)      0.0000 (1.0)           0;0  1.2545 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     518.0445 (1.17)     518.0445 (1.17)     518.0445 (1.17)     0.0000 (1.0)      518.0445 (1.17)     0.0000 (1.0)           0;0  1.9303 (0.85)          1           1
test_status-status-changed[3.10.0]     533.2068 (1.21)     533.2068 (1.21)     533.2068 (1.21)     0.0000 (1.0)      533.2068 (1.21)     0.0000 (1.0)           0;0  1.8754 (0.83)          1           1
test_status-status-changed[3.53.2]     505.5596 (1.14)     505.5596 (1.14)     505.5596 (1.14)     0.0000 (1.0)      505.5596 (1.14)     0.0000 (1.0)           0;0  1.9780 (0.87)          1           1
test_status-status-changed[main]       442.2873 (1.0)      442.2873 (1.0)      442.2873 (1.0)      0.0000 (1.0)      442.2873 (1.0)      0.0000 (1.0)           0;0  2.2610 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     516.0664 (1.18)     516.0664 (1.18)     516.0664 (1.18)     0.0000 (1.0)      516.0664 (1.18)     0.0000 (1.0)           0;0  1.9377 (0.85)          1           1
test_status-status-changed-noop[3.10.0]     542.7060 (1.24)     542.7060 (1.24)     542.7060 (1.24)     0.0000 (1.0)      542.7060 (1.24)     0.0000 (1.0)           0;0  1.8426 (0.80)          1           1
test_status-status-changed-noop[3.53.2]     506.1942 (1.16)     506.1942 (1.16)     506.1942 (1.16)     0.0000 (1.0)      506.1942 (1.16)     0.0000 (1.0)           0;0  1.9755 (0.86)          1           1
test_status-status-changed-noop[main]       436.7731 (1.0)      436.7731 (1.0)      436.7731 (1.0)      0.0000 (1.0)      436.7731 (1.0)      0.0000 (1.0)           0;0  2.2895 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     523.1927 (1.19)     523.1927 (1.19)     523.1927 (1.19)     0.0000 (1.0)      523.1927 (1.19)     0.0000 (1.0)           0;0  1.9113 (0.84)          1           1
test_status-status-noop[3.10.0]     538.4398 (1.22)     538.4398 (1.22)     538.4398 (1.22)     0.0000 (1.0)      538.4398 (1.22)     0.0000 (1.0)           0;0  1.8572 (0.82)          1           1
test_status-status-noop[3.53.2]     518.1559 (1.18)     518.1559 (1.18)     518.1559 (1.18)     0.0000 (1.0)      518.1559 (1.18)     0.0000 (1.0)           0;0  1.9299 (0.85)          1           1
test_status-status-noop[main]       439.7813 (1.0)      439.7813 (1.0)      439.7813 (1.0)      0.0000 (1.0)      439.7813 (1.0)      0.0000 (1.0)           0;0  2.2739 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     5.8671 (2.06)     5.8671 (2.06)     5.8671 (2.06)     0.0000 (1.0)      5.8671 (2.06)     0.0000 (1.0)           0;0  0.1704 (0.48)          1           1
test_update-import-url[3.10.0]     6.1526 (2.16)     6.1526 (2.16)     6.1526 (2.16)     0.0000 (1.0)      6.1526 (2.16)     0.0000 (1.0)           0;0  0.1625 (0.46)          1           1
test_update-import-url[3.53.2]     4.7256 (1.66)     4.7256 (1.66)     4.7256 (1.66)     0.0000 (1.0)      4.7256 (1.66)     0.0000 (1.0)           0;0  0.2116 (0.60)          1           1
test_update-import-url[main]       2.8427 (1.0)      2.8427 (1.0)      2.8427 (1.0)      0.0000 (1.0)      2.8427 (1.0)      0.0000 (1.0)           0;0  0.3518 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     4.9671 (2.96)     4.9671 (2.96)     4.9671 (2.96)     0.0000 (1.0)      4.9671 (2.96)     0.0000 (1.0)           0;0  0.2013 (0.34)          1           1
test_update-update[3.10.0]     5.4290 (3.23)     5.4290 (3.23)     5.4290 (3.23)     0.0000 (1.0)      5.4290 (3.23)     0.0000 (1.0)           0;0  0.1842 (0.31)          1           1
test_update-update[3.53.2]     3.9876 (2.37)     3.9876 (2.37)     3.9876 (2.37)     0.0000 (1.0)      3.9876 (2.37)     0.0000 (1.0)           0;0  0.2508 (0.42)          1           1
test_update-update[main]       1.6793 (1.0)      1.6793 (1.0)      1.6793 (1.0)      0.0000 (1.0)      1.6793 (1.0)      0.0000 (1.0)           0;0  0.5955 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     885.1859 (1.47)     885.1859 (1.47)     885.1859 (1.47)     0.0000 (1.0)      885.1859 (1.47)     0.0000 (1.0)           0;0  1.1297 (0.68)          1           1
test_update-update-noop[3.10.0]     922.6591 (1.53)     922.6591 (1.53)     922.6591 (1.53)     0.0000 (1.0)      922.6591 (1.53)     0.0000 (1.0)           0;0  1.0838 (0.65)          1           1
test_update-update-noop[3.53.2]     876.8335 (1.46)     876.8335 (1.46)     876.8335 (1.46)     0.0000 (1.0)      876.8335 (1.46)     0.0000 (1.0)           0;0  1.1405 (0.69)          1           1
test_update-update-noop[main]       602.2978 (1.0)      602.2978 (1.0)      602.2978 (1.0)      0.0000 (1.0)      602.2978 (1.0)      0.0000 (1.0)           0;0  1.6603 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean