Wed Jun  4 08:18:41 UTC 2025
dataset: small
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     3.5869 (1.68)     3.5869 (1.68)     3.5869 (1.68)     0.0000 (1.0)      3.5869 (1.68)     0.0000 (1.0)           0;0  0.2788 (0.60)          1           1
test_add_copy-add[3.10.0]     3.6965 (1.73)     3.6965 (1.73)     3.6965 (1.73)     0.0000 (1.0)      3.6965 (1.73)     0.0000 (1.0)           0;0  0.2705 (0.58)          1           1
test_add_copy-add[3.53.2]     3.2786 (1.53)     3.2786 (1.53)     3.2786 (1.53)     0.0000 (1.0)      3.2786 (1.53)     0.0000 (1.0)           0;0  0.3050 (0.65)          1           1
test_add_copy-add[main]       2.1379 (1.0)      2.1379 (1.0)      2.1379 (1.0)      0.0000 (1.0)      2.1379 (1.0)      0.0000 (1.0)           0;0  0.4677 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     1.4627 (2.08)     1.4627 (2.08)     1.4627 (2.08)     0.0000 (1.0)      1.4627 (2.08)     0.0000 (1.0)           0;0  0.6837 (0.48)          1           1
test_add_copy-add-noop[3.10.0]     1.4488 (2.06)     1.4488 (2.06)     1.4488 (2.06)     0.0000 (1.0)      1.4488 (2.06)     0.0000 (1.0)           0;0  0.6902 (0.49)          1           1
test_add_copy-add-noop[3.53.2]     2.3387 (3.32)     2.3387 (3.32)     2.3387 (3.32)     0.0000 (1.0)      2.3387 (3.32)     0.0000 (1.0)           0;0  0.4276 (0.30)          1           1
test_add_copy-add-noop[main]       0.7041 (1.0)      0.7041 (1.0)      0.7041 (1.0)      0.0000 (1.0)      0.7041 (1.0)      0.0000 (1.0)           0;0  1.4203 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     2.7499 (1.57)     2.7499 (1.57)     2.7499 (1.57)     0.0000 (1.0)      2.7499 (1.57)     0.0000 (1.0)           0;0  0.3637 (0.64)          1           1
test_add_hardlink-add[3.10.0]     2.9173 (1.67)     2.9173 (1.67)     2.9173 (1.67)     0.0000 (1.0)      2.9173 (1.67)     0.0000 (1.0)           0;0  0.3428 (0.60)          1           1
test_add_hardlink-add[3.53.2]     2.6206 (1.50)     2.6206 (1.50)     2.6206 (1.50)     0.0000 (1.0)      2.6206 (1.50)     0.0000 (1.0)           0;0  0.3816 (0.67)          1           1
test_add_hardlink-add[main]       1.7514 (1.0)      1.7514 (1.0)      1.7514 (1.0)      0.0000 (1.0)      1.7514 (1.0)      0.0000 (1.0)           0;0  0.5710 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     1.4942 (2.30)     1.4942 (2.30)     1.4942 (2.30)     0.0000 (1.0)      1.4942 (2.30)     0.0000 (1.0)           0;0  0.6692 (0.44)          1           1
test_add_hardlink-add-noop[3.10.0]     1.5350 (2.36)     1.5350 (2.36)     1.5350 (2.36)     0.0000 (1.0)      1.5350 (2.36)     0.0000 (1.0)           0;0  0.6515 (0.42)          1           1
test_add_hardlink-add-noop[3.53.2]     1.4420 (2.22)     1.4420 (2.22)     1.4420 (2.22)     0.0000 (1.0)      1.4420 (2.22)     0.0000 (1.0)           0;0  0.6935 (0.45)          1           1
test_add_hardlink-add-noop[main]       0.6505 (1.0)      0.6505 (1.0)      0.6505 (1.0)      0.0000 (1.0)      0.6505 (1.0)      0.0000 (1.0)           0;0  1.5372 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     2.9555 (1.25)     2.9555 (1.25)     2.9555 (1.25)     0.0000 (1.0)      2.9555 (1.25)     0.0000 (1.0)           0;0  0.3384 (0.80)          1           1
test_add_symlink-add[3.10.0]     3.1996 (1.35)     3.1996 (1.35)     3.1996 (1.35)     0.0000 (1.0)      3.1996 (1.35)     0.0000 (1.0)           0;0  0.3125 (0.74)          1           1
test_add_symlink-add[3.53.2]     2.8569 (1.21)     2.8569 (1.21)     2.8569 (1.21)     0.0000 (1.0)      2.8569 (1.21)     0.0000 (1.0)           0;0  0.3500 (0.83)          1           1
test_add_symlink-add[main]       2.3638 (1.0)      2.3638 (1.0)      2.3638 (1.0)      0.0000 (1.0)      2.3638 (1.0)      0.0000 (1.0)           0;0  0.4231 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     1.8776 (2.74)     1.8776 (2.74)     1.8776 (2.74)     0.0000 (1.0)      1.8776 (2.74)     0.0000 (1.0)           0;0  0.5326 (0.37)          1           1
test_add_symlink-add-noop[3.10.0]     1.9122 (2.79)     1.9122 (2.79)     1.9122 (2.79)     0.0000 (1.0)      1.9122 (2.79)     0.0000 (1.0)           0;0  0.5230 (0.36)          1           1
test_add_symlink-add-noop[3.53.2]     2.4532 (3.58)     2.4532 (3.58)     2.4532 (3.58)     0.0000 (1.0)      2.4532 (3.58)     0.0000 (1.0)           0;0  0.4076 (0.28)          1           1
test_add_symlink-add-noop[main]       0.6861 (1.0)      0.6861 (1.0)      0.6861 (1.0)      0.0000 (1.0)      0.6861 (1.0)      0.0000 (1.0)           0;0  1.4576 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     2.3621 (1.40)     2.3621 (1.40)     2.3621 (1.40)     0.0000 (1.0)      2.3621 (1.40)     0.0000 (1.0)           0;0  0.4233 (0.71)          1           1
test_checkout_copy-checkout[3.10.0]     2.7739 (1.65)     2.7739 (1.65)     2.7739 (1.65)     0.0000 (1.0)      2.7739 (1.65)     0.0000 (1.0)           0;0  0.3605 (0.61)          1           1
test_checkout_copy-checkout[3.53.2]     1.6861 (1.0)      1.6861 (1.0)      1.6861 (1.0)      0.0000 (1.0)      1.6861 (1.0)      0.0000 (1.0)           0;0  0.5931 (1.0)           1           1
test_checkout_copy-checkout[main]       1.9215 (1.14)     1.9215 (1.14)     1.9215 (1.14)     0.0000 (1.0)      1.9215 (1.14)     0.0000 (1.0)           0;0  0.5204 (0.88)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     708.9081 (1.44)     708.9081 (1.44)     708.9081 (1.44)     0.0000 (1.0)      708.9081 (1.44)     0.0000 (1.0)           0;0  1.4106 (0.69)          1           1
test_checkout_copy-checkout-noop[3.10.0]     583.8296 (1.19)     583.8296 (1.19)     583.8296 (1.19)     0.0000 (1.0)      583.8296 (1.19)     0.0000 (1.0)           0;0  1.7128 (0.84)          1           1
test_checkout_copy-checkout-noop[3.53.2]     544.9769 (1.11)     544.9769 (1.11)     544.9769 (1.11)     0.0000 (1.0)      544.9769 (1.11)     0.0000 (1.0)           0;0  1.8349 (0.90)          1           1
test_checkout_copy-checkout-noop[main]       492.5082 (1.0)      492.5082 (1.0)      492.5082 (1.0)      0.0000 (1.0)      492.5082 (1.0)      0.0000 (1.0)           0;0  2.0304 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     1.0330 (1.88)     1.0330 (1.88)     1.0330 (1.88)     0.0000 (1.0)      1.0330 (1.88)     0.0000 (1.0)           0;0  0.9681 (0.53)          1           1
test_checkout_copy-checkout-update[3.10.0]     0.6523 (1.19)     0.6523 (1.19)     0.6523 (1.19)     0.0000 (1.0)      0.6523 (1.19)     0.0000 (1.0)           0;0  1.5331 (0.84)          1           1
test_checkout_copy-checkout-update[3.53.2]     0.6156 (1.12)     0.6156 (1.12)     0.6156 (1.12)     0.0000 (1.0)      0.6156 (1.12)     0.0000 (1.0)           0;0  1.6244 (0.89)          1           1
test_checkout_copy-checkout-update[main]       0.5481 (1.0)      0.5481 (1.0)      0.5481 (1.0)      0.0000 (1.0)      0.5481 (1.0)      0.0000 (1.0)           0;0  1.8246 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     1.2913 (1.07)     1.2913 (1.07)     1.2913 (1.07)     0.0000 (1.0)      1.2913 (1.07)     0.0000 (1.0)           0;0  0.7744 (0.94)          1           1
test_checkout_hardlink-checkout[3.10.0]     1.2980 (1.07)     1.2980 (1.07)     1.2980 (1.07)     0.0000 (1.0)      1.2980 (1.07)     0.0000 (1.0)           0;0  0.7704 (0.93)          1           1
test_checkout_hardlink-checkout[3.53.2]     1.2104 (1.0)      1.2104 (1.0)      1.2104 (1.0)      0.0000 (1.0)      1.2104 (1.0)      0.0000 (1.0)           0;0  0.8262 (1.0)           1           1
test_checkout_hardlink-checkout[main]       1.3997 (1.16)     1.3997 (1.16)     1.3997 (1.16)     0.0000 (1.0)      1.3997 (1.16)     0.0000 (1.0)           0;0  0.7144 (0.86)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     526.1551 (1.14)     526.1551 (1.14)     526.1551 (1.14)     0.0000 (1.0)      526.1551 (1.14)     0.0000 (1.0)           0;0  1.9006 (0.88)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     555.3270 (1.20)     555.3270 (1.20)     555.3270 (1.20)     0.0000 (1.0)      555.3270 (1.20)     0.0000 (1.0)           0;0  1.8007 (0.83)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     540.0913 (1.17)     540.0913 (1.17)     540.0913 (1.17)     0.0000 (1.0)      540.0913 (1.17)     0.0000 (1.0)           0;0  1.8515 (0.86)          1           1
test_checkout_hardlink-checkout-noop[main]       462.8491 (1.0)      462.8491 (1.0)      462.8491 (1.0)      0.0000 (1.0)      462.8491 (1.0)      0.0000 (1.0)           0;0  2.1605 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     655.8175 (1.26)     655.8175 (1.26)     655.8175 (1.26)     0.0000 (1.0)      655.8175 (1.26)     0.0000 (1.0)           0;0  1.5248 (0.80)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     614.7229 (1.18)     614.7229 (1.18)     614.7229 (1.18)     0.0000 (1.0)      614.7229 (1.18)     0.0000 (1.0)           0;0  1.6267 (0.85)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     581.7831 (1.11)     581.7831 (1.11)     581.7831 (1.11)     0.0000 (1.0)      581.7831 (1.11)     0.0000 (1.0)           0;0  1.7189 (0.90)          1           1
test_checkout_hardlink-checkout-update[main]       521.7807 (1.0)      521.7807 (1.0)      521.7807 (1.0)      0.0000 (1.0)      521.7807 (1.0)      0.0000 (1.0)           0;0  1.9165 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     1.4146 (1.11)     1.4146 (1.11)     1.4146 (1.11)     0.0000 (1.0)      1.4146 (1.11)     0.0000 (1.0)           0;0  0.7069 (0.90)          1           1
test_checkout_symlink-checkout[3.10.0]     1.4156 (1.11)     1.4156 (1.11)     1.4156 (1.11)     0.0000 (1.0)      1.4156 (1.11)     0.0000 (1.0)           0;0  0.7064 (0.90)          1           1
test_checkout_symlink-checkout[3.53.2]     1.2800 (1.0)      1.2800 (1.0)      1.2800 (1.0)      0.0000 (1.0)      1.2800 (1.0)      0.0000 (1.0)           0;0  0.7813 (1.0)           1           1
test_checkout_symlink-checkout[main]       1.4978 (1.17)     1.4978 (1.17)     1.4978 (1.17)     0.0000 (1.0)      1.4978 (1.17)     0.0000 (1.0)           0;0  0.6676 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     577.2356 (1.16)     577.2356 (1.16)     577.2356 (1.16)     0.0000 (1.0)      577.2356 (1.16)     0.0000 (1.0)           0;0  1.7324 (0.86)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     590.4273 (1.19)     590.4273 (1.19)     590.4273 (1.19)     0.0000 (1.0)      590.4273 (1.19)     0.0000 (1.0)           0;0  1.6937 (0.84)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     574.5689 (1.16)     574.5689 (1.16)     574.5689 (1.16)     0.0000 (1.0)      574.5689 (1.16)     0.0000 (1.0)           0;0  1.7404 (0.86)          1           1
test_checkout_symlink-checkout-noop[main]       496.1778 (1.0)      496.1778 (1.0)      496.1778 (1.0)      0.0000 (1.0)      496.1778 (1.0)      0.0000 (1.0)           0;0  2.0154 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     1.2084 (2.14)     1.2084 (2.14)     1.2084 (2.14)     0.0000 (1.0)      1.2084 (2.14)     0.0000 (1.0)           0;0  0.8275 (0.47)          1           1
test_checkout_symlink-checkout-update[3.10.0]     0.6854 (1.21)     0.6854 (1.21)     0.6854 (1.21)     0.0000 (1.0)      0.6854 (1.21)     0.0000 (1.0)           0;0  1.4589 (0.82)          1           1
test_checkout_symlink-checkout-update[3.53.2]     0.6588 (1.17)     0.6588 (1.17)     0.6588 (1.17)     0.0000 (1.0)      0.6588 (1.17)     0.0000 (1.0)           0;0  1.5179 (0.86)          1           1
test_checkout_symlink-checkout-update[main]       0.5641 (1.0)      0.5641 (1.0)      0.5641 (1.0)      0.0000 (1.0)      0.5641 (1.0)      0.0000 (1.0)           0;0  1.7726 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     717.1734 (1.38)     717.1734 (1.38)     717.1734 (1.38)     0.0000 (1.0)      717.1734 (1.38)     0.0000 (1.0)           0;0  1.3944 (0.73)          1           1
test_data_status-data-changed[3.10.0]     620.4790 (1.19)     620.4790 (1.19)     620.4790 (1.19)     0.0000 (1.0)      620.4790 (1.19)     0.0000 (1.0)           0;0  1.6117 (0.84)          1           1
test_data_status-data-changed[3.53.2]     560.4232 (1.08)     560.4232 (1.08)     560.4232 (1.08)     0.0000 (1.0)      560.4232 (1.08)     0.0000 (1.0)           0;0  1.7844 (0.93)          1           1
test_data_status-data-changed[main]       520.2103 (1.0)      520.2103 (1.0)      520.2103 (1.0)      0.0000 (1.0)      520.2103 (1.0)      0.0000 (1.0)           0;0  1.9223 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     671.3802 (1.34)     671.3802 (1.34)     671.3802 (1.34)     0.0000 (1.0)      671.3802 (1.34)     0.0000 (1.0)           0;0  1.4895 (0.75)          1           1
test_data_status-data-changed-noop[3.10.0]     637.1974 (1.27)     637.1974 (1.27)     637.1974 (1.27)     0.0000 (1.0)      637.1974 (1.27)     0.0000 (1.0)           0;0  1.5694 (0.79)          1           1
test_data_status-data-changed-noop[3.53.2]     576.7209 (1.15)     576.7209 (1.15)     576.7209 (1.15)     0.0000 (1.0)      576.7209 (1.15)     0.0000 (1.0)           0;0  1.7339 (0.87)          1           1
test_data_status-data-changed-noop[main]       502.8282 (1.0)      502.8282 (1.0)      502.8282 (1.0)      0.0000 (1.0)      502.8282 (1.0)      0.0000 (1.0)           0;0  1.9888 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     1.5590 (1.65)     1.5590 (1.65)     1.5590 (1.65)     0.0000 (1.0)      1.5590 (1.65)     0.0000 (1.0)           0;0  0.6414 (0.60)          1           1
test_data_status-data-new[3.10.0]     1.5363 (1.63)     1.5363 (1.63)     1.5363 (1.63)     0.0000 (1.0)      1.5363 (1.63)     0.0000 (1.0)           0;0  0.6509 (0.61)          1           1
test_data_status-data-new[3.53.2]     1.3871 (1.47)     1.3871 (1.47)     1.3871 (1.47)     0.0000 (1.0)      1.3871 (1.47)     0.0000 (1.0)           0;0  0.7209 (0.68)          1           1
test_data_status-data-new[main]       0.9428 (1.0)      0.9428 (1.0)      0.9428 (1.0)      0.0000 (1.0)      0.9428 (1.0)      0.0000 (1.0)           0;0  1.0606 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     665.3904 (1.25)     665.3904 (1.25)     665.3904 (1.25)     0.0000 (1.0)      665.3904 (1.25)     0.0000 (1.0)           0;0  1.5029 (0.80)          1           1
test_data_status-data-noop[3.10.0]     615.5026 (1.16)     615.5026 (1.16)     615.5026 (1.16)     0.0000 (1.0)      615.5026 (1.16)     0.0000 (1.0)           0;0  1.6247 (0.86)          1           1
test_data_status-data-noop[3.53.2]     564.1741 (1.06)     564.1741 (1.06)     564.1741 (1.06)     0.0000 (1.0)      564.1741 (1.06)     0.0000 (1.0)           0;0  1.7725 (0.94)          1           1
test_data_status-data-noop[main]       530.2900 (1.0)      530.2900 (1.0)      530.2900 (1.0)      0.0000 (1.0)      530.2900 (1.0)      0.0000 (1.0)           0;0  1.8858 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     988.7404 (1.16)     988.7404 (1.16)     988.7404 (1.16)     0.0000 (1.0)      988.7404 (1.16)     0.0000 (1.0)           0;0  1.0114 (0.86)          1           1
test_data_status_all_flags-data-changed[3.10.0]     979.3199 (1.15)     979.3199 (1.15)     979.3199 (1.15)     0.0000 (1.0)      979.3199 (1.15)     0.0000 (1.0)           0;0  1.0211 (0.87)          1           1
test_data_status_all_flags-data-changed[3.53.2]     930.2425 (1.09)     930.2425 (1.09)     930.2425 (1.09)     0.0000 (1.0)      930.2425 (1.09)     0.0000 (1.0)           0;0  1.0750 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       850.1198 (1.0)      850.1198 (1.0)      850.1198 (1.0)      0.0000 (1.0)      850.1198 (1.0)      0.0000 (1.0)           0;0  1.1763 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     979.5317 (1.14)     979.5317 (1.14)     979.5317 (1.14)     0.0000 (1.0)      979.5317 (1.14)     0.0000 (1.0)           0;0  1.0209 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     976.9360 (1.13)     976.9360 (1.13)     976.9360 (1.13)     0.0000 (1.0)      976.9360 (1.13)     0.0000 (1.0)           0;0  1.0236 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     939.7681 (1.09)     939.7681 (1.09)     939.7681 (1.09)     0.0000 (1.0)      939.7681 (1.09)     0.0000 (1.0)           0;0  1.0641 (0.92)          1           1
test_data_status_all_flags-data-changed-noop[main]       861.8178 (1.0)      861.8178 (1.0)      861.8178 (1.0)      0.0000 (1.0)      861.8178 (1.0)      0.0000 (1.0)           0;0  1.1603 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     1.8381 (1.37)     1.8381 (1.37)     1.8381 (1.37)     0.0000 (1.0)      1.8381 (1.37)     0.0000 (1.0)           0;0  0.5440 (0.73)          1           1
test_data_status_all_flags-data-new[3.10.0]     1.8811 (1.40)     1.8811 (1.40)     1.8811 (1.40)     0.0000 (1.0)      1.8811 (1.40)     0.0000 (1.0)           0;0  0.5316 (0.71)          1           1
test_data_status_all_flags-data-new[3.53.2]     1.7470 (1.30)     1.7470 (1.30)     1.7470 (1.30)     0.0000 (1.0)      1.7470 (1.30)     0.0000 (1.0)           0;0  0.5724 (0.77)          1           1
test_data_status_all_flags-data-new[main]       1.3414 (1.0)      1.3414 (1.0)      1.3414 (1.0)      0.0000 (1.0)      1.3414 (1.0)      0.0000 (1.0)           0;0  0.7455 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     962.8571 (1.14)     962.8571 (1.14)     962.8571 (1.14)     0.0000 (1.0)      962.8571 (1.14)     0.0000 (1.0)           0;0  1.0386 (0.87)          1           1
test_data_status_all_flags-data-noop[3.10.0]     965.3551 (1.15)     965.3551 (1.15)     965.3551 (1.15)     0.0000 (1.0)      965.3551 (1.15)     0.0000 (1.0)           0;0  1.0359 (0.87)          1           1
test_data_status_all_flags-data-noop[3.53.2]     909.2407 (1.08)     909.2407 (1.08)     909.2407 (1.08)     0.0000 (1.0)      909.2407 (1.08)     0.0000 (1.0)           0;0  1.0998 (0.93)          1           1
test_data_status_all_flags-data-noop[main]       842.3746 (1.0)      842.3746 (1.0)      842.3746 (1.0)      0.0000 (1.0)      842.3746 (1.0)      0.0000 (1.0)           0;0  1.1871 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     1.4805 (1.27)     1.4805 (1.27)     1.4805 (1.27)     0.0000 (1.0)      1.4805 (1.27)     0.0000 (1.0)           0;0  0.6755 (0.78)          1           1
test_diff-diff[3.10.0]     1.6320 (1.41)     1.6320 (1.41)     1.6320 (1.41)     0.0000 (1.0)      1.6320 (1.41)     0.0000 (1.0)           0;0  0.6127 (0.71)          1           1
test_diff-diff[3.53.2]     1.4463 (1.25)     1.4463 (1.25)     1.4463 (1.25)     0.0000 (1.0)      1.4463 (1.25)     0.0000 (1.0)           0;0  0.6914 (0.80)          1           1
test_diff-diff[main]       1.1613 (1.0)      1.1613 (1.0)      1.1613 (1.0)      0.0000 (1.0)      1.1613 (1.0)      0.0000 (1.0)           0;0  0.8611 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     750.9912 (1.24)     750.9912 (1.24)     750.9912 (1.24)     0.0000 (1.0)      750.9912 (1.24)     0.0000 (1.0)           0;0  1.3316 (0.81)          1           1
test_diff-diff-changed[3.10.0]     767.8937 (1.26)     767.8937 (1.26)     767.8937 (1.26)     0.0000 (1.0)      767.8937 (1.26)     0.0000 (1.0)           0;0  1.3023 (0.79)          1           1
test_diff-diff-changed[3.53.2]     676.0465 (1.11)     676.0465 (1.11)     676.0465 (1.11)     0.0000 (1.0)      676.0465 (1.11)     0.0000 (1.0)           0;0  1.4792 (0.90)          1           1
test_diff-diff-changed[main]       608.0671 (1.0)      608.0671 (1.0)      608.0671 (1.0)      0.0000 (1.0)      608.0671 (1.0)      0.0000 (1.0)           0;0  1.6446 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     705.1580 (1.12)     705.1580 (1.12)     705.1580 (1.12)     0.0000 (1.0)      705.1580 (1.12)     0.0000 (1.0)           0;0  1.4181 (0.89)          1           1
test_diff-diff-changed-noop[3.10.0]     727.2892 (1.15)     727.2892 (1.15)     727.2892 (1.15)     0.0000 (1.0)      727.2892 (1.15)     0.0000 (1.0)           0;0  1.3750 (0.87)          1           1
test_diff-diff-changed-noop[3.53.2]     727.6934 (1.15)     727.6934 (1.15)     727.6934 (1.15)     0.0000 (1.0)      727.6934 (1.15)     0.0000 (1.0)           0;0  1.3742 (0.87)          1           1
test_diff-diff-changed-noop[main]       630.7184 (1.0)      630.7184 (1.0)      630.7184 (1.0)      0.0000 (1.0)      630.7184 (1.0)      0.0000 (1.0)           0;0  1.5855 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     685.9574 (1.08)     685.9574 (1.08)     685.9574 (1.08)     0.0000 (1.0)      685.9574 (1.08)     0.0000 (1.0)           0;0  1.4578 (0.92)          1           1
test_diff-diff-noop[3.10.0]     695.2680 (1.10)     695.2680 (1.10)     695.2680 (1.10)     0.0000 (1.0)      695.2680 (1.10)     0.0000 (1.0)           0;0  1.4383 (0.91)          1           1
test_diff-diff-noop[3.53.2]     676.6160 (1.07)     676.6160 (1.07)     676.6160 (1.07)     0.0000 (1.0)      676.6160 (1.07)     0.0000 (1.0)           0;0  1.4779 (0.94)          1           1
test_diff-diff-noop[main]       633.6668 (1.0)      633.6668 (1.0)      633.6668 (1.0)      0.0000 (1.0)      633.6668 (1.0)      0.0000 (1.0)           0;0  1.5781 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.1634 (1.0)      1.1634 (1.0)      1.1634 (1.0)      0.0000 (1.0)      1.1634 (1.0)      0.0000 (1.0)           0;0  0.8596 (1.0)           1           1
test_exp_show-exp[3.10.0]     8.6256 (7.41)     8.6256 (7.41)     8.6256 (7.41)     0.0000 (1.0)      8.6256 (7.41)     0.0000 (1.0)           0;0  0.1159 (0.13)          1           1
test_exp_show-exp[3.53.2]     4.6312 (3.98)     4.6312 (3.98)     4.6312 (3.98)     0.0000 (1.0)      4.6312 (3.98)     0.0000 (1.0)           0;0  0.2159 (0.25)          1           1
test_exp_show-exp[main]       7.8474 (6.75)     7.8474 (6.75)     7.8474 (6.75)     0.0000 (1.0)      7.8474 (6.75)     0.0000 (1.0)           0;0  0.1274 (0.15)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     2.7159 (1.69)     2.7159 (1.69)     2.7159 (1.69)     0.0000 (1.0)      2.7159 (1.69)     0.0000 (1.0)           0;0  0.3682 (0.59)          1           1
test_fetch-fetch[3.10.0]     3.1948 (1.98)     3.1948 (1.98)     3.1948 (1.98)     0.0000 (1.0)      3.1948 (1.98)     0.0000 (1.0)           0;0  0.3130 (0.50)          1           1
test_fetch-fetch[3.53.2]     1.9619 (1.22)     1.9619 (1.22)     1.9619 (1.22)     0.0000 (1.0)      1.9619 (1.22)     0.0000 (1.0)           0;0  0.5097 (0.82)          1           1
test_fetch-fetch[main]       1.6110 (1.0)      1.6110 (1.0)      1.6110 (1.0)      0.0000 (1.0)      1.6110 (1.0)      0.0000 (1.0)           0;0  0.6207 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     606.7566 (1.03)     606.7566 (1.03)     606.7566 (1.03)     0.0000 (1.0)      606.7566 (1.03)     0.0000 (1.0)           0;0  1.6481 (0.97)          1           1
test_gc-gc[3.10.0]     711.4664 (1.21)     711.4664 (1.21)     711.4664 (1.21)     0.0000 (1.0)      711.4664 (1.21)     0.0000 (1.0)           0;0  1.4055 (0.83)          1           1
test_gc-gc[3.53.2]     627.5093 (1.07)     627.5093 (1.07)     627.5093 (1.07)     0.0000 (1.0)      627.5093 (1.07)     0.0000 (1.0)           0;0  1.5936 (0.94)          1           1
test_gc-gc[main]       588.5380 (1.0)      588.5380 (1.0)      588.5380 (1.0)      0.0000 (1.0)      588.5380 (1.0)      0.0000 (1.0)           0;0  1.6991 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     4.2678 (1.92)     4.2678 (1.92)     4.2678 (1.92)     0.0000 (1.0)      4.2678 (1.92)     0.0000 (1.0)           0;0  0.2343 (0.52)          1           1
test_get-get[3.10.0]     5.0954 (2.30)     5.0954 (2.30)     5.0954 (2.30)     0.0000 (1.0)      5.0954 (2.30)     0.0000 (1.0)           0;0  0.1963 (0.44)          1           1
test_get-get[3.53.2]     4.4870 (2.02)     4.4870 (2.02)     4.4870 (2.02)     0.0000 (1.0)      4.4870 (2.02)     0.0000 (1.0)           0;0  0.2229 (0.49)          1           1
test_get-get[main]       2.2176 (1.0)      2.2176 (1.0)      2.2176 (1.0)      0.0000 (1.0)      2.2176 (1.0)      0.0000 (1.0)           0;0  0.4509 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     1.9333 (1.94)     1.9333 (1.94)     1.9333 (1.94)     0.0000 (1.0)      1.9333 (1.94)     0.0000 (1.0)           0;0  0.5173 (0.52)          1           1
test_get_url-get-url[3.10.0]     2.0262 (2.03)     2.0262 (2.03)     2.0262 (2.03)     0.0000 (1.0)      2.0262 (2.03)     0.0000 (1.0)           0;0  0.4935 (0.49)          1           1
test_get_url-get-url[3.53.2]     1.0237 (1.03)     1.0237 (1.03)     1.0237 (1.03)     0.0000 (1.0)      1.0237 (1.03)     0.0000 (1.0)           0;0  0.9769 (0.98)          1           1
test_get_url-get-url[main]       0.9986 (1.0)      0.9986 (1.0)      0.9986 (1.0)      0.0000 (1.0)      0.9986 (1.0)      0.0000 (1.0)           0;0  1.0014 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.6715 (1.01)     134.6864 (1.0)      131.1093 (1.01)     1.4349 (1.0)      131.0448 (1.01)     2.0301 (1.0)          34;0  7.6272 (0.99)        100           1
test_help---help[3.10.0]     126.7095 (1.0)      144.4024 (1.07)     130.0059 (1.0)      2.3993 (1.67)     129.5554 (1.0)      2.0971 (1.03)         16;3  7.6920 (1.0)         100           1
test_help---help[3.53.2]     127.1191 (1.00)     142.7145 (1.06)     131.1268 (1.01)     2.2450 (1.56)     130.8125 (1.01)     2.1030 (1.04)         23;5  7.6262 (0.99)        100           1
test_help---help[main]       128.9698 (1.02)     140.9644 (1.05)     132.1121 (1.02)     2.0334 (1.42)     131.8388 (1.02)     2.1344 (1.05)         21;5  7.5693 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import-import': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     7.8376 (2.06)     7.8376 (2.06)     7.8376 (2.06)     0.0000 (1.0)      7.8376 (2.06)     0.0000 (1.0)           0;0  0.1276 (0.49)          1           1
test_import-import[3.10.0]     8.3346 (2.19)     8.3346 (2.19)     8.3346 (2.19)     0.0000 (1.0)      8.3346 (2.19)     0.0000 (1.0)           0;0  0.1200 (0.46)          1           1
test_import-import[main]       3.8116 (1.0)      3.8116 (1.0)      3.8116 (1.0)      0.0000 (1.0)      3.8116 (1.0)      0.0000 (1.0)           0;0  0.2624 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     7.6465 (2.68)     7.6465 (2.68)     7.6465 (2.68)     0.0000 (1.0)      7.6465 (2.68)     0.0000 (1.0)           0;0  0.1308 (0.37)          1           1
test_import_url-import-url[3.10.0]     6.0793 (2.13)     6.0793 (2.13)     6.0793 (2.13)     0.0000 (1.0)      6.0793 (2.13)     0.0000 (1.0)           0;0  0.1645 (0.47)          1           1
test_import_url-import-url[3.53.2]     4.8491 (1.70)     4.8491 (1.70)     4.8491 (1.70)     0.0000 (1.0)      4.8491 (1.70)     0.0000 (1.0)           0;0  0.2062 (0.59)          1           1
test_import_url-import-url[main]       2.8574 (1.0)      2.8574 (1.0)      2.8574 (1.0)      0.0000 (1.0)      2.8574 (1.0)      0.0000 (1.0)           0;0  0.3500 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     387.8935 (1.01)     423.2158 (1.01)     396.1917 (1.01)      6.9003 (1.60)     393.9021 (1.00)      6.6632 (1.44)         19;8  2.5240 (0.99)        100           1
test_init-init[3.10.0]     397.3874 (1.04)     425.0774 (1.01)     404.7016 (1.03)      4.3080 (1.0)      403.8002 (1.03)      4.6326 (1.0)          23;3  2.4710 (0.97)        100           1
test_init-init[3.53.2]     383.4559 (1.0)      420.9714 (1.0)      393.3564 (1.0)       5.5434 (1.29)     392.4764 (1.0)       6.2060 (1.34)         25;3  2.5422 (1.0)         100           1
test_init-init[main]       385.2893 (1.00)     631.6736 (1.50)     403.0532 (1.02)     25.1123 (5.83)     398.6115 (1.02)     12.0601 (2.60)          3;4  2.4811 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     621.0282 (1.20)     621.0282 (1.20)     621.0282 (1.20)     0.0000 (1.0)      621.0282 (1.20)     0.0000 (1.0)           0;0  1.6102 (0.83)          1           1
test_list-list[3.10.0]     647.1584 (1.25)     647.1584 (1.25)     647.1584 (1.25)     0.0000 (1.0)      647.1584 (1.25)     0.0000 (1.0)           0;0  1.5452 (0.80)          1           1
test_list-list[3.53.2]     554.4652 (1.07)     554.4652 (1.07)     554.4652 (1.07)     0.0000 (1.0)      554.4652 (1.07)     0.0000 (1.0)           0;0  1.8035 (0.93)          1           1
test_list-list[main]       518.0270 (1.0)      518.0270 (1.0)      518.0270 (1.0)      0.0000 (1.0)      518.0270 (1.0)      0.0000 (1.0)           0;0  1.9304 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     414.6338 (1.06)     414.6338 (1.06)     414.6338 (1.06)     0.0000 (1.0)      414.6338 (1.06)     0.0000 (1.0)           0;0  2.4118 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     418.4803 (1.07)     418.4803 (1.07)     418.4803 (1.07)     0.0000 (1.0)      418.4803 (1.07)     0.0000 (1.0)           0;0  2.3896 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     392.9019 (1.01)     392.9019 (1.01)     392.9019 (1.01)     0.0000 (1.0)      392.9019 (1.01)     0.0000 (1.0)           0;0  2.5452 (0.99)          1           1
test_list-list-dvc-only[main]       390.5844 (1.0)      390.5844 (1.0)      390.5844 (1.0)      0.0000 (1.0)      390.5844 (1.0)      0.0000 (1.0)           0;0  2.5603 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     494.4244 (1.05)     494.4244 (1.05)     494.4244 (1.05)     0.0000 (1.0)      494.4244 (1.05)     0.0000 (1.0)           0;0  2.0226 (0.95)          1           1
test_list-list-recursive[3.10.0]     476.7314 (1.01)     476.7314 (1.01)     476.7314 (1.01)     0.0000 (1.0)      476.7314 (1.01)     0.0000 (1.0)           0;0  2.0976 (0.99)          1           1
test_list-list-recursive[3.53.2]     471.8476 (1.00)     471.8476 (1.00)     471.8476 (1.00)     0.0000 (1.0)      471.8476 (1.00)     0.0000 (1.0)           0;0  2.1193 (1.00)          1           1
test_list-list-recursive[main]       470.1745 (1.0)      470.1745 (1.0)      470.1745 (1.0)      0.0000 (1.0)      470.1745 (1.0)      0.0000 (1.0)           0;0  2.1269 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     411.5737 (1.07)     411.5737 (1.07)     411.5737 (1.07)     0.0000 (1.0)      411.5737 (1.07)     0.0000 (1.0)           0;0  2.4297 (0.94)          1           1
test_list-list-shallow[3.10.0]     406.9579 (1.06)     406.9579 (1.06)     406.9579 (1.06)     0.0000 (1.0)      406.9579 (1.06)     0.0000 (1.0)           0;0  2.4573 (0.95)          1           1
test_list-list-shallow[3.53.2]     389.8753 (1.01)     389.8753 (1.01)     389.8753 (1.01)     0.0000 (1.0)      389.8753 (1.01)     0.0000 (1.0)           0;0  2.5649 (0.99)          1           1
test_list-list-shallow[main]       385.7001 (1.0)      385.7001 (1.0)      385.7001 (1.0)      0.0000 (1.0)      385.7001 (1.0)      0.0000 (1.0)           0;0  2.5927 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     2.0922 (1.30)     2.0922 (1.30)     2.0922 (1.30)     0.0000 (1.0)      2.0922 (1.30)     0.0000 (1.0)           0;0  0.4780 (0.77)          1           1
test_partial_add-add[3.10.0]     2.2234 (1.38)     2.2234 (1.38)     2.2234 (1.38)     0.0000 (1.0)      2.2234 (1.38)     0.0000 (1.0)           0;0  0.4498 (0.72)          1           1
test_partial_add-add[3.53.2]     2.6666 (1.66)     2.6666 (1.66)     2.6666 (1.66)     0.0000 (1.0)      2.6666 (1.66)     0.0000 (1.0)           0;0  0.3750 (0.60)          1           1
test_partial_add-add[main]       1.6075 (1.0)      1.6075 (1.0)      1.6075 (1.0)      0.0000 (1.0)      1.6075 (1.0)      0.0000 (1.0)           0;0  0.6221 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     2.8364 (2.82)     2.8364 (2.82)     2.8364 (2.82)     0.0000 (1.0)      2.8364 (2.82)     0.0000 (1.0)           0;0  0.3526 (0.35)          1           1
test_partial_add-add-partial[3.10.0]     2.8281 (2.81)     2.8281 (2.81)     2.8281 (2.81)     0.0000 (1.0)      2.8281 (2.81)     0.0000 (1.0)           0;0  0.3536 (0.36)          1           1
test_partial_add-add-partial[3.53.2]     2.5386 (2.53)     2.5386 (2.53)     2.5386 (2.53)     0.0000 (1.0)      2.5386 (2.53)     0.0000 (1.0)           0;0  0.3939 (0.40)          1           1
test_partial_add-add-partial[main]       1.0047 (1.0)      1.0047 (1.0)      1.0047 (1.0)      0.0000 (1.0)      1.0047 (1.0)      0.0000 (1.0)           0;0  0.9953 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     524.1469 (1.0)      524.1469 (1.0)      524.1469 (1.0)      0.0000 (1.0)      524.1469 (1.0)      0.0000 (1.0)           0;0  1.9079 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     567.1402 (1.08)     567.1402 (1.08)     567.1402 (1.08)     0.0000 (1.0)      567.1402 (1.08)     0.0000 (1.0)           0;0  1.7632 (0.92)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     570.3294 (1.09)     570.3294 (1.09)     570.3294 (1.09)     0.0000 (1.0)      570.3294 (1.09)     0.0000 (1.0)           0;0  1.7534 (0.92)          1           1
test_partial_add-gc-cloud-noop[main]       574.3581 (1.10)     574.3581 (1.10)     574.3581 (1.10)     0.0000 (1.0)      574.3581 (1.10)     0.0000 (1.0)           0;0  1.7411 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     515.1807 (1.05)     515.1807 (1.05)     515.1807 (1.05)     0.0000 (1.0)      515.1807 (1.05)     0.0000 (1.0)           0;0  1.9411 (0.96)          1           1
test_partial_add-gc-noop[3.10.0]     519.2896 (1.05)     519.2896 (1.05)     519.2896 (1.05)     0.0000 (1.0)      519.2896 (1.05)     0.0000 (1.0)           0;0  1.9257 (0.95)          1           1
test_partial_add-gc-noop[3.53.2]     493.9982 (1.00)     493.9982 (1.00)     493.9982 (1.00)     0.0000 (1.0)      493.9982 (1.00)     0.0000 (1.0)           0;0  2.0243 (1.00)          1           1
test_partial_add-gc-noop[main]       492.6431 (1.0)      492.6431 (1.0)      492.6431 (1.0)      0.0000 (1.0)      492.6431 (1.0)      0.0000 (1.0)           0;0  2.0299 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     1.2611 (1.20)     1.2611 (1.20)     1.2611 (1.20)     0.0000 (1.0)      1.2611 (1.20)     0.0000 (1.0)           0;0  0.7929 (0.84)          1           1
test_partial_add-push[3.10.0]     1.1696 (1.11)     1.1696 (1.11)     1.1696 (1.11)     0.0000 (1.0)      1.1696 (1.11)     0.0000 (1.0)           0;0  0.8550 (0.90)          1           1
test_partial_add-push[3.53.2]     1.0546 (1.0)      1.0546 (1.0)      1.0546 (1.0)      0.0000 (1.0)      1.0546 (1.0)      0.0000 (1.0)           0;0  0.9482 (1.0)           1           1
test_partial_add-push[main]       1.1403 (1.08)     1.1403 (1.08)     1.1403 (1.08)     0.0000 (1.0)      1.1403 (1.08)     0.0000 (1.0)           0;0  0.8770 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     1.2914 (1.16)     1.2914 (1.16)     1.2914 (1.16)     0.0000 (1.0)      1.2914 (1.16)     0.0000 (1.0)           0;0  0.7743 (0.86)          1           1
test_partial_add-push-partial[3.10.0]     1.2051 (1.08)     1.2051 (1.08)     1.2051 (1.08)     0.0000 (1.0)      1.2051 (1.08)     0.0000 (1.0)           0;0  0.8298 (0.92)          1           1
test_partial_add-push-partial[3.53.2]     1.1111 (1.0)      1.1111 (1.0)      1.1111 (1.0)      0.0000 (1.0)      1.1111 (1.0)      0.0000 (1.0)           0;0  0.9000 (1.0)           1           1
test_partial_add-push-partial[main]       1.1248 (1.01)     1.1248 (1.01)     1.1248 (1.01)     0.0000 (1.0)      1.1248 (1.01)     0.0000 (1.0)           0;0  0.8890 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     3.4612 (1.68)     3.4612 (1.68)     3.4612 (1.68)     0.0000 (1.0)      3.4612 (1.68)     0.0000 (1.0)           0;0  0.2889 (0.59)          1           1
test_partial_remove-add[3.10.0]     3.6141 (1.76)     3.6141 (1.76)     3.6141 (1.76)     0.0000 (1.0)      3.6141 (1.76)     0.0000 (1.0)           0;0  0.2767 (0.57)          1           1
test_partial_remove-add[3.53.2]     3.7616 (1.83)     3.7616 (1.83)     3.7616 (1.83)     0.0000 (1.0)      3.7616 (1.83)     0.0000 (1.0)           0;0  0.2658 (0.55)          1           1
test_partial_remove-add[main]       2.0568 (1.0)      2.0568 (1.0)      2.0568 (1.0)      0.0000 (1.0)      2.0568 (1.0)      0.0000 (1.0)           0;0  0.4862 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     1.4140 (2.36)     1.4140 (2.36)     1.4140 (2.36)     0.0000 (1.0)      1.4140 (2.36)     0.0000 (1.0)           0;0  0.7072 (0.42)          1           1
test_partial_remove-add-update[3.10.0]     1.4086 (2.35)     1.4086 (2.35)     1.4086 (2.35)     0.0000 (1.0)      1.4086 (2.35)     0.0000 (1.0)           0;0  0.7099 (0.43)          1           1
test_partial_remove-add-update[3.53.2]     1.2768 (2.13)     1.2768 (2.13)     1.2768 (2.13)     0.0000 (1.0)      1.2768 (2.13)     0.0000 (1.0)           0;0  0.7832 (0.47)          1           1
test_partial_remove-add-update[main]       0.6001 (1.0)      0.6001 (1.0)      0.6001 (1.0)      0.0000 (1.0)      0.6001 (1.0)      0.0000 (1.0)           0;0  1.6665 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     474.5059 (1.0)      474.5059 (1.0)      474.5059 (1.0)      0.0000 (1.0)      474.5059 (1.0)      0.0000 (1.0)           0;0  2.1075 (1.0)           1           1
test_partial_remove-gc[3.10.0]     509.8850 (1.07)     509.8850 (1.07)     509.8850 (1.07)     0.0000 (1.0)      509.8850 (1.07)     0.0000 (1.0)           0;0  1.9612 (0.93)          1           1
test_partial_remove-gc[3.53.2]     497.4010 (1.05)     497.4010 (1.05)     497.4010 (1.05)     0.0000 (1.0)      497.4010 (1.05)     0.0000 (1.0)           0;0  2.0105 (0.95)          1           1
test_partial_remove-gc[main]       493.3856 (1.04)     493.3856 (1.04)     493.3856 (1.04)     0.0000 (1.0)      493.3856 (1.04)     0.0000 (1.0)           0;0  2.0268 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     545.8551 (1.0)      545.8551 (1.0)      545.8551 (1.0)      0.0000 (1.0)      545.8551 (1.0)      0.0000 (1.0)           0;0  1.8320 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     550.1646 (1.01)     550.1646 (1.01)     550.1646 (1.01)     0.0000 (1.0)      550.1646 (1.01)     0.0000 (1.0)           0;0  1.8176 (0.99)          1           1
test_partial_remove-gc-cloud[3.53.2]     568.8695 (1.04)     568.8695 (1.04)     568.8695 (1.04)     0.0000 (1.0)      568.8695 (1.04)     0.0000 (1.0)           0;0  1.7579 (0.96)          1           1
test_partial_remove-gc-cloud[main]       552.1884 (1.01)     552.1884 (1.01)     552.1884 (1.01)     0.0000 (1.0)      552.1884 (1.01)     0.0000 (1.0)           0;0  1.8110 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     2.0449 (1.54)     2.0449 (1.54)     2.0449 (1.54)     0.0000 (1.0)      2.0449 (1.54)     0.0000 (1.0)           0;0  0.4890 (0.65)          1           1
test_partial_remove-push[3.10.0]     1.8596 (1.40)     1.8596 (1.40)     1.8596 (1.40)     0.0000 (1.0)      1.8596 (1.40)     0.0000 (1.0)           0;0  0.5377 (0.71)          1           1
test_partial_remove-push[3.53.2]     1.3627 (1.03)     1.3627 (1.03)     1.3627 (1.03)     0.0000 (1.0)      1.3627 (1.03)     0.0000 (1.0)           0;0  0.7339 (0.97)          1           1
test_partial_remove-push[main]       1.3258 (1.0)      1.3258 (1.0)      1.3258 (1.0)      0.0000 (1.0)      1.3258 (1.0)      0.0000 (1.0)           0;0  0.7543 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     481.5540 (1.01)     481.5540 (1.01)     481.5540 (1.01)     0.0000 (1.0)      481.5540 (1.01)     0.0000 (1.0)           0;0  2.0766 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     477.8092 (1.0)      477.8092 (1.0)      477.8092 (1.0)      0.0000 (1.0)      477.8092 (1.0)      0.0000 (1.0)           0;0  2.0929 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     748.4546 (1.57)     748.4546 (1.57)     748.4546 (1.57)     0.0000 (1.0)      748.4546 (1.57)     0.0000 (1.0)           0;0  1.3361 (0.64)          1           1
test_partial_remove-push-update[main]       741.0742 (1.55)     741.0742 (1.55)     741.0742 (1.55)     0.0000 (1.0)      741.0742 (1.55)     0.0000 (1.0)           0;0  1.3494 (0.64)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     491.2755 (1.0)      495.1259 (1.0)      493.5108 (1.0)      1.8281 (1.0)      494.2017 (1.0)      3.4005 (1.0)           1;0  2.0263 (1.0)           5           3
test_plots-plots-diff[3.10.0]     922.9720 (1.88)     930.1396 (1.88)     926.9624 (1.88)     2.8936 (1.58)     927.9396 (1.88)     4.4973 (1.32)          2;0  1.0788 (0.53)          5           3
test_plots-plots-diff[3.53.2]     811.2402 (1.65)     821.3268 (1.66)     817.2006 (1.66)     3.7185 (2.03)     818.0174 (1.66)     3.8517 (1.13)          2;0  1.2237 (0.60)          5           3
test_plots-plots-diff[main]       809.9802 (1.65)     826.6271 (1.67)     816.4823 (1.65)     6.2032 (3.39)     814.7710 (1.65)     6.2651 (1.84)          2;0  1.2248 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       511.0337 (1.0)        518.5346 (1.0)        514.6799 (1.0)      2.7648 (1.59)       514.9123 (1.0)       3.4739 (1.84)          2;0  1.9430 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,131.5825 (2.21)     1,143.5811 (2.21)     1,137.4796 (2.21)     5.5652 (3.20)     1,139.1240 (2.21)     10.3072 (5.46)          3;0  0.8791 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       898.3144 (1.76)       921.2404 (1.78)       906.8598 (1.76)     8.7770 (5.04)       905.5574 (1.76)     10.0195 (5.31)          1;0  1.1027 (0.57)          5           3
test_plots-plots-diff-json[main]         884.8946 (1.73)       889.2282 (1.71)       887.8665 (1.73)     1.7409 (1.0)        888.3917 (1.73)      1.8863 (1.0)           1;0  1.1263 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     411.0333 (1.0)      423.4563 (1.0)      417.1623 (1.0)       4.4937 (1.40)     417.1115 (1.0)       5.1135 (1.43)          2;0  2.3971 (1.0)           5           3
test_plots-plots-show[3.10.0]     728.4747 (1.77)     747.9483 (1.77)     738.2450 (1.77)      8.8711 (2.76)     742.0377 (1.78)     15.6771 (4.38)          3;0  1.3546 (0.57)          5           3
test_plots-plots-show[3.53.2]     694.9679 (1.69)     703.7365 (1.66)     698.8308 (1.68)      3.2156 (1.0)      698.9282 (1.68)      3.5806 (1.0)           2;0  1.4310 (0.60)          5           3
test_plots-plots-show[main]       695.8905 (1.69)     724.8302 (1.71)     704.0267 (1.69)     11.8226 (3.68)     699.5551 (1.68)      9.9456 (2.78)          1;1  1.4204 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     424.9485 (1.0)      427.8409 (1.0)      426.5994 (1.0)      1.2362 (1.08)     427.0566 (1.0)       2.0795 (1.14)          2;0  2.3441 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     866.7754 (2.04)     883.2160 (2.06)     874.3189 (2.05)     6.7724 (5.91)     876.3585 (2.05)     10.6039 (5.80)          2;0  1.1437 (0.49)          5           3
test_plots-plots-show-json[3.53.2]     740.2203 (1.74)     742.9119 (1.74)     741.4053 (1.74)     1.1457 (1.0)      740.8119 (1.73)      1.8288 (1.0)           2;0  1.3488 (0.58)          5           3
test_plots-plots-show-json[main]       744.0906 (1.75)     759.2580 (1.77)     751.3240 (1.76)     6.6849 (5.83)     748.1486 (1.75)     11.3168 (6.19)          2;0  1.3310 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     2.2350 (1.47)     2.2350 (1.47)     2.2350 (1.47)     0.0000 (1.0)      2.2350 (1.47)     0.0000 (1.0)           0;0  0.4474 (0.68)          1           1
test_push-push[3.10.0]     2.1749 (1.43)     2.1749 (1.43)     2.1749 (1.43)     0.0000 (1.0)      2.1749 (1.43)     0.0000 (1.0)           0;0  0.4598 (0.70)          1           1
test_push-push[3.53.2]     1.5811 (1.04)     1.5811 (1.04)     1.5811 (1.04)     0.0000 (1.0)      1.5811 (1.04)     0.0000 (1.0)           0;0  0.6325 (0.96)          1           1
test_push-push[main]       1.5245 (1.0)      1.5245 (1.0)      1.5245 (1.0)      0.0000 (1.0)      1.5245 (1.0)      0.0000 (1.0)           0;0  0.6559 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     2.4677 (1.75)     2.4677 (1.75)     2.4677 (1.75)     0.0000 (1.0)      2.4677 (1.75)     0.0000 (1.0)           0;0  0.4052 (0.57)          1           1
test_sharing-fetch[3.10.0]     2.8214 (2.01)     2.8214 (2.01)     2.8214 (2.01)     0.0000 (1.0)      2.8214 (2.01)     0.0000 (1.0)           0;0  0.3544 (0.50)          1           1
test_sharing-fetch[3.53.2]     1.6694 (1.19)     1.6694 (1.19)     1.6694 (1.19)     0.0000 (1.0)      1.6694 (1.19)     0.0000 (1.0)           0;0  0.5990 (0.84)          1           1
test_sharing-fetch[main]       1.4071 (1.0)      1.4071 (1.0)      1.4071 (1.0)      0.0000 (1.0)      1.4071 (1.0)      0.0000 (1.0)           0;0  0.7107 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     447.4910 (1.0)      447.4910 (1.0)      447.4910 (1.0)      0.0000 (1.0)      447.4910 (1.0)      0.0000 (1.0)           0;0  2.2347 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     515.8236 (1.15)     515.8236 (1.15)     515.8236 (1.15)     0.0000 (1.0)      515.8236 (1.15)     0.0000 (1.0)           0;0  1.9386 (0.87)          1           1
test_sharing-fetch-noop[3.53.2]     800.7186 (1.79)     800.7186 (1.79)     800.7186 (1.79)     0.0000 (1.0)      800.7186 (1.79)     0.0000 (1.0)           0;0  1.2489 (0.56)          1           1
test_sharing-fetch-noop[main]       794.7523 (1.78)     794.7523 (1.78)     794.7523 (1.78)     0.0000 (1.0)      794.7523 (1.78)     0.0000 (1.0)           0;0  1.2583 (0.56)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     2.1943 (1.48)     2.1943 (1.48)     2.1943 (1.48)     0.0000 (1.0)      2.1943 (1.48)     0.0000 (1.0)           0;0  0.4557 (0.67)          1           1
test_sharing-push[3.10.0]     2.0874 (1.41)     2.0874 (1.41)     2.0874 (1.41)     0.0000 (1.0)      2.0874 (1.41)     0.0000 (1.0)           0;0  0.4791 (0.71)          1           1
test_sharing-push[3.53.2]     1.7178 (1.16)     1.7178 (1.16)     1.7178 (1.16)     0.0000 (1.0)      1.7178 (1.16)     0.0000 (1.0)           0;0  0.5821 (0.86)          1           1
test_sharing-push[main]       1.4809 (1.0)      1.4809 (1.0)      1.4809 (1.0)      0.0000 (1.0)      1.4809 (1.0)      0.0000 (1.0)           0;0  0.6753 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                         Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]       455.2119 (1.00)       455.2119 (1.00)       455.2119 (1.00)     0.0000 (1.0)        455.2119 (1.00)     0.0000 (1.0)           0;0  2.1968 (1.00)          1           1
test_sharing-push-noop[3.10.0]       453.3804 (1.0)        453.3804 (1.0)        453.3804 (1.0)      0.0000 (1.0)        453.3804 (1.0)      0.0000 (1.0)           0;0  2.2057 (1.0)           1           1
test_sharing-push-noop[3.53.2]     1,183.7737 (2.61)     1,183.7737 (2.61)     1,183.7737 (2.61)     0.0000 (1.0)      1,183.7737 (2.61)     0.0000 (1.0)           0;0  0.8448 (0.38)          1           1
test_sharing-push-noop[main]         837.5602 (1.85)       837.5602 (1.85)       837.5602 (1.85)     0.0000 (1.0)        837.5602 (1.85)     0.0000 (1.0)           0;0  1.1939 (0.54)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     2.6310 (3.31)     2.6310 (3.31)     2.6310 (3.31)     0.0000 (1.0)      2.6310 (3.31)     0.0000 (1.0)           0;0  0.3801 (0.30)          1           1
test_status-status[3.10.0]     1.4107 (1.77)     1.4107 (1.77)     1.4107 (1.77)     0.0000 (1.0)      1.4107 (1.77)     0.0000 (1.0)           0;0  0.7089 (0.56)          1           1
test_status-status[3.53.2]     1.2433 (1.56)     1.2433 (1.56)     1.2433 (1.56)     0.0000 (1.0)      1.2433 (1.56)     0.0000 (1.0)           0;0  0.8043 (0.64)          1           1
test_status-status[main]       0.7954 (1.0)      0.7954 (1.0)      0.7954 (1.0)      0.0000 (1.0)      0.7954 (1.0)      0.0000 (1.0)           0;0  1.2573 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     532.3431 (1.17)     532.3431 (1.17)     532.3431 (1.17)     0.0000 (1.0)      532.3431 (1.17)     0.0000 (1.0)           0;0  1.8785 (0.85)          1           1
test_status-status-changed[3.10.0]     530.5803 (1.17)     530.5803 (1.17)     530.5803 (1.17)     0.0000 (1.0)      530.5803 (1.17)     0.0000 (1.0)           0;0  1.8847 (0.86)          1           1
test_status-status-changed[3.53.2]     514.0824 (1.13)     514.0824 (1.13)     514.0824 (1.13)     0.0000 (1.0)      514.0824 (1.13)     0.0000 (1.0)           0;0  1.9452 (0.88)          1           1
test_status-status-changed[main]       453.9850 (1.0)      453.9850 (1.0)      453.9850 (1.0)      0.0000 (1.0)      453.9850 (1.0)      0.0000 (1.0)           0;0  2.2027 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     527.5724 (1.20)     527.5724 (1.20)     527.5724 (1.20)     0.0000 (1.0)      527.5724 (1.20)     0.0000 (1.0)           0;0  1.8955 (0.83)          1           1
test_status-status-changed-noop[3.10.0]     536.6950 (1.22)     536.6950 (1.22)     536.6950 (1.22)     0.0000 (1.0)      536.6950 (1.22)     0.0000 (1.0)           0;0  1.8633 (0.82)          1           1
test_status-status-changed-noop[3.53.2]     504.0621 (1.15)     504.0621 (1.15)     504.0621 (1.15)     0.0000 (1.0)      504.0621 (1.15)     0.0000 (1.0)           0;0  1.9839 (0.87)          1           1
test_status-status-changed-noop[main]       438.3551 (1.0)      438.3551 (1.0)      438.3551 (1.0)      0.0000 (1.0)      438.3551 (1.0)      0.0000 (1.0)           0;0  2.2813 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     510.1631 (1.15)     510.1631 (1.15)     510.1631 (1.15)     0.0000 (1.0)      510.1631 (1.15)     0.0000 (1.0)           0;0  1.9602 (0.87)          1           1
test_status-status-noop[3.10.0]     540.5806 (1.22)     540.5806 (1.22)     540.5806 (1.22)     0.0000 (1.0)      540.5806 (1.22)     0.0000 (1.0)           0;0  1.8499 (0.82)          1           1
test_status-status-noop[3.53.2]     511.9572 (1.16)     511.9572 (1.16)     511.9572 (1.16)     0.0000 (1.0)      511.9572 (1.16)     0.0000 (1.0)           0;0  1.9533 (0.87)          1           1
test_status-status-noop[main]       443.0175 (1.0)      443.0175 (1.0)      443.0175 (1.0)      0.0000 (1.0)      443.0175 (1.0)      0.0000 (1.0)           0;0  2.2572 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     6.2774 (2.21)     6.2774 (2.21)     6.2774 (2.21)     0.0000 (1.0)      6.2774 (2.21)     0.0000 (1.0)           0;0  0.1593 (0.45)          1           1
test_update-import-url[3.10.0]     6.1046 (2.15)     6.1046 (2.15)     6.1046 (2.15)     0.0000 (1.0)      6.1046 (2.15)     0.0000 (1.0)           0;0  0.1638 (0.47)          1           1
test_update-import-url[3.53.2]     4.7015 (1.65)     4.7015 (1.65)     4.7015 (1.65)     0.0000 (1.0)      4.7015 (1.65)     0.0000 (1.0)           0;0  0.2127 (0.60)          1           1
test_update-import-url[main]       2.8418 (1.0)      2.8418 (1.0)      2.8418 (1.0)      0.0000 (1.0)      2.8418 (1.0)      0.0000 (1.0)           0;0  0.3519 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     5.0047 (2.94)     5.0047 (2.94)     5.0047 (2.94)     0.0000 (1.0)      5.0047 (2.94)     0.0000 (1.0)           0;0  0.1998 (0.34)          1           1
test_update-update[3.10.0]     5.2974 (3.12)     5.2974 (3.12)     5.2974 (3.12)     0.0000 (1.0)      5.2974 (3.12)     0.0000 (1.0)           0;0  0.1888 (0.32)          1           1
test_update-update[3.53.2]     3.9652 (2.33)     3.9652 (2.33)     3.9652 (2.33)     0.0000 (1.0)      3.9652 (2.33)     0.0000 (1.0)           0;0  0.2522 (0.43)          1           1
test_update-update[main]       1.6997 (1.0)      1.6997 (1.0)      1.6997 (1.0)      0.0000 (1.0)      1.6997 (1.0)      0.0000 (1.0)           0;0  0.5884 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     892.1554 (1.46)     892.1554 (1.46)     892.1554 (1.46)     0.0000 (1.0)      892.1554 (1.46)     0.0000 (1.0)           0;0  1.1209 (0.68)          1           1
test_update-update-noop[3.10.0]     950.2048 (1.56)     950.2048 (1.56)     950.2048 (1.56)     0.0000 (1.0)      950.2048 (1.56)     0.0000 (1.0)           0;0  1.0524 (0.64)          1           1
test_update-update-noop[3.53.2]     874.9685 (1.43)     874.9685 (1.43)     874.9685 (1.43)     0.0000 (1.0)      874.9685 (1.43)     0.0000 (1.0)           0;0  1.1429 (0.70)          1           1
test_update-update-noop[main]       610.4889 (1.0)      610.4889 (1.0)      610.4889 (1.0)      0.0000 (1.0)      610.4889 (1.0)      0.0000 (1.0)           0;0  1.6380 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean