Fri Jun  6 00:39:42 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     90.0052 (3.87)     90.0052 (3.87)     90.0052 (3.87)     0.0000 (1.0)      90.0052 (3.87)     0.0000 (1.0)           0;0  0.0111 (0.26)          1           1
test_add_copy-add[3.10.0]     90.2853 (3.88)     90.2853 (3.88)     90.2853 (3.88)     0.0000 (1.0)      90.2853 (3.88)     0.0000 (1.0)           0;0  0.0111 (0.26)          1           1
test_add_copy-add[3.53.2]     81.5894 (3.51)     81.5894 (3.51)     81.5894 (3.51)     0.0000 (1.0)      81.5894 (3.51)     0.0000 (1.0)           0;0  0.0123 (0.29)          1           1
test_add_copy-add[main]       23.2588 (1.0)      23.2588 (1.0)      23.2588 (1.0)      0.0000 (1.0)      23.2588 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.7028 (7.15)     30.7028 (7.15)     30.7028 (7.15)     0.0000 (1.0)      30.7028 (7.15)     0.0000 (1.0)           0;0  0.0326 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     30.8273 (7.18)     30.8273 (7.18)     30.8273 (7.18)     0.0000 (1.0)      30.8273 (7.18)     0.0000 (1.0)           0;0  0.0324 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     29.4076 (6.85)     29.4076 (6.85)     29.4076 (6.85)     0.0000 (1.0)      29.4076 (6.85)     0.0000 (1.0)           0;0  0.0340 (0.15)          1           1
test_add_copy-add-noop[main]        4.2936 (1.0)       4.2936 (1.0)       4.2936 (1.0)      0.0000 (1.0)       4.2936 (1.0)      0.0000 (1.0)           0;0  0.2329 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     74.0865 (4.35)     74.0865 (4.35)     74.0865 (4.35)     0.0000 (1.0)      74.0865 (4.35)     0.0000 (1.0)           0;0  0.0135 (0.23)          1           1
test_add_hardlink-add[3.10.0]     74.4267 (4.37)     74.4267 (4.37)     74.4267 (4.37)     0.0000 (1.0)      74.4267 (4.37)     0.0000 (1.0)           0;0  0.0134 (0.23)          1           1
test_add_hardlink-add[3.53.2]     69.5234 (4.08)     69.5234 (4.08)     69.5234 (4.08)     0.0000 (1.0)      69.5234 (4.08)     0.0000 (1.0)           0;0  0.0144 (0.24)          1           1
test_add_hardlink-add[main]       17.0277 (1.0)      17.0277 (1.0)      17.0277 (1.0)      0.0000 (1.0)      17.0277 (1.0)      0.0000 (1.0)           0;0  0.0587 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.7798 (8.03)     36.7798 (8.03)     36.7798 (8.03)     0.0000 (1.0)      36.7798 (8.03)     0.0000 (1.0)           0;0  0.0272 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     37.4614 (8.18)     37.4614 (8.18)     37.4614 (8.18)     0.0000 (1.0)      37.4614 (8.18)     0.0000 (1.0)           0;0  0.0267 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     35.6473 (7.78)     35.6473 (7.78)     35.6473 (7.78)     0.0000 (1.0)      35.6473 (7.78)     0.0000 (1.0)           0;0  0.0281 (0.13)          1           1
test_add_hardlink-add-noop[main]        4.5807 (1.0)       4.5807 (1.0)       4.5807 (1.0)      0.0000 (1.0)       4.5807 (1.0)      0.0000 (1.0)           0;0  0.2183 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     76.6262 (2.13)     76.6262 (2.13)     76.6262 (2.13)     0.0000 (1.0)      76.6262 (2.13)     0.0000 (1.0)           0;0  0.0131 (0.47)          1           1
test_add_symlink-add[3.10.0]     77.3057 (2.15)     77.3057 (2.15)     77.3057 (2.15)     0.0000 (1.0)      77.3057 (2.15)     0.0000 (1.0)           0;0  0.0129 (0.47)          1           1
test_add_symlink-add[3.53.2]     71.6714 (1.99)     71.6714 (1.99)     71.6714 (1.99)     0.0000 (1.0)      71.6714 (1.99)     0.0000 (1.0)           0;0  0.0140 (0.50)          1           1
test_add_symlink-add[main]       35.9707 (1.0)      35.9707 (1.0)      35.9707 (1.0)      0.0000 (1.0)      35.9707 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     49.0685 (8.64)     49.0685 (8.64)     49.0685 (8.64)     0.0000 (1.0)      49.0685 (8.64)     0.0000 (1.0)           0;0  0.0204 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.4980 (8.71)     49.4980 (8.71)     49.4980 (8.71)     0.0000 (1.0)      49.4980 (8.71)     0.0000 (1.0)           0;0  0.0202 (0.11)          1           1
test_add_symlink-add-noop[3.53.2]     49.1996 (8.66)     49.1996 (8.66)     49.1996 (8.66)     0.0000 (1.0)      49.1996 (8.66)     0.0000 (1.0)           0;0  0.0203 (0.12)          1           1
test_add_symlink-add-noop[main]        5.6822 (1.0)       5.6822 (1.0)       5.6822 (1.0)      0.0000 (1.0)       5.6822 (1.0)      0.0000 (1.0)           0;0  0.1760 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.6094 (2.03)     43.6094 (2.03)     43.6094 (2.03)     0.0000 (1.0)      43.6094 (2.03)     0.0000 (1.0)           0;0  0.0229 (0.49)          1           1
test_checkout_copy-checkout[3.10.0]     62.0489 (2.88)     62.0489 (2.88)     62.0489 (2.88)     0.0000 (1.0)      62.0489 (2.88)     0.0000 (1.0)           0;0  0.0161 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.3157 (1.36)     29.3157 (1.36)     29.3157 (1.36)     0.0000 (1.0)      29.3157 (1.36)     0.0000 (1.0)           0;0  0.0341 (0.73)          1           1
test_checkout_copy-checkout[main]       21.5082 (1.0)      21.5082 (1.0)      21.5082 (1.0)      0.0000 (1.0)      21.5082 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4555 (1.67)     5.4555 (1.67)     5.4555 (1.67)     0.0000 (1.0)      5.4555 (1.67)     0.0000 (1.0)           0;0  0.1833 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6135 (1.72)     5.6135 (1.72)     5.6135 (1.72)     0.0000 (1.0)      5.6135 (1.72)     0.0000 (1.0)           0;0  0.1781 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4979 (1.68)     5.4979 (1.68)     5.4979 (1.68)     0.0000 (1.0)      5.4979 (1.68)     0.0000 (1.0)           0;0  0.1819 (0.59)          1           1
test_checkout_copy-checkout-noop[main]       3.2640 (1.0)      3.2640 (1.0)      3.2640 (1.0)      0.0000 (1.0)      3.2640 (1.0)      0.0000 (1.0)           0;0  0.3064 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6884 (2.19)     8.6884 (2.19)     8.6884 (2.19)     0.0000 (1.0)      8.6884 (2.19)     0.0000 (1.0)           0;0  0.1151 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3744 (1.61)     6.3744 (1.61)     6.3744 (1.61)     0.0000 (1.0)      6.3744 (1.61)     0.0000 (1.0)           0;0  0.1569 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1559 (1.55)     6.1559 (1.55)     6.1559 (1.55)     0.0000 (1.0)      6.1559 (1.55)     0.0000 (1.0)           0;0  0.1624 (0.64)          1           1
test_checkout_copy-checkout-update[main]       3.9629 (1.0)      3.9629 (1.0)      3.9629 (1.0)      0.0000 (1.0)      3.9629 (1.0)      0.0000 (1.0)           0;0  0.2523 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.6965 (3.19)     24.6965 (3.19)     24.6965 (3.19)     0.0000 (1.0)      24.6965 (3.19)     0.0000 (1.0)           0;0  0.0405 (0.31)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.4380 (2.25)     17.4380 (2.25)     17.4380 (2.25)     0.0000 (1.0)      17.4380 (2.25)     0.0000 (1.0)           0;0  0.0573 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.0564 (2.07)     16.0564 (2.07)     16.0564 (2.07)     0.0000 (1.0)      16.0564 (2.07)     0.0000 (1.0)           0;0  0.0623 (0.48)          1           1
test_checkout_hardlink-checkout[main]        7.7424 (1.0)       7.7424 (1.0)       7.7424 (1.0)      0.0000 (1.0)       7.7424 (1.0)      0.0000 (1.0)           0;0  0.1292 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5536 (1.71)     5.5536 (1.71)     5.5536 (1.71)     0.0000 (1.0)      5.5536 (1.71)     0.0000 (1.0)           0;0  0.1801 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7067 (1.75)     5.7067 (1.75)     5.7067 (1.75)     0.0000 (1.0)      5.7067 (1.75)     0.0000 (1.0)           0;0  0.1752 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4849 (1.68)     5.4849 (1.68)     5.4849 (1.68)     0.0000 (1.0)      5.4849 (1.68)     0.0000 (1.0)           0;0  0.1823 (0.59)          1           1
test_checkout_hardlink-checkout-noop[main]       3.2556 (1.0)      3.2556 (1.0)      3.2556 (1.0)      0.0000 (1.0)      3.2556 (1.0)      0.0000 (1.0)           0;0  0.3072 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6597 (2.24)     8.6597 (2.24)     8.6597 (2.24)     0.0000 (1.0)      8.6597 (2.24)     0.0000 (1.0)           0;0  0.1155 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4783 (1.68)     6.4783 (1.68)     6.4783 (1.68)     0.0000 (1.0)      6.4783 (1.68)     0.0000 (1.0)           0;0  0.1544 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3282 (1.64)     6.3282 (1.64)     6.3282 (1.64)     0.0000 (1.0)      6.3282 (1.64)     0.0000 (1.0)           0;0  0.1580 (0.61)          1           1
test_checkout_hardlink-checkout-update[main]       3.8646 (1.0)      3.8646 (1.0)      3.8646 (1.0)      0.0000 (1.0)      3.8646 (1.0)      0.0000 (1.0)           0;0  0.2588 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.0917 (2.39)     27.0917 (2.39)     27.0917 (2.39)     0.0000 (1.0)      27.0917 (2.39)     0.0000 (1.0)           0;0  0.0369 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     21.3532 (1.88)     21.3532 (1.88)     21.3532 (1.88)     0.0000 (1.0)      21.3532 (1.88)     0.0000 (1.0)           0;0  0.0468 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.4505 (1.72)     19.4505 (1.72)     19.4505 (1.72)     0.0000 (1.0)      19.4505 (1.72)     0.0000 (1.0)           0;0  0.0514 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.3386 (1.0)      11.3386 (1.0)      11.3386 (1.0)      0.0000 (1.0)      11.3386 (1.0)      0.0000 (1.0)           0;0  0.0882 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.5241 (1.52)     6.5241 (1.52)     6.5241 (1.52)     0.0000 (1.0)      6.5241 (1.52)     0.0000 (1.0)           0;0  0.1533 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9728 (1.63)     6.9728 (1.63)     6.9728 (1.63)     0.0000 (1.0)      6.9728 (1.63)     0.0000 (1.0)           0;0  0.1434 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6120 (1.54)     6.6120 (1.54)     6.6120 (1.54)     0.0000 (1.0)      6.6120 (1.54)     0.0000 (1.0)           0;0  0.1512 (0.65)          1           1
test_checkout_symlink-checkout-noop[main]       4.2847 (1.0)      4.2847 (1.0)      4.2847 (1.0)      0.0000 (1.0)      4.2847 (1.0)      0.0000 (1.0)           0;0  0.2334 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.4698 (1.82)     10.4698 (1.82)     10.4698 (1.82)     0.0000 (1.0)      10.4698 (1.82)     0.0000 (1.0)           0;0  0.0955 (0.55)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.3789 (1.45)      8.3789 (1.45)      8.3789 (1.45)     0.0000 (1.0)       8.3789 (1.45)     0.0000 (1.0)           0;0  0.1193 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.2070 (1.42)      8.2070 (1.42)      8.2070 (1.42)     0.0000 (1.0)       8.2070 (1.42)     0.0000 (1.0)           0;0  0.1218 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        5.7618 (1.0)       5.7618 (1.0)       5.7618 (1.0)      0.0000 (1.0)       5.7618 (1.0)      0.0000 (1.0)           0;0  0.1736 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.8990 (1.72)     3.8990 (1.72)     3.8990 (1.72)     0.0000 (1.0)      3.8990 (1.72)     0.0000 (1.0)           0;0  0.2565 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.8377 (2.13)     4.8377 (2.13)     4.8377 (2.13)     0.0000 (1.0)      4.8377 (2.13)     0.0000 (1.0)           0;0  0.2067 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.3944 (1.93)     4.3944 (1.93)     4.3944 (1.93)     0.0000 (1.0)      4.3944 (1.93)     0.0000 (1.0)           0;0  0.2276 (0.52)          1           1
test_data_status-data-changed[main]       2.2717 (1.0)      2.2717 (1.0)      2.2717 (1.0)      0.0000 (1.0)      2.2717 (1.0)      0.0000 (1.0)           0;0  0.4402 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0603 (1.82)     4.0603 (1.82)     4.0603 (1.82)     0.0000 (1.0)      4.0603 (1.82)     0.0000 (1.0)           0;0  0.2463 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7386 (2.13)     4.7386 (2.13)     4.7386 (2.13)     0.0000 (1.0)      4.7386 (2.13)     0.0000 (1.0)           0;0  0.2110 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6076 (2.07)     4.6076 (2.07)     4.6076 (2.07)     0.0000 (1.0)      4.6076 (2.07)     0.0000 (1.0)           0;0  0.2170 (0.48)          1           1
test_data_status-data-changed-noop[main]       2.2257 (1.0)      2.2257 (1.0)      2.2257 (1.0)      0.0000 (1.0)      2.2257 (1.0)      0.0000 (1.0)           0;0  0.4493 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.3549 (3.83)     19.3549 (3.83)     19.3549 (3.83)     0.0000 (1.0)      19.3549 (3.83)     0.0000 (1.0)           0;0  0.0517 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.8307 (4.13)     20.8307 (4.13)     20.8307 (4.13)     0.0000 (1.0)      20.8307 (4.13)     0.0000 (1.0)           0;0  0.0480 (0.24)          1           1
test_data_status-data-new[3.53.2]     20.5910 (4.08)     20.5910 (4.08)     20.5910 (4.08)     0.0000 (1.0)      20.5910 (4.08)     0.0000 (1.0)           0;0  0.0486 (0.25)          1           1
test_data_status-data-new[main]        5.0479 (1.0)       5.0479 (1.0)       5.0479 (1.0)      0.0000 (1.0)       5.0479 (1.0)      0.0000 (1.0)           0;0  0.1981 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0477 (1.81)     4.0477 (1.81)     4.0477 (1.81)     0.0000 (1.0)      4.0477 (1.81)     0.0000 (1.0)           0;0  0.2471 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.6186 (2.06)     4.6186 (2.06)     4.6186 (2.06)     0.0000 (1.0)      4.6186 (2.06)     0.0000 (1.0)           0;0  0.2165 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6655 (2.09)     4.6655 (2.09)     4.6655 (2.09)     0.0000 (1.0)      4.6655 (2.09)     0.0000 (1.0)           0;0  0.2143 (0.48)          1           1
test_data_status-data-noop[main]       2.2369 (1.0)      2.2369 (1.0)      2.2369 (1.0)      0.0000 (1.0)      2.2369 (1.0)      0.0000 (1.0)           0;0  0.4470 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     15.7271 (1.11)     15.7271 (1.11)     15.7271 (1.11)     0.0000 (1.0)      15.7271 (1.11)     0.0000 (1.0)           0;0  0.0636 (0.90)          1           1
test_data_status_all_flags-data-changed[3.10.0]     16.4090 (1.15)     16.4090 (1.15)     16.4090 (1.15)     0.0000 (1.0)      16.4090 (1.15)     0.0000 (1.0)           0;0  0.0609 (0.87)          1           1
test_data_status_all_flags-data-changed[3.53.2]     16.4616 (1.16)     16.4616 (1.16)     16.4616 (1.16)     0.0000 (1.0)      16.4616 (1.16)     0.0000 (1.0)           0;0  0.0607 (0.86)          1           1
test_data_status_all_flags-data-changed[main]       14.2129 (1.0)      14.2129 (1.0)      14.2129 (1.0)      0.0000 (1.0)      14.2129 (1.0)      0.0000 (1.0)           0;0  0.0704 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     15.8012 (1.11)     15.8012 (1.11)     15.8012 (1.11)     0.0000 (1.0)      15.8012 (1.11)     0.0000 (1.0)           0;0  0.0633 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     16.2941 (1.14)     16.2941 (1.14)     16.2941 (1.14)     0.0000 (1.0)      16.2941 (1.14)     0.0000 (1.0)           0;0  0.0614 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     16.3197 (1.14)     16.3197 (1.14)     16.3197 (1.14)     0.0000 (1.0)      16.3197 (1.14)     0.0000 (1.0)           0;0  0.0613 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[main]       14.2853 (1.0)      14.2853 (1.0)      14.2853 (1.0)      0.0000 (1.0)      14.2853 (1.0)      0.0000 (1.0)           0;0  0.0700 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     31.8501 (1.83)     31.8501 (1.83)     31.8501 (1.83)     0.0000 (1.0)      31.8501 (1.83)     0.0000 (1.0)           0;0  0.0314 (0.55)          1           1
test_data_status_all_flags-data-new[3.10.0]     32.4460 (1.87)     32.4460 (1.87)     32.4460 (1.87)     0.0000 (1.0)      32.4460 (1.87)     0.0000 (1.0)           0;0  0.0308 (0.54)          1           1
test_data_status_all_flags-data-new[3.53.2]     32.6973 (1.88)     32.6973 (1.88)     32.6973 (1.88)     0.0000 (1.0)      32.6973 (1.88)     0.0000 (1.0)           0;0  0.0306 (0.53)          1           1
test_data_status_all_flags-data-new[main]       17.3831 (1.0)      17.3831 (1.0)      17.3831 (1.0)      0.0000 (1.0)      17.3831 (1.0)      0.0000 (1.0)           0;0  0.0575 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     15.1284 (1.10)     15.1284 (1.10)     15.1284 (1.10)     0.0000 (1.0)      15.1284 (1.10)     0.0000 (1.0)           0;0  0.0661 (0.91)          1           1
test_data_status_all_flags-data-noop[3.10.0]     15.6376 (1.13)     15.6376 (1.13)     15.6376 (1.13)     0.0000 (1.0)      15.6376 (1.13)     0.0000 (1.0)           0;0  0.0639 (0.88)          1           1
test_data_status_all_flags-data-noop[3.53.2]     15.6534 (1.13)     15.6534 (1.13)     15.6534 (1.13)     0.0000 (1.0)      15.6534 (1.13)     0.0000 (1.0)           0;0  0.0639 (0.88)          1           1
test_data_status_all_flags-data-noop[main]       13.8040 (1.0)      13.8040 (1.0)      13.8040 (1.0)      0.0000 (1.0)      13.8040 (1.0)      0.0000 (1.0)           0;0  0.0724 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.5121 (2.76)     19.5121 (2.76)     19.5121 (2.76)     0.0000 (1.0)      19.5121 (2.76)     0.0000 (1.0)           0;0  0.0513 (0.36)          1           1
test_diff-diff[3.10.0]     20.3434 (2.88)     20.3434 (2.88)     20.3434 (2.88)     0.0000 (1.0)      20.3434 (2.88)     0.0000 (1.0)           0;0  0.0492 (0.35)          1           1
test_diff-diff[3.53.2]     20.2749 (2.87)     20.2749 (2.87)     20.2749 (2.87)     0.0000 (1.0)      20.2749 (2.87)     0.0000 (1.0)           0;0  0.0493 (0.35)          1           1
test_diff-diff[main]        7.0733 (1.0)       7.0733 (1.0)       7.0733 (1.0)      0.0000 (1.0)       7.0733 (1.0)      0.0000 (1.0)           0;0  0.1414 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1183 (1.82)     6.1183 (1.82)     6.1183 (1.82)     0.0000 (1.0)      6.1183 (1.82)     0.0000 (1.0)           0;0  0.1634 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.7220 (2.00)     6.7220 (2.00)     6.7220 (2.00)     0.0000 (1.0)      6.7220 (2.00)     0.0000 (1.0)           0;0  0.1488 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.5589 (1.65)     5.5589 (1.65)     5.5589 (1.65)     0.0000 (1.0)      5.5589 (1.65)     0.0000 (1.0)           0;0  0.1799 (0.60)          1           1
test_diff-diff-changed[main]       3.3608 (1.0)      3.3608 (1.0)      3.3608 (1.0)      0.0000 (1.0)      3.3608 (1.0)      0.0000 (1.0)           0;0  0.2975 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1955 (1.56)     5.1955 (1.56)     5.1955 (1.56)     0.0000 (1.0)      5.1955 (1.56)     0.0000 (1.0)           0;0  0.1925 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.5919 (1.68)     5.5919 (1.68)     5.5919 (1.68)     0.0000 (1.0)      5.5919 (1.68)     0.0000 (1.0)           0;0  0.1788 (0.60)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4645 (1.64)     5.4645 (1.64)     5.4645 (1.64)     0.0000 (1.0)      5.4645 (1.64)     0.0000 (1.0)           0;0  0.1830 (0.61)          1           1
test_diff-diff-changed-noop[main]       3.3360 (1.0)      3.3360 (1.0)      3.3360 (1.0)      0.0000 (1.0)      3.3360 (1.0)      0.0000 (1.0)           0;0  0.2998 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2505 (1.27)     4.2505 (1.27)     4.2505 (1.27)     0.0000 (1.0)      4.2505 (1.27)     0.0000 (1.0)           0;0  0.2353 (0.79)          1           1
test_diff-diff-noop[3.10.0]     4.8124 (1.44)     4.8124 (1.44)     4.8124 (1.44)     0.0000 (1.0)      4.8124 (1.44)     0.0000 (1.0)           0;0  0.2078 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.5164 (1.65)     5.5164 (1.65)     5.5164 (1.65)     0.0000 (1.0)      5.5164 (1.65)     0.0000 (1.0)           0;0  0.1813 (0.61)          1           1
test_diff-diff-noop[main]       3.3473 (1.0)      3.3473 (1.0)      3.3473 (1.0)      0.0000 (1.0)      3.3473 (1.0)      0.0000 (1.0)           0;0  0.2988 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        987.6699 (1.0)         987.6699 (1.0)         987.6699 (1.0)      0.0000 (1.0)         987.6699 (1.0)      0.0000 (1.0)           0;0  1.0125 (1.0)           1           1
test_exp_show-exp[3.10.0]     15,258.4815 (15.45)    15,258.4815 (15.45)    15,258.4815 (15.45)    0.0000 (1.0)      15,258.4815 (15.45)    0.0000 (1.0)           0;0  0.0655 (0.06)          1           1
test_exp_show-exp[3.53.2]      8,357.0420 (8.46)      8,357.0420 (8.46)      8,357.0420 (8.46)     0.0000 (1.0)       8,357.0420 (8.46)     0.0000 (1.0)           0;0  0.1197 (0.12)          1           1
test_exp_show-exp[main]       14,853.4155 (15.04)    14,853.4155 (15.04)    14,853.4155 (15.04)    0.0000 (1.0)      14,853.4155 (15.04)    0.0000 (1.0)           0;0  0.0673 (0.07)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.1025 (2.87)     67.1025 (2.87)     67.1025 (2.87)     0.0000 (1.0)      67.1025 (2.87)     0.0000 (1.0)           0;0  0.0149 (0.35)          1           1
test_fetch-fetch[3.10.0]     72.2719 (3.10)     72.2719 (3.10)     72.2719 (3.10)     0.0000 (1.0)      72.2719 (3.10)     0.0000 (1.0)           0;0  0.0138 (0.32)          1           1
test_fetch-fetch[3.53.2]     35.7713 (1.53)     35.7713 (1.53)     35.7713 (1.53)     0.0000 (1.0)      35.7713 (1.53)     0.0000 (1.0)           0;0  0.0280 (0.65)          1           1
test_fetch-fetch[main]       23.3438 (1.0)      23.3438 (1.0)      23.3438 (1.0)      0.0000 (1.0)      23.3438 (1.0)      0.0000 (1.0)           0;0  0.0428 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8341 (1.03)     2.8341 (1.03)     2.8341 (1.03)     0.0000 (1.0)      2.8341 (1.03)     0.0000 (1.0)           0;0  0.3528 (0.98)          1           1
test_gc-gc[3.10.0]     2.9052 (1.05)     2.9052 (1.05)     2.9052 (1.05)     0.0000 (1.0)      2.9052 (1.05)     0.0000 (1.0)           0;0  0.3442 (0.95)          1           1
test_gc-gc[3.53.2]     2.8564 (1.03)     2.8564 (1.03)     2.8564 (1.03)     0.0000 (1.0)      2.8564 (1.03)     0.0000 (1.0)           0;0  0.3501 (0.97)          1           1
test_gc-gc[main]       2.7633 (1.0)      2.7633 (1.0)      2.7633 (1.0)      0.0000 (1.0)      2.7633 (1.0)      0.0000 (1.0)           0;0  0.3619 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     133.6482 (2.68)     133.6482 (2.68)     133.6482 (2.68)     0.0000 (1.0)      133.6482 (2.68)     0.0000 (1.0)           0;0  0.0075 (0.37)          1           1
test_get-get[3.10.0]     160.9313 (3.23)     160.9313 (3.23)     160.9313 (3.23)     0.0000 (1.0)      160.9313 (3.23)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     141.7571 (2.85)     141.7571 (2.85)     141.7571 (2.85)     0.0000 (1.0)      141.7571 (2.85)     0.0000 (1.0)           0;0  0.0071 (0.35)          1           1
test_get-get[main]        49.8108 (1.0)       49.8108 (1.0)       49.8108 (1.0)      0.0000 (1.0)       49.8108 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.7965 (2.70)     44.7965 (2.70)     44.7965 (2.70)     0.0000 (1.0)      44.7965 (2.70)     0.0000 (1.0)           0;0  0.0223 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.5463 (2.87)     47.5463 (2.87)     47.5463 (2.87)     0.0000 (1.0)      47.5463 (2.87)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.5905 (1.0)      16.5905 (1.0)      16.5905 (1.0)      0.0000 (1.0)      16.5905 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
test_get_url-get-url[main]       16.6176 (1.00)     16.6176 (1.00)     16.6176 (1.00)     0.0000 (1.0)      16.6176 (1.00)     0.0000 (1.0)           0;0  0.0602 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     126.8948 (1.01)     134.4769 (1.00)     131.7332 (1.02)     1.3761 (1.0)      131.9248 (1.02)     1.4279 (1.0)          22;5  7.5911 (0.98)        100           1
test_help---help[3.10.0]     125.6223 (1.0)      133.9054 (1.0)      128.9295 (1.0)      1.6701 (1.21)     129.0210 (1.0)      2.2055 (1.54)         31;1  7.7562 (1.0)         100           1
test_help---help[3.53.2]     127.9250 (1.02)     195.5909 (1.46)     133.4012 (1.03)     7.4783 (5.43)     131.9608 (1.02)     1.8231 (1.28)         6;15  7.4962 (0.97)        100           1
test_help---help[main]       128.9732 (1.03)     145.9775 (1.09)     132.7012 (1.03)     2.2288 (1.62)     132.4344 (1.03)     2.0044 (1.40)         25;3  7.5357 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     233.9857 (3.00)     233.9857 (3.00)     233.9857 (3.00)     0.0000 (1.0)      233.9857 (3.00)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     266.5239 (3.41)     266.5239 (3.41)     266.5239 (3.41)     0.0000 (1.0)      266.5239 (3.41)     0.0000 (1.0)           0;0  0.0038 (0.29)          1           1
test_import-import[main]        78.0675 (1.0)       78.0675 (1.0)       78.0675 (1.0)      0.0000 (1.0)       78.0675 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     165.0450 (3.41)     165.0450 (3.41)     165.0450 (3.41)     0.0000 (1.0)      165.0450 (3.41)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.10.0]     168.4091 (3.48)     168.4091 (3.48)     168.4091 (3.48)     0.0000 (1.0)      168.4091 (3.48)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.0923 (2.60)     126.0923 (2.60)     126.0923 (2.60)     0.0000 (1.0)      126.0923 (2.60)     0.0000 (1.0)           0;0  0.0079 (0.38)          1           1
test_import_url-import-url[main]        48.4260 (1.0)       48.4260 (1.0)       48.4260 (1.0)      0.0000 (1.0)       48.4260 (1.0)      0.0000 (1.0)           0;0  0.0207 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     391.2750 (1.01)     431.2518 (1.0)      404.8525 (1.0)       7.2672 (1.0)      403.4052 (1.0)       7.2225 (1.0)          22;7  2.4700 (1.0)         100           1
test_init-init[3.10.0]     403.7919 (1.04)     440.2025 (1.02)     417.5555 (1.03)      8.1483 (1.12)     415.4933 (1.03)      9.1349 (1.26)         31;6  2.3949 (0.97)        100           1
test_init-init[3.53.2]     390.9172 (1.01)     438.0929 (1.02)     406.3106 (1.00)      7.9357 (1.09)     404.7876 (1.00)      8.8945 (1.23)         25;4  2.4612 (1.00)        100           1
test_init-init[main]       388.0829 (1.0)      743.0400 (1.72)     415.8664 (1.03)     36.2088 (4.98)     410.1365 (1.02)     14.4081 (1.99)          4;6  2.4046 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     564.3266 (1.08)     564.3266 (1.08)     564.3266 (1.08)     0.0000 (1.0)      564.3266 (1.08)     0.0000 (1.0)           0;0  1.7720 (0.92)          1           1
test_list-list[3.10.0]     650.0290 (1.25)     650.0290 (1.25)     650.0290 (1.25)     0.0000 (1.0)      650.0290 (1.25)     0.0000 (1.0)           0;0  1.5384 (0.80)          1           1
test_list-list[3.53.2]     553.5393 (1.06)     553.5393 (1.06)     553.5393 (1.06)     0.0000 (1.0)      553.5393 (1.06)     0.0000 (1.0)           0;0  1.8066 (0.94)          1           1
test_list-list[main]       520.2669 (1.0)      520.2669 (1.0)      520.2669 (1.0)      0.0000 (1.0)      520.2669 (1.0)      0.0000 (1.0)           0;0  1.9221 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     408.0173 (1.06)     408.0173 (1.06)     408.0173 (1.06)     0.0000 (1.0)      408.0173 (1.06)     0.0000 (1.0)           0;0  2.4509 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     415.5972 (1.08)     415.5972 (1.08)     415.5972 (1.08)     0.0000 (1.0)      415.5972 (1.08)     0.0000 (1.0)           0;0  2.4062 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     389.5456 (1.01)     389.5456 (1.01)     389.5456 (1.01)     0.0000 (1.0)      389.5456 (1.01)     0.0000 (1.0)           0;0  2.5671 (0.99)          1           1
test_list-list-dvc-only[main]       385.9778 (1.0)      385.9778 (1.0)      385.9778 (1.0)      0.0000 (1.0)      385.9778 (1.0)      0.0000 (1.0)           0;0  2.5908 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5774 (1.0)      2.5774 (1.0)      2.5774 (1.0)      0.0000 (1.0)      2.5774 (1.0)      0.0000 (1.0)           0;0  0.3880 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6438 (1.03)     2.6438 (1.03)     2.6438 (1.03)     0.0000 (1.0)      2.6438 (1.03)     0.0000 (1.0)           0;0  0.3782 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.6774 (1.04)     2.6774 (1.04)     2.6774 (1.04)     0.0000 (1.0)      2.6774 (1.04)     0.0000 (1.0)           0;0  0.3735 (0.96)          1           1
test_list-list-recursive[main]       2.6462 (1.03)     2.6462 (1.03)     2.6462 (1.03)     0.0000 (1.0)      2.6462 (1.03)     0.0000 (1.0)           0;0  0.3779 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     403.4116 (1.04)     403.4116 (1.04)     403.4116 (1.04)     0.0000 (1.0)      403.4116 (1.04)     0.0000 (1.0)           0;0  2.4789 (0.96)          1           1
test_list-list-shallow[3.10.0]     410.4823 (1.06)     410.4823 (1.06)     410.4823 (1.06)     0.0000 (1.0)      410.4823 (1.06)     0.0000 (1.0)           0;0  2.4362 (0.95)          1           1
test_list-list-shallow[3.53.2]     388.2260 (1.0)      388.2260 (1.0)      388.2260 (1.0)      0.0000 (1.0)      388.2260 (1.0)      0.0000 (1.0)           0;0  2.5758 (1.0)           1           1
test_list-list-shallow[main]       396.1914 (1.02)     396.1914 (1.02)     396.1914 (1.02)     0.0000 (1.0)      396.1914 (1.02)     0.0000 (1.0)           0;0  2.5240 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.6871 (2.91)     12.6871 (2.91)     12.6871 (2.91)     0.0000 (1.0)      12.6871 (2.91)     0.0000 (1.0)           0;0  0.0788 (0.34)          1           1
test_partial_add-add[3.10.0]     12.9963 (2.98)     12.9963 (2.98)     12.9963 (2.98)     0.0000 (1.0)      12.9963 (2.98)     0.0000 (1.0)           0;0  0.0769 (0.34)          1           1
test_partial_add-add[3.53.2]     11.4990 (2.64)     11.4990 (2.64)     11.4990 (2.64)     0.0000 (1.0)      11.4990 (2.64)     0.0000 (1.0)           0;0  0.0870 (0.38)          1           1
test_partial_add-add[main]        4.3587 (1.0)       4.3587 (1.0)       4.3587 (1.0)      0.0000 (1.0)       4.3587 (1.0)      0.0000 (1.0)           0;0  0.2294 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     86.7174 (4.25)     86.7174 (4.25)     86.7174 (4.25)     0.0000 (1.0)      86.7174 (4.25)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     86.2162 (4.23)     86.2162 (4.23)     86.2162 (4.23)     0.0000 (1.0)      86.2162 (4.23)     0.0000 (1.0)           0;0  0.0116 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     78.5061 (3.85)     78.5061 (3.85)     78.5061 (3.85)     0.0000 (1.0)      78.5061 (3.85)     0.0000 (1.0)           0;0  0.0127 (0.26)          1           1
test_partial_add-add-partial[main]       20.3994 (1.0)      20.3994 (1.0)      20.3994 (1.0)      0.0000 (1.0)      20.3994 (1.0)      0.0000 (1.0)           0;0  0.0490 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6859 (1.0)      4.6859 (1.0)      4.6859 (1.0)      0.0000 (1.0)      4.6859 (1.0)      0.0000 (1.0)           0;0  0.2134 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9701 (1.27)     5.9701 (1.27)     5.9701 (1.27)     0.0000 (1.0)      5.9701 (1.27)     0.0000 (1.0)           0;0  0.1675 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.0034 (1.49)     7.0034 (1.49)     7.0034 (1.49)     0.0000 (1.0)      7.0034 (1.49)     0.0000 (1.0)           0;0  0.1428 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       7.0156 (1.50)     7.0156 (1.50)     7.0156 (1.50)     0.0000 (1.0)      7.0156 (1.50)     0.0000 (1.0)           0;0  0.1425 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5209 (1.0)      2.5209 (1.0)      2.5209 (1.0)      0.0000 (1.0)      2.5209 (1.0)      0.0000 (1.0)           0;0  0.3967 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7181 (1.47)     3.7181 (1.47)     3.7181 (1.47)     0.0000 (1.0)      3.7181 (1.47)     0.0000 (1.0)           0;0  0.2690 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.8450 (1.53)     3.8450 (1.53)     3.8450 (1.53)     0.0000 (1.0)      3.8450 (1.53)     0.0000 (1.0)           0;0  0.2601 (0.66)          1           1
test_partial_add-gc-noop[main]       3.7565 (1.49)     3.7565 (1.49)     3.7565 (1.49)     0.0000 (1.0)      3.7565 (1.49)     0.0000 (1.0)           0;0  0.2662 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.6780 (2.16)     7.6780 (2.16)     7.6780 (2.16)     0.0000 (1.0)      7.6780 (2.16)     0.0000 (1.0)           0;0  0.1302 (0.46)          1           1
test_partial_add-push[3.10.0]     6.9493 (1.95)     6.9493 (1.95)     6.9493 (1.95)     0.0000 (1.0)      6.9493 (1.95)     0.0000 (1.0)           0;0  0.1439 (0.51)          1           1
test_partial_add-push[3.53.2]     3.6529 (1.03)     3.6529 (1.03)     3.6529 (1.03)     0.0000 (1.0)      3.6529 (1.03)     0.0000 (1.0)           0;0  0.2738 (0.97)          1           1
test_partial_add-push[main]       3.5569 (1.0)      3.5569 (1.0)      3.5569 (1.0)      0.0000 (1.0)      3.5569 (1.0)      0.0000 (1.0)           0;0  0.2811 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.0805 (2.21)     45.0805 (2.21)     45.0805 (2.21)     0.0000 (1.0)      45.0805 (2.21)     0.0000 (1.0)           0;0  0.0222 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     40.6654 (1.99)     40.6654 (1.99)     40.6654 (1.99)     0.0000 (1.0)      40.6654 (1.99)     0.0000 (1.0)           0;0  0.0246 (0.50)          1           1
test_partial_add-push-partial[3.53.2]     21.0730 (1.03)     21.0730 (1.03)     21.0730 (1.03)     0.0000 (1.0)      21.0730 (1.03)     0.0000 (1.0)           0;0  0.0475 (0.97)          1           1
test_partial_add-push-partial[main]       20.4353 (1.0)      20.4353 (1.0)      20.4353 (1.0)      0.0000 (1.0)      20.4353 (1.0)      0.0000 (1.0)           0;0  0.0489 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     91.6877 (3.93)     91.6877 (3.93)     91.6877 (3.93)     0.0000 (1.0)      91.6877 (3.93)     0.0000 (1.0)           0;0  0.0109 (0.25)          1           1
test_partial_remove-add[3.10.0]     92.6820 (3.97)     92.6820 (3.97)     92.6820 (3.97)     0.0000 (1.0)      92.6820 (3.97)     0.0000 (1.0)           0;0  0.0108 (0.25)          1           1
test_partial_remove-add[3.53.2]     83.3829 (3.58)     83.3829 (3.58)     83.3829 (3.58)     0.0000 (1.0)      83.3829 (3.58)     0.0000 (1.0)           0;0  0.0120 (0.28)          1           1
test_partial_remove-add[main]       23.3162 (1.0)      23.3162 (1.0)      23.3162 (1.0)      0.0000 (1.0)      23.3162 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     50.3433 (13.30)    50.3433 (13.30)    50.3433 (13.30)    0.0000 (1.0)      50.3433 (13.30)    0.0000 (1.0)           0;0  0.0199 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     51.2487 (13.54)    51.2487 (13.54)    51.2487 (13.54)    0.0000 (1.0)      51.2487 (13.54)    0.0000 (1.0)           0;0  0.0195 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     46.1867 (12.20)    46.1867 (12.20)    46.1867 (12.20)    0.0000 (1.0)      46.1867 (12.20)    0.0000 (1.0)           0;0  0.0217 (0.08)          1           1
test_partial_remove-add-update[main]        3.7859 (1.0)       3.7859 (1.0)       3.7859 (1.0)      0.0000 (1.0)       3.7859 (1.0)      0.0000 (1.0)           0;0  0.2641 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5025 (1.0)      2.5025 (1.0)      2.5025 (1.0)      0.0000 (1.0)      2.5025 (1.0)      0.0000 (1.0)           0;0  0.3996 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6232 (1.45)     3.6232 (1.45)     3.6232 (1.45)     0.0000 (1.0)      3.6232 (1.45)     0.0000 (1.0)           0;0  0.2760 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.6065 (1.44)     3.6065 (1.44)     3.6065 (1.44)     0.0000 (1.0)      3.6065 (1.44)     0.0000 (1.0)           0;0  0.2773 (0.69)          1           1
test_partial_remove-gc[main]       3.6084 (1.44)     3.6084 (1.44)     3.6084 (1.44)     0.0000 (1.0)      3.6084 (1.44)     0.0000 (1.0)           0;0  0.2771 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8142 (1.0)      4.8142 (1.0)      4.8142 (1.0)      0.0000 (1.0)      4.8142 (1.0)      0.0000 (1.0)           0;0  0.2077 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.8896 (1.22)     5.8896 (1.22)     5.8896 (1.22)     0.0000 (1.0)      5.8896 (1.22)     0.0000 (1.0)           0;0  0.1698 (0.82)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8521 (1.42)     6.8521 (1.42)     6.8521 (1.42)     0.0000 (1.0)      6.8521 (1.42)     0.0000 (1.0)           0;0  0.1459 (0.70)          1           1
test_partial_remove-gc-cloud[main]       6.8737 (1.43)     6.8737 (1.43)     6.8737 (1.43)     0.0000 (1.0)      6.8737 (1.43)     0.0000 (1.0)           0;0  0.1455 (0.70)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.5043 (2.32)     52.5043 (2.32)     52.5043 (2.32)     0.0000 (1.0)      52.5043 (2.32)     0.0000 (1.0)           0;0  0.0190 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.3055 (2.04)     46.3055 (2.04)     46.3055 (2.04)     0.0000 (1.0)      46.3055 (2.04)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.6488 (1.04)     23.6488 (1.04)     23.6488 (1.04)     0.0000 (1.0)      23.6488 (1.04)     0.0000 (1.0)           0;0  0.0423 (0.96)          1           1
test_partial_remove-push[main]       22.6517 (1.0)      22.6517 (1.0)      22.6517 (1.0)      0.0000 (1.0)      22.6517 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9411 (1.01)     3.9411 (1.01)     3.9411 (1.01)     0.0000 (1.0)      3.9411 (1.01)     0.0000 (1.0)           0;0  0.2537 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     3.8844 (1.0)      3.8844 (1.0)      3.8844 (1.0)      0.0000 (1.0)      3.8844 (1.0)      0.0000 (1.0)           0;0  0.2574 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.2593 (1.87)     7.2593 (1.87)     7.2593 (1.87)     0.0000 (1.0)      7.2593 (1.87)     0.0000 (1.0)           0;0  0.1378 (0.54)          1           1
test_partial_remove-push-update[main]       7.1128 (1.83)     7.1128 (1.83)     7.1128 (1.83)     0.0000 (1.0)      7.1128 (1.83)     0.0000 (1.0)           0;0  0.1406 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     484.3949 (1.0)      489.1628 (1.0)      486.0608 (1.0)       2.0793 (1.0)      485.1011 (1.0)       3.2764 (1.0)           1;0  2.0574 (1.0)           5           3
test_plots-plots-diff[3.10.0]     883.9632 (1.82)     898.8327 (1.84)     891.2905 (1.83)      6.9828 (3.36)     888.0074 (1.83)     12.5266 (3.82)          3;0  1.1220 (0.55)          5           3
test_plots-plots-diff[3.53.2]     803.5183 (1.66)     837.0133 (1.71)     814.4860 (1.68)     13.4233 (6.46)     810.4845 (1.67)     15.7519 (4.81)          1;0  1.2278 (0.60)          5           3
test_plots-plots-diff[main]       812.5146 (1.68)     822.2035 (1.68)     817.2032 (1.68)      3.4889 (1.68)     816.5729 (1.68)      3.6102 (1.10)          2;0  1.2237 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       502.0864 (1.0)        505.7076 (1.0)        503.2249 (1.0)      1.4435 (1.0)        502.6985 (1.0)       1.4491 (1.0)           1;0  1.9872 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,107.6198 (2.21)     1,134.8365 (2.24)     1,121.0906 (2.23)     9.6724 (6.70)     1,121.0521 (2.23)      8.8654 (6.12)          2;0  0.8920 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       884.0047 (1.76)       897.1805 (1.77)       890.6664 (1.77)     5.9203 (4.10)       890.6767 (1.77)     11.0434 (7.62)          2;0  1.1228 (0.56)          5           3
test_plots-plots-diff-json[main]         914.7772 (1.82)       930.6394 (1.84)       921.7770 (1.83)     6.6426 (4.60)       921.1023 (1.83)     11.2984 (7.80)          2;0  1.0849 (0.55)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     404.5123 (1.0)      409.5188 (1.0)      407.3508 (1.0)       2.0609 (1.0)      407.9243 (1.0)       3.3458 (1.0)           2;0  2.4549 (1.0)           5           3
test_plots-plots-show[3.10.0]     715.8160 (1.77)     751.7788 (1.84)     731.0864 (1.79)     14.1836 (6.88)     728.6274 (1.79)     21.2182 (6.34)          2;0  1.3678 (0.56)          5           3
test_plots-plots-show[3.53.2]     695.0493 (1.72)     764.2607 (1.87)     714.9748 (1.76)     28.5864 (13.87)    705.0711 (1.73)     30.5185 (9.12)          1;0  1.3987 (0.57)          5           3
test_plots-plots-show[main]       685.3784 (1.69)     695.1018 (1.70)     689.2473 (1.69)      3.9461 (1.91)     687.9764 (1.69)      5.9763 (1.79)          1;0  1.4509 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     418.8182 (1.0)      422.2021 (1.0)      420.1916 (1.0)       1.2672 (1.0)      420.0011 (1.0)       1.4815 (1.0)           2;0  2.3799 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     842.2248 (2.01)     921.3613 (2.18)     860.0601 (2.05)     34.3291 (27.09)    844.8437 (2.01)     22.6814 (15.31)         1;1  1.1627 (0.49)          5           3
test_plots-plots-show-json[3.53.2]     738.9544 (1.76)     772.4402 (1.83)     748.9246 (1.78)     13.4751 (10.63)    744.6706 (1.77)     12.1455 (8.20)          1;1  1.3352 (0.56)          5           3
test_plots-plots-show-json[main]       736.5575 (1.76)     760.2479 (1.80)     750.9123 (1.79)      8.8074 (6.95)     752.4260 (1.79)      9.0391 (6.10)          2;0  1.3317 (0.56)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.9197 (2.32)     51.9197 (2.32)     51.9197 (2.32)     0.0000 (1.0)      51.9197 (2.32)     0.0000 (1.0)           0;0  0.0193 (0.43)          1           1
test_push-push[3.10.0]     47.0371 (2.10)     47.0371 (2.10)     47.0371 (2.10)     0.0000 (1.0)      47.0371 (2.10)     0.0000 (1.0)           0;0  0.0213 (0.48)          1           1
test_push-push[3.53.2]     23.5219 (1.05)     23.5219 (1.05)     23.5219 (1.05)     0.0000 (1.0)      23.5219 (1.05)     0.0000 (1.0)           0;0  0.0425 (0.95)          1           1
test_push-push[main]       22.3803 (1.0)      22.3803 (1.0)      22.3803 (1.0)      0.0000 (1.0)      22.3803 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.6527 (2.76)     65.6527 (2.76)     65.6527 (2.76)     0.0000 (1.0)      65.6527 (2.76)     0.0000 (1.0)           0;0  0.0152 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.3350 (3.00)     71.3350 (3.00)     71.3350 (3.00)     0.0000 (1.0)      71.3350 (3.00)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.7202 (1.50)     35.7202 (1.50)     35.7202 (1.50)     0.0000 (1.0)      35.7202 (1.50)     0.0000 (1.0)           0;0  0.0280 (0.67)          1           1
test_sharing-fetch[main]       23.7555 (1.0)      23.7555 (1.0)      23.7555 (1.0)      0.0000 (1.0)      23.7555 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2387 (1.0)      1.2387 (1.0)      1.2387 (1.0)      0.0000 (1.0)      1.2387 (1.0)      0.0000 (1.0)           0;0  0.8073 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6485 (2.95)     3.6485 (2.95)     3.6485 (2.95)     0.0000 (1.0)      3.6485 (2.95)     0.0000 (1.0)           0;0  0.2741 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.8440 (4.72)     5.8440 (4.72)     5.8440 (4.72)     0.0000 (1.0)      5.8440 (4.72)     0.0000 (1.0)           0;0  0.1711 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9012 (4.76)     5.9012 (4.76)     5.9012 (4.76)     0.0000 (1.0)      5.9012 (4.76)     0.0000 (1.0)           0;0  0.1695 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.0018 (2.30)     52.0018 (2.30)     52.0018 (2.30)     0.0000 (1.0)      52.0018 (2.30)     0.0000 (1.0)           0;0  0.0192 (0.44)          1           1
test_sharing-push[3.10.0]     46.4010 (2.05)     46.4010 (2.05)     46.4010 (2.05)     0.0000 (1.0)      46.4010 (2.05)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_sharing-push[3.53.2]     23.2009 (1.02)     23.2009 (1.02)     23.2009 (1.02)     0.0000 (1.0)      23.2009 (1.02)     0.0000 (1.0)           0;0  0.0431 (0.98)          1           1
test_sharing-push[main]       22.6353 (1.0)      22.6353 (1.0)      22.6353 (1.0)      0.0000 (1.0)      22.6353 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0858 (1.0)      2.0858 (1.0)      2.0858 (1.0)      0.0000 (1.0)      2.0858 (1.0)      0.0000 (1.0)           0;0  0.4794 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1012 (1.01)     2.1012 (1.01)     2.1012 (1.01)     0.0000 (1.0)      2.1012 (1.01)     0.0000 (1.0)           0;0  0.4759 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.0552 (2.90)     6.0552 (2.90)     6.0552 (2.90)     0.0000 (1.0)      6.0552 (2.90)     0.0000 (1.0)           0;0  0.1651 (0.34)          1           1
test_sharing-push-noop[main]       6.0689 (2.91)     6.0689 (2.91)     6.0689 (2.91)     0.0000 (1.0)      6.0689 (2.91)     0.0000 (1.0)           0;0  0.1648 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.3264 (3.98)     21.3264 (3.98)     21.3264 (3.98)     0.0000 (1.0)      21.3264 (3.98)     0.0000 (1.0)           0;0  0.0469 (0.25)          1           1
test_status-status[3.10.0]     21.2256 (3.96)     21.2256 (3.96)     21.2256 (3.96)     0.0000 (1.0)      21.2256 (3.96)     0.0000 (1.0)           0;0  0.0471 (0.25)          1           1
test_status-status[3.53.2]     19.0926 (3.56)     19.0926 (3.56)     19.0926 (3.56)     0.0000 (1.0)      19.0926 (3.56)     0.0000 (1.0)           0;0  0.0524 (0.28)          1           1
test_status-status[main]        5.3617 (1.0)       5.3617 (1.0)       5.3617 (1.0)      0.0000 (1.0)       5.3617 (1.0)      0.0000 (1.0)           0;0  0.1865 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6992 (1.68)     4.6992 (1.68)     4.6992 (1.68)     0.0000 (1.0)      4.6992 (1.68)     0.0000 (1.0)           0;0  0.2128 (0.60)          1           1
test_status-status-changed[3.10.0]     4.8512 (1.73)     4.8512 (1.73)     4.8512 (1.73)     0.0000 (1.0)      4.8512 (1.73)     0.0000 (1.0)           0;0  0.2061 (0.58)          1           1
test_status-status-changed[3.53.2]     4.9276 (1.76)     4.9276 (1.76)     4.9276 (1.76)     0.0000 (1.0)      4.9276 (1.76)     0.0000 (1.0)           0;0  0.2029 (0.57)          1           1
test_status-status-changed[main]       2.7981 (1.0)      2.7981 (1.0)      2.7981 (1.0)      0.0000 (1.0)      2.7981 (1.0)      0.0000 (1.0)           0;0  0.3574 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7471 (1.79)     4.7471 (1.79)     4.7471 (1.79)     0.0000 (1.0)      4.7471 (1.79)     0.0000 (1.0)           0;0  0.2107 (0.56)          1           1
test_status-status-changed-noop[3.10.0]     4.8811 (1.85)     4.8811 (1.85)     4.8811 (1.85)     0.0000 (1.0)      4.8811 (1.85)     0.0000 (1.0)           0;0  0.2049 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.6574 (1.76)     4.6574 (1.76)     4.6574 (1.76)     0.0000 (1.0)      4.6574 (1.76)     0.0000 (1.0)           0;0  0.2147 (0.57)          1           1
test_status-status-changed-noop[main]       2.6453 (1.0)      2.6453 (1.0)      2.6453 (1.0)      0.0000 (1.0)      2.6453 (1.0)      0.0000 (1.0)           0;0  0.3780 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7424 (1.82)     4.7424 (1.82)     4.7424 (1.82)     0.0000 (1.0)      4.7424 (1.82)     0.0000 (1.0)           0;0  0.2109 (0.55)          1           1
test_status-status-noop[3.10.0]     4.9486 (1.90)     4.9486 (1.90)     4.9486 (1.90)     0.0000 (1.0)      4.9486 (1.90)     0.0000 (1.0)           0;0  0.2021 (0.53)          1           1
test_status-status-noop[3.53.2]     4.8115 (1.85)     4.8115 (1.85)     4.8115 (1.85)     0.0000 (1.0)      4.8115 (1.85)     0.0000 (1.0)           0;0  0.2078 (0.54)          1           1
test_status-status-noop[main]       2.6032 (1.0)      2.6032 (1.0)      2.6032 (1.0)      0.0000 (1.0)      2.6032 (1.0)      0.0000 (1.0)           0;0  0.3841 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     160.6962 (3.41)     160.6962 (3.41)     160.6962 (3.41)     0.0000 (1.0)      160.6962 (3.41)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.10.0]     165.4970 (3.52)     165.4970 (3.52)     165.4970 (3.52)     0.0000 (1.0)      165.4970 (3.52)     0.0000 (1.0)           0;0  0.0060 (0.28)          1           1
test_update-import-url[3.53.2]     124.2336 (2.64)     124.2336 (2.64)     124.2336 (2.64)     0.0000 (1.0)      124.2336 (2.64)     0.0000 (1.0)           0;0  0.0080 (0.38)          1           1
test_update-import-url[main]        47.0715 (1.0)       47.0715 (1.0)       47.0715 (1.0)      0.0000 (1.0)       47.0715 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     141.8826 (3.96)     141.8826 (3.96)     141.8826 (3.96)     0.0000 (1.0)      141.8826 (3.96)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.10.0]     146.3113 (4.08)     146.3113 (4.08)     146.3113 (4.08)     0.0000 (1.0)      146.3113 (4.08)     0.0000 (1.0)           0;0  0.0068 (0.25)          1           1
test_update-update[3.53.2]     112.5930 (3.14)     112.5930 (3.14)     112.5930 (3.14)     0.0000 (1.0)      112.5930 (3.14)     0.0000 (1.0)           0;0  0.0089 (0.32)          1           1
test_update-update[main]        35.8634 (1.0)       35.8634 (1.0)       35.8634 (1.0)      0.0000 (1.0)       35.8634 (1.0)      0.0000 (1.0)           0;0  0.0279 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.7694 (2.06)     15.7694 (2.06)     15.7694 (2.06)     0.0000 (1.0)      15.7694 (2.06)     0.0000 (1.0)           0;0  0.0634 (0.49)          1           1
test_update-update-noop[3.10.0]     16.5561 (2.16)     16.5561 (2.16)     16.5561 (2.16)     0.0000 (1.0)      16.5561 (2.16)     0.0000 (1.0)           0;0  0.0604 (0.46)          1           1
test_update-update-noop[3.53.2]     15.7278 (2.05)     15.7278 (2.05)     15.7278 (2.05)     0.0000 (1.0)      15.7278 (2.05)     0.0000 (1.0)           0;0  0.0636 (0.49)          1           1
test_update-update-noop[main]        7.6602 (1.0)       7.6602 (1.0)       7.6602 (1.0)      0.0000 (1.0)       7.6602 (1.0)      0.0000 (1.0)           0;0  0.1305 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean