Sat Jun  7 00:40:02 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     90.0417 (3.83)     90.0417 (3.83)     90.0417 (3.83)     0.0000 (1.0)      90.0417 (3.83)     0.0000 (1.0)           0;0  0.0111 (0.26)          1           1
test_add_copy-add[3.10.0]     90.6238 (3.85)     90.6238 (3.85)     90.6238 (3.85)     0.0000 (1.0)      90.6238 (3.85)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_add_copy-add[3.53.2]     81.1829 (3.45)     81.1829 (3.45)     81.1829 (3.45)     0.0000 (1.0)      81.1829 (3.45)     0.0000 (1.0)           0;0  0.0123 (0.29)          1           1
test_add_copy-add[main]       23.5278 (1.0)      23.5278 (1.0)      23.5278 (1.0)      0.0000 (1.0)      23.5278 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.6427 (7.05)     30.6427 (7.05)     30.6427 (7.05)     0.0000 (1.0)      30.6427 (7.05)     0.0000 (1.0)           0;0  0.0326 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     31.3562 (7.21)     31.3562 (7.21)     31.3562 (7.21)     0.0000 (1.0)      31.3562 (7.21)     0.0000 (1.0)           0;0  0.0319 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     29.5611 (6.80)     29.5611 (6.80)     29.5611 (6.80)     0.0000 (1.0)      29.5611 (6.80)     0.0000 (1.0)           0;0  0.0338 (0.15)          1           1
test_add_copy-add-noop[main]        4.3485 (1.0)       4.3485 (1.0)       4.3485 (1.0)      0.0000 (1.0)       4.3485 (1.0)      0.0000 (1.0)           0;0  0.2300 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     71.6672 (4.29)     71.6672 (4.29)     71.6672 (4.29)     0.0000 (1.0)      71.6672 (4.29)     0.0000 (1.0)           0;0  0.0140 (0.23)          1           1
test_add_hardlink-add[3.10.0]     73.0479 (4.37)     73.0479 (4.37)     73.0479 (4.37)     0.0000 (1.0)      73.0479 (4.37)     0.0000 (1.0)           0;0  0.0137 (0.23)          1           1
test_add_hardlink-add[3.53.2]     67.3930 (4.03)     67.3930 (4.03)     67.3930 (4.03)     0.0000 (1.0)      67.3930 (4.03)     0.0000 (1.0)           0;0  0.0148 (0.25)          1           1
test_add_hardlink-add[main]       16.7121 (1.0)      16.7121 (1.0)      16.7121 (1.0)      0.0000 (1.0)      16.7121 (1.0)      0.0000 (1.0)           0;0  0.0598 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.2969 (8.28)     36.2969 (8.28)     36.2969 (8.28)     0.0000 (1.0)      36.2969 (8.28)     0.0000 (1.0)           0;0  0.0276 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     36.6924 (8.37)     36.6924 (8.37)     36.6924 (8.37)     0.0000 (1.0)      36.6924 (8.37)     0.0000 (1.0)           0;0  0.0273 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     35.2825 (8.05)     35.2825 (8.05)     35.2825 (8.05)     0.0000 (1.0)      35.2825 (8.05)     0.0000 (1.0)           0;0  0.0283 (0.12)          1           1
test_add_hardlink-add-noop[main]        4.3851 (1.0)       4.3851 (1.0)       4.3851 (1.0)      0.0000 (1.0)       4.3851 (1.0)      0.0000 (1.0)           0;0  0.2280 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     76.0522 (2.11)     76.0522 (2.11)     76.0522 (2.11)     0.0000 (1.0)      76.0522 (2.11)     0.0000 (1.0)           0;0  0.0131 (0.47)          1           1
test_add_symlink-add[3.10.0]     76.7659 (2.13)     76.7659 (2.13)     76.7659 (2.13)     0.0000 (1.0)      76.7659 (2.13)     0.0000 (1.0)           0;0  0.0130 (0.47)          1           1
test_add_symlink-add[3.53.2]     70.3584 (1.95)     70.3584 (1.95)     70.3584 (1.95)     0.0000 (1.0)      70.3584 (1.95)     0.0000 (1.0)           0;0  0.0142 (0.51)          1           1
test_add_symlink-add[main]       36.0886 (1.0)      36.0886 (1.0)      36.0886 (1.0)      0.0000 (1.0)      36.0886 (1.0)      0.0000 (1.0)           0;0  0.0277 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     49.1565 (8.27)     49.1565 (8.27)     49.1565 (8.27)     0.0000 (1.0)      49.1565 (8.27)     0.0000 (1.0)           0;0  0.0203 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.9077 (8.40)     49.9077 (8.40)     49.9077 (8.40)     0.0000 (1.0)      49.9077 (8.40)     0.0000 (1.0)           0;0  0.0200 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.2794 (7.96)     47.2794 (7.96)     47.2794 (7.96)     0.0000 (1.0)      47.2794 (7.96)     0.0000 (1.0)           0;0  0.0212 (0.13)          1           1
test_add_symlink-add-noop[main]        5.9413 (1.0)       5.9413 (1.0)       5.9413 (1.0)      0.0000 (1.0)       5.9413 (1.0)      0.0000 (1.0)           0;0  0.1683 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.7009 (2.01)     43.7009 (2.01)     43.7009 (2.01)     0.0000 (1.0)      43.7009 (2.01)     0.0000 (1.0)           0;0  0.0229 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     62.1637 (2.86)     62.1637 (2.86)     62.1637 (2.86)     0.0000 (1.0)      62.1637 (2.86)     0.0000 (1.0)           0;0  0.0161 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.8570 (1.37)     29.8570 (1.37)     29.8570 (1.37)     0.0000 (1.0)      29.8570 (1.37)     0.0000 (1.0)           0;0  0.0335 (0.73)          1           1
test_checkout_copy-checkout[main]       21.7190 (1.0)      21.7190 (1.0)      21.7190 (1.0)      0.0000 (1.0)      21.7190 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4358 (1.60)     5.4358 (1.60)     5.4358 (1.60)     0.0000 (1.0)      5.4358 (1.60)     0.0000 (1.0)           0;0  0.1840 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7135 (1.68)     5.7135 (1.68)     5.7135 (1.68)     0.0000 (1.0)      5.7135 (1.68)     0.0000 (1.0)           0;0  0.1750 (0.59)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4089 (1.59)     5.4089 (1.59)     5.4089 (1.59)     0.0000 (1.0)      5.4089 (1.59)     0.0000 (1.0)           0;0  0.1849 (0.63)          1           1
test_checkout_copy-checkout-noop[main]       3.3937 (1.0)      3.3937 (1.0)      3.3937 (1.0)      0.0000 (1.0)      3.3937 (1.0)      0.0000 (1.0)           0;0  0.2947 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5808 (2.18)     8.5808 (2.18)     8.5808 (2.18)     0.0000 (1.0)      8.5808 (2.18)     0.0000 (1.0)           0;0  0.1165 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3331 (1.61)     6.3331 (1.61)     6.3331 (1.61)     0.0000 (1.0)      6.3331 (1.61)     0.0000 (1.0)           0;0  0.1579 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2350 (1.58)     6.2350 (1.58)     6.2350 (1.58)     0.0000 (1.0)      6.2350 (1.58)     0.0000 (1.0)           0;0  0.1604 (0.63)          1           1
test_checkout_copy-checkout-update[main]       3.9342 (1.0)      3.9342 (1.0)      3.9342 (1.0)      0.0000 (1.0)      3.9342 (1.0)      0.0000 (1.0)           0;0  0.2542 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     23.8820 (3.09)     23.8820 (3.09)     23.8820 (3.09)     0.0000 (1.0)      23.8820 (3.09)     0.0000 (1.0)           0;0  0.0419 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.5601 (2.27)     17.5601 (2.27)     17.5601 (2.27)     0.0000 (1.0)      17.5601 (2.27)     0.0000 (1.0)           0;0  0.0569 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.9752 (2.06)     15.9752 (2.06)     15.9752 (2.06)     0.0000 (1.0)      15.9752 (2.06)     0.0000 (1.0)           0;0  0.0626 (0.48)          1           1
test_checkout_hardlink-checkout[main]        7.7362 (1.0)       7.7362 (1.0)       7.7362 (1.0)      0.0000 (1.0)       7.7362 (1.0)      0.0000 (1.0)           0;0  0.1293 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3945 (1.65)     5.3945 (1.65)     5.3945 (1.65)     0.0000 (1.0)      5.3945 (1.65)     0.0000 (1.0)           0;0  0.1854 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6145 (1.72)     5.6145 (1.72)     5.6145 (1.72)     0.0000 (1.0)      5.6145 (1.72)     0.0000 (1.0)           0;0  0.1781 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4981 (1.68)     5.4981 (1.68)     5.4981 (1.68)     0.0000 (1.0)      5.4981 (1.68)     0.0000 (1.0)           0;0  0.1819 (0.60)          1           1
test_checkout_hardlink-checkout-noop[main]       3.2729 (1.0)      3.2729 (1.0)      3.2729 (1.0)      0.0000 (1.0)      3.2729 (1.0)      0.0000 (1.0)           0;0  0.3055 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6206 (2.22)     8.6206 (2.22)     8.6206 (2.22)     0.0000 (1.0)      8.6206 (2.22)     0.0000 (1.0)           0;0  0.1160 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3229 (1.62)     6.3229 (1.62)     6.3229 (1.62)     0.0000 (1.0)      6.3229 (1.62)     0.0000 (1.0)           0;0  0.1582 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3395 (1.63)     6.3395 (1.63)     6.3395 (1.63)     0.0000 (1.0)      6.3395 (1.63)     0.0000 (1.0)           0;0  0.1577 (0.61)          1           1
test_checkout_hardlink-checkout-update[main]       3.8914 (1.0)      3.8914 (1.0)      3.8914 (1.0)      0.0000 (1.0)      3.8914 (1.0)      0.0000 (1.0)           0;0  0.2570 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.1462 (2.40)     27.1462 (2.40)     27.1462 (2.40)     0.0000 (1.0)      27.1462 (2.40)     0.0000 (1.0)           0;0  0.0368 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     21.2339 (1.87)     21.2339 (1.87)     21.2339 (1.87)     0.0000 (1.0)      21.2339 (1.87)     0.0000 (1.0)           0;0  0.0471 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.4366 (1.72)     19.4366 (1.72)     19.4366 (1.72)     0.0000 (1.0)      19.4366 (1.72)     0.0000 (1.0)           0;0  0.0514 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.3295 (1.0)      11.3295 (1.0)      11.3295 (1.0)      0.0000 (1.0)      11.3295 (1.0)      0.0000 (1.0)           0;0  0.0883 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7166 (1.53)     6.7166 (1.53)     6.7166 (1.53)     0.0000 (1.0)      6.7166 (1.53)     0.0000 (1.0)           0;0  0.1489 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.0210 (1.60)     7.0210 (1.60)     7.0210 (1.60)     0.0000 (1.0)      7.0210 (1.60)     0.0000 (1.0)           0;0  0.1424 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.5273 (1.49)     6.5273 (1.49)     6.5273 (1.49)     0.0000 (1.0)      6.5273 (1.49)     0.0000 (1.0)           0;0  0.1532 (0.67)          1           1
test_checkout_symlink-checkout-noop[main]       4.3777 (1.0)      4.3777 (1.0)      4.3777 (1.0)      0.0000 (1.0)      4.3777 (1.0)      0.0000 (1.0)           0;0  0.2284 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.9133 (1.88)     10.9133 (1.88)     10.9133 (1.88)     0.0000 (1.0)      10.9133 (1.88)     0.0000 (1.0)           0;0  0.0916 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6838 (1.50)      8.6838 (1.50)      8.6838 (1.50)     0.0000 (1.0)       8.6838 (1.50)     0.0000 (1.0)           0;0  0.1152 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.4909 (1.47)      8.4909 (1.47)      8.4909 (1.47)     0.0000 (1.0)       8.4909 (1.47)     0.0000 (1.0)           0;0  0.1178 (0.68)          1           1
test_checkout_symlink-checkout-update[main]        5.7924 (1.0)       5.7924 (1.0)       5.7924 (1.0)      0.0000 (1.0)       5.7924 (1.0)      0.0000 (1.0)           0;0  0.1726 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.7834 (1.72)     3.7834 (1.72)     3.7834 (1.72)     0.0000 (1.0)      3.7834 (1.72)     0.0000 (1.0)           0;0  0.2643 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.6847 (2.13)     4.6847 (2.13)     4.6847 (2.13)     0.0000 (1.0)      4.6847 (2.13)     0.0000 (1.0)           0;0  0.2135 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.3898 (1.99)     4.3898 (1.99)     4.3898 (1.99)     0.0000 (1.0)      4.3898 (1.99)     0.0000 (1.0)           0;0  0.2278 (0.50)          1           1
test_data_status-data-changed[main]       2.2026 (1.0)      2.2026 (1.0)      2.2026 (1.0)      0.0000 (1.0)      2.2026 (1.0)      0.0000 (1.0)           0;0  0.4540 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1166 (1.83)     4.1166 (1.83)     4.1166 (1.83)     0.0000 (1.0)      4.1166 (1.83)     0.0000 (1.0)           0;0  0.2429 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.5323 (2.01)     4.5323 (2.01)     4.5323 (2.01)     0.0000 (1.0)      4.5323 (2.01)     0.0000 (1.0)           0;0  0.2206 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5396 (2.02)     4.5396 (2.02)     4.5396 (2.02)     0.0000 (1.0)      4.5396 (2.02)     0.0000 (1.0)           0;0  0.2203 (0.50)          1           1
test_data_status-data-changed-noop[main]       2.2495 (1.0)      2.2495 (1.0)      2.2495 (1.0)      0.0000 (1.0)      2.2495 (1.0)      0.0000 (1.0)           0;0  0.4445 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.2250 (3.98)     19.2250 (3.98)     19.2250 (3.98)     0.0000 (1.0)      19.2250 (3.98)     0.0000 (1.0)           0;0  0.0520 (0.25)          1           1
test_data_status-data-new[3.10.0]     20.3280 (4.21)     20.3280 (4.21)     20.3280 (4.21)     0.0000 (1.0)      20.3280 (4.21)     0.0000 (1.0)           0;0  0.0492 (0.24)          1           1
test_data_status-data-new[3.53.2]     20.0195 (4.15)     20.0195 (4.15)     20.0195 (4.15)     0.0000 (1.0)      20.0195 (4.15)     0.0000 (1.0)           0;0  0.0500 (0.24)          1           1
test_data_status-data-new[main]        4.8286 (1.0)       4.8286 (1.0)       4.8286 (1.0)      0.0000 (1.0)       4.8286 (1.0)      0.0000 (1.0)           0;0  0.2071 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9156 (1.77)     3.9156 (1.77)     3.9156 (1.77)     0.0000 (1.0)      3.9156 (1.77)     0.0000 (1.0)           0;0  0.2554 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.5916 (2.07)     4.5916 (2.07)     4.5916 (2.07)     0.0000 (1.0)      4.5916 (2.07)     0.0000 (1.0)           0;0  0.2178 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.5580 (2.06)     4.5580 (2.06)     4.5580 (2.06)     0.0000 (1.0)      4.5580 (2.06)     0.0000 (1.0)           0;0  0.2194 (0.49)          1           1
test_data_status-data-noop[main]       2.2168 (1.0)      2.2168 (1.0)      2.2168 (1.0)      0.0000 (1.0)      2.2168 (1.0)      0.0000 (1.0)           0;0  0.4511 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     15.7358 (1.10)     15.7358 (1.10)     15.7358 (1.10)     0.0000 (1.0)      15.7358 (1.10)     0.0000 (1.0)           0;0  0.0635 (0.91)          1           1
test_data_status_all_flags-data-changed[3.10.0]     16.5635 (1.16)     16.5635 (1.16)     16.5635 (1.16)     0.0000 (1.0)      16.5635 (1.16)     0.0000 (1.0)           0;0  0.0604 (0.86)          1           1
test_data_status_all_flags-data-changed[3.53.2]     16.3979 (1.15)     16.3979 (1.15)     16.3979 (1.15)     0.0000 (1.0)      16.3979 (1.15)     0.0000 (1.0)           0;0  0.0610 (0.87)          1           1
test_data_status_all_flags-data-changed[main]       14.3074 (1.0)      14.3074 (1.0)      14.3074 (1.0)      0.0000 (1.0)      14.3074 (1.0)      0.0000 (1.0)           0;0  0.0699 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     15.8034 (1.13)     15.8034 (1.13)     15.8034 (1.13)     0.0000 (1.0)      15.8034 (1.13)     0.0000 (1.0)           0;0  0.0633 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     16.2055 (1.16)     16.2055 (1.16)     16.2055 (1.16)     0.0000 (1.0)      16.2055 (1.16)     0.0000 (1.0)           0;0  0.0617 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     16.3510 (1.17)     16.3510 (1.17)     16.3510 (1.17)     0.0000 (1.0)      16.3510 (1.17)     0.0000 (1.0)           0;0  0.0612 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[main]       14.0175 (1.0)      14.0175 (1.0)      14.0175 (1.0)      0.0000 (1.0)      14.0175 (1.0)      0.0000 (1.0)           0;0  0.0713 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     31.3388 (1.87)     31.3388 (1.87)     31.3388 (1.87)     0.0000 (1.0)      31.3388 (1.87)     0.0000 (1.0)           0;0  0.0319 (0.53)          1           1
test_data_status_all_flags-data-new[3.10.0]     32.0179 (1.91)     32.0179 (1.91)     32.0179 (1.91)     0.0000 (1.0)      32.0179 (1.91)     0.0000 (1.0)           0;0  0.0312 (0.52)          1           1
test_data_status_all_flags-data-new[3.53.2]     31.9634 (1.91)     31.9634 (1.91)     31.9634 (1.91)     0.0000 (1.0)      31.9634 (1.91)     0.0000 (1.0)           0;0  0.0313 (0.52)          1           1
test_data_status_all_flags-data-new[main]       16.7654 (1.0)      16.7654 (1.0)      16.7654 (1.0)      0.0000 (1.0)      16.7654 (1.0)      0.0000 (1.0)           0;0  0.0596 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     15.0587 (1.11)     15.0587 (1.11)     15.0587 (1.11)     0.0000 (1.0)      15.0587 (1.11)     0.0000 (1.0)           0;0  0.0664 (0.90)          1           1
test_data_status_all_flags-data-noop[3.10.0]     15.6648 (1.15)     15.6648 (1.15)     15.6648 (1.15)     0.0000 (1.0)      15.6648 (1.15)     0.0000 (1.0)           0;0  0.0638 (0.87)          1           1
test_data_status_all_flags-data-noop[3.53.2]     15.5824 (1.15)     15.5824 (1.15)     15.5824 (1.15)     0.0000 (1.0)      15.5824 (1.15)     0.0000 (1.0)           0;0  0.0642 (0.87)          1           1
test_data_status_all_flags-data-noop[main]       13.5824 (1.0)      13.5824 (1.0)      13.5824 (1.0)      0.0000 (1.0)      13.5824 (1.0)      0.0000 (1.0)           0;0  0.0736 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.2991 (2.67)     19.2991 (2.67)     19.2991 (2.67)     0.0000 (1.0)      19.2991 (2.67)     0.0000 (1.0)           0;0  0.0518 (0.37)          1           1
test_diff-diff[3.10.0]     20.2416 (2.80)     20.2416 (2.80)     20.2416 (2.80)     0.0000 (1.0)      20.2416 (2.80)     0.0000 (1.0)           0;0  0.0494 (0.36)          1           1
test_diff-diff[3.53.2]     20.6044 (2.85)     20.6044 (2.85)     20.6044 (2.85)     0.0000 (1.0)      20.6044 (2.85)     0.0000 (1.0)           0;0  0.0485 (0.35)          1           1
test_diff-diff[main]        7.2255 (1.0)       7.2255 (1.0)       7.2255 (1.0)      0.0000 (1.0)       7.2255 (1.0)      0.0000 (1.0)           0;0  0.1384 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0389 (1.80)     6.0389 (1.80)     6.0389 (1.80)     0.0000 (1.0)      6.0389 (1.80)     0.0000 (1.0)           0;0  0.1656 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.7331 (2.01)     6.7331 (2.01)     6.7331 (2.01)     0.0000 (1.0)      6.7331 (2.01)     0.0000 (1.0)           0;0  0.1485 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.6043 (1.67)     5.6043 (1.67)     5.6043 (1.67)     0.0000 (1.0)      5.6043 (1.67)     0.0000 (1.0)           0;0  0.1784 (0.60)          1           1
test_diff-diff-changed[main]       3.3566 (1.0)      3.3566 (1.0)      3.3566 (1.0)      0.0000 (1.0)      3.3566 (1.0)      0.0000 (1.0)           0;0  0.2979 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2172 (1.53)     5.2172 (1.53)     5.2172 (1.53)     0.0000 (1.0)      5.2172 (1.53)     0.0000 (1.0)           0;0  0.1917 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6714 (1.67)     5.6714 (1.67)     5.6714 (1.67)     0.0000 (1.0)      5.6714 (1.67)     0.0000 (1.0)           0;0  0.1763 (0.60)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4257 (1.59)     5.4257 (1.59)     5.4257 (1.59)     0.0000 (1.0)      5.4257 (1.59)     0.0000 (1.0)           0;0  0.1843 (0.63)          1           1
test_diff-diff-changed-noop[main]       3.4049 (1.0)      3.4049 (1.0)      3.4049 (1.0)      0.0000 (1.0)      3.4049 (1.0)      0.0000 (1.0)           0;0  0.2937 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1661 (1.21)     4.1661 (1.21)     4.1661 (1.21)     0.0000 (1.0)      4.1661 (1.21)     0.0000 (1.0)           0;0  0.2400 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.7632 (1.39)     4.7632 (1.39)     4.7632 (1.39)     0.0000 (1.0)      4.7632 (1.39)     0.0000 (1.0)           0;0  0.2099 (0.72)          1           1
test_diff-diff-noop[3.53.2]     5.5632 (1.62)     5.5632 (1.62)     5.5632 (1.62)     0.0000 (1.0)      5.5632 (1.62)     0.0000 (1.0)           0;0  0.1798 (0.62)          1           1
test_diff-diff-noop[main]       3.4370 (1.0)      3.4370 (1.0)      3.4370 (1.0)      0.0000 (1.0)      3.4370 (1.0)      0.0000 (1.0)           0;0  0.2910 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       981.8758 (1.0)        981.8758 (1.0)        981.8758 (1.0)      0.0000 (1.0)        981.8758 (1.0)      0.0000 (1.0)           0;0  1.0185 (1.0)           1           1
test_exp_show-exp[3.10.0]     7,169.7380 (7.30)     7,169.7380 (7.30)     7,169.7380 (7.30)     0.0000 (1.0)      7,169.7380 (7.30)     0.0000 (1.0)           0;0  0.1395 (0.14)          1           1
test_exp_show-exp[3.53.2]     4,076.7154 (4.15)     4,076.7154 (4.15)     4,076.7154 (4.15)     0.0000 (1.0)      4,076.7154 (4.15)     0.0000 (1.0)           0;0  0.2453 (0.24)          1           1
test_exp_show-exp[main]       5,749.4470 (5.86)     5,749.4470 (5.86)     5,749.4470 (5.86)     0.0000 (1.0)      5,749.4470 (5.86)     0.0000 (1.0)           0;0  0.1739 (0.17)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.8900 (2.84)     66.8900 (2.84)     66.8900 (2.84)     0.0000 (1.0)      66.8900 (2.84)     0.0000 (1.0)           0;0  0.0149 (0.35)          1           1
test_fetch-fetch[3.10.0]     72.2356 (3.07)     72.2356 (3.07)     72.2356 (3.07)     0.0000 (1.0)      72.2356 (3.07)     0.0000 (1.0)           0;0  0.0138 (0.33)          1           1
test_fetch-fetch[3.53.2]     35.7050 (1.52)     35.7050 (1.52)     35.7050 (1.52)     0.0000 (1.0)      35.7050 (1.52)     0.0000 (1.0)           0;0  0.0280 (0.66)          1           1
test_fetch-fetch[main]       23.5482 (1.0)      23.5482 (1.0)      23.5482 (1.0)      0.0000 (1.0)      23.5482 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8179 (1.0)      2.8179 (1.0)      2.8179 (1.0)      0.0000 (1.0)      2.8179 (1.0)      0.0000 (1.0)           0;0  0.3549 (1.0)           1           1
test_gc-gc[3.10.0]     2.8952 (1.03)     2.8952 (1.03)     2.8952 (1.03)     0.0000 (1.0)      2.8952 (1.03)     0.0000 (1.0)           0;0  0.3454 (0.97)          1           1
test_gc-gc[3.53.2]     2.8874 (1.02)     2.8874 (1.02)     2.8874 (1.02)     0.0000 (1.0)      2.8874 (1.02)     0.0000 (1.0)           0;0  0.3463 (0.98)          1           1
test_gc-gc[main]       2.8230 (1.00)     2.8230 (1.00)     2.8230 (1.00)     0.0000 (1.0)      2.8230 (1.00)     0.0000 (1.0)           0;0  0.3542 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.0716 (2.70)     137.0716 (2.70)     137.0716 (2.70)     0.0000 (1.0)      137.0716 (2.70)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     165.8900 (3.27)     165.8900 (3.27)     165.8900 (3.27)     0.0000 (1.0)      165.8900 (3.27)     0.0000 (1.0)           0;0  0.0060 (0.31)          1           1
test_get-get[3.53.2]     145.4236 (2.86)     145.4236 (2.86)     145.4236 (2.86)     0.0000 (1.0)      145.4236 (2.86)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[main]        50.7869 (1.0)       50.7869 (1.0)       50.7869 (1.0)      0.0000 (1.0)       50.7869 (1.0)      0.0000 (1.0)           0;0  0.0197 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.0909 (2.68)     45.0909 (2.68)     45.0909 (2.68)     0.0000 (1.0)      45.0909 (2.68)     0.0000 (1.0)           0;0  0.0222 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.9872 (2.86)     47.9872 (2.86)     47.9872 (2.86)     0.0000 (1.0)      47.9872 (2.86)     0.0000 (1.0)           0;0  0.0208 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.7962 (1.0)      16.7962 (1.0)      16.7962 (1.0)      0.0000 (1.0)      16.7962 (1.0)      0.0000 (1.0)           0;0  0.0595 (1.0)           1           1
test_get_url-get-url[main]       17.0326 (1.01)     17.0326 (1.01)     17.0326 (1.01)     0.0000 (1.0)      17.0326 (1.01)     0.0000 (1.0)           0;0  0.0587 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.6594 (1.01)     135.5233 (1.00)     131.6872 (1.01)     1.5449 (1.0)      131.5809 (1.01)     2.1473 (1.0)          31;0  7.5938 (0.99)        100           1
test_help---help[3.10.0]     127.3040 (1.0)      134.9785 (1.0)      130.0131 (1.0)      1.5750 (1.02)     129.6598 (1.0)      2.2448 (1.05)         32;2  7.6915 (1.0)         100           1
test_help---help[3.53.2]     127.8528 (1.00)     136.1262 (1.01)     131.1987 (1.01)     1.7580 (1.14)     130.9234 (1.01)     2.4318 (1.13)         32;1  7.6220 (0.99)        100           1
test_help---help[main]       128.9038 (1.01)     153.3147 (1.14)     134.2501 (1.03)     4.9249 (3.19)     132.9075 (1.03)     3.7881 (1.76)         12;9  7.4488 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     226.9387 (2.97)     226.9387 (2.97)     226.9387 (2.97)     0.0000 (1.0)      226.9387 (2.97)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     256.6506 (3.36)     256.6506 (3.36)     256.6506 (3.36)     0.0000 (1.0)      256.6506 (3.36)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[main]        76.4583 (1.0)       76.4583 (1.0)       76.4583 (1.0)      0.0000 (1.0)       76.4583 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     162.4082 (3.43)     162.4082 (3.43)     162.4082 (3.43)     0.0000 (1.0)      162.4082 (3.43)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_import_url-import-url[3.10.0]     164.1214 (3.46)     164.1214 (3.46)     164.1214 (3.46)     0.0000 (1.0)      164.1214 (3.46)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.53.2]     123.3752 (2.60)     123.3752 (2.60)     123.3752 (2.60)     0.0000 (1.0)      123.3752 (2.60)     0.0000 (1.0)           0;0  0.0081 (0.38)          1           1
test_import_url-import-url[main]        47.3959 (1.0)       47.3959 (1.0)       47.3959 (1.0)      0.0000 (1.0)       47.3959 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     386.1656 (1.00)     431.7034 (1.01)     405.7376 (1.01)      6.8726 (1.0)      406.4771 (1.01)     6.7826 (1.0)         18;10  2.4646 (0.99)        100           1
test_init-init[3.10.0]     399.8900 (1.04)     440.6490 (1.03)     417.2119 (1.03)      6.8996 (1.00)     418.4181 (1.04)     7.2630 (1.07)         26;5  2.3969 (0.97)        100           1
test_init-init[3.53.2]     385.2182 (1.0)      428.0008 (1.0)      403.1420 (1.0)       7.0335 (1.02)     403.5919 (1.0)      8.8311 (1.30)         30;2  2.4805 (1.0)         100           1
test_init-init[main]       386.4722 (1.00)     540.8768 (1.26)     407.7664 (1.01)     21.2570 (3.09)     405.0863 (1.00)     8.6207 (1.27)          5;6  2.4524 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     572.2580 (1.02)     572.2580 (1.02)     572.2580 (1.02)     0.0000 (1.0)      572.2580 (1.02)     0.0000 (1.0)           0;0  1.7475 (0.98)          1           1
test_list-list[3.10.0]     682.9763 (1.22)     682.9763 (1.22)     682.9763 (1.22)     0.0000 (1.0)      682.9763 (1.22)     0.0000 (1.0)           0;0  1.4642 (0.82)          1           1
test_list-list[3.53.2]     565.9842 (1.01)     565.9842 (1.01)     565.9842 (1.01)     0.0000 (1.0)      565.9842 (1.01)     0.0000 (1.0)           0;0  1.7668 (0.99)          1           1
test_list-list[main]       561.0415 (1.0)      561.0415 (1.0)      561.0415 (1.0)      0.0000 (1.0)      561.0415 (1.0)      0.0000 (1.0)           0;0  1.7824 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     414.1120 (1.04)     414.1120 (1.04)     414.1120 (1.04)     0.0000 (1.0)      414.1120 (1.04)     0.0000 (1.0)           0;0  2.4148 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     434.0481 (1.09)     434.0481 (1.09)     434.0481 (1.09)     0.0000 (1.0)      434.0481 (1.09)     0.0000 (1.0)           0;0  2.3039 (0.91)          1           1
test_list-list-dvc-only[3.53.2]     396.9559 (1.0)      396.9559 (1.0)      396.9559 (1.0)      0.0000 (1.0)      396.9559 (1.0)      0.0000 (1.0)           0;0  2.5192 (1.0)           1           1
test_list-list-dvc-only[main]       442.8642 (1.12)     442.8642 (1.12)     442.8642 (1.12)     0.0000 (1.0)      442.8642 (1.12)     0.0000 (1.0)           0;0  2.2580 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6697 (1.0)      2.6697 (1.0)      2.6697 (1.0)      0.0000 (1.0)      2.6697 (1.0)      0.0000 (1.0)           0;0  0.3746 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8108 (1.05)     2.8108 (1.05)     2.8108 (1.05)     0.0000 (1.0)      2.8108 (1.05)     0.0000 (1.0)           0;0  0.3558 (0.95)          1           1
test_list-list-recursive[3.53.2]     2.7472 (1.03)     2.7472 (1.03)     2.7472 (1.03)     0.0000 (1.0)      2.7472 (1.03)     0.0000 (1.0)           0;0  0.3640 (0.97)          1           1
test_list-list-recursive[main]       2.8891 (1.08)     2.8891 (1.08)     2.8891 (1.08)     0.0000 (1.0)      2.8891 (1.08)     0.0000 (1.0)           0;0  0.3461 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     413.7228 (1.03)     413.7228 (1.03)     413.7228 (1.03)     0.0000 (1.0)      413.7228 (1.03)     0.0000 (1.0)           0;0  2.4171 (0.97)          1           1
test_list-list-shallow[3.10.0]     422.9568 (1.06)     422.9568 (1.06)     422.9568 (1.06)     0.0000 (1.0)      422.9568 (1.06)     0.0000 (1.0)           0;0  2.3643 (0.95)          1           1
test_list-list-shallow[3.53.2]     400.1135 (1.0)      400.1135 (1.0)      400.1135 (1.0)      0.0000 (1.0)      400.1135 (1.0)      0.0000 (1.0)           0;0  2.4993 (1.0)           1           1
test_list-list-shallow[main]       470.7182 (1.18)     470.7182 (1.18)     470.7182 (1.18)     0.0000 (1.0)      470.7182 (1.18)     0.0000 (1.0)           0;0  2.1244 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     13.0666 (2.97)     13.0666 (2.97)     13.0666 (2.97)     0.0000 (1.0)      13.0666 (2.97)     0.0000 (1.0)           0;0  0.0765 (0.34)          1           1
test_partial_add-add[3.10.0]     12.9623 (2.95)     12.9623 (2.95)     12.9623 (2.95)     0.0000 (1.0)      12.9623 (2.95)     0.0000 (1.0)           0;0  0.0771 (0.34)          1           1
test_partial_add-add[3.53.2]     11.8710 (2.70)     11.8710 (2.70)     11.8710 (2.70)     0.0000 (1.0)      11.8710 (2.70)     0.0000 (1.0)           0;0  0.0842 (0.37)          1           1
test_partial_add-add[main]        4.3970 (1.0)       4.3970 (1.0)       4.3970 (1.0)      0.0000 (1.0)       4.3970 (1.0)      0.0000 (1.0)           0;0  0.2274 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     88.7662 (4.33)     88.7662 (4.33)     88.7662 (4.33)     0.0000 (1.0)      88.7662 (4.33)     0.0000 (1.0)           0;0  0.0113 (0.23)          1           1
test_partial_add-add-partial[3.10.0]     86.9049 (4.24)     86.9049 (4.24)     86.9049 (4.24)     0.0000 (1.0)      86.9049 (4.24)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     78.5690 (3.83)     78.5690 (3.83)     78.5690 (3.83)     0.0000 (1.0)      78.5690 (3.83)     0.0000 (1.0)           0;0  0.0127 (0.26)          1           1
test_partial_add-add-partial[main]       20.5066 (1.0)      20.5066 (1.0)      20.5066 (1.0)      0.0000 (1.0)      20.5066 (1.0)      0.0000 (1.0)           0;0  0.0488 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.0915 (1.0)      5.0915 (1.0)      5.0915 (1.0)      0.0000 (1.0)      5.0915 (1.0)      0.0000 (1.0)           0;0  0.1964 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1998 (1.22)     6.1998 (1.22)     6.1998 (1.22)     0.0000 (1.0)      6.1998 (1.22)     0.0000 (1.0)           0;0  0.1613 (0.82)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.0304 (1.38)     7.0304 (1.38)     7.0304 (1.38)     0.0000 (1.0)      7.0304 (1.38)     0.0000 (1.0)           0;0  0.1422 (0.72)          1           1
test_partial_add-gc-cloud-noop[main]       6.9719 (1.37)     6.9719 (1.37)     6.9719 (1.37)     0.0000 (1.0)      6.9719 (1.37)     0.0000 (1.0)           0;0  0.1434 (0.73)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5527 (1.0)      2.5527 (1.0)      2.5527 (1.0)      0.0000 (1.0)      2.5527 (1.0)      0.0000 (1.0)           0;0  0.3917 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8157 (1.49)     3.8157 (1.49)     3.8157 (1.49)     0.0000 (1.0)      3.8157 (1.49)     0.0000 (1.0)           0;0  0.2621 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.7359 (1.46)     3.7359 (1.46)     3.7359 (1.46)     0.0000 (1.0)      3.7359 (1.46)     0.0000 (1.0)           0;0  0.2677 (0.68)          1           1
test_partial_add-gc-noop[main]       3.7831 (1.48)     3.7831 (1.48)     3.7831 (1.48)     0.0000 (1.0)      3.7831 (1.48)     0.0000 (1.0)           0;0  0.2643 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.8267 (2.15)     7.8267 (2.15)     7.8267 (2.15)     0.0000 (1.0)      7.8267 (2.15)     0.0000 (1.0)           0;0  0.1278 (0.47)          1           1
test_partial_add-push[3.10.0]     7.0148 (1.93)     7.0148 (1.93)     7.0148 (1.93)     0.0000 (1.0)      7.0148 (1.93)     0.0000 (1.0)           0;0  0.1426 (0.52)          1           1
test_partial_add-push[3.53.2]     3.7144 (1.02)     3.7144 (1.02)     3.7144 (1.02)     0.0000 (1.0)      3.7144 (1.02)     0.0000 (1.0)           0;0  0.2692 (0.98)          1           1
test_partial_add-push[main]       3.6418 (1.0)      3.6418 (1.0)      3.6418 (1.0)      0.0000 (1.0)      3.6418 (1.0)      0.0000 (1.0)           0;0  0.2746 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.7570 (2.26)     45.7570 (2.26)     45.7570 (2.26)     0.0000 (1.0)      45.7570 (2.26)     0.0000 (1.0)           0;0  0.0219 (0.44)          1           1
test_partial_add-push-partial[3.10.0]     40.9366 (2.02)     40.9366 (2.02)     40.9366 (2.02)     0.0000 (1.0)      40.9366 (2.02)     0.0000 (1.0)           0;0  0.0244 (0.50)          1           1
test_partial_add-push-partial[3.53.2]     21.0616 (1.04)     21.0616 (1.04)     21.0616 (1.04)     0.0000 (1.0)      21.0616 (1.04)     0.0000 (1.0)           0;0  0.0475 (0.96)          1           1
test_partial_add-push-partial[main]       20.2899 (1.0)      20.2899 (1.0)      20.2899 (1.0)      0.0000 (1.0)      20.2899 (1.0)      0.0000 (1.0)           0;0  0.0493 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     91.0963 (3.86)     91.0963 (3.86)     91.0963 (3.86)     0.0000 (1.0)      91.0963 (3.86)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_partial_remove-add[3.10.0]     91.2800 (3.87)     91.2800 (3.87)     91.2800 (3.87)     0.0000 (1.0)      91.2800 (3.87)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_partial_remove-add[3.53.2]     82.8568 (3.51)     82.8568 (3.51)     82.8568 (3.51)     0.0000 (1.0)      82.8568 (3.51)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_partial_remove-add[main]       23.5886 (1.0)      23.5886 (1.0)      23.5886 (1.0)      0.0000 (1.0)      23.5886 (1.0)      0.0000 (1.0)           0;0  0.0424 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     50.9649 (13.79)    50.9649 (13.79)    50.9649 (13.79)    0.0000 (1.0)      50.9649 (13.79)    0.0000 (1.0)           0;0  0.0196 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     50.7480 (13.73)    50.7480 (13.73)    50.7480 (13.73)    0.0000 (1.0)      50.7480 (13.73)    0.0000 (1.0)           0;0  0.0197 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     45.6972 (12.36)    45.6972 (12.36)    45.6972 (12.36)    0.0000 (1.0)      45.6972 (12.36)    0.0000 (1.0)           0;0  0.0219 (0.08)          1           1
test_partial_remove-add-update[main]        3.6960 (1.0)       3.6960 (1.0)       3.6960 (1.0)      0.0000 (1.0)       3.6960 (1.0)      0.0000 (1.0)           0;0  0.2706 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5021 (1.0)      2.5021 (1.0)      2.5021 (1.0)      0.0000 (1.0)      2.5021 (1.0)      0.0000 (1.0)           0;0  0.3997 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5273 (1.41)     3.5273 (1.41)     3.5273 (1.41)     0.0000 (1.0)      3.5273 (1.41)     0.0000 (1.0)           0;0  0.2835 (0.71)          1           1
test_partial_remove-gc[3.53.2]     3.5981 (1.44)     3.5981 (1.44)     3.5981 (1.44)     0.0000 (1.0)      3.5981 (1.44)     0.0000 (1.0)           0;0  0.2779 (0.70)          1           1
test_partial_remove-gc[main]       3.5856 (1.43)     3.5856 (1.43)     3.5856 (1.43)     0.0000 (1.0)      3.5856 (1.43)     0.0000 (1.0)           0;0  0.2789 (0.70)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.9262 (1.0)      4.9262 (1.0)      4.9262 (1.0)      0.0000 (1.0)      4.9262 (1.0)      0.0000 (1.0)           0;0  0.2030 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.9447 (1.21)     5.9447 (1.21)     5.9447 (1.21)     0.0000 (1.0)      5.9447 (1.21)     0.0000 (1.0)           0;0  0.1682 (0.83)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.5784 (1.34)     6.5784 (1.34)     6.5784 (1.34)     0.0000 (1.0)      6.5784 (1.34)     0.0000 (1.0)           0;0  0.1520 (0.75)          1           1
test_partial_remove-gc-cloud[main]       6.4984 (1.32)     6.4984 (1.32)     6.4984 (1.32)     0.0000 (1.0)      6.4984 (1.32)     0.0000 (1.0)           0;0  0.1539 (0.76)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.5528 (2.33)     51.5528 (2.33)     51.5528 (2.33)     0.0000 (1.0)      51.5528 (2.33)     0.0000 (1.0)           0;0  0.0194 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.4118 (2.10)     46.4118 (2.10)     46.4118 (2.10)     0.0000 (1.0)      46.4118 (2.10)     0.0000 (1.0)           0;0  0.0215 (0.48)          1           1
test_partial_remove-push[3.53.2]     23.2579 (1.05)     23.2579 (1.05)     23.2579 (1.05)     0.0000 (1.0)      23.2579 (1.05)     0.0000 (1.0)           0;0  0.0430 (0.95)          1           1
test_partial_remove-push[main]       22.1429 (1.0)      22.1429 (1.0)      22.1429 (1.0)      0.0000 (1.0)      22.1429 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8410 (1.0)      3.8410 (1.0)      3.8410 (1.0)      0.0000 (1.0)      3.8410 (1.0)      0.0000 (1.0)           0;0  0.2604 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.8796 (1.01)     3.8796 (1.01)     3.8796 (1.01)     0.0000 (1.0)      3.8796 (1.01)     0.0000 (1.0)           0;0  0.2578 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     7.2849 (1.90)     7.2849 (1.90)     7.2849 (1.90)     0.0000 (1.0)      7.2849 (1.90)     0.0000 (1.0)           0;0  0.1373 (0.53)          1           1
test_partial_remove-push-update[main]       6.9813 (1.82)     6.9813 (1.82)     6.9813 (1.82)     0.0000 (1.0)      6.9813 (1.82)     0.0000 (1.0)           0;0  0.1432 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     502.3197 (1.0)      539.3685 (1.0)      523.4584 (1.0)      13.3447 (4.79)     525.7051 (1.0)      11.0540 (3.81)          2;0  1.9104 (1.0)           5           3
test_plots-plots-diff[3.10.0]     894.0129 (1.78)     928.5864 (1.72)     915.4221 (1.75)     13.0182 (4.67)     917.5742 (1.75)     13.7353 (4.74)          2;0  1.0924 (0.57)          5           3
test_plots-plots-diff[3.53.2]     809.4065 (1.61)     816.1727 (1.51)     814.1897 (1.56)      2.7860 (1.0)      814.6550 (1.55)      2.8984 (1.0)           1;0  1.2282 (0.64)          5           3
test_plots-plots-diff[main]       810.9886 (1.61)     819.4148 (1.52)     814.8486 (1.56)      3.8951 (1.40)     813.5555 (1.55)      7.2035 (2.49)          1;0  1.2272 (0.64)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       516.7829 (1.0)        535.1911 (1.0)        524.4823 (1.0)      6.8794 (1.94)       523.7857 (1.0)       8.3050 (2.09)          2;0  1.9066 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,121.1347 (2.17)     1,143.1248 (2.14)     1,131.1467 (2.16)     7.8303 (2.21)     1,130.3190 (2.16)      5.9758 (1.51)          2;1  0.8841 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       888.7835 (1.72)       909.9432 (1.70)       896.5526 (1.71)     8.4560 (2.38)       896.5069 (1.71)     11.1764 (2.82)          1;0  1.1154 (0.58)          5           3
test_plots-plots-diff-json[main]         887.7599 (1.72)       896.8921 (1.68)       893.6468 (1.70)     3.5504 (1.0)        894.0168 (1.71)      3.9655 (1.0)           1;0  1.1190 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     415.2001 (1.0)      419.4302 (1.0)      416.4368 (1.0)      1.7283 (1.0)      416.0455 (1.0)      1.7053 (1.0)           1;0  2.4013 (1.0)           5           3
test_plots-plots-show[3.10.0]     723.0984 (1.74)     733.4810 (1.75)     728.6881 (1.75)     4.1677 (2.41)     727.3878 (1.75)     6.1725 (3.62)          2;0  1.3723 (0.57)          5           3
test_plots-plots-show[3.53.2]     694.6420 (1.67)     708.1234 (1.69)     701.3303 (1.68)     5.0854 (2.94)     702.1723 (1.69)     6.9530 (4.08)          2;0  1.4259 (0.59)          5           3
test_plots-plots-show[main]       701.6283 (1.69)     713.6607 (1.70)     707.1929 (1.70)     5.0957 (2.95)     705.0974 (1.69)     8.4130 (4.93)          2;0  1.4140 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     444.9751 (1.0)      458.6759 (1.0)      453.2273 (1.0)      5.2176 (1.08)     453.8248 (1.0)       6.4838 (1.0)           2;0  2.2064 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     856.9100 (1.93)     882.9524 (1.93)     870.0937 (1.92)     9.3715 (1.94)     870.5665 (1.92)     10.1712 (1.57)          2;0  1.1493 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     739.1387 (1.66)     751.1299 (1.64)     745.6089 (1.65)     4.8387 (1.0)      747.5468 (1.65)      7.3790 (1.14)          2;0  1.3412 (0.61)          5           3
test_plots-plots-show-json[main]       756.2185 (1.70)     777.2262 (1.69)     767.1127 (1.69)     9.7817 (2.02)     771.0205 (1.70)     17.8734 (2.76)          3;0  1.3036 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.1342 (2.31)     51.1342 (2.31)     51.1342 (2.31)     0.0000 (1.0)      51.1342 (2.31)     0.0000 (1.0)           0;0  0.0196 (0.43)          1           1
test_push-push[3.10.0]     45.8238 (2.07)     45.8238 (2.07)     45.8238 (2.07)     0.0000 (1.0)      45.8238 (2.07)     0.0000 (1.0)           0;0  0.0218 (0.48)          1           1
test_push-push[3.53.2]     23.1831 (1.05)     23.1831 (1.05)     23.1831 (1.05)     0.0000 (1.0)      23.1831 (1.05)     0.0000 (1.0)           0;0  0.0431 (0.96)          1           1
test_push-push[main]       22.1779 (1.0)      22.1779 (1.0)      22.1779 (1.0)      0.0000 (1.0)      22.1779 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.6333 (2.83)     65.6333 (2.83)     65.6333 (2.83)     0.0000 (1.0)      65.6333 (2.83)     0.0000 (1.0)           0;0  0.0152 (0.35)          1           1
test_sharing-fetch[3.10.0]     71.1322 (3.06)     71.1322 (3.06)     71.1322 (3.06)     0.0000 (1.0)      71.1322 (3.06)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.3943 (1.52)     35.3943 (1.52)     35.3943 (1.52)     0.0000 (1.0)      35.3943 (1.52)     0.0000 (1.0)           0;0  0.0283 (0.66)          1           1
test_sharing-fetch[main]       23.2246 (1.0)      23.2246 (1.0)      23.2246 (1.0)      0.0000 (1.0)      23.2246 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2057 (1.0)      1.2057 (1.0)      1.2057 (1.0)      0.0000 (1.0)      1.2057 (1.0)      0.0000 (1.0)           0;0  0.8294 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6533 (3.03)     3.6533 (3.03)     3.6533 (3.03)     0.0000 (1.0)      3.6533 (3.03)     0.0000 (1.0)           0;0  0.2737 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     5.7384 (4.76)     5.7384 (4.76)     5.7384 (4.76)     0.0000 (1.0)      5.7384 (4.76)     0.0000 (1.0)           0;0  0.1743 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8373 (4.84)     5.8373 (4.84)     5.8373 (4.84)     0.0000 (1.0)      5.8373 (4.84)     0.0000 (1.0)           0;0  0.1713 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.4112 (2.33)     52.4112 (2.33)     52.4112 (2.33)     0.0000 (1.0)      52.4112 (2.33)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_sharing-push[3.10.0]     46.3094 (2.06)     46.3094 (2.06)     46.3094 (2.06)     0.0000 (1.0)      46.3094 (2.06)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_sharing-push[3.53.2]     22.9808 (1.02)     22.9808 (1.02)     22.9808 (1.02)     0.0000 (1.0)      22.9808 (1.02)     0.0000 (1.0)           0;0  0.0435 (0.98)          1           1
test_sharing-push[main]       22.4833 (1.0)      22.4833 (1.0)      22.4833 (1.0)      0.0000 (1.0)      22.4833 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1494 (1.05)     2.1494 (1.05)     2.1494 (1.05)     0.0000 (1.0)      2.1494 (1.05)     0.0000 (1.0)           0;0  0.4652 (0.96)          1           1
test_sharing-push-noop[3.10.0]     2.0567 (1.0)      2.0567 (1.0)      2.0567 (1.0)      0.0000 (1.0)      2.0567 (1.0)      0.0000 (1.0)           0;0  0.4862 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9840 (2.91)     5.9840 (2.91)     5.9840 (2.91)     0.0000 (1.0)      5.9840 (2.91)     0.0000 (1.0)           0;0  0.1671 (0.34)          1           1
test_sharing-push-noop[main]       6.0988 (2.97)     6.0988 (2.97)     6.0988 (2.97)     0.0000 (1.0)      6.0988 (2.97)     0.0000 (1.0)           0;0  0.1640 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.1735 (3.93)     21.1735 (3.93)     21.1735 (3.93)     0.0000 (1.0)      21.1735 (3.93)     0.0000 (1.0)           0;0  0.0472 (0.25)          1           1
test_status-status[3.10.0]     21.3128 (3.95)     21.3128 (3.95)     21.3128 (3.95)     0.0000 (1.0)      21.3128 (3.95)     0.0000 (1.0)           0;0  0.0469 (0.25)          1           1
test_status-status[3.53.2]     19.4762 (3.61)     19.4762 (3.61)     19.4762 (3.61)     0.0000 (1.0)      19.4762 (3.61)     0.0000 (1.0)           0;0  0.0513 (0.28)          1           1
test_status-status[main]        5.3905 (1.0)       5.3905 (1.0)       5.3905 (1.0)      0.0000 (1.0)       5.3905 (1.0)      0.0000 (1.0)           0;0  0.1855 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6369 (1.76)     4.6369 (1.76)     4.6369 (1.76)     0.0000 (1.0)      4.6369 (1.76)     0.0000 (1.0)           0;0  0.2157 (0.57)          1           1
test_status-status-changed[3.10.0]     4.9935 (1.90)     4.9935 (1.90)     4.9935 (1.90)     0.0000 (1.0)      4.9935 (1.90)     0.0000 (1.0)           0;0  0.2003 (0.53)          1           1
test_status-status-changed[3.53.2]     4.8295 (1.84)     4.8295 (1.84)     4.8295 (1.84)     0.0000 (1.0)      4.8295 (1.84)     0.0000 (1.0)           0;0  0.2071 (0.54)          1           1
test_status-status-changed[main]       2.6289 (1.0)      2.6289 (1.0)      2.6289 (1.0)      0.0000 (1.0)      2.6289 (1.0)      0.0000 (1.0)           0;0  0.3804 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.6971 (1.84)     4.6971 (1.84)     4.6971 (1.84)     0.0000 (1.0)      4.6971 (1.84)     0.0000 (1.0)           0;0  0.2129 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.8464 (1.90)     4.8464 (1.90)     4.8464 (1.90)     0.0000 (1.0)      4.8464 (1.90)     0.0000 (1.0)           0;0  0.2063 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.9639 (1.95)     4.9639 (1.95)     4.9639 (1.95)     0.0000 (1.0)      4.9639 (1.95)     0.0000 (1.0)           0;0  0.2015 (0.51)          1           1
test_status-status-changed-noop[main]       2.5460 (1.0)      2.5460 (1.0)      2.5460 (1.0)      0.0000 (1.0)      2.5460 (1.0)      0.0000 (1.0)           0;0  0.3928 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8336 (1.89)     4.8336 (1.89)     4.8336 (1.89)     0.0000 (1.0)      4.8336 (1.89)     0.0000 (1.0)           0;0  0.2069 (0.53)          1           1
test_status-status-noop[3.10.0]     4.9686 (1.94)     4.9686 (1.94)     4.9686 (1.94)     0.0000 (1.0)      4.9686 (1.94)     0.0000 (1.0)           0;0  0.2013 (0.52)          1           1
test_status-status-noop[3.53.2]     4.6771 (1.83)     4.6771 (1.83)     4.6771 (1.83)     0.0000 (1.0)      4.6771 (1.83)     0.0000 (1.0)           0;0  0.2138 (0.55)          1           1
test_status-status-noop[main]       2.5610 (1.0)      2.5610 (1.0)      2.5610 (1.0)      0.0000 (1.0)      2.5610 (1.0)      0.0000 (1.0)           0;0  0.3905 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     160.6813 (3.42)     160.6813 (3.42)     160.6813 (3.42)     0.0000 (1.0)      160.6813 (3.42)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.10.0]     164.4136 (3.50)     164.4136 (3.50)     164.4136 (3.50)     0.0000 (1.0)      164.4136 (3.50)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.53.2]     123.8774 (2.64)     123.8774 (2.64)     123.8774 (2.64)     0.0000 (1.0)      123.8774 (2.64)     0.0000 (1.0)           0;0  0.0081 (0.38)          1           1
test_update-import-url[main]        46.9873 (1.0)       46.9873 (1.0)       46.9873 (1.0)      0.0000 (1.0)       46.9873 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     142.2366 (4.01)     142.2366 (4.01)     142.2366 (4.01)     0.0000 (1.0)      142.2366 (4.01)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.10.0]     146.5079 (4.13)     146.5079 (4.13)     146.5079 (4.13)     0.0000 (1.0)      146.5079 (4.13)     0.0000 (1.0)           0;0  0.0068 (0.24)          1           1
test_update-update[3.53.2]     111.5165 (3.14)     111.5165 (3.14)     111.5165 (3.14)     0.0000 (1.0)      111.5165 (3.14)     0.0000 (1.0)           0;0  0.0090 (0.32)          1           1
test_update-update[main]        35.4848 (1.0)       35.4848 (1.0)       35.4848 (1.0)      0.0000 (1.0)       35.4848 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.8156 (2.10)     15.8156 (2.10)     15.8156 (2.10)     0.0000 (1.0)      15.8156 (2.10)     0.0000 (1.0)           0;0  0.0632 (0.48)          1           1
test_update-update-noop[3.10.0]     16.0994 (2.14)     16.0994 (2.14)     16.0994 (2.14)     0.0000 (1.0)      16.0994 (2.14)     0.0000 (1.0)           0;0  0.0621 (0.47)          1           1
test_update-update-noop[3.53.2]     16.0064 (2.13)     16.0064 (2.13)     16.0064 (2.13)     0.0000 (1.0)      16.0064 (2.13)     0.0000 (1.0)           0;0  0.0625 (0.47)          1           1
test_update-update-noop[main]        7.5267 (1.0)       7.5267 (1.0)       7.5267 (1.0)      0.0000 (1.0)       7.5267 (1.0)      0.0000 (1.0)           0;0  0.1329 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean