Wed Jun 18 00:39:57 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     91.3361 (3.87)     91.3361 (3.87)     91.3361 (3.87)     0.0000 (1.0)      91.3361 (3.87)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_add_copy-add[3.10.0]     92.3536 (3.91)     92.3536 (3.91)     92.3536 (3.91)     0.0000 (1.0)      92.3536 (3.91)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_add_copy-add[3.53.2]     84.6679 (3.58)     84.6679 (3.58)     84.6679 (3.58)     0.0000 (1.0)      84.6679 (3.58)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_add_copy-add[main]       23.6282 (1.0)      23.6282 (1.0)      23.6282 (1.0)      0.0000 (1.0)      23.6282 (1.0)      0.0000 (1.0)           0;0  0.0423 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.4371 (7.06)     31.4371 (7.06)     31.4371 (7.06)     0.0000 (1.0)      31.4371 (7.06)     0.0000 (1.0)           0;0  0.0318 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     31.9972 (7.18)     31.9972 (7.18)     31.9972 (7.18)     0.0000 (1.0)      31.9972 (7.18)     0.0000 (1.0)           0;0  0.0313 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     30.8500 (6.93)     30.8500 (6.93)     30.8500 (6.93)     0.0000 (1.0)      30.8500 (6.93)     0.0000 (1.0)           0;0  0.0324 (0.14)          1           1
test_add_copy-add-noop[main]        4.4547 (1.0)       4.4547 (1.0)       4.4547 (1.0)      0.0000 (1.0)       4.4547 (1.0)      0.0000 (1.0)           0;0  0.2245 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     72.8832 (4.23)     72.8832 (4.23)     72.8832 (4.23)     0.0000 (1.0)      72.8832 (4.23)     0.0000 (1.0)           0;0  0.0137 (0.24)          1           1
test_add_hardlink-add[3.10.0]     73.8203 (4.29)     73.8203 (4.29)     73.8203 (4.29)     0.0000 (1.0)      73.8203 (4.29)     0.0000 (1.0)           0;0  0.0135 (0.23)          1           1
test_add_hardlink-add[3.53.2]     69.9730 (4.07)     69.9730 (4.07)     69.9730 (4.07)     0.0000 (1.0)      69.9730 (4.07)     0.0000 (1.0)           0;0  0.0143 (0.25)          1           1
test_add_hardlink-add[main]       17.2102 (1.0)      17.2102 (1.0)      17.2102 (1.0)      0.0000 (1.0)      17.2102 (1.0)      0.0000 (1.0)           0;0  0.0581 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     37.2379 (8.14)     37.2379 (8.14)     37.2379 (8.14)     0.0000 (1.0)      37.2379 (8.14)     0.0000 (1.0)           0;0  0.0269 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     37.8867 (8.28)     37.8867 (8.28)     37.8867 (8.28)     0.0000 (1.0)      37.8867 (8.28)     0.0000 (1.0)           0;0  0.0264 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     35.8354 (7.84)     35.8354 (7.84)     35.8354 (7.84)     0.0000 (1.0)      35.8354 (7.84)     0.0000 (1.0)           0;0  0.0279 (0.13)          1           1
test_add_hardlink-add-noop[main]        4.5731 (1.0)       4.5731 (1.0)       4.5731 (1.0)      0.0000 (1.0)       4.5731 (1.0)      0.0000 (1.0)           0;0  0.2187 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     75.8988 (2.08)     75.8988 (2.08)     75.8988 (2.08)     0.0000 (1.0)      75.8988 (2.08)     0.0000 (1.0)           0;0  0.0132 (0.48)          1           1
test_add_symlink-add[3.10.0]     76.8905 (2.11)     76.8905 (2.11)     76.8905 (2.11)     0.0000 (1.0)      76.8905 (2.11)     0.0000 (1.0)           0;0  0.0130 (0.47)          1           1
test_add_symlink-add[3.53.2]     71.1857 (1.95)     71.1857 (1.95)     71.1857 (1.95)     0.0000 (1.0)      71.1857 (1.95)     0.0000 (1.0)           0;0  0.0140 (0.51)          1           1
test_add_symlink-add[main]       36.4175 (1.0)      36.4175 (1.0)      36.4175 (1.0)      0.0000 (1.0)      36.4175 (1.0)      0.0000 (1.0)           0;0  0.0275 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     49.8092 (8.38)     49.8092 (8.38)     49.8092 (8.38)     0.0000 (1.0)      49.8092 (8.38)     0.0000 (1.0)           0;0  0.0201 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.3006 (8.29)     49.3006 (8.29)     49.3006 (8.29)     0.0000 (1.0)      49.3006 (8.29)     0.0000 (1.0)           0;0  0.0203 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.8195 (8.04)     47.8195 (8.04)     47.8195 (8.04)     0.0000 (1.0)      47.8195 (8.04)     0.0000 (1.0)           0;0  0.0209 (0.12)          1           1
test_add_symlink-add-noop[main]        5.9460 (1.0)       5.9460 (1.0)       5.9460 (1.0)      0.0000 (1.0)       5.9460 (1.0)      0.0000 (1.0)           0;0  0.1682 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.8382 (1.98)     42.8382 (1.98)     42.8382 (1.98)     0.0000 (1.0)      42.8382 (1.98)     0.0000 (1.0)           0;0  0.0233 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     61.5460 (2.84)     61.5460 (2.84)     61.5460 (2.84)     0.0000 (1.0)      61.5460 (2.84)     0.0000 (1.0)           0;0  0.0162 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.2954 (1.35)     29.2954 (1.35)     29.2954 (1.35)     0.0000 (1.0)      29.2954 (1.35)     0.0000 (1.0)           0;0  0.0341 (0.74)          1           1
test_checkout_copy-checkout[main]       21.6409 (1.0)      21.6409 (1.0)      21.6409 (1.0)      0.0000 (1.0)      21.6409 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4956 (1.63)     5.4956 (1.63)     5.4956 (1.63)     0.0000 (1.0)      5.4956 (1.63)     0.0000 (1.0)           0;0  0.1820 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6081 (1.66)     5.6081 (1.66)     5.6081 (1.66)     0.0000 (1.0)      5.6081 (1.66)     0.0000 (1.0)           0;0  0.1783 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5841 (1.66)     5.5841 (1.66)     5.5841 (1.66)     0.0000 (1.0)      5.5841 (1.66)     0.0000 (1.0)           0;0  0.1791 (0.60)          1           1
test_checkout_copy-checkout-noop[main]       3.3738 (1.0)      3.3738 (1.0)      3.3738 (1.0)      0.0000 (1.0)      3.3738 (1.0)      0.0000 (1.0)           0;0  0.2964 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6021 (2.15)     8.6021 (2.15)     8.6021 (2.15)     0.0000 (1.0)      8.6021 (2.15)     0.0000 (1.0)           0;0  0.1163 (0.47)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3461 (1.58)     6.3461 (1.58)     6.3461 (1.58)     0.0000 (1.0)      6.3461 (1.58)     0.0000 (1.0)           0;0  0.1576 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2317 (1.56)     6.2317 (1.56)     6.2317 (1.56)     0.0000 (1.0)      6.2317 (1.56)     0.0000 (1.0)           0;0  0.1605 (0.64)          1           1
test_checkout_copy-checkout-update[main]       4.0052 (1.0)      4.0052 (1.0)      4.0052 (1.0)      0.0000 (1.0)      4.0052 (1.0)      0.0000 (1.0)           0;0  0.2497 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     23.6448 (2.94)     23.6448 (2.94)     23.6448 (2.94)     0.0000 (1.0)      23.6448 (2.94)     0.0000 (1.0)           0;0  0.0423 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.9600 (2.11)     16.9600 (2.11)     16.9600 (2.11)     0.0000 (1.0)      16.9600 (2.11)     0.0000 (1.0)           0;0  0.0590 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.8444 (1.97)     15.8444 (1.97)     15.8444 (1.97)     0.0000 (1.0)      15.8444 (1.97)     0.0000 (1.0)           0;0  0.0631 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.0483 (1.0)       8.0483 (1.0)       8.0483 (1.0)      0.0000 (1.0)       8.0483 (1.0)      0.0000 (1.0)           0;0  0.1242 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5076 (1.67)     5.5076 (1.67)     5.5076 (1.67)     0.0000 (1.0)      5.5076 (1.67)     0.0000 (1.0)           0;0  0.1816 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7043 (1.73)     5.7043 (1.73)     5.7043 (1.73)     0.0000 (1.0)      5.7043 (1.73)     0.0000 (1.0)           0;0  0.1753 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5055 (1.67)     5.5055 (1.67)     5.5055 (1.67)     0.0000 (1.0)      5.5055 (1.67)     0.0000 (1.0)           0;0  0.1816 (0.60)          1           1
test_checkout_hardlink-checkout-noop[main]       3.3046 (1.0)      3.3046 (1.0)      3.3046 (1.0)      0.0000 (1.0)      3.3046 (1.0)      0.0000 (1.0)           0;0  0.3026 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7612 (2.19)     8.7612 (2.19)     8.7612 (2.19)     0.0000 (1.0)      8.7612 (2.19)     0.0000 (1.0)           0;0  0.1141 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4987 (1.63)     6.4987 (1.63)     6.4987 (1.63)     0.0000 (1.0)      6.4987 (1.63)     0.0000 (1.0)           0;0  0.1539 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3119 (1.58)     6.3119 (1.58)     6.3119 (1.58)     0.0000 (1.0)      6.3119 (1.58)     0.0000 (1.0)           0;0  0.1584 (0.63)          1           1
test_checkout_hardlink-checkout-update[main]       3.9917 (1.0)      3.9917 (1.0)      3.9917 (1.0)      0.0000 (1.0)      3.9917 (1.0)      0.0000 (1.0)           0;0  0.2505 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.1823 (2.51)     27.1823 (2.51)     27.1823 (2.51)     0.0000 (1.0)      27.1823 (2.51)     0.0000 (1.0)           0;0  0.0368 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.1842 (1.95)     21.1842 (1.95)     21.1842 (1.95)     0.0000 (1.0)      21.1842 (1.95)     0.0000 (1.0)           0;0  0.0472 (0.51)          1           1
test_checkout_symlink-checkout[3.53.2]     19.5683 (1.81)     19.5683 (1.81)     19.5683 (1.81)     0.0000 (1.0)      19.5683 (1.81)     0.0000 (1.0)           0;0  0.0511 (0.55)          1           1
test_checkout_symlink-checkout[main]       10.8394 (1.0)      10.8394 (1.0)      10.8394 (1.0)      0.0000 (1.0)      10.8394 (1.0)      0.0000 (1.0)           0;0  0.0923 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6687 (1.56)     6.6687 (1.56)     6.6687 (1.56)     0.0000 (1.0)      6.6687 (1.56)     0.0000 (1.0)           0;0  0.1500 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8097 (1.60)     6.8097 (1.60)     6.8097 (1.60)     0.0000 (1.0)      6.8097 (1.60)     0.0000 (1.0)           0;0  0.1468 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.5939 (1.55)     6.5939 (1.55)     6.5939 (1.55)     0.0000 (1.0)      6.5939 (1.55)     0.0000 (1.0)           0;0  0.1517 (0.65)          1           1
test_checkout_symlink-checkout-noop[main]       4.2623 (1.0)      4.2623 (1.0)      4.2623 (1.0)      0.0000 (1.0)      4.2623 (1.0)      0.0000 (1.0)           0;0  0.2346 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.5134 (1.84)     10.5134 (1.84)     10.5134 (1.84)     0.0000 (1.0)      10.5134 (1.84)     0.0000 (1.0)           0;0  0.0951 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4224 (1.47)      8.4224 (1.47)      8.4224 (1.47)     0.0000 (1.0)       8.4224 (1.47)     0.0000 (1.0)           0;0  0.1187 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3788 (1.47)      8.3788 (1.47)      8.3788 (1.47)     0.0000 (1.0)       8.3788 (1.47)     0.0000 (1.0)           0;0  0.1193 (0.68)          1           1
test_checkout_symlink-checkout-update[main]        5.7165 (1.0)       5.7165 (1.0)       5.7165 (1.0)      0.0000 (1.0)       5.7165 (1.0)      0.0000 (1.0)           0;0  0.1749 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9263 (1.75)     3.9263 (1.75)     3.9263 (1.75)     0.0000 (1.0)      3.9263 (1.75)     0.0000 (1.0)           0;0  0.2547 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.8021 (2.14)     4.8021 (2.14)     4.8021 (2.14)     0.0000 (1.0)      4.8021 (2.14)     0.0000 (1.0)           0;0  0.2082 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.5246 (2.02)     4.5246 (2.02)     4.5246 (2.02)     0.0000 (1.0)      4.5246 (2.02)     0.0000 (1.0)           0;0  0.2210 (0.50)          1           1
test_data_status-data-changed[main]       2.2428 (1.0)      2.2428 (1.0)      2.2428 (1.0)      0.0000 (1.0)      2.2428 (1.0)      0.0000 (1.0)           0;0  0.4459 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0650 (1.79)     4.0650 (1.79)     4.0650 (1.79)     0.0000 (1.0)      4.0650 (1.79)     0.0000 (1.0)           0;0  0.2460 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.6827 (2.06)     4.6827 (2.06)     4.6827 (2.06)     0.0000 (1.0)      4.6827 (2.06)     0.0000 (1.0)           0;0  0.2136 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6467 (2.05)     4.6467 (2.05)     4.6467 (2.05)     0.0000 (1.0)      4.6467 (2.05)     0.0000 (1.0)           0;0  0.2152 (0.49)          1           1
test_data_status-data-changed-noop[main]       2.2685 (1.0)      2.2685 (1.0)      2.2685 (1.0)      0.0000 (1.0)      2.2685 (1.0)      0.0000 (1.0)           0;0  0.4408 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.6262 (3.98)     19.6262 (3.98)     19.6262 (3.98)     0.0000 (1.0)      19.6262 (3.98)     0.0000 (1.0)           0;0  0.0510 (0.25)          1           1
test_data_status-data-new[3.10.0]     20.4889 (4.15)     20.4889 (4.15)     20.4889 (4.15)     0.0000 (1.0)      20.4889 (4.15)     0.0000 (1.0)           0;0  0.0488 (0.24)          1           1
test_data_status-data-new[3.53.2]     20.3064 (4.12)     20.3064 (4.12)     20.3064 (4.12)     0.0000 (1.0)      20.3064 (4.12)     0.0000 (1.0)           0;0  0.0492 (0.24)          1           1
test_data_status-data-new[main]        4.9333 (1.0)       4.9333 (1.0)       4.9333 (1.0)      0.0000 (1.0)       4.9333 (1.0)      0.0000 (1.0)           0;0  0.2027 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1452 (1.83)     4.1452 (1.83)     4.1452 (1.83)     0.0000 (1.0)      4.1452 (1.83)     0.0000 (1.0)           0;0  0.2412 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.8762 (2.15)     4.8762 (2.15)     4.8762 (2.15)     0.0000 (1.0)      4.8762 (2.15)     0.0000 (1.0)           0;0  0.2051 (0.46)          1           1
test_data_status-data-noop[3.53.2]     4.6448 (2.05)     4.6448 (2.05)     4.6448 (2.05)     0.0000 (1.0)      4.6448 (2.05)     0.0000 (1.0)           0;0  0.2153 (0.49)          1           1
test_data_status-data-noop[main]       2.2671 (1.0)      2.2671 (1.0)      2.2671 (1.0)      0.0000 (1.0)      2.2671 (1.0)      0.0000 (1.0)           0;0  0.4411 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     16.0891 (1.10)     16.0891 (1.10)     16.0891 (1.10)     0.0000 (1.0)      16.0891 (1.10)     0.0000 (1.0)           0;0  0.0622 (0.91)          1           1
test_data_status_all_flags-data-changed[3.10.0]     16.7461 (1.15)     16.7461 (1.15)     16.7461 (1.15)     0.0000 (1.0)      16.7461 (1.15)     0.0000 (1.0)           0;0  0.0597 (0.87)          1           1
test_data_status_all_flags-data-changed[3.53.2]     16.5018 (1.13)     16.5018 (1.13)     16.5018 (1.13)     0.0000 (1.0)      16.5018 (1.13)     0.0000 (1.0)           0;0  0.0606 (0.88)          1           1
test_data_status_all_flags-data-changed[main]       14.5752 (1.0)      14.5752 (1.0)      14.5752 (1.0)      0.0000 (1.0)      14.5752 (1.0)      0.0000 (1.0)           0;0  0.0686 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     16.1455 (1.12)     16.1455 (1.12)     16.1455 (1.12)     0.0000 (1.0)      16.1455 (1.12)     0.0000 (1.0)           0;0  0.0619 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     16.7184 (1.16)     16.7184 (1.16)     16.7184 (1.16)     0.0000 (1.0)      16.7184 (1.16)     0.0000 (1.0)           0;0  0.0598 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     16.7521 (1.16)     16.7521 (1.16)     16.7521 (1.16)     0.0000 (1.0)      16.7521 (1.16)     0.0000 (1.0)           0;0  0.0597 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[main]       14.4288 (1.0)      14.4288 (1.0)      14.4288 (1.0)      0.0000 (1.0)      14.4288 (1.0)      0.0000 (1.0)           0;0  0.0693 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     32.0595 (1.88)     32.0595 (1.88)     32.0595 (1.88)     0.0000 (1.0)      32.0595 (1.88)     0.0000 (1.0)           0;0  0.0312 (0.53)          1           1
test_data_status_all_flags-data-new[3.10.0]     32.3426 (1.89)     32.3426 (1.89)     32.3426 (1.89)     0.0000 (1.0)      32.3426 (1.89)     0.0000 (1.0)           0;0  0.0309 (0.53)          1           1
test_data_status_all_flags-data-new[3.53.2]     32.4404 (1.90)     32.4404 (1.90)     32.4404 (1.90)     0.0000 (1.0)      32.4404 (1.90)     0.0000 (1.0)           0;0  0.0308 (0.53)          1           1
test_data_status_all_flags-data-new[main]       17.0736 (1.0)      17.0736 (1.0)      17.0736 (1.0)      0.0000 (1.0)      17.0736 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     15.3269 (1.09)     15.3269 (1.09)     15.3269 (1.09)     0.0000 (1.0)      15.3269 (1.09)     0.0000 (1.0)           0;0  0.0652 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     15.8856 (1.13)     15.8856 (1.13)     15.8856 (1.13)     0.0000 (1.0)      15.8856 (1.13)     0.0000 (1.0)           0;0  0.0630 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     15.7284 (1.11)     15.7284 (1.11)     15.7284 (1.11)     0.0000 (1.0)      15.7284 (1.11)     0.0000 (1.0)           0;0  0.0636 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       14.1144 (1.0)      14.1144 (1.0)      14.1144 (1.0)      0.0000 (1.0)      14.1144 (1.0)      0.0000 (1.0)           0;0  0.0708 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.2561 (2.72)     19.2561 (2.72)     19.2561 (2.72)     0.0000 (1.0)      19.2561 (2.72)     0.0000 (1.0)           0;0  0.0519 (0.37)          1           1
test_diff-diff[3.10.0]     20.3246 (2.88)     20.3246 (2.88)     20.3246 (2.88)     0.0000 (1.0)      20.3246 (2.88)     0.0000 (1.0)           0;0  0.0492 (0.35)          1           1
test_diff-diff[3.53.2]     20.4873 (2.90)     20.4873 (2.90)     20.4873 (2.90)     0.0000 (1.0)      20.4873 (2.90)     0.0000 (1.0)           0;0  0.0488 (0.34)          1           1
test_diff-diff[main]        7.0672 (1.0)       7.0672 (1.0)       7.0672 (1.0)      0.0000 (1.0)       7.0672 (1.0)      0.0000 (1.0)           0;0  0.1415 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2279 (1.90)     6.2279 (1.90)     6.2279 (1.90)     0.0000 (1.0)      6.2279 (1.90)     0.0000 (1.0)           0;0  0.1606 (0.53)          1           1
test_diff-diff-changed[3.10.0]     6.7707 (2.06)     6.7707 (2.06)     6.7707 (2.06)     0.0000 (1.0)      6.7707 (2.06)     0.0000 (1.0)           0;0  0.1477 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.6135 (1.71)     5.6135 (1.71)     5.6135 (1.71)     0.0000 (1.0)      5.6135 (1.71)     0.0000 (1.0)           0;0  0.1781 (0.59)          1           1
test_diff-diff-changed[main]       3.2864 (1.0)      3.2864 (1.0)      3.2864 (1.0)      0.0000 (1.0)      3.2864 (1.0)      0.0000 (1.0)           0;0  0.3043 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3603 (1.60)     5.3603 (1.60)     5.3603 (1.60)     0.0000 (1.0)      5.3603 (1.60)     0.0000 (1.0)           0;0  0.1866 (0.62)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7227 (1.71)     5.7227 (1.71)     5.7227 (1.71)     0.0000 (1.0)      5.7227 (1.71)     0.0000 (1.0)           0;0  0.1747 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.7409 (1.72)     5.7409 (1.72)     5.7409 (1.72)     0.0000 (1.0)      5.7409 (1.72)     0.0000 (1.0)           0;0  0.1742 (0.58)          1           1
test_diff-diff-changed-noop[main]       3.3444 (1.0)      3.3444 (1.0)      3.3444 (1.0)      0.0000 (1.0)      3.3444 (1.0)      0.0000 (1.0)           0;0  0.2990 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3070 (1.29)     4.3070 (1.29)     4.3070 (1.29)     0.0000 (1.0)      4.3070 (1.29)     0.0000 (1.0)           0;0  0.2322 (0.78)          1           1
test_diff-diff-noop[3.10.0]     4.9161 (1.47)     4.9161 (1.47)     4.9161 (1.47)     0.0000 (1.0)      4.9161 (1.47)     0.0000 (1.0)           0;0  0.2034 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.5792 (1.67)     5.5792 (1.67)     5.5792 (1.67)     0.0000 (1.0)      5.5792 (1.67)     0.0000 (1.0)           0;0  0.1792 (0.60)          1           1
test_diff-diff-noop[main]       3.3447 (1.0)      3.3447 (1.0)      3.3447 (1.0)      0.0000 (1.0)      3.3447 (1.0)      0.0000 (1.0)           0;0  0.2990 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       997.2704 (1.0)        997.2704 (1.0)        997.2704 (1.0)      0.0000 (1.0)        997.2704 (1.0)      0.0000 (1.0)           0;0  1.0027 (1.0)           1           1
test_exp_show-exp[3.10.0]     7,616.9292 (7.64)     7,616.9292 (7.64)     7,616.9292 (7.64)     0.0000 (1.0)      7,616.9292 (7.64)     0.0000 (1.0)           0;0  0.1313 (0.13)          1           1
test_exp_show-exp[3.53.2]     5,786.0142 (5.80)     5,786.0142 (5.80)     5,786.0142 (5.80)     0.0000 (1.0)      5,786.0142 (5.80)     0.0000 (1.0)           0;0  0.1728 (0.17)          1           1
test_exp_show-exp[main]       9,538.7822 (9.56)     9,538.7822 (9.56)     9,538.7822 (9.56)     0.0000 (1.0)      9,538.7822 (9.56)     0.0000 (1.0)           0;0  0.1048 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.7217 (2.87)     67.7217 (2.87)     67.7217 (2.87)     0.0000 (1.0)      67.7217 (2.87)     0.0000 (1.0)           0;0  0.0148 (0.35)          1           1
test_fetch-fetch[3.10.0]     73.2870 (3.10)     73.2870 (3.10)     73.2870 (3.10)     0.0000 (1.0)      73.2870 (3.10)     0.0000 (1.0)           0;0  0.0136 (0.32)          1           1
test_fetch-fetch[3.53.2]     35.9674 (1.52)     35.9674 (1.52)     35.9674 (1.52)     0.0000 (1.0)      35.9674 (1.52)     0.0000 (1.0)           0;0  0.0278 (0.66)          1           1
test_fetch-fetch[main]       23.6362 (1.0)      23.6362 (1.0)      23.6362 (1.0)      0.0000 (1.0)      23.6362 (1.0)      0.0000 (1.0)           0;0  0.0423 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8754 (1.0)      2.8754 (1.0)      2.8754 (1.0)      0.0000 (1.0)      2.8754 (1.0)      0.0000 (1.0)           0;0  0.3478 (1.0)           1           1
test_gc-gc[3.10.0]     2.9778 (1.04)     2.9778 (1.04)     2.9778 (1.04)     0.0000 (1.0)      2.9778 (1.04)     0.0000 (1.0)           0;0  0.3358 (0.97)          1           1
test_gc-gc[3.53.2]     2.9921 (1.04)     2.9921 (1.04)     2.9921 (1.04)     0.0000 (1.0)      2.9921 (1.04)     0.0000 (1.0)           0;0  0.3342 (0.96)          1           1
test_gc-gc[main]       2.9795 (1.04)     2.9795 (1.04)     2.9795 (1.04)     0.0000 (1.0)      2.9795 (1.04)     0.0000 (1.0)           0;0  0.3356 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     136.2428 (2.70)     136.2428 (2.70)     136.2428 (2.70)     0.0000 (1.0)      136.2428 (2.70)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     164.9604 (3.27)     164.9604 (3.27)     164.9604 (3.27)     0.0000 (1.0)      164.9604 (3.27)     0.0000 (1.0)           0;0  0.0061 (0.31)          1           1
test_get-get[3.53.2]     144.1244 (2.86)     144.1244 (2.86)     144.1244 (2.86)     0.0000 (1.0)      144.1244 (2.86)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[main]        50.3741 (1.0)       50.3741 (1.0)       50.3741 (1.0)      0.0000 (1.0)       50.3741 (1.0)      0.0000 (1.0)           0;0  0.0199 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.1598 (2.70)     45.1598 (2.70)     45.1598 (2.70)     0.0000 (1.0)      45.1598 (2.70)     0.0000 (1.0)           0;0  0.0221 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.3048 (2.89)     48.3048 (2.89)     48.3048 (2.89)     0.0000 (1.0)      48.3048 (2.89)     0.0000 (1.0)           0;0  0.0207 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.7172 (1.0)      16.7172 (1.0)      16.7172 (1.0)      0.0000 (1.0)      16.7172 (1.0)      0.0000 (1.0)           0;0  0.0598 (1.0)           1           1
test_get_url-get-url[main]       16.8353 (1.01)     16.8353 (1.01)     16.8353 (1.01)     0.0000 (1.0)      16.8353 (1.01)     0.0000 (1.0)           0;0  0.0594 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.2106 (1.02)     136.0093 (1.02)     131.4314 (1.02)     1.7750 (1.20)     131.3239 (1.03)     2.8387 (2.71)         35;0  7.6085 (0.98)        100           1
test_help---help[3.10.0]     126.1559 (1.0)      133.5595 (1.0)      128.6337 (1.0)      1.7221 (1.16)     128.0025 (1.0)      1.7588 (1.68)         26;8  7.7740 (1.0)         100           1
test_help---help[3.53.2]     127.9749 (1.01)     153.7002 (1.15)     131.5184 (1.02)     4.6509 (3.13)     130.2253 (1.02)     1.8048 (1.72)         8;10  7.6035 (0.98)        100           1
test_help---help[main]       128.6142 (1.02)     137.3003 (1.03)     130.5746 (1.02)     1.4840 (1.0)      130.1284 (1.02)     1.0485 (1.0)          16;9  7.6585 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     226.2957 (2.97)     226.2957 (2.97)     226.2957 (2.97)     0.0000 (1.0)      226.2957 (2.97)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     256.7837 (3.37)     256.7837 (3.37)     256.7837 (3.37)     0.0000 (1.0)      256.7837 (3.37)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[main]        76.1588 (1.0)       76.1588 (1.0)       76.1588 (1.0)      0.0000 (1.0)       76.1588 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     170.2453 (3.48)     170.2453 (3.48)     170.2453 (3.48)     0.0000 (1.0)      170.2453 (3.48)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.10.0]     173.8349 (3.55)     173.8349 (3.55)     173.8349 (3.55)     0.0000 (1.0)      173.8349 (3.55)     0.0000 (1.0)           0;0  0.0058 (0.28)          1           1
test_import_url-import-url[3.53.2]     131.5555 (2.69)     131.5555 (2.69)     131.5555 (2.69)     0.0000 (1.0)      131.5555 (2.69)     0.0000 (1.0)           0;0  0.0076 (0.37)          1           1
test_import_url-import-url[main]        48.9546 (1.0)       48.9546 (1.0)       48.9546 (1.0)      0.0000 (1.0)       48.9546 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     413.5308 (1.00)     444.6419 (1.0)      423.2641 (1.0)       6.1627 (1.0)      422.2791 (1.0)      7.6898 (1.13)         28;2  2.3626 (1.0)         100           1
test_init-init[3.10.0]     425.9676 (1.03)     457.7066 (1.03)     436.3651 (1.03)      6.1861 (1.00)     435.3955 (1.03)     6.7895 (1.0)          34;3  2.2917 (0.97)        100           1
test_init-init[3.53.2]     413.4941 (1.0)      451.5987 (1.02)     424.5118 (1.00)      7.3005 (1.18)     423.6126 (1.00)     8.7014 (1.28)         25;3  2.3556 (1.00)        100           1
test_init-init[main]       414.1951 (1.00)     590.2341 (1.33)     428.9550 (1.01)     20.3183 (3.30)     424.8261 (1.01)     8.3860 (1.24)          6;8  2.3312 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     563.3398 (1.01)     563.3398 (1.01)     563.3398 (1.01)     0.0000 (1.0)      563.3398 (1.01)     0.0000 (1.0)           0;0  1.7751 (0.99)          1           1
test_list-list[3.10.0]     650.2880 (1.17)     650.2880 (1.17)     650.2880 (1.17)     0.0000 (1.0)      650.2880 (1.17)     0.0000 (1.0)           0;0  1.5378 (0.85)          1           1
test_list-list[3.53.2]     555.9218 (1.0)      555.9218 (1.0)      555.9218 (1.0)      0.0000 (1.0)      555.9218 (1.0)      0.0000 (1.0)           0;0  1.7988 (1.0)           1           1
test_list-list[main]       563.4562 (1.01)     563.4562 (1.01)     563.4562 (1.01)     0.0000 (1.0)      563.4562 (1.01)     0.0000 (1.0)           0;0  1.7748 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     407.2868 (1.05)     407.2868 (1.05)     407.2868 (1.05)     0.0000 (1.0)      407.2868 (1.05)     0.0000 (1.0)           0;0  2.4553 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     405.1528 (1.04)     405.1528 (1.04)     405.1528 (1.04)     0.0000 (1.0)      405.1528 (1.04)     0.0000 (1.0)           0;0  2.4682 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     439.3807 (1.13)     439.3807 (1.13)     439.3807 (1.13)     0.0000 (1.0)      439.3807 (1.13)     0.0000 (1.0)           0;0  2.2759 (0.89)          1           1
test_list-list-dvc-only[main]       389.5584 (1.0)      389.5584 (1.0)      389.5584 (1.0)      0.0000 (1.0)      389.5584 (1.0)      0.0000 (1.0)           0;0  2.5670 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5559 (1.0)      2.5559 (1.0)      2.5559 (1.0)      0.0000 (1.0)      2.5559 (1.0)      0.0000 (1.0)           0;0  0.3913 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6194 (1.02)     2.6194 (1.02)     2.6194 (1.02)     0.0000 (1.0)      2.6194 (1.02)     0.0000 (1.0)           0;0  0.3818 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.6796 (1.05)     2.6796 (1.05)     2.6796 (1.05)     0.0000 (1.0)      2.6796 (1.05)     0.0000 (1.0)           0;0  0.3732 (0.95)          1           1
test_list-list-recursive[main]       2.6307 (1.03)     2.6307 (1.03)     2.6307 (1.03)     0.0000 (1.0)      2.6307 (1.03)     0.0000 (1.0)           0;0  0.3801 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     407.2904 (1.06)     407.2904 (1.06)     407.2904 (1.06)     0.0000 (1.0)      407.2904 (1.06)     0.0000 (1.0)           0;0  2.4553 (0.95)          1           1
test_list-list-shallow[3.10.0]     405.7560 (1.05)     405.7560 (1.05)     405.7560 (1.05)     0.0000 (1.0)      405.7560 (1.05)     0.0000 (1.0)           0;0  2.4645 (0.95)          1           1
test_list-list-shallow[3.53.2]     385.0830 (1.0)      385.0830 (1.0)      385.0830 (1.0)      0.0000 (1.0)      385.0830 (1.0)      0.0000 (1.0)           0;0  2.5968 (1.0)           1           1
test_list-list-shallow[main]       388.1514 (1.01)     388.1514 (1.01)     388.1514 (1.01)     0.0000 (1.0)      388.1514 (1.01)     0.0000 (1.0)           0;0  2.5763 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.7711 (2.73)     12.7711 (2.73)     12.7711 (2.73)     0.0000 (1.0)      12.7711 (2.73)     0.0000 (1.0)           0;0  0.0783 (0.37)          1           1
test_partial_add-add[3.10.0]     12.9121 (2.76)     12.9121 (2.76)     12.9121 (2.76)     0.0000 (1.0)      12.9121 (2.76)     0.0000 (1.0)           0;0  0.0774 (0.36)          1           1
test_partial_add-add[3.53.2]     11.8130 (2.53)     11.8130 (2.53)     11.8130 (2.53)     0.0000 (1.0)      11.8130 (2.53)     0.0000 (1.0)           0;0  0.0847 (0.40)          1           1
test_partial_add-add[main]        4.6709 (1.0)       4.6709 (1.0)       4.6709 (1.0)      0.0000 (1.0)       4.6709 (1.0)      0.0000 (1.0)           0;0  0.2141 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     87.0117 (4.19)     87.0117 (4.19)     87.0117 (4.19)     0.0000 (1.0)      87.0117 (4.19)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     87.4871 (4.21)     87.4871 (4.21)     87.4871 (4.21)     0.0000 (1.0)      87.4871 (4.21)     0.0000 (1.0)           0;0  0.0114 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     79.3057 (3.82)     79.3057 (3.82)     79.3057 (3.82)     0.0000 (1.0)      79.3057 (3.82)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add-partial[main]       20.7871 (1.0)      20.7871 (1.0)      20.7871 (1.0)      0.0000 (1.0)      20.7871 (1.0)      0.0000 (1.0)           0;0  0.0481 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.7617 (1.0)      4.7617 (1.0)      4.7617 (1.0)      0.0000 (1.0)      4.7617 (1.0)      0.0000 (1.0)           0;0  0.2100 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.3612 (1.34)     6.3612 (1.34)     6.3612 (1.34)     0.0000 (1.0)      6.3612 (1.34)     0.0000 (1.0)           0;0  0.1572 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.0715 (1.49)     7.0715 (1.49)     7.0715 (1.49)     0.0000 (1.0)      7.0715 (1.49)     0.0000 (1.0)           0;0  0.1414 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       7.0594 (1.48)     7.0594 (1.48)     7.0594 (1.48)     0.0000 (1.0)      7.0594 (1.48)     0.0000 (1.0)           0;0  0.1417 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5651 (1.0)      2.5651 (1.0)      2.5651 (1.0)      0.0000 (1.0)      2.5651 (1.0)      0.0000 (1.0)           0;0  0.3898 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7675 (1.47)     3.7675 (1.47)     3.7675 (1.47)     0.0000 (1.0)      3.7675 (1.47)     0.0000 (1.0)           0;0  0.2654 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.8752 (1.51)     3.8752 (1.51)     3.8752 (1.51)     0.0000 (1.0)      3.8752 (1.51)     0.0000 (1.0)           0;0  0.2581 (0.66)          1           1
test_partial_add-gc-noop[main]       4.0132 (1.56)     4.0132 (1.56)     4.0132 (1.56)     0.0000 (1.0)      4.0132 (1.56)     0.0000 (1.0)           0;0  0.2492 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.8491 (2.11)     7.8491 (2.11)     7.8491 (2.11)     0.0000 (1.0)      7.8491 (2.11)     0.0000 (1.0)           0;0  0.1274 (0.47)          1           1
test_partial_add-push[3.10.0]     6.9949 (1.88)     6.9949 (1.88)     6.9949 (1.88)     0.0000 (1.0)      6.9949 (1.88)     0.0000 (1.0)           0;0  0.1430 (0.53)          1           1
test_partial_add-push[3.53.2]     3.7212 (1.0)      3.7212 (1.0)      3.7212 (1.0)      0.0000 (1.0)      3.7212 (1.0)      0.0000 (1.0)           0;0  0.2687 (1.0)           1           1
test_partial_add-push[main]       3.7459 (1.01)     3.7459 (1.01)     3.7459 (1.01)     0.0000 (1.0)      3.7459 (1.01)     0.0000 (1.0)           0;0  0.2670 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     46.3741 (2.21)     46.3741 (2.21)     46.3741 (2.21)     0.0000 (1.0)      46.3741 (2.21)     0.0000 (1.0)           0;0  0.0216 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     40.7119 (1.94)     40.7119 (1.94)     40.7119 (1.94)     0.0000 (1.0)      40.7119 (1.94)     0.0000 (1.0)           0;0  0.0246 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.1006 (1.01)     21.1006 (1.01)     21.1006 (1.01)     0.0000 (1.0)      21.1006 (1.01)     0.0000 (1.0)           0;0  0.0474 (0.99)          1           1
test_partial_add-push-partial[main]       20.9650 (1.0)      20.9650 (1.0)      20.9650 (1.0)      0.0000 (1.0)      20.9650 (1.0)      0.0000 (1.0)           0;0  0.0477 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     91.4408 (3.85)     91.4408 (3.85)     91.4408 (3.85)     0.0000 (1.0)      91.4408 (3.85)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_partial_remove-add[3.10.0]     92.5800 (3.90)     92.5800 (3.90)     92.5800 (3.90)     0.0000 (1.0)      92.5800 (3.90)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.53.2]     83.5781 (3.52)     83.5781 (3.52)     83.5781 (3.52)     0.0000 (1.0)      83.5781 (3.52)     0.0000 (1.0)           0;0  0.0120 (0.28)          1           1
test_partial_remove-add[main]       23.7436 (1.0)      23.7436 (1.0)      23.7436 (1.0)      0.0000 (1.0)      23.7436 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     51.2598 (13.27)    51.2598 (13.27)    51.2598 (13.27)    0.0000 (1.0)      51.2598 (13.27)    0.0000 (1.0)           0;0  0.0195 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     52.0812 (13.48)    52.0812 (13.48)    52.0812 (13.48)    0.0000 (1.0)      52.0812 (13.48)    0.0000 (1.0)           0;0  0.0192 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     47.0343 (12.17)    47.0343 (12.17)    47.0343 (12.17)    0.0000 (1.0)      47.0343 (12.17)    0.0000 (1.0)           0;0  0.0213 (0.08)          1           1
test_partial_remove-add-update[main]        3.8639 (1.0)       3.8639 (1.0)       3.8639 (1.0)      0.0000 (1.0)       3.8639 (1.0)      0.0000 (1.0)           0;0  0.2588 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5858 (1.0)      2.5858 (1.0)      2.5858 (1.0)      0.0000 (1.0)      2.5858 (1.0)      0.0000 (1.0)           0;0  0.3867 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7158 (1.44)     3.7158 (1.44)     3.7158 (1.44)     0.0000 (1.0)      3.7158 (1.44)     0.0000 (1.0)           0;0  0.2691 (0.70)          1           1
test_partial_remove-gc[3.53.2]     3.6946 (1.43)     3.6946 (1.43)     3.6946 (1.43)     0.0000 (1.0)      3.6946 (1.43)     0.0000 (1.0)           0;0  0.2707 (0.70)          1           1
test_partial_remove-gc[main]       3.7491 (1.45)     3.7491 (1.45)     3.7491 (1.45)     0.0000 (1.0)      3.7491 (1.45)     0.0000 (1.0)           0;0  0.2667 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1265 (1.0)      5.1265 (1.0)      5.1265 (1.0)      0.0000 (1.0)      5.1265 (1.0)      0.0000 (1.0)           0;0  0.1951 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.0793 (1.19)     6.0793 (1.19)     6.0793 (1.19)     0.0000 (1.0)      6.0793 (1.19)     0.0000 (1.0)           0;0  0.1645 (0.84)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.1267 (1.39)     7.1267 (1.39)     7.1267 (1.39)     0.0000 (1.0)      7.1267 (1.39)     0.0000 (1.0)           0;0  0.1403 (0.72)          1           1
test_partial_remove-gc-cloud[main]       6.9959 (1.36)     6.9959 (1.36)     6.9959 (1.36)     0.0000 (1.0)      6.9959 (1.36)     0.0000 (1.0)           0;0  0.1429 (0.73)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.9275 (2.30)     51.9275 (2.30)     51.9275 (2.30)     0.0000 (1.0)      51.9275 (2.30)     0.0000 (1.0)           0;0  0.0193 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.3714 (2.06)     46.3714 (2.06)     46.3714 (2.06)     0.0000 (1.0)      46.3714 (2.06)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.4302 (1.04)     23.4302 (1.04)     23.4302 (1.04)     0.0000 (1.0)      23.4302 (1.04)     0.0000 (1.0)           0;0  0.0427 (0.96)          1           1
test_partial_remove-push[main]       22.5597 (1.0)      22.5597 (1.0)      22.5597 (1.0)      0.0000 (1.0)      22.5597 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.0526 (1.02)     4.0526 (1.02)     4.0526 (1.02)     0.0000 (1.0)      4.0526 (1.02)     0.0000 (1.0)           0;0  0.2468 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     3.9609 (1.0)      3.9609 (1.0)      3.9609 (1.0)      0.0000 (1.0)      3.9609 (1.0)      0.0000 (1.0)           0;0  0.2525 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.3137 (1.85)     7.3137 (1.85)     7.3137 (1.85)     0.0000 (1.0)      7.3137 (1.85)     0.0000 (1.0)           0;0  0.1367 (0.54)          1           1
test_partial_remove-push-update[main]       7.2383 (1.83)     7.2383 (1.83)     7.2383 (1.83)     0.0000 (1.0)      7.2383 (1.83)     0.0000 (1.0)           0;0  0.1382 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     502.6289 (1.0)      514.6626 (1.0)      505.7141 (1.0)      5.0273 (1.14)     503.8323 (1.0)      3.2040 (1.0)           1;1  1.9774 (1.0)           5           3
test_plots-plots-diff[3.10.0]     898.3695 (1.79)     911.6088 (1.77)     904.8378 (1.79)     5.5504 (1.26)     906.5722 (1.80)     9.1636 (2.86)          2;0  1.1052 (0.56)          5           3
test_plots-plots-diff[3.53.2]     823.6270 (1.64)     834.8986 (1.62)     830.2161 (1.64)     5.3207 (1.20)     832.8327 (1.65)     9.5928 (2.99)          1;0  1.2045 (0.61)          5           3
test_plots-plots-diff[main]       821.9224 (1.64)     833.1451 (1.62)     826.0598 (1.63)     4.4221 (1.0)      824.3554 (1.64)     5.6558 (1.77)          1;0  1.2106 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       516.7220 (1.0)        522.8851 (1.0)        520.9690 (1.0)      2.4280 (1.0)        521.8453 (1.0)      1.7704 (1.0)           1;1  1.9195 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,133.9579 (2.19)     1,142.8031 (2.19)     1,138.2864 (2.18)     4.1908 (1.73)     1,137.9735 (2.18)     8.1177 (4.59)          2;0  0.8785 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       892.4707 (1.73)       898.9253 (1.72)       896.6451 (1.72)     2.6489 (1.09)       898.0052 (1.72)     3.5837 (2.02)          1;0  1.1153 (0.58)          5           3
test_plots-plots-diff-json[main]         905.5703 (1.75)       920.4229 (1.76)       913.8232 (1.75)     6.1565 (2.54)       912.1135 (1.75)     9.6533 (5.45)          2;0  1.0943 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     419.7694 (1.0)      426.0880 (1.0)      422.1105 (1.0)       2.5300 (1.0)      421.0354 (1.0)       3.4136 (1.0)           1;0  2.3690 (1.0)           5           3
test_plots-plots-show[3.10.0]     727.5453 (1.73)     755.0722 (1.77)     738.8529 (1.75)     10.1041 (3.99)     737.5248 (1.75)     10.1094 (2.96)          2;0  1.3534 (0.57)          5           3
test_plots-plots-show[3.53.2]     705.8890 (1.68)     716.5824 (1.68)     710.1669 (1.68)      5.2311 (2.07)     706.8903 (1.68)      9.2642 (2.71)          1;0  1.4081 (0.59)          5           3
test_plots-plots-show[main]       704.8182 (1.68)     797.3082 (1.87)     728.5316 (1.73)     38.6390 (15.27)    713.8100 (1.70)     24.7359 (7.25)          1;1  1.3726 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     430.9381 (1.0)      435.7651 (1.0)      433.8550 (1.0)       2.0281 (1.0)      433.7710 (1.0)       3.2454 (1.0)           1;0  2.3049 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     855.6476 (1.99)     884.9045 (2.03)     867.6813 (2.00)     10.9451 (5.40)     864.9492 (1.99)     12.8507 (3.96)          2;0  1.1525 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     749.0304 (1.74)     762.1121 (1.75)     754.0849 (1.74)      4.8747 (2.40)     752.5306 (1.73)      4.6311 (1.43)          2;0  1.3261 (0.58)          5           3
test_plots-plots-show-json[main]       751.1992 (1.74)     767.1780 (1.76)     759.8872 (1.75)      5.8715 (2.90)     759.6932 (1.75)      6.9868 (2.15)          2;0  1.3160 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.5083 (2.38)     52.5083 (2.38)     52.5083 (2.38)     0.0000 (1.0)      52.5083 (2.38)     0.0000 (1.0)           0;0  0.0190 (0.42)          1           1
test_push-push[3.10.0]     46.4579 (2.11)     46.4579 (2.11)     46.4579 (2.11)     0.0000 (1.0)      46.4579 (2.11)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_push-push[3.53.2]     22.6081 (1.02)     22.6081 (1.02)     22.6081 (1.02)     0.0000 (1.0)      22.6081 (1.02)     0.0000 (1.0)           0;0  0.0442 (0.98)          1           1
test_push-push[main]       22.0586 (1.0)      22.0586 (1.0)      22.0586 (1.0)      0.0000 (1.0)      22.0586 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.4171 (2.78)     66.4171 (2.78)     66.4171 (2.78)     0.0000 (1.0)      66.4171 (2.78)     0.0000 (1.0)           0;0  0.0151 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.5315 (2.99)     71.5315 (2.99)     71.5315 (2.99)     0.0000 (1.0)      71.5315 (2.99)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.4901 (1.49)     35.4901 (1.49)     35.4901 (1.49)     0.0000 (1.0)      35.4901 (1.49)     0.0000 (1.0)           0;0  0.0282 (0.67)          1           1
test_sharing-fetch[main]       23.8976 (1.0)      23.8976 (1.0)      23.8976 (1.0)      0.0000 (1.0)      23.8976 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2258 (1.0)      1.2258 (1.0)      1.2258 (1.0)      0.0000 (1.0)      1.2258 (1.0)      0.0000 (1.0)           0;0  0.8158 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5198 (2.87)     3.5198 (2.87)     3.5198 (2.87)     0.0000 (1.0)      3.5198 (2.87)     0.0000 (1.0)           0;0  0.2841 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.7015 (4.65)     5.7015 (4.65)     5.7015 (4.65)     0.0000 (1.0)      5.7015 (4.65)     0.0000 (1.0)           0;0  0.1754 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8583 (4.78)     5.8583 (4.78)     5.8583 (4.78)     0.0000 (1.0)      5.8583 (4.78)     0.0000 (1.0)           0;0  0.1707 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.5192 (2.36)     52.5192 (2.36)     52.5192 (2.36)     0.0000 (1.0)      52.5192 (2.36)     0.0000 (1.0)           0;0  0.0190 (0.42)          1           1
test_sharing-push[3.10.0]     46.5622 (2.09)     46.5622 (2.09)     46.5622 (2.09)     0.0000 (1.0)      46.5622 (2.09)     0.0000 (1.0)           0;0  0.0215 (0.48)          1           1
test_sharing-push[3.53.2]     23.3540 (1.05)     23.3540 (1.05)     23.3540 (1.05)     0.0000 (1.0)      23.3540 (1.05)     0.0000 (1.0)           0;0  0.0428 (0.95)          1           1
test_sharing-push[main]       22.2897 (1.0)      22.2897 (1.0)      22.2897 (1.0)      0.0000 (1.0)      22.2897 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0697 (1.0)      2.0697 (1.0)      2.0697 (1.0)      0.0000 (1.0)      2.0697 (1.0)      0.0000 (1.0)           0;0  0.4832 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0780 (1.00)     2.0780 (1.00)     2.0780 (1.00)     0.0000 (1.0)      2.0780 (1.00)     0.0000 (1.0)           0;0  0.4812 (1.00)          1           1
test_sharing-push-noop[3.53.2]     6.3044 (3.05)     6.3044 (3.05)     6.3044 (3.05)     0.0000 (1.0)      6.3044 (3.05)     0.0000 (1.0)           0;0  0.1586 (0.33)          1           1
test_sharing-push-noop[main]       5.9807 (2.89)     5.9807 (2.89)     5.9807 (2.89)     0.0000 (1.0)      5.9807 (2.89)     0.0000 (1.0)           0;0  0.1672 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.7517 (3.76)     20.7517 (3.76)     20.7517 (3.76)     0.0000 (1.0)      20.7517 (3.76)     0.0000 (1.0)           0;0  0.0482 (0.27)          1           1
test_status-status[3.10.0]     21.3308 (3.87)     21.3308 (3.87)     21.3308 (3.87)     0.0000 (1.0)      21.3308 (3.87)     0.0000 (1.0)           0;0  0.0469 (0.26)          1           1
test_status-status[3.53.2]     19.2180 (3.48)     19.2180 (3.48)     19.2180 (3.48)     0.0000 (1.0)      19.2180 (3.48)     0.0000 (1.0)           0;0  0.0520 (0.29)          1           1
test_status-status[main]        5.5182 (1.0)       5.5182 (1.0)       5.5182 (1.0)      0.0000 (1.0)       5.5182 (1.0)      0.0000 (1.0)           0;0  0.1812 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9158 (1.73)     4.9158 (1.73)     4.9158 (1.73)     0.0000 (1.0)      4.9158 (1.73)     0.0000 (1.0)           0;0  0.2034 (0.58)          1           1
test_status-status-changed[3.10.0]     5.0732 (1.79)     5.0732 (1.79)     5.0732 (1.79)     0.0000 (1.0)      5.0732 (1.79)     0.0000 (1.0)           0;0  0.1971 (0.56)          1           1
test_status-status-changed[3.53.2]     4.9329 (1.74)     4.9329 (1.74)     4.9329 (1.74)     0.0000 (1.0)      4.9329 (1.74)     0.0000 (1.0)           0;0  0.2027 (0.57)          1           1
test_status-status-changed[main]       2.8339 (1.0)      2.8339 (1.0)      2.8339 (1.0)      0.0000 (1.0)      2.8339 (1.0)      0.0000 (1.0)           0;0  0.3529 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7532 (1.80)     4.7532 (1.80)     4.7532 (1.80)     0.0000 (1.0)      4.7532 (1.80)     0.0000 (1.0)           0;0  0.2104 (0.56)          1           1
test_status-status-changed-noop[3.10.0]     5.0341 (1.90)     5.0341 (1.90)     5.0341 (1.90)     0.0000 (1.0)      5.0341 (1.90)     0.0000 (1.0)           0;0  0.1986 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.8589 (1.84)     4.8589 (1.84)     4.8589 (1.84)     0.0000 (1.0)      4.8589 (1.84)     0.0000 (1.0)           0;0  0.2058 (0.54)          1           1
test_status-status-changed-noop[main]       2.6453 (1.0)      2.6453 (1.0)      2.6453 (1.0)      0.0000 (1.0)      2.6453 (1.0)      0.0000 (1.0)           0;0  0.3780 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8482 (1.82)     4.8482 (1.82)     4.8482 (1.82)     0.0000 (1.0)      4.8482 (1.82)     0.0000 (1.0)           0;0  0.2063 (0.55)          1           1
test_status-status-noop[3.10.0]     4.9786 (1.87)     4.9786 (1.87)     4.9786 (1.87)     0.0000 (1.0)      4.9786 (1.87)     0.0000 (1.0)           0;0  0.2009 (0.53)          1           1
test_status-status-noop[3.53.2]     4.8603 (1.83)     4.8603 (1.83)     4.8603 (1.83)     0.0000 (1.0)      4.8603 (1.83)     0.0000 (1.0)           0;0  0.2057 (0.55)          1           1
test_status-status-noop[main]       2.6584 (1.0)      2.6584 (1.0)      2.6584 (1.0)      0.0000 (1.0)      2.6584 (1.0)      0.0000 (1.0)           0;0  0.3762 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     161.8512 (3.48)     161.8512 (3.48)     161.8512 (3.48)     0.0000 (1.0)      161.8512 (3.48)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.10.0]     166.2733 (3.58)     166.2733 (3.58)     166.2733 (3.58)     0.0000 (1.0)      166.2733 (3.58)     0.0000 (1.0)           0;0  0.0060 (0.28)          1           1
test_update-import-url[3.53.2]     124.1765 (2.67)     124.1765 (2.67)     124.1765 (2.67)     0.0000 (1.0)      124.1765 (2.67)     0.0000 (1.0)           0;0  0.0081 (0.37)          1           1
test_update-import-url[main]        46.5078 (1.0)       46.5078 (1.0)       46.5078 (1.0)      0.0000 (1.0)       46.5078 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     143.4735 (4.01)     143.4735 (4.01)     143.4735 (4.01)     0.0000 (1.0)      143.4735 (4.01)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.10.0]     147.8588 (4.13)     147.8588 (4.13)     147.8588 (4.13)     0.0000 (1.0)      147.8588 (4.13)     0.0000 (1.0)           0;0  0.0068 (0.24)          1           1
test_update-update[3.53.2]     115.1418 (3.22)     115.1418 (3.22)     115.1418 (3.22)     0.0000 (1.0)      115.1418 (3.22)     0.0000 (1.0)           0;0  0.0087 (0.31)          1           1
test_update-update[main]        35.8025 (1.0)       35.8025 (1.0)       35.8025 (1.0)      0.0000 (1.0)       35.8025 (1.0)      0.0000 (1.0)           0;0  0.0279 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.2016 (2.23)     17.2016 (2.23)     17.2016 (2.23)     0.0000 (1.0)      17.2016 (2.23)     0.0000 (1.0)           0;0  0.0581 (0.45)          1           1
test_update-update-noop[3.10.0]     17.3592 (2.25)     17.3592 (2.25)     17.3592 (2.25)     0.0000 (1.0)      17.3592 (2.25)     0.0000 (1.0)           0;0  0.0576 (0.44)          1           1
test_update-update-noop[3.53.2]     16.6520 (2.16)     16.6520 (2.16)     16.6520 (2.16)     0.0000 (1.0)      16.6520 (2.16)     0.0000 (1.0)           0;0  0.0601 (0.46)          1           1
test_update-update-noop[main]        7.7051 (1.0)       7.7051 (1.0)       7.7051 (1.0)      0.0000 (1.0)       7.7051 (1.0)      0.0000 (1.0)           0;0  0.1298 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean