Fri Jun 13 00:40:06 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.8125 (3.88)     92.8125 (3.88)     92.8125 (3.88)     0.0000 (1.0)      92.8125 (3.88)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_add_copy-add[3.10.0]     93.7620 (3.92)     93.7620 (3.92)     93.7620 (3.92)     0.0000 (1.0)      93.7620 (3.92)     0.0000 (1.0)           0;0  0.0107 (0.25)          1           1
test_add_copy-add[3.53.2]     84.3040 (3.53)     84.3040 (3.53)     84.3040 (3.53)     0.0000 (1.0)      84.3040 (3.53)     0.0000 (1.0)           0;0  0.0119 (0.28)          1           1
test_add_copy-add[main]       23.8937 (1.0)      23.8937 (1.0)      23.8937 (1.0)      0.0000 (1.0)      23.8937 (1.0)      0.0000 (1.0)           0;0  0.0419 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     32.0732 (6.81)     32.0732 (6.81)     32.0732 (6.81)     0.0000 (1.0)      32.0732 (6.81)     0.0000 (1.0)           0;0  0.0312 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     32.5905 (6.92)     32.5905 (6.92)     32.5905 (6.92)     0.0000 (1.0)      32.5905 (6.92)     0.0000 (1.0)           0;0  0.0307 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     31.3196 (6.65)     31.3196 (6.65)     31.3196 (6.65)     0.0000 (1.0)      31.3196 (6.65)     0.0000 (1.0)           0;0  0.0319 (0.15)          1           1
test_add_copy-add-noop[main]        4.7066 (1.0)       4.7066 (1.0)       4.7066 (1.0)      0.0000 (1.0)       4.7066 (1.0)      0.0000 (1.0)           0;0  0.2125 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     71.2445 (4.18)     71.2445 (4.18)     71.2445 (4.18)     0.0000 (1.0)      71.2445 (4.18)     0.0000 (1.0)           0;0  0.0140 (0.24)          1           1
test_add_hardlink-add[3.10.0]     71.7704 (4.21)     71.7704 (4.21)     71.7704 (4.21)     0.0000 (1.0)      71.7704 (4.21)     0.0000 (1.0)           0;0  0.0139 (0.24)          1           1
test_add_hardlink-add[3.53.2]     66.0402 (3.87)     66.0402 (3.87)     66.0402 (3.87)     0.0000 (1.0)      66.0402 (3.87)     0.0000 (1.0)           0;0  0.0151 (0.26)          1           1
test_add_hardlink-add[main]       17.0614 (1.0)      17.0614 (1.0)      17.0614 (1.0)      0.0000 (1.0)      17.0614 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.2854 (8.44)     36.2854 (8.44)     36.2854 (8.44)     0.0000 (1.0)      36.2854 (8.44)     0.0000 (1.0)           0;0  0.0276 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     36.5166 (8.50)     36.5166 (8.50)     36.5166 (8.50)     0.0000 (1.0)      36.5166 (8.50)     0.0000 (1.0)           0;0  0.0274 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     35.4319 (8.24)     35.4319 (8.24)     35.4319 (8.24)     0.0000 (1.0)      35.4319 (8.24)     0.0000 (1.0)           0;0  0.0282 (0.12)          1           1
test_add_hardlink-add-noop[main]        4.2984 (1.0)       4.2984 (1.0)       4.2984 (1.0)      0.0000 (1.0)       4.2984 (1.0)      0.0000 (1.0)           0;0  0.2326 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     77.0523 (2.10)     77.0523 (2.10)     77.0523 (2.10)     0.0000 (1.0)      77.0523 (2.10)     0.0000 (1.0)           0;0  0.0130 (0.48)          1           1
test_add_symlink-add[3.10.0]     78.2419 (2.13)     78.2419 (2.13)     78.2419 (2.13)     0.0000 (1.0)      78.2419 (2.13)     0.0000 (1.0)           0;0  0.0128 (0.47)          1           1
test_add_symlink-add[3.53.2]     72.3632 (1.97)     72.3632 (1.97)     72.3632 (1.97)     0.0000 (1.0)      72.3632 (1.97)     0.0000 (1.0)           0;0  0.0138 (0.51)          1           1
test_add_symlink-add[main]       36.6956 (1.0)      36.6956 (1.0)      36.6956 (1.0)      0.0000 (1.0)      36.6956 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     50.8342 (8.57)     50.8342 (8.57)     50.8342 (8.57)     0.0000 (1.0)      50.8342 (8.57)     0.0000 (1.0)           0;0  0.0197 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     52.1801 (8.80)     52.1801 (8.80)     52.1801 (8.80)     0.0000 (1.0)      52.1801 (8.80)     0.0000 (1.0)           0;0  0.0192 (0.11)          1           1
test_add_symlink-add-noop[3.53.2]     48.3609 (8.16)     48.3609 (8.16)     48.3609 (8.16)     0.0000 (1.0)      48.3609 (8.16)     0.0000 (1.0)           0;0  0.0207 (0.12)          1           1
test_add_symlink-add-noop[main]        5.9286 (1.0)       5.9286 (1.0)       5.9286 (1.0)      0.0000 (1.0)       5.9286 (1.0)      0.0000 (1.0)           0;0  0.1687 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.7261 (2.02)     43.7261 (2.02)     43.7261 (2.02)     0.0000 (1.0)      43.7261 (2.02)     0.0000 (1.0)           0;0  0.0229 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     61.9316 (2.86)     61.9316 (2.86)     61.9316 (2.86)     0.0000 (1.0)      61.9316 (2.86)     0.0000 (1.0)           0;0  0.0161 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.6748 (1.37)     29.6748 (1.37)     29.6748 (1.37)     0.0000 (1.0)      29.6748 (1.37)     0.0000 (1.0)           0;0  0.0337 (0.73)          1           1
test_checkout_copy-checkout[main]       21.6563 (1.0)      21.6563 (1.0)      21.6563 (1.0)      0.0000 (1.0)      21.6563 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3855 (1.63)     5.3855 (1.63)     5.3855 (1.63)     0.0000 (1.0)      5.3855 (1.63)     0.0000 (1.0)           0;0  0.1857 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7917 (1.75)     5.7917 (1.75)     5.7917 (1.75)     0.0000 (1.0)      5.7917 (1.75)     0.0000 (1.0)           0;0  0.1727 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5046 (1.66)     5.5046 (1.66)     5.5046 (1.66)     0.0000 (1.0)      5.5046 (1.66)     0.0000 (1.0)           0;0  0.1817 (0.60)          1           1
test_checkout_copy-checkout-noop[main]       3.3082 (1.0)      3.3082 (1.0)      3.3082 (1.0)      0.0000 (1.0)      3.3082 (1.0)      0.0000 (1.0)           0;0  0.3023 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6583 (2.25)     8.6583 (2.25)     8.6583 (2.25)     0.0000 (1.0)      8.6583 (2.25)     0.0000 (1.0)           0;0  0.1155 (0.44)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3739 (1.65)     6.3739 (1.65)     6.3739 (1.65)     0.0000 (1.0)      6.3739 (1.65)     0.0000 (1.0)           0;0  0.1569 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2600 (1.63)     6.2600 (1.63)     6.2600 (1.63)     0.0000 (1.0)      6.2600 (1.63)     0.0000 (1.0)           0;0  0.1597 (0.62)          1           1
test_checkout_copy-checkout-update[main]       3.8518 (1.0)      3.8518 (1.0)      3.8518 (1.0)      0.0000 (1.0)      3.8518 (1.0)      0.0000 (1.0)           0;0  0.2596 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.1025 (3.05)     24.1025 (3.05)     24.1025 (3.05)     0.0000 (1.0)      24.1025 (3.05)     0.0000 (1.0)           0;0  0.0415 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.2819 (2.19)     17.2819 (2.19)     17.2819 (2.19)     0.0000 (1.0)      17.2819 (2.19)     0.0000 (1.0)           0;0  0.0579 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.1780 (2.05)     16.1780 (2.05)     16.1780 (2.05)     0.0000 (1.0)      16.1780 (2.05)     0.0000 (1.0)           0;0  0.0618 (0.49)          1           1
test_checkout_hardlink-checkout[main]        7.9064 (1.0)       7.9064 (1.0)       7.9064 (1.0)      0.0000 (1.0)       7.9064 (1.0)      0.0000 (1.0)           0;0  0.1265 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6130 (1.71)     5.6130 (1.71)     5.6130 (1.71)     0.0000 (1.0)      5.6130 (1.71)     0.0000 (1.0)           0;0  0.1782 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6468 (1.72)     5.6468 (1.72)     5.6468 (1.72)     0.0000 (1.0)      5.6468 (1.72)     0.0000 (1.0)           0;0  0.1771 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4165 (1.65)     5.4165 (1.65)     5.4165 (1.65)     0.0000 (1.0)      5.4165 (1.65)     0.0000 (1.0)           0;0  0.1846 (0.61)          1           1
test_checkout_hardlink-checkout-noop[main]       3.2895 (1.0)      3.2895 (1.0)      3.2895 (1.0)      0.0000 (1.0)      3.2895 (1.0)      0.0000 (1.0)           0;0  0.3040 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7261 (2.22)     8.7261 (2.22)     8.7261 (2.22)     0.0000 (1.0)      8.7261 (2.22)     0.0000 (1.0)           0;0  0.1146 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5218 (1.66)     6.5218 (1.66)     6.5218 (1.66)     0.0000 (1.0)      6.5218 (1.66)     0.0000 (1.0)           0;0  0.1533 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2745 (1.60)     6.2745 (1.60)     6.2745 (1.60)     0.0000 (1.0)      6.2745 (1.60)     0.0000 (1.0)           0;0  0.1594 (0.63)          1           1
test_checkout_hardlink-checkout-update[main]       3.9245 (1.0)      3.9245 (1.0)      3.9245 (1.0)      0.0000 (1.0)      3.9245 (1.0)      0.0000 (1.0)           0;0  0.2548 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.9719 (2.46)     27.9719 (2.46)     27.9719 (2.46)     0.0000 (1.0)      27.9719 (2.46)     0.0000 (1.0)           0;0  0.0358 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     21.3832 (1.88)     21.3832 (1.88)     21.3832 (1.88)     0.0000 (1.0)      21.3832 (1.88)     0.0000 (1.0)           0;0  0.0468 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.7638 (1.74)     19.7638 (1.74)     19.7638 (1.74)     0.0000 (1.0)      19.7638 (1.74)     0.0000 (1.0)           0;0  0.0506 (0.57)          1           1
test_checkout_symlink-checkout[main]       11.3572 (1.0)      11.3572 (1.0)      11.3572 (1.0)      0.0000 (1.0)      11.3572 (1.0)      0.0000 (1.0)           0;0  0.0880 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7590 (1.53)     6.7590 (1.53)     6.7590 (1.53)     0.0000 (1.0)      6.7590 (1.53)     0.0000 (1.0)           0;0  0.1480 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8007 (1.54)     6.8007 (1.54)     6.8007 (1.54)     0.0000 (1.0)      6.8007 (1.54)     0.0000 (1.0)           0;0  0.1470 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6651 (1.51)     6.6651 (1.51)     6.6651 (1.51)     0.0000 (1.0)      6.6651 (1.51)     0.0000 (1.0)           0;0  0.1500 (0.66)          1           1
test_checkout_symlink-checkout-noop[main]       4.4269 (1.0)      4.4269 (1.0)      4.4269 (1.0)      0.0000 (1.0)      4.4269 (1.0)      0.0000 (1.0)           0;0  0.2259 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.8062 (1.83)     10.8062 (1.83)     10.8062 (1.83)     0.0000 (1.0)      10.8062 (1.83)     0.0000 (1.0)           0;0  0.0925 (0.55)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7313 (1.48)      8.7313 (1.48)      8.7313 (1.48)     0.0000 (1.0)       8.7313 (1.48)     0.0000 (1.0)           0;0  0.1145 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3337 (1.41)      8.3337 (1.41)      8.3337 (1.41)     0.0000 (1.0)       8.3337 (1.41)     0.0000 (1.0)           0;0  0.1200 (0.71)          1           1
test_checkout_symlink-checkout-update[main]        5.8943 (1.0)       5.8943 (1.0)       5.8943 (1.0)      0.0000 (1.0)       5.8943 (1.0)      0.0000 (1.0)           0;0  0.1697 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0908 (1.76)     4.0908 (1.76)     4.0908 (1.76)     0.0000 (1.0)      4.0908 (1.76)     0.0000 (1.0)           0;0  0.2445 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.7519 (2.05)     4.7519 (2.05)     4.7519 (2.05)     0.0000 (1.0)      4.7519 (2.05)     0.0000 (1.0)           0;0  0.2104 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.6182 (1.99)     4.6182 (1.99)     4.6182 (1.99)     0.0000 (1.0)      4.6182 (1.99)     0.0000 (1.0)           0;0  0.2165 (0.50)          1           1
test_data_status-data-changed[main]       2.3207 (1.0)      2.3207 (1.0)      2.3207 (1.0)      0.0000 (1.0)      2.3207 (1.0)      0.0000 (1.0)           0;0  0.4309 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2668 (1.81)     4.2668 (1.81)     4.2668 (1.81)     0.0000 (1.0)      4.2668 (1.81)     0.0000 (1.0)           0;0  0.2344 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8674 (2.06)     4.8674 (2.06)     4.8674 (2.06)     0.0000 (1.0)      4.8674 (2.06)     0.0000 (1.0)           0;0  0.2054 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5898 (1.95)     4.5898 (1.95)     4.5898 (1.95)     0.0000 (1.0)      4.5898 (1.95)     0.0000 (1.0)           0;0  0.2179 (0.51)          1           1
test_data_status-data-changed-noop[main]       2.3580 (1.0)      2.3580 (1.0)      2.3580 (1.0)      0.0000 (1.0)      2.3580 (1.0)      0.0000 (1.0)           0;0  0.4241 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.9942 (3.92)     19.9942 (3.92)     19.9942 (3.92)     0.0000 (1.0)      19.9942 (3.92)     0.0000 (1.0)           0;0  0.0500 (0.25)          1           1
test_data_status-data-new[3.10.0]     20.2869 (3.98)     20.2869 (3.98)     20.2869 (3.98)     0.0000 (1.0)      20.2869 (3.98)     0.0000 (1.0)           0;0  0.0493 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.9973 (3.92)     19.9973 (3.92)     19.9973 (3.92)     0.0000 (1.0)      19.9973 (3.92)     0.0000 (1.0)           0;0  0.0500 (0.25)          1           1
test_data_status-data-new[main]        5.0959 (1.0)       5.0959 (1.0)       5.0959 (1.0)      0.0000 (1.0)       5.0959 (1.0)      0.0000 (1.0)           0;0  0.1962 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0780 (1.76)     4.0780 (1.76)     4.0780 (1.76)     0.0000 (1.0)      4.0780 (1.76)     0.0000 (1.0)           0;0  0.2452 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.7898 (2.06)     4.7898 (2.06)     4.7898 (2.06)     0.0000 (1.0)      4.7898 (2.06)     0.0000 (1.0)           0;0  0.2088 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6965 (2.02)     4.6965 (2.02)     4.6965 (2.02)     0.0000 (1.0)      4.6965 (2.02)     0.0000 (1.0)           0;0  0.2129 (0.49)          1           1
test_data_status-data-noop[main]       2.3208 (1.0)      2.3208 (1.0)      2.3208 (1.0)      0.0000 (1.0)      2.3208 (1.0)      0.0000 (1.0)           0;0  0.4309 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     16.1066 (1.10)     16.1066 (1.10)     16.1066 (1.10)     0.0000 (1.0)      16.1066 (1.10)     0.0000 (1.0)           0;0  0.0621 (0.91)          1           1
test_data_status_all_flags-data-changed[3.10.0]     16.7626 (1.15)     16.7626 (1.15)     16.7626 (1.15)     0.0000 (1.0)      16.7626 (1.15)     0.0000 (1.0)           0;0  0.0597 (0.87)          1           1
test_data_status_all_flags-data-changed[3.53.2]     16.9011 (1.16)     16.9011 (1.16)     16.9011 (1.16)     0.0000 (1.0)      16.9011 (1.16)     0.0000 (1.0)           0;0  0.0592 (0.86)          1           1
test_data_status_all_flags-data-changed[main]       14.5971 (1.0)      14.5971 (1.0)      14.5971 (1.0)      0.0000 (1.0)      14.5971 (1.0)      0.0000 (1.0)           0;0  0.0685 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     16.2247 (1.10)     16.2247 (1.10)     16.2247 (1.10)     0.0000 (1.0)      16.2247 (1.10)     0.0000 (1.0)           0;0  0.0616 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     16.8115 (1.14)     16.8115 (1.14)     16.8115 (1.14)     0.0000 (1.0)      16.8115 (1.14)     0.0000 (1.0)           0;0  0.0595 (0.87)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     16.8407 (1.15)     16.8407 (1.15)     16.8407 (1.15)     0.0000 (1.0)      16.8407 (1.15)     0.0000 (1.0)           0;0  0.0594 (0.87)          1           1
test_data_status_all_flags-data-changed-noop[main]       14.6889 (1.0)      14.6889 (1.0)      14.6889 (1.0)      0.0000 (1.0)      14.6889 (1.0)      0.0000 (1.0)           0;0  0.0681 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     32.2116 (1.85)     32.2116 (1.85)     32.2116 (1.85)     0.0000 (1.0)      32.2116 (1.85)     0.0000 (1.0)           0;0  0.0310 (0.54)          1           1
test_data_status_all_flags-data-new[3.10.0]     33.1278 (1.90)     33.1278 (1.90)     33.1278 (1.90)     0.0000 (1.0)      33.1278 (1.90)     0.0000 (1.0)           0;0  0.0302 (0.53)          1           1
test_data_status_all_flags-data-new[3.53.2]     32.9616 (1.89)     32.9616 (1.89)     32.9616 (1.89)     0.0000 (1.0)      32.9616 (1.89)     0.0000 (1.0)           0;0  0.0303 (0.53)          1           1
test_data_status_all_flags-data-new[main]       17.4189 (1.0)      17.4189 (1.0)      17.4189 (1.0)      0.0000 (1.0)      17.4189 (1.0)      0.0000 (1.0)           0;0  0.0574 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     15.5823 (1.11)     15.5823 (1.11)     15.5823 (1.11)     0.0000 (1.0)      15.5823 (1.11)     0.0000 (1.0)           0;0  0.0642 (0.90)          1           1
test_data_status_all_flags-data-noop[3.10.0]     15.9835 (1.14)     15.9835 (1.14)     15.9835 (1.14)     0.0000 (1.0)      15.9835 (1.14)     0.0000 (1.0)           0;0  0.0626 (0.88)          1           1
test_data_status_all_flags-data-noop[3.53.2]     16.0857 (1.14)     16.0857 (1.14)     16.0857 (1.14)     0.0000 (1.0)      16.0857 (1.14)     0.0000 (1.0)           0;0  0.0622 (0.87)          1           1
test_data_status_all_flags-data-noop[main]       14.0696 (1.0)      14.0696 (1.0)      14.0696 (1.0)      0.0000 (1.0)      14.0696 (1.0)      0.0000 (1.0)           0;0  0.0711 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.4624 (2.78)     19.4624 (2.78)     19.4624 (2.78)     0.0000 (1.0)      19.4624 (2.78)     0.0000 (1.0)           0;0  0.0514 (0.36)          1           1
test_diff-diff[3.10.0]     20.1996 (2.89)     20.1996 (2.89)     20.1996 (2.89)     0.0000 (1.0)      20.1996 (2.89)     0.0000 (1.0)           0;0  0.0495 (0.35)          1           1
test_diff-diff[3.53.2]     20.4437 (2.92)     20.4437 (2.92)     20.4437 (2.92)     0.0000 (1.0)      20.4437 (2.92)     0.0000 (1.0)           0;0  0.0489 (0.34)          1           1
test_diff-diff[main]        6.9996 (1.0)       6.9996 (1.0)       6.9996 (1.0)      0.0000 (1.0)       6.9996 (1.0)      0.0000 (1.0)           0;0  0.1429 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2039 (1.88)     6.2039 (1.88)     6.2039 (1.88)     0.0000 (1.0)      6.2039 (1.88)     0.0000 (1.0)           0;0  0.1612 (0.53)          1           1
test_diff-diff-changed[3.10.0]     6.7768 (2.05)     6.7768 (2.05)     6.7768 (2.05)     0.0000 (1.0)      6.7768 (2.05)     0.0000 (1.0)           0;0  0.1476 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.6650 (1.72)     5.6650 (1.72)     5.6650 (1.72)     0.0000 (1.0)      5.6650 (1.72)     0.0000 (1.0)           0;0  0.1765 (0.58)          1           1
test_diff-diff-changed[main]       3.2985 (1.0)      3.2985 (1.0)      3.2985 (1.0)      0.0000 (1.0)      3.2985 (1.0)      0.0000 (1.0)           0;0  0.3032 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1462 (1.54)     5.1462 (1.54)     5.1462 (1.54)     0.0000 (1.0)      5.1462 (1.54)     0.0000 (1.0)           0;0  0.1943 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6735 (1.69)     5.6735 (1.69)     5.6735 (1.69)     0.0000 (1.0)      5.6735 (1.69)     0.0000 (1.0)           0;0  0.1763 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4604 (1.63)     5.4604 (1.63)     5.4604 (1.63)     0.0000 (1.0)      5.4604 (1.63)     0.0000 (1.0)           0;0  0.1831 (0.61)          1           1
test_diff-diff-changed-noop[main]       3.3513 (1.0)      3.3513 (1.0)      3.3513 (1.0)      0.0000 (1.0)      3.3513 (1.0)      0.0000 (1.0)           0;0  0.2984 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1929 (1.29)     4.1929 (1.29)     4.1929 (1.29)     0.0000 (1.0)      4.1929 (1.29)     0.0000 (1.0)           0;0  0.2385 (0.78)          1           1
test_diff-diff-noop[3.10.0]     4.7882 (1.47)     4.7882 (1.47)     4.7882 (1.47)     0.0000 (1.0)      4.7882 (1.47)     0.0000 (1.0)           0;0  0.2088 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.5293 (1.70)     5.5293 (1.70)     5.5293 (1.70)     0.0000 (1.0)      5.5293 (1.70)     0.0000 (1.0)           0;0  0.1809 (0.59)          1           1
test_diff-diff-noop[main]       3.2614 (1.0)      3.2614 (1.0)      3.2614 (1.0)      0.0000 (1.0)      3.2614 (1.0)      0.0000 (1.0)           0;0  0.3066 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       976.8625 (1.0)        976.8625 (1.0)        976.8625 (1.0)      0.0000 (1.0)        976.8625 (1.0)      0.0000 (1.0)           0;0  1.0237 (1.0)           1           1
test_exp_show-exp[3.10.0]     8,449.3526 (8.65)     8,449.3526 (8.65)     8,449.3526 (8.65)     0.0000 (1.0)      8,449.3526 (8.65)     0.0000 (1.0)           0;0  0.1184 (0.12)          1           1
test_exp_show-exp[3.53.2]     4,977.1517 (5.10)     4,977.1517 (5.10)     4,977.1517 (5.10)     0.0000 (1.0)      4,977.1517 (5.10)     0.0000 (1.0)           0;0  0.2009 (0.20)          1           1
test_exp_show-exp[main]       8,591.3429 (8.79)     8,591.3429 (8.79)     8,591.3429 (8.79)     0.0000 (1.0)      8,591.3429 (8.79)     0.0000 (1.0)           0;0  0.1164 (0.11)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.9078 (2.87)     67.9078 (2.87)     67.9078 (2.87)     0.0000 (1.0)      67.9078 (2.87)     0.0000 (1.0)           0;0  0.0147 (0.35)          1           1
test_fetch-fetch[3.10.0]     73.5191 (3.11)     73.5191 (3.11)     73.5191 (3.11)     0.0000 (1.0)      73.5191 (3.11)     0.0000 (1.0)           0;0  0.0136 (0.32)          1           1
test_fetch-fetch[3.53.2]     35.8097 (1.51)     35.8097 (1.51)     35.8097 (1.51)     0.0000 (1.0)      35.8097 (1.51)     0.0000 (1.0)           0;0  0.0279 (0.66)          1           1
test_fetch-fetch[main]       23.6398 (1.0)      23.6398 (1.0)      23.6398 (1.0)      0.0000 (1.0)      23.6398 (1.0)      0.0000 (1.0)           0;0  0.0423 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8475 (1.00)     2.8475 (1.00)     2.8475 (1.00)     0.0000 (1.0)      2.8475 (1.00)     0.0000 (1.0)           0;0  0.3512 (1.00)          1           1
test_gc-gc[3.10.0]     2.9594 (1.04)     2.9594 (1.04)     2.9594 (1.04)     0.0000 (1.0)      2.9594 (1.04)     0.0000 (1.0)           0;0  0.3379 (0.96)          1           1
test_gc-gc[3.53.2]     2.9737 (1.05)     2.9737 (1.05)     2.9737 (1.05)     0.0000 (1.0)      2.9737 (1.05)     0.0000 (1.0)           0;0  0.3363 (0.95)          1           1
test_gc-gc[main]       2.8364 (1.0)      2.8364 (1.0)      2.8364 (1.0)      0.0000 (1.0)      2.8364 (1.0)      0.0000 (1.0)           0;0  0.3526 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     135.3325 (2.70)     135.3325 (2.70)     135.3325 (2.70)     0.0000 (1.0)      135.3325 (2.70)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     163.5332 (3.26)     163.5332 (3.26)     163.5332 (3.26)     0.0000 (1.0)      163.5332 (3.26)     0.0000 (1.0)           0;0  0.0061 (0.31)          1           1
test_get-get[3.53.2]     143.9870 (2.87)     143.9870 (2.87)     143.9870 (2.87)     0.0000 (1.0)      143.9870 (2.87)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[main]        50.1178 (1.0)       50.1178 (1.0)       50.1178 (1.0)      0.0000 (1.0)       50.1178 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.3040 (2.69)     45.3040 (2.69)     45.3040 (2.69)     0.0000 (1.0)      45.3040 (2.69)     0.0000 (1.0)           0;0  0.0221 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.4865 (2.88)     48.4865 (2.88)     48.4865 (2.88)     0.0000 (1.0)      48.4865 (2.88)     0.0000 (1.0)           0;0  0.0206 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.8502 (1.0)      16.8502 (1.0)      16.8502 (1.0)      0.0000 (1.0)      16.8502 (1.0)      0.0000 (1.0)           0;0  0.0593 (1.0)           1           1
test_get_url-get-url[main]       16.8675 (1.00)     16.8675 (1.00)     16.8675 (1.00)     0.0000 (1.0)      16.8675 (1.00)     0.0000 (1.0)           0;0  0.0593 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     132.2676 (1.01)     138.3654 (1.00)     135.3108 (1.01)     1.2863 (1.0)      135.2506 (1.01)     1.9842 (1.35)         36;0  7.3904 (0.99)        100           1
test_help---help[3.10.0]     130.4277 (1.0)      138.0175 (1.0)      133.4135 (1.0)      1.3305 (1.03)     133.3029 (1.0)      1.4673 (1.0)          28;3  7.4955 (1.0)         100           1
test_help---help[3.53.2]     132.1261 (1.01)     166.0844 (1.20)     135.9976 (1.02)     5.0950 (3.96)     134.6384 (1.01)     2.3651 (1.61)          7;8  7.3531 (0.98)        100           1
test_help---help[main]       133.1886 (1.02)     144.3362 (1.05)     136.3022 (1.02)     2.2488 (1.75)     135.8790 (1.02)     2.4564 (1.67)         23;5  7.3366 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     228.0319 (2.93)     228.0319 (2.93)     228.0319 (2.93)     0.0000 (1.0)      228.0319 (2.93)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     259.9720 (3.34)     259.9720 (3.34)     259.9720 (3.34)     0.0000 (1.0)      259.9720 (3.34)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        77.7448 (1.0)       77.7448 (1.0)       77.7448 (1.0)      0.0000 (1.0)       77.7448 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     159.5177 (3.41)     159.5177 (3.41)     159.5177 (3.41)     0.0000 (1.0)      159.5177 (3.41)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.10.0]     165.9177 (3.55)     165.9177 (3.55)     165.9177 (3.55)     0.0000 (1.0)      165.9177 (3.55)     0.0000 (1.0)           0;0  0.0060 (0.28)          1           1
test_import_url-import-url[3.53.2]     123.7086 (2.64)     123.7086 (2.64)     123.7086 (2.64)     0.0000 (1.0)      123.7086 (2.64)     0.0000 (1.0)           0;0  0.0081 (0.38)          1           1
test_import_url-import-url[main]        46.7801 (1.0)       46.7801 (1.0)       46.7801 (1.0)      0.0000 (1.0)       46.7801 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     387.7034 (1.01)     413.5420 (1.02)     394.8807 (1.01)      5.4166 (1.36)     393.4294 (1.01)     5.6271 (1.0)          23;9  2.5324 (0.99)        100           1
test_init-init[3.10.0]     396.8505 (1.03)     416.2418 (1.03)     406.0507 (1.04)      3.9819 (1.0)      405.4711 (1.04)     5.7218 (1.02)         31;0  2.4627 (0.97)        100           1
test_init-init[3.53.2]     383.7473 (1.00)     404.0728 (1.0)      392.2783 (1.0)       4.5898 (1.15)     391.3034 (1.0)      6.3981 (1.14)         37;0  2.5492 (1.0)         100           1
test_init-init[main]       383.7206 (1.0)      465.5942 (1.15)     395.0532 (1.01)     12.1369 (3.05)     391.7138 (1.00)     6.2542 (1.11)          6;8  2.5313 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     586.0135 (1.09)     586.0135 (1.09)     586.0135 (1.09)     0.0000 (1.0)      586.0135 (1.09)     0.0000 (1.0)           0;0  1.7064 (0.92)          1           1
test_list-list[3.10.0]     681.6342 (1.27)     681.6342 (1.27)     681.6342 (1.27)     0.0000 (1.0)      681.6342 (1.27)     0.0000 (1.0)           0;0  1.4671 (0.79)          1           1
test_list-list[3.53.2]     559.3480 (1.04)     559.3480 (1.04)     559.3480 (1.04)     0.0000 (1.0)      559.3480 (1.04)     0.0000 (1.0)           0;0  1.7878 (0.96)          1           1
test_list-list[main]       537.4177 (1.0)      537.4177 (1.0)      537.4177 (1.0)      0.0000 (1.0)      537.4177 (1.0)      0.0000 (1.0)           0;0  1.8608 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     423.0876 (1.09)     423.0876 (1.09)     423.0876 (1.09)     0.0000 (1.0)      423.0876 (1.09)     0.0000 (1.0)           0;0  2.3636 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     406.9565 (1.05)     406.9565 (1.05)     406.9565 (1.05)     0.0000 (1.0)      406.9565 (1.05)     0.0000 (1.0)           0;0  2.4573 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     388.4655 (1.0)      388.4655 (1.0)      388.4655 (1.0)      0.0000 (1.0)      388.4655 (1.0)      0.0000 (1.0)           0;0  2.5742 (1.0)           1           1
test_list-list-dvc-only[main]       392.0542 (1.01)     392.0542 (1.01)     392.0542 (1.01)     0.0000 (1.0)      392.0542 (1.01)     0.0000 (1.0)           0;0  2.5507 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6000 (1.0)      2.6000 (1.0)      2.6000 (1.0)      0.0000 (1.0)      2.6000 (1.0)      0.0000 (1.0)           0;0  0.3846 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6611 (1.02)     2.6611 (1.02)     2.6611 (1.02)     0.0000 (1.0)      2.6611 (1.02)     0.0000 (1.0)           0;0  0.3758 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.7126 (1.04)     2.7126 (1.04)     2.7126 (1.04)     0.0000 (1.0)      2.7126 (1.04)     0.0000 (1.0)           0;0  0.3687 (0.96)          1           1
test_list-list-recursive[main]       2.6835 (1.03)     2.6835 (1.03)     2.6835 (1.03)     0.0000 (1.0)      2.6835 (1.03)     0.0000 (1.0)           0;0  0.3726 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     407.0495 (1.05)     407.0495 (1.05)     407.0495 (1.05)     0.0000 (1.0)      407.0495 (1.05)     0.0000 (1.0)           0;0  2.4567 (0.95)          1           1
test_list-list-shallow[3.10.0]     415.5021 (1.07)     415.5021 (1.07)     415.5021 (1.07)     0.0000 (1.0)      415.5021 (1.07)     0.0000 (1.0)           0;0  2.4067 (0.93)          1           1
test_list-list-shallow[3.53.2]     386.9808 (1.0)      386.9808 (1.0)      386.9808 (1.0)      0.0000 (1.0)      386.9808 (1.0)      0.0000 (1.0)           0;0  2.5841 (1.0)           1           1
test_list-list-shallow[main]       396.4392 (1.02)     396.4392 (1.02)     396.4392 (1.02)     0.0000 (1.0)      396.4392 (1.02)     0.0000 (1.0)           0;0  2.5225 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.6458 (2.83)     12.6458 (2.83)     12.6458 (2.83)     0.0000 (1.0)      12.6458 (2.83)     0.0000 (1.0)           0;0  0.0791 (0.35)          1           1
test_partial_add-add[3.10.0]     13.1030 (2.93)     13.1030 (2.93)     13.1030 (2.93)     0.0000 (1.0)      13.1030 (2.93)     0.0000 (1.0)           0;0  0.0763 (0.34)          1           1
test_partial_add-add[3.53.2]     11.9614 (2.68)     11.9614 (2.68)     11.9614 (2.68)     0.0000 (1.0)      11.9614 (2.68)     0.0000 (1.0)           0;0  0.0836 (0.37)          1           1
test_partial_add-add[main]        4.4654 (1.0)       4.4654 (1.0)       4.4654 (1.0)      0.0000 (1.0)       4.4654 (1.0)      0.0000 (1.0)           0;0  0.2239 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     86.6233 (4.19)     86.6233 (4.19)     86.6233 (4.19)     0.0000 (1.0)      86.6233 (4.19)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     87.9330 (4.26)     87.9330 (4.26)     87.9330 (4.26)     0.0000 (1.0)      87.9330 (4.26)     0.0000 (1.0)           0;0  0.0114 (0.23)          1           1
test_partial_add-add-partial[3.53.2]     79.3201 (3.84)     79.3201 (3.84)     79.3201 (3.84)     0.0000 (1.0)      79.3201 (3.84)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add-partial[main]       20.6591 (1.0)      20.6591 (1.0)      20.6591 (1.0)      0.0000 (1.0)      20.6591 (1.0)      0.0000 (1.0)           0;0  0.0484 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.8931 (1.0)      4.8931 (1.0)      4.8931 (1.0)      0.0000 (1.0)      4.8931 (1.0)      0.0000 (1.0)           0;0  0.2044 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1032 (1.25)     6.1032 (1.25)     6.1032 (1.25)     0.0000 (1.0)      6.1032 (1.25)     0.0000 (1.0)           0;0  0.1638 (0.80)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1285 (1.46)     7.1285 (1.46)     7.1285 (1.46)     0.0000 (1.0)      7.1285 (1.46)     0.0000 (1.0)           0;0  0.1403 (0.69)          1           1
test_partial_add-gc-cloud-noop[main]       7.0845 (1.45)     7.0845 (1.45)     7.0845 (1.45)     0.0000 (1.0)      7.0845 (1.45)     0.0000 (1.0)           0;0  0.1412 (0.69)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6301 (1.0)      2.6301 (1.0)      2.6301 (1.0)      0.0000 (1.0)      2.6301 (1.0)      0.0000 (1.0)           0;0  0.3802 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7754 (1.44)     3.7754 (1.44)     3.7754 (1.44)     0.0000 (1.0)      3.7754 (1.44)     0.0000 (1.0)           0;0  0.2649 (0.70)          1           1
test_partial_add-gc-noop[3.53.2]     3.8687 (1.47)     3.8687 (1.47)     3.8687 (1.47)     0.0000 (1.0)      3.8687 (1.47)     0.0000 (1.0)           0;0  0.2585 (0.68)          1           1
test_partial_add-gc-noop[main]       4.0409 (1.54)     4.0409 (1.54)     4.0409 (1.54)     0.0000 (1.0)      4.0409 (1.54)     0.0000 (1.0)           0;0  0.2475 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7286 (2.07)     7.7286 (2.07)     7.7286 (2.07)     0.0000 (1.0)      7.7286 (2.07)     0.0000 (1.0)           0;0  0.1294 (0.48)          1           1
test_partial_add-push[3.10.0]     6.9639 (1.86)     6.9639 (1.86)     6.9639 (1.86)     0.0000 (1.0)      6.9639 (1.86)     0.0000 (1.0)           0;0  0.1436 (0.54)          1           1
test_partial_add-push[3.53.2]     3.7895 (1.01)     3.7895 (1.01)     3.7895 (1.01)     0.0000 (1.0)      3.7895 (1.01)     0.0000 (1.0)           0;0  0.2639 (0.99)          1           1
test_partial_add-push[main]       3.7352 (1.0)      3.7352 (1.0)      3.7352 (1.0)      0.0000 (1.0)      3.7352 (1.0)      0.0000 (1.0)           0;0  0.2677 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.2040 (2.16)     45.2040 (2.16)     45.2040 (2.16)     0.0000 (1.0)      45.2040 (2.16)     0.0000 (1.0)           0;0  0.0221 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     40.9782 (1.96)     40.9782 (1.96)     40.9782 (1.96)     0.0000 (1.0)      40.9782 (1.96)     0.0000 (1.0)           0;0  0.0244 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.3357 (1.02)     21.3357 (1.02)     21.3357 (1.02)     0.0000 (1.0)      21.3357 (1.02)     0.0000 (1.0)           0;0  0.0469 (0.98)          1           1
test_partial_add-push-partial[main]       20.9491 (1.0)      20.9491 (1.0)      20.9491 (1.0)      0.0000 (1.0)      20.9491 (1.0)      0.0000 (1.0)           0;0  0.0477 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     92.0786 (3.93)     92.0786 (3.93)     92.0786 (3.93)     0.0000 (1.0)      92.0786 (3.93)     0.0000 (1.0)           0;0  0.0109 (0.25)          1           1
test_partial_remove-add[3.10.0]     92.0736 (3.93)     92.0736 (3.93)     92.0736 (3.93)     0.0000 (1.0)      92.0736 (3.93)     0.0000 (1.0)           0;0  0.0109 (0.25)          1           1
test_partial_remove-add[3.53.2]     82.5326 (3.52)     82.5326 (3.52)     82.5326 (3.52)     0.0000 (1.0)      82.5326 (3.52)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_partial_remove-add[main]       23.4292 (1.0)      23.4292 (1.0)      23.4292 (1.0)      0.0000 (1.0)      23.4292 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     50.8933 (13.53)    50.8933 (13.53)    50.8933 (13.53)    0.0000 (1.0)      50.8933 (13.53)    0.0000 (1.0)           0;0  0.0196 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     51.8523 (13.79)    51.8523 (13.79)    51.8523 (13.79)    0.0000 (1.0)      51.8523 (13.79)    0.0000 (1.0)           0;0  0.0193 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     46.2262 (12.29)    46.2262 (12.29)    46.2262 (12.29)    0.0000 (1.0)      46.2262 (12.29)    0.0000 (1.0)           0;0  0.0216 (0.08)          1           1
test_partial_remove-add-update[main]        3.7611 (1.0)       3.7611 (1.0)       3.7611 (1.0)      0.0000 (1.0)       3.7611 (1.0)      0.0000 (1.0)           0;0  0.2659 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5430 (1.0)      2.5430 (1.0)      2.5430 (1.0)      0.0000 (1.0)      2.5430 (1.0)      0.0000 (1.0)           0;0  0.3932 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6584 (1.44)     3.6584 (1.44)     3.6584 (1.44)     0.0000 (1.0)      3.6584 (1.44)     0.0000 (1.0)           0;0  0.2733 (0.70)          1           1
test_partial_remove-gc[3.53.2]     3.7120 (1.46)     3.7120 (1.46)     3.7120 (1.46)     0.0000 (1.0)      3.7120 (1.46)     0.0000 (1.0)           0;0  0.2694 (0.69)          1           1
test_partial_remove-gc[main]       3.6837 (1.45)     3.6837 (1.45)     3.6837 (1.45)     0.0000 (1.0)      3.6837 (1.45)     0.0000 (1.0)           0;0  0.2715 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.0335 (1.0)      5.0335 (1.0)      5.0335 (1.0)      0.0000 (1.0)      5.0335 (1.0)      0.0000 (1.0)           0;0  0.1987 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.9488 (1.18)     5.9488 (1.18)     5.9488 (1.18)     0.0000 (1.0)      5.9488 (1.18)     0.0000 (1.0)           0;0  0.1681 (0.85)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.9408 (1.38)     6.9408 (1.38)     6.9408 (1.38)     0.0000 (1.0)      6.9408 (1.38)     0.0000 (1.0)           0;0  0.1441 (0.73)          1           1
test_partial_remove-gc-cloud[main]       6.7777 (1.35)     6.7777 (1.35)     6.7777 (1.35)     0.0000 (1.0)      6.7777 (1.35)     0.0000 (1.0)           0;0  0.1475 (0.74)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.7489 (2.33)     52.7489 (2.33)     52.7489 (2.33)     0.0000 (1.0)      52.7489 (2.33)     0.0000 (1.0)           0;0  0.0190 (0.43)          1           1
test_partial_remove-push[3.10.0]     47.0734 (2.08)     47.0734 (2.08)     47.0734 (2.08)     0.0000 (1.0)      47.0734 (2.08)     0.0000 (1.0)           0;0  0.0212 (0.48)          1           1
test_partial_remove-push[3.53.2]     22.7733 (1.01)     22.7733 (1.01)     22.7733 (1.01)     0.0000 (1.0)      22.7733 (1.01)     0.0000 (1.0)           0;0  0.0439 (0.99)          1           1
test_partial_remove-push[main]       22.6413 (1.0)      22.6413 (1.0)      22.6413 (1.0)      0.0000 (1.0)      22.6413 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9175 (1.0)      3.9175 (1.0)      3.9175 (1.0)      0.0000 (1.0)      3.9175 (1.0)      0.0000 (1.0)           0;0  0.2553 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.9938 (1.02)     3.9938 (1.02)     3.9938 (1.02)     0.0000 (1.0)      3.9938 (1.02)     0.0000 (1.0)           0;0  0.2504 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     7.1706 (1.83)     7.1706 (1.83)     7.1706 (1.83)     0.0000 (1.0)      7.1706 (1.83)     0.0000 (1.0)           0;0  0.1395 (0.55)          1           1
test_partial_remove-push-update[main]       7.0428 (1.80)     7.0428 (1.80)     7.0428 (1.80)     0.0000 (1.0)      7.0428 (1.80)     0.0000 (1.0)           0;0  0.1420 (0.56)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     496.0879 (1.0)      503.8870 (1.0)      498.2795 (1.0)      3.1933 (1.54)     496.9786 (1.0)      2.7792 (1.21)          1;1  2.0069 (1.0)           5           3
test_plots-plots-diff[3.10.0]     896.4405 (1.81)     910.2911 (1.81)     905.1088 (1.82)     5.3383 (2.57)     905.9009 (1.82)     6.4136 (2.79)          1;0  1.1048 (0.55)          5           3
test_plots-plots-diff[3.53.2]     814.1902 (1.64)     819.7470 (1.63)     817.5311 (1.64)     2.0761 (1.0)      817.8033 (1.65)     2.2966 (1.0)           2;0  1.2232 (0.61)          5           3
test_plots-plots-diff[main]       819.5989 (1.65)     826.7245 (1.64)     822.3123 (1.65)     3.0414 (1.46)     821.4905 (1.65)     4.9826 (2.17)          1;0  1.2161 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       513.8505 (1.0)        518.4863 (1.0)        516.2999 (1.0)      2.0245 (1.38)       515.6543 (1.0)      3.4791 (2.34)          2;0  1.9369 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,124.4101 (2.19)     1,139.3656 (2.20)     1,130.5472 (2.19)     5.5808 (3.79)     1,128.6151 (2.19)     6.1432 (4.12)          2;0  0.8845 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       893.8087 (1.74)       897.8969 (1.73)       895.7128 (1.73)     1.4723 (1.0)        895.4290 (1.74)     1.4898 (1.0)           2;0  1.1164 (0.58)          5           3
test_plots-plots-diff-json[main]         890.2633 (1.73)       898.9411 (1.73)       894.6920 (1.73)     3.2392 (2.20)       894.7795 (1.74)     4.3662 (2.93)          2;0  1.1177 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     411.0172 (1.0)      423.5973 (1.0)      417.9864 (1.0)       5.2169 (3.98)     420.3543 (1.0)      8.1978 (8.17)          2;0  2.3924 (1.0)           5           3
test_plots-plots-show[3.10.0]     729.6989 (1.78)     733.4070 (1.73)     731.5668 (1.75)      1.3116 (1.0)      731.5813 (1.74)     1.0030 (1.0)           2;0  1.3669 (0.57)          5           3
test_plots-plots-show[3.53.2]     699.0572 (1.70)     720.6393 (1.70)     704.3170 (1.69)      9.1546 (6.98)     700.6327 (1.67)     6.0235 (6.01)          1;1  1.4198 (0.59)          5           3
test_plots-plots-show[main]       705.3157 (1.72)     731.7177 (1.73)     714.6496 (1.71)     10.0899 (7.69)     711.4026 (1.69)     9.6321 (9.60)          1;0  1.3993 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     428.2421 (1.0)      435.6193 (1.0)      432.5774 (1.0)      2.6954 (1.62)     433.2713 (1.0)       2.4726 (1.0)           2;0  2.3117 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     861.0419 (2.01)     871.8003 (2.00)     865.8207 (2.00)     5.4511 (3.27)     863.6060 (1.99)     10.5446 (4.26)          2;0  1.1550 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     746.5643 (1.74)     750.6946 (1.72)     748.7337 (1.73)     1.6675 (1.0)      748.2910 (1.73)      2.5925 (1.05)          2;0  1.3356 (0.58)          5           3
test_plots-plots-show-json[main]       750.5894 (1.75)     757.7611 (1.74)     753.2675 (1.74)     3.0757 (1.84)     752.2599 (1.74)      4.9985 (2.02)          1;0  1.3275 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.8244 (2.27)     51.8244 (2.27)     51.8244 (2.27)     0.0000 (1.0)      51.8244 (2.27)     0.0000 (1.0)           0;0  0.0193 (0.44)          1           1
test_push-push[3.10.0]     46.2891 (2.03)     46.2891 (2.03)     46.2891 (2.03)     0.0000 (1.0)      46.2891 (2.03)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_push-push[3.53.2]     23.2931 (1.02)     23.2931 (1.02)     23.2931 (1.02)     0.0000 (1.0)      23.2931 (1.02)     0.0000 (1.0)           0;0  0.0429 (0.98)          1           1
test_push-push[main]       22.8209 (1.0)      22.8209 (1.0)      22.8209 (1.0)      0.0000 (1.0)      22.8209 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     67.2656 (2.83)     67.2656 (2.83)     67.2656 (2.83)     0.0000 (1.0)      67.2656 (2.83)     0.0000 (1.0)           0;0  0.0149 (0.35)          1           1
test_sharing-fetch[3.10.0]     72.3978 (3.04)     72.3978 (3.04)     72.3978 (3.04)     0.0000 (1.0)      72.3978 (3.04)     0.0000 (1.0)           0;0  0.0138 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.7506 (1.50)     35.7506 (1.50)     35.7506 (1.50)     0.0000 (1.0)      35.7506 (1.50)     0.0000 (1.0)           0;0  0.0280 (0.67)          1           1
test_sharing-fetch[main]       23.7808 (1.0)      23.7808 (1.0)      23.7808 (1.0)      0.0000 (1.0)      23.7808 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2537 (1.0)      1.2537 (1.0)      1.2537 (1.0)      0.0000 (1.0)      1.2537 (1.0)      0.0000 (1.0)           0;0  0.7977 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6522 (2.91)     3.6522 (2.91)     3.6522 (2.91)     0.0000 (1.0)      3.6522 (2.91)     0.0000 (1.0)           0;0  0.2738 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.8624 (4.68)     5.8624 (4.68)     5.8624 (4.68)     0.0000 (1.0)      5.8624 (4.68)     0.0000 (1.0)           0;0  0.1706 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9036 (4.71)     5.9036 (4.71)     5.9036 (4.71)     0.0000 (1.0)      5.9036 (4.71)     0.0000 (1.0)           0;0  0.1694 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.4839 (2.33)     52.4839 (2.33)     52.4839 (2.33)     0.0000 (1.0)      52.4839 (2.33)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_sharing-push[3.10.0]     47.5499 (2.11)     47.5499 (2.11)     47.5499 (2.11)     0.0000 (1.0)      47.5499 (2.11)     0.0000 (1.0)           0;0  0.0210 (0.47)          1           1
test_sharing-push[3.53.2]     23.6918 (1.05)     23.6918 (1.05)     23.6918 (1.05)     0.0000 (1.0)      23.6918 (1.05)     0.0000 (1.0)           0;0  0.0422 (0.95)          1           1
test_sharing-push[main]       22.5216 (1.0)      22.5216 (1.0)      22.5216 (1.0)      0.0000 (1.0)      22.5216 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1809 (1.01)     2.1809 (1.01)     2.1809 (1.01)     0.0000 (1.0)      2.1809 (1.01)     0.0000 (1.0)           0;0  0.4585 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.1531 (1.0)      2.1531 (1.0)      2.1531 (1.0)      0.0000 (1.0)      2.1531 (1.0)      0.0000 (1.0)           0;0  0.4644 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.1910 (2.88)     6.1910 (2.88)     6.1910 (2.88)     0.0000 (1.0)      6.1910 (2.88)     0.0000 (1.0)           0;0  0.1615 (0.35)          1           1
test_sharing-push-noop[main]       6.2505 (2.90)     6.2505 (2.90)     6.2505 (2.90)     0.0000 (1.0)      6.2505 (2.90)     0.0000 (1.0)           0;0  0.1600 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.6681 (3.97)     20.6681 (3.97)     20.6681 (3.97)     0.0000 (1.0)      20.6681 (3.97)     0.0000 (1.0)           0;0  0.0484 (0.25)          1           1
test_status-status[3.10.0]     20.9989 (4.04)     20.9989 (4.04)     20.9989 (4.04)     0.0000 (1.0)      20.9989 (4.04)     0.0000 (1.0)           0;0  0.0476 (0.25)          1           1
test_status-status[3.53.2]     19.2899 (3.71)     19.2899 (3.71)     19.2899 (3.71)     0.0000 (1.0)      19.2899 (3.71)     0.0000 (1.0)           0;0  0.0518 (0.27)          1           1
test_status-status[main]        5.2029 (1.0)       5.2029 (1.0)       5.2029 (1.0)      0.0000 (1.0)       5.2029 (1.0)      0.0000 (1.0)           0;0  0.1922 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6970 (1.78)     4.6970 (1.78)     4.6970 (1.78)     0.0000 (1.0)      4.6970 (1.78)     0.0000 (1.0)           0;0  0.2129 (0.56)          1           1
test_status-status-changed[3.10.0]     5.1267 (1.95)     5.1267 (1.95)     5.1267 (1.95)     0.0000 (1.0)      5.1267 (1.95)     0.0000 (1.0)           0;0  0.1951 (0.51)          1           1
test_status-status-changed[3.53.2]     4.8096 (1.83)     4.8096 (1.83)     4.8096 (1.83)     0.0000 (1.0)      4.8096 (1.83)     0.0000 (1.0)           0;0  0.2079 (0.55)          1           1
test_status-status-changed[main]       2.6346 (1.0)      2.6346 (1.0)      2.6346 (1.0)      0.0000 (1.0)      2.6346 (1.0)      0.0000 (1.0)           0;0  0.3796 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7293 (1.80)     4.7293 (1.80)     4.7293 (1.80)     0.0000 (1.0)      4.7293 (1.80)     0.0000 (1.0)           0;0  0.2114 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     5.0628 (1.93)     5.0628 (1.93)     5.0628 (1.93)     0.0000 (1.0)      5.0628 (1.93)     0.0000 (1.0)           0;0  0.1975 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.7928 (1.83)     4.7928 (1.83)     4.7928 (1.83)     0.0000 (1.0)      4.7928 (1.83)     0.0000 (1.0)           0;0  0.2086 (0.55)          1           1
test_status-status-changed-noop[main]       2.6244 (1.0)      2.6244 (1.0)      2.6244 (1.0)      0.0000 (1.0)      2.6244 (1.0)      0.0000 (1.0)           0;0  0.3810 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8446 (1.90)     4.8446 (1.90)     4.8446 (1.90)     0.0000 (1.0)      4.8446 (1.90)     0.0000 (1.0)           0;0  0.2064 (0.53)          1           1
test_status-status-noop[3.10.0]     4.9676 (1.95)     4.9676 (1.95)     4.9676 (1.95)     0.0000 (1.0)      4.9676 (1.95)     0.0000 (1.0)           0;0  0.2013 (0.51)          1           1
test_status-status-noop[3.53.2]     4.8354 (1.89)     4.8354 (1.89)     4.8354 (1.89)     0.0000 (1.0)      4.8354 (1.89)     0.0000 (1.0)           0;0  0.2068 (0.53)          1           1
test_status-status-noop[main]       2.5521 (1.0)      2.5521 (1.0)      2.5521 (1.0)      0.0000 (1.0)      2.5521 (1.0)      0.0000 (1.0)           0;0  0.3918 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     161.9668 (3.41)     161.9668 (3.41)     161.9668 (3.41)     0.0000 (1.0)      161.9668 (3.41)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.10.0]     165.5287 (3.49)     165.5287 (3.49)     165.5287 (3.49)     0.0000 (1.0)      165.5287 (3.49)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.53.2]     124.9146 (2.63)     124.9146 (2.63)     124.9146 (2.63)     0.0000 (1.0)      124.9146 (2.63)     0.0000 (1.0)           0;0  0.0080 (0.38)          1           1
test_update-import-url[main]        47.4360 (1.0)       47.4360 (1.0)       47.4360 (1.0)      0.0000 (1.0)       47.4360 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     141.8351 (3.94)     141.8351 (3.94)     141.8351 (3.94)     0.0000 (1.0)      141.8351 (3.94)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.10.0]     147.9239 (4.11)     147.9239 (4.11)     147.9239 (4.11)     0.0000 (1.0)      147.9239 (4.11)     0.0000 (1.0)           0;0  0.0068 (0.24)          1           1
test_update-update[3.53.2]     113.1367 (3.14)     113.1367 (3.14)     113.1367 (3.14)     0.0000 (1.0)      113.1367 (3.14)     0.0000 (1.0)           0;0  0.0088 (0.32)          1           1
test_update-update[main]        35.9760 (1.0)       35.9760 (1.0)       35.9760 (1.0)      0.0000 (1.0)       35.9760 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1686 (2.08)     16.1686 (2.08)     16.1686 (2.08)     0.0000 (1.0)      16.1686 (2.08)     0.0000 (1.0)           0;0  0.0618 (0.48)          1           1
test_update-update-noop[3.10.0]     16.6602 (2.14)     16.6602 (2.14)     16.6602 (2.14)     0.0000 (1.0)      16.6602 (2.14)     0.0000 (1.0)           0;0  0.0600 (0.47)          1           1
test_update-update-noop[3.53.2]     16.1762 (2.08)     16.1762 (2.08)     16.1762 (2.08)     0.0000 (1.0)      16.1762 (2.08)     0.0000 (1.0)           0;0  0.0618 (0.48)          1           1
test_update-update-noop[main]        7.7789 (1.0)       7.7789 (1.0)       7.7789 (1.0)      0.0000 (1.0)       7.7789 (1.0)      0.0000 (1.0)           0;0  0.1286 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean