Tue Mar 10 01:24:32 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.3934 (3.60)     84.3934 (3.60)     84.3934 (3.60)     0.0000 (1.0)      84.3934 (3.60)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_add_copy-add[3.10.0]     84.7751 (3.61)     84.7751 (3.61)     84.7751 (3.61)     0.0000 (1.0)      84.7751 (3.61)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_add_copy-add[3.53.2]     77.0774 (3.29)     77.0774 (3.29)     77.0774 (3.29)     0.0000 (1.0)      77.0774 (3.29)     0.0000 (1.0)           0;0  0.0130 (0.30)          1           1
test_add_copy-add[3.60.1]     23.4557 (1.0)      23.4557 (1.0)      23.4557 (1.0)      0.0000 (1.0)      23.4557 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
test_add_copy-add[main]       24.5705 (1.05)     24.5705 (1.05)     24.5705 (1.05)     0.0000 (1.0)      24.5705 (1.05)     0.0000 (1.0)           0;0  0.0407 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.4401 (6.30)     27.4401 (6.30)     27.4401 (6.30)     0.0000 (1.0)      27.4401 (6.30)     0.0000 (1.0)           0;0  0.0364 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     28.3564 (6.51)     28.3564 (6.51)     28.3564 (6.51)     0.0000 (1.0)      28.3564 (6.51)     0.0000 (1.0)           0;0  0.0353 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.5811 (6.10)     26.5811 (6.10)     26.5811 (6.10)     0.0000 (1.0)      26.5811 (6.10)     0.0000 (1.0)           0;0  0.0376 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.3961 (1.01)      4.3961 (1.01)      4.3961 (1.01)     0.0000 (1.0)       4.3961 (1.01)     0.0000 (1.0)           0;0  0.2275 (0.99)          1           1
test_add_copy-add-noop[main]        4.3544 (1.0)       4.3544 (1.0)       4.3544 (1.0)      0.0000 (1.0)       4.3544 (1.0)      0.0000 (1.0)           0;0  0.2297 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     59.2872 (3.83)     59.2872 (3.83)     59.2872 (3.83)     0.0000 (1.0)      59.2872 (3.83)     0.0000 (1.0)           0;0  0.0169 (0.26)          1           1
test_add_hardlink-add[3.10.0]     60.2258 (3.89)     60.2258 (3.89)     60.2258 (3.89)     0.0000 (1.0)      60.2258 (3.89)     0.0000 (1.0)           0;0  0.0166 (0.26)          1           1
test_add_hardlink-add[3.53.2]     54.6131 (3.53)     54.6131 (3.53)     54.6131 (3.53)     0.0000 (1.0)      54.6131 (3.53)     0.0000 (1.0)           0;0  0.0183 (0.28)          1           1
test_add_hardlink-add[3.60.1]     15.4852 (1.0)      15.4852 (1.0)      15.4852 (1.0)      0.0000 (1.0)      15.4852 (1.0)      0.0000 (1.0)           0;0  0.0646 (1.0)           1           1
test_add_hardlink-add[main]       16.9047 (1.09)     16.9047 (1.09)     16.9047 (1.09)     0.0000 (1.0)      16.9047 (1.09)     0.0000 (1.0)           0;0  0.0592 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     29.3892 (6.83)     29.3892 (6.83)     29.3892 (6.83)     0.0000 (1.0)      29.3892 (6.83)     0.0000 (1.0)           0;0  0.0340 (0.15)          1           1
test_add_hardlink-add-noop[3.10.0]     29.6225 (6.88)     29.6225 (6.88)     29.6225 (6.88)     0.0000 (1.0)      29.6225 (6.88)     0.0000 (1.0)           0;0  0.0338 (0.15)          1           1
test_add_hardlink-add-noop[3.53.2]     27.2812 (6.34)     27.2812 (6.34)     27.2812 (6.34)     0.0000 (1.0)      27.2812 (6.34)     0.0000 (1.0)           0;0  0.0367 (0.16)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3031 (1.0)       4.3031 (1.0)       4.3031 (1.0)      0.0000 (1.0)       4.3031 (1.0)      0.0000 (1.0)           0;0  0.2324 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.5327 (1.05)      4.5327 (1.05)      4.5327 (1.05)     0.0000 (1.0)       4.5327 (1.05)     0.0000 (1.0)           0;0  0.2206 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.0633 (1.91)     69.0633 (1.91)     69.0633 (1.91)     0.0000 (1.0)      69.0633 (1.91)     0.0000 (1.0)           0;0  0.0145 (0.52)          1           1
test_add_symlink-add[3.10.0]     69.6050 (1.92)     69.6050 (1.92)     69.6050 (1.92)     0.0000 (1.0)      69.6050 (1.92)     0.0000 (1.0)           0;0  0.0144 (0.52)          1           1
test_add_symlink-add[3.53.2]     63.7645 (1.76)     63.7645 (1.76)     63.7645 (1.76)     0.0000 (1.0)      63.7645 (1.76)     0.0000 (1.0)           0;0  0.0157 (0.57)          1           1
test_add_symlink-add[3.60.1]     36.2322 (1.0)      36.2322 (1.0)      36.2322 (1.0)      0.0000 (1.0)      36.2322 (1.0)      0.0000 (1.0)           0;0  0.0276 (1.0)           1           1
test_add_symlink-add[main]       38.3856 (1.06)     38.3856 (1.06)     38.3856 (1.06)     0.0000 (1.0)      38.3856 (1.06)     0.0000 (1.0)           0;0  0.0261 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     44.3946 (8.43)     44.3946 (8.43)     44.3946 (8.43)     0.0000 (1.0)      44.3946 (8.43)     0.0000 (1.0)           0;0  0.0225 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.2912 (8.60)     45.2912 (8.60)     45.2912 (8.60)     0.0000 (1.0)      45.2912 (8.60)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.7973 (8.51)     44.7973 (8.51)     44.7973 (8.51)     0.0000 (1.0)      44.7973 (8.51)     0.0000 (1.0)           0;0  0.0223 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.2646 (1.0)       5.2646 (1.0)       5.2646 (1.0)      0.0000 (1.0)       5.2646 (1.0)      0.0000 (1.0)           0;0  0.1899 (1.0)           1           1
test_add_symlink-add-noop[main]        5.4197 (1.03)      5.4197 (1.03)      5.4197 (1.03)     0.0000 (1.0)       5.4197 (1.03)     0.0000 (1.0)           0;0  0.1845 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     27.4664 (2.12)     27.4664 (2.12)     27.4664 (2.12)     0.0000 (1.0)      27.4664 (2.12)     0.0000 (1.0)           0;0  0.0364 (0.47)          1           1
test_checkout_copy-checkout[3.10.0]     91.8549 (7.07)     91.8549 (7.07)     91.8549 (7.07)     0.0000 (1.0)      91.8549 (7.07)     0.0000 (1.0)           0;0  0.0109 (0.14)          1           1
test_checkout_copy-checkout[3.53.2]     17.4785 (1.35)     17.4785 (1.35)     17.4785 (1.35)     0.0000 (1.0)      17.4785 (1.35)     0.0000 (1.0)           0;0  0.0572 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     12.9835 (1.0)      12.9835 (1.0)      12.9835 (1.0)      0.0000 (1.0)      12.9835 (1.0)      0.0000 (1.0)           0;0  0.0770 (1.0)           1           1
test_checkout_copy-checkout[main]       13.6924 (1.05)     13.6924 (1.05)     13.6924 (1.05)     0.0000 (1.0)      13.6924 (1.05)     0.0000 (1.0)           0;0  0.0730 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     4.4043 (1.39)     4.4043 (1.39)     4.4043 (1.39)     0.0000 (1.0)      4.4043 (1.39)     0.0000 (1.0)           0;0  0.2271 (0.72)          1           1
test_checkout_copy-checkout-noop[3.10.0]     4.4491 (1.41)     4.4491 (1.41)     4.4491 (1.41)     0.0000 (1.0)      4.4491 (1.41)     0.0000 (1.0)           0;0  0.2248 (0.71)          1           1
test_checkout_copy-checkout-noop[3.53.2]     4.3230 (1.37)     4.3230 (1.37)     4.3230 (1.37)     0.0000 (1.0)      4.3230 (1.37)     0.0000 (1.0)           0;0  0.2313 (0.73)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.1613 (1.0)      3.1613 (1.0)      3.1613 (1.0)      0.0000 (1.0)      3.1613 (1.0)      0.0000 (1.0)           0;0  0.3163 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.2507 (1.03)     3.2507 (1.03)     3.2507 (1.03)     0.0000 (1.0)      3.2507 (1.03)     0.0000 (1.0)           0;0  0.3076 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     6.1333 (1.62)     6.1333 (1.62)     6.1333 (1.62)     0.0000 (1.0)      6.1333 (1.62)     0.0000 (1.0)           0;0  0.1630 (0.62)          1           1
test_checkout_copy-checkout-update[3.10.0]     5.0515 (1.34)     5.0515 (1.34)     5.0515 (1.34)     0.0000 (1.0)      5.0515 (1.34)     0.0000 (1.0)           0;0  0.1980 (0.75)          1           1
test_checkout_copy-checkout-update[3.53.2]     5.0408 (1.33)     5.0408 (1.33)     5.0408 (1.33)     0.0000 (1.0)      5.0408 (1.33)     0.0000 (1.0)           0;0  0.1984 (0.75)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.7819 (1.0)      3.7819 (1.0)      3.7819 (1.0)      0.0000 (1.0)      3.7819 (1.0)      0.0000 (1.0)           0;0  0.2644 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.0221 (1.06)     4.0221 (1.06)     4.0221 (1.06)     0.0000 (1.0)      4.0221 (1.06)     0.0000 (1.0)           0;0  0.2486 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.0454 (2.85)     21.0454 (2.85)     21.0454 (2.85)     0.0000 (1.0)      21.0454 (2.85)     0.0000 (1.0)           0;0  0.0475 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.5364 (2.24)     16.5364 (2.24)     16.5364 (2.24)     0.0000 (1.0)      16.5364 (2.24)     0.0000 (1.0)           0;0  0.0605 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.5734 (1.97)     14.5734 (1.97)     14.5734 (1.97)     0.0000 (1.0)      14.5734 (1.97)     0.0000 (1.0)           0;0  0.0686 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3943 (1.0)       7.3943 (1.0)       7.3943 (1.0)      0.0000 (1.0)       7.3943 (1.0)      0.0000 (1.0)           0;0  0.1352 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2138 (1.11)      8.2138 (1.11)      8.2138 (1.11)     0.0000 (1.0)       8.2138 (1.11)     0.0000 (1.0)           0;0  0.1217 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5417 (1.73)     5.5417 (1.73)     5.5417 (1.73)     0.0000 (1.0)      5.5417 (1.73)     0.0000 (1.0)           0;0  0.1804 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7316 (1.79)     5.7316 (1.79)     5.7316 (1.79)     0.0000 (1.0)      5.7316 (1.79)     0.0000 (1.0)           0;0  0.1745 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5561 (1.73)     5.5561 (1.73)     5.5561 (1.73)     0.0000 (1.0)      5.5561 (1.73)     0.0000 (1.0)           0;0  0.1800 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2065 (1.0)      3.2065 (1.0)      3.2065 (1.0)      0.0000 (1.0)      3.2065 (1.0)      0.0000 (1.0)           0;0  0.3119 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3996 (1.06)     3.3996 (1.06)     3.3996 (1.06)     0.0000 (1.0)      3.3996 (1.06)     0.0000 (1.0)           0;0  0.2942 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.0204 (2.09)     8.0204 (2.09)     8.0204 (2.09)     0.0000 (1.0)      8.0204 (2.09)     0.0000 (1.0)           0;0  0.1247 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5111 (1.70)     6.5111 (1.70)     6.5111 (1.70)     0.0000 (1.0)      6.5111 (1.70)     0.0000 (1.0)           0;0  0.1536 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4561 (1.68)     6.4561 (1.68)     6.4561 (1.68)     0.0000 (1.0)      6.4561 (1.68)     0.0000 (1.0)           0;0  0.1549 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8402 (1.0)      3.8402 (1.0)      3.8402 (1.0)      0.0000 (1.0)      3.8402 (1.0)      0.0000 (1.0)           0;0  0.2604 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3184 (1.12)     4.3184 (1.12)     4.3184 (1.12)     0.0000 (1.0)      4.3184 (1.12)     0.0000 (1.0)           0;0  0.2316 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.1723 (2.22)     24.1723 (2.22)     24.1723 (2.22)     0.0000 (1.0)      24.1723 (2.22)     0.0000 (1.0)           0;0  0.0414 (0.45)          1           1
test_checkout_symlink-checkout[3.10.0]     19.6753 (1.81)     19.6753 (1.81)     19.6753 (1.81)     0.0000 (1.0)      19.6753 (1.81)     0.0000 (1.0)           0;0  0.0508 (0.55)          1           1
test_checkout_symlink-checkout[3.53.2]     17.8643 (1.64)     17.8643 (1.64)     17.8643 (1.64)     0.0000 (1.0)      17.8643 (1.64)     0.0000 (1.0)           0;0  0.0560 (0.61)          1           1
test_checkout_symlink-checkout[3.60.1]     10.8793 (1.0)      10.8793 (1.0)      10.8793 (1.0)      0.0000 (1.0)      10.8793 (1.0)      0.0000 (1.0)           0;0  0.0919 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.9376 (1.10)     11.9376 (1.10)     11.9376 (1.10)     0.0000 (1.0)      11.9376 (1.10)     0.0000 (1.0)           0;0  0.0838 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8966 (1.62)     6.8966 (1.62)     6.8966 (1.62)     0.0000 (1.0)      6.8966 (1.62)     0.0000 (1.0)           0;0  0.1450 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.0816 (1.67)     7.0816 (1.67)     7.0816 (1.67)     0.0000 (1.0)      7.0816 (1.67)     0.0000 (1.0)           0;0  0.1412 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7093 (1.58)     6.7093 (1.58)     6.7093 (1.58)     0.0000 (1.0)      6.7093 (1.58)     0.0000 (1.0)           0;0  0.1490 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2532 (1.0)      4.2532 (1.0)      4.2532 (1.0)      0.0000 (1.0)      4.2532 (1.0)      0.0000 (1.0)           0;0  0.2351 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4822 (1.05)     4.4822 (1.05)     4.4822 (1.05)     0.0000 (1.0)      4.4822 (1.05)     0.0000 (1.0)           0;0  0.2231 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.7663 (1.69)     9.7663 (1.69)     9.7663 (1.69)     0.0000 (1.0)      9.7663 (1.69)     0.0000 (1.0)           0;0  0.1024 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.6665 (1.50)     8.6665 (1.50)     8.6665 (1.50)     0.0000 (1.0)      8.6665 (1.50)     0.0000 (1.0)           0;0  0.1154 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.6909 (1.51)     8.6909 (1.51)     8.6909 (1.51)     0.0000 (1.0)      8.6909 (1.51)     0.0000 (1.0)           0;0  0.1151 (0.66)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.7621 (1.0)      5.7621 (1.0)      5.7621 (1.0)      0.0000 (1.0)      5.7621 (1.0)      0.0000 (1.0)           0;0  0.1735 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.1142 (1.06)     6.1142 (1.06)     6.1142 (1.06)     0.0000 (1.0)      6.1142 (1.06)     0.0000 (1.0)           0;0  0.1636 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.3129 (1.85)     4.3129 (1.85)     4.3129 (1.85)     0.0000 (1.0)      4.3129 (1.85)     0.0000 (1.0)           0;0  0.2319 (0.54)          1           1
test_data_status-data-changed[3.10.0]     5.1064 (2.20)     5.1064 (2.20)     5.1064 (2.20)     0.0000 (1.0)      5.1064 (2.20)     0.0000 (1.0)           0;0  0.1958 (0.46)          1           1
test_data_status-data-changed[3.53.2]     4.8454 (2.08)     4.8454 (2.08)     4.8454 (2.08)     0.0000 (1.0)      4.8454 (2.08)     0.0000 (1.0)           0;0  0.2064 (0.48)          1           1
test_data_status-data-changed[3.60.1]     2.3256 (1.0)      2.3256 (1.0)      2.3256 (1.0)      0.0000 (1.0)      2.3256 (1.0)      0.0000 (1.0)           0;0  0.4300 (1.0)           1           1
test_data_status-data-changed[main]       2.5944 (1.12)     2.5944 (1.12)     2.5944 (1.12)     0.0000 (1.0)      2.5944 (1.12)     0.0000 (1.0)           0;0  0.3855 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.3002 (1.85)     4.3002 (1.85)     4.3002 (1.85)     0.0000 (1.0)      4.3002 (1.85)     0.0000 (1.0)           0;0  0.2325 (0.54)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0008 (2.15)     5.0008 (2.15)     5.0008 (2.15)     0.0000 (1.0)      5.0008 (2.15)     0.0000 (1.0)           0;0  0.2000 (0.46)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8872 (2.10)     4.8872 (2.10)     4.8872 (2.10)     0.0000 (1.0)      4.8872 (2.10)     0.0000 (1.0)           0;0  0.2046 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3232 (1.0)      2.3232 (1.0)      2.3232 (1.0)      0.0000 (1.0)      2.3232 (1.0)      0.0000 (1.0)           0;0  0.4304 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5689 (1.11)     2.5689 (1.11)     2.5689 (1.11)     0.0000 (1.0)      2.5689 (1.11)     0.0000 (1.0)           0;0  0.3893 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.4768 (3.93)     19.4768 (3.93)     19.4768 (3.93)     0.0000 (1.0)      19.4768 (3.93)     0.0000 (1.0)           0;0  0.0513 (0.25)          1           1
test_data_status-data-new[3.10.0]     20.5323 (4.14)     20.5323 (4.14)     20.5323 (4.14)     0.0000 (1.0)      20.5323 (4.14)     0.0000 (1.0)           0;0  0.0487 (0.24)          1           1
test_data_status-data-new[3.53.2]     20.0050 (4.04)     20.0050 (4.04)     20.0050 (4.04)     0.0000 (1.0)      20.0050 (4.04)     0.0000 (1.0)           0;0  0.0500 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.9543 (1.0)       4.9543 (1.0)       4.9543 (1.0)      0.0000 (1.0)       4.9543 (1.0)      0.0000 (1.0)           0;0  0.2018 (1.0)           1           1
test_data_status-data-new[main]        5.4056 (1.09)      5.4056 (1.09)      5.4056 (1.09)     0.0000 (1.0)       5.4056 (1.09)     0.0000 (1.0)           0;0  0.1850 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2423 (1.83)     4.2423 (1.83)     4.2423 (1.83)     0.0000 (1.0)      4.2423 (1.83)     0.0000 (1.0)           0;0  0.2357 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.9757 (2.14)     4.9757 (2.14)     4.9757 (2.14)     0.0000 (1.0)      4.9757 (2.14)     0.0000 (1.0)           0;0  0.2010 (0.47)          1           1
test_data_status-data-noop[3.53.2]     4.8347 (2.08)     4.8347 (2.08)     4.8347 (2.08)     0.0000 (1.0)      4.8347 (2.08)     0.0000 (1.0)           0;0  0.2068 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3214 (1.0)      2.3214 (1.0)      2.3214 (1.0)      0.0000 (1.0)      2.3214 (1.0)      0.0000 (1.0)           0;0  0.4308 (1.0)           1           1
test_data_status-data-noop[main]       2.8800 (1.24)     2.8800 (1.24)     2.8800 (1.24)     0.0000 (1.0)      2.8800 (1.24)     0.0000 (1.0)           0;0  0.3472 (0.81)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.4655 (1.18)     6.4655 (1.18)     6.4655 (1.18)     0.0000 (1.0)      6.4655 (1.18)     0.0000 (1.0)           0;0  0.1547 (0.85)          1           1
test_data_status_all_flags-data-changed[3.10.0]     6.6709 (1.22)     6.6709 (1.22)     6.6709 (1.22)     0.0000 (1.0)      6.6709 (1.22)     0.0000 (1.0)           0;0  0.1499 (0.82)          1           1
test_data_status_all_flags-data-changed[3.53.2]     6.6328 (1.21)     6.6328 (1.21)     6.6328 (1.21)     0.0000 (1.0)      6.6328 (1.21)     0.0000 (1.0)           0;0  0.1508 (0.83)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4804 (1.0)      5.4804 (1.0)      5.4804 (1.0)      0.0000 (1.0)      5.4804 (1.0)      0.0000 (1.0)           0;0  0.1825 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.8651 (1.07)     5.8651 (1.07)     5.8651 (1.07)     0.0000 (1.0)      5.8651 (1.07)     0.0000 (1.0)           0;0  0.1705 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.3374 (1.13)     6.3374 (1.13)     6.3374 (1.13)     0.0000 (1.0)      6.3374 (1.13)     0.0000 (1.0)           0;0  0.1578 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     6.6427 (1.19)     6.6427 (1.19)     6.6427 (1.19)     0.0000 (1.0)      6.6427 (1.19)     0.0000 (1.0)           0;0  0.1505 (0.84)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     6.7157 (1.20)     6.7157 (1.20)     6.7157 (1.20)     0.0000 (1.0)      6.7157 (1.20)     0.0000 (1.0)           0;0  0.1489 (0.83)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5862 (1.0)      5.5862 (1.0)      5.5862 (1.0)      0.0000 (1.0)      5.5862 (1.0)      0.0000 (1.0)           0;0  0.1790 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.9158 (1.06)     5.9158 (1.06)     5.9158 (1.06)     0.0000 (1.0)      5.9158 (1.06)     0.0000 (1.0)           0;0  0.1690 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.2298 (2.59)     20.2298 (2.59)     20.2298 (2.59)     0.0000 (1.0)      20.2298 (2.59)     0.0000 (1.0)           0;0  0.0494 (0.39)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.7754 (2.78)     21.7754 (2.78)     21.7754 (2.78)     0.0000 (1.0)      21.7754 (2.78)     0.0000 (1.0)           0;0  0.0459 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     20.9513 (2.68)     20.9513 (2.68)     20.9513 (2.68)     0.0000 (1.0)      20.9513 (2.68)     0.0000 (1.0)           0;0  0.0477 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.8249 (1.0)       7.8249 (1.0)       7.8249 (1.0)      0.0000 (1.0)       7.8249 (1.0)      0.0000 (1.0)           0;0  0.1278 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1416 (1.04)      8.1416 (1.04)      8.1416 (1.04)     0.0000 (1.0)       8.1416 (1.04)     0.0000 (1.0)           0;0  0.1228 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     5.8290 (1.21)     5.8290 (1.21)     5.8290 (1.21)     0.0000 (1.0)      5.8290 (1.21)     0.0000 (1.0)           0;0  0.1716 (0.82)          1           1
test_data_status_all_flags-data-noop[3.10.0]     6.2455 (1.30)     6.2455 (1.30)     6.2455 (1.30)     0.0000 (1.0)      6.2455 (1.30)     0.0000 (1.0)           0;0  0.1601 (0.77)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.0786 (1.27)     6.0786 (1.27)     6.0786 (1.27)     0.0000 (1.0)      6.0786 (1.27)     0.0000 (1.0)           0;0  0.1645 (0.79)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7980 (1.0)      4.7980 (1.0)      4.7980 (1.0)      0.0000 (1.0)      4.7980 (1.0)      0.0000 (1.0)           0;0  0.2084 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2666 (1.10)     5.2666 (1.10)     5.2666 (1.10)     0.0000 (1.0)      5.2666 (1.10)     0.0000 (1.0)           0;0  0.1899 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.5639 (2.72)     18.5639 (2.72)     18.5639 (2.72)     0.0000 (1.0)      18.5639 (2.72)     0.0000 (1.0)           0;0  0.0539 (0.37)          1           1
test_diff-diff[3.10.0]     20.7085 (3.04)     20.7085 (3.04)     20.7085 (3.04)     0.0000 (1.0)      20.7085 (3.04)     0.0000 (1.0)           0;0  0.0483 (0.33)          1           1
test_diff-diff[3.53.2]     19.7747 (2.90)     19.7747 (2.90)     19.7747 (2.90)     0.0000 (1.0)      19.7747 (2.90)     0.0000 (1.0)           0;0  0.0506 (0.34)          1           1
test_diff-diff[3.60.1]      6.8215 (1.0)       6.8215 (1.0)       6.8215 (1.0)      0.0000 (1.0)       6.8215 (1.0)      0.0000 (1.0)           0;0  0.1466 (1.0)           1           1
test_diff-diff[main]        8.4553 (1.24)      8.4553 (1.24)      8.4553 (1.24)     0.0000 (1.0)       8.4553 (1.24)     0.0000 (1.0)           0;0  0.1183 (0.81)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9676 (1.80)     5.9676 (1.80)     5.9676 (1.80)     0.0000 (1.0)      5.9676 (1.80)     0.0000 (1.0)           0;0  0.1676 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.8176 (2.06)     6.8176 (2.06)     6.8176 (2.06)     0.0000 (1.0)      6.8176 (2.06)     0.0000 (1.0)           0;0  0.1467 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.7958 (1.75)     5.7958 (1.75)     5.7958 (1.75)     0.0000 (1.0)      5.7958 (1.75)     0.0000 (1.0)           0;0  0.1725 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.3154 (1.0)      3.3154 (1.0)      3.3154 (1.0)      0.0000 (1.0)      3.3154 (1.0)      0.0000 (1.0)           0;0  0.3016 (1.0)           1           1
test_diff-diff-changed[main]       4.0403 (1.22)     4.0403 (1.22)     4.0403 (1.22)     0.0000 (1.0)      4.0403 (1.22)     0.0000 (1.0)           0;0  0.2475 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3971 (1.63)     5.3971 (1.63)     5.3971 (1.63)     0.0000 (1.0)      5.3971 (1.63)     0.0000 (1.0)           0;0  0.1853 (0.61)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8079 (1.75)     5.8079 (1.75)     5.8079 (1.75)     0.0000 (1.0)      5.8079 (1.75)     0.0000 (1.0)           0;0  0.1722 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4790 (1.65)     5.4790 (1.65)     5.4790 (1.65)     0.0000 (1.0)      5.4790 (1.65)     0.0000 (1.0)           0;0  0.1825 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3122 (1.0)      3.3122 (1.0)      3.3122 (1.0)      0.0000 (1.0)      3.3122 (1.0)      0.0000 (1.0)           0;0  0.3019 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0495 (1.22)     4.0495 (1.22)     4.0495 (1.22)     0.0000 (1.0)      4.0495 (1.22)     0.0000 (1.0)           0;0  0.2469 (0.82)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1544 (1.25)     4.1544 (1.25)     4.1544 (1.25)     0.0000 (1.0)      4.1544 (1.25)     0.0000 (1.0)           0;0  0.2407 (0.80)          1           1
test_diff-diff-noop[3.10.0]     5.2650 (1.58)     5.2650 (1.58)     5.2650 (1.58)     0.0000 (1.0)      5.2650 (1.58)     0.0000 (1.0)           0;0  0.1899 (0.63)          1           1
test_diff-diff-noop[3.53.2]     5.7569 (1.73)     5.7569 (1.73)     5.7569 (1.73)     0.0000 (1.0)      5.7569 (1.73)     0.0000 (1.0)           0;0  0.1737 (0.58)          1           1
test_diff-diff-noop[3.60.1]     3.3339 (1.0)      3.3339 (1.0)      3.3339 (1.0)      0.0000 (1.0)      3.3339 (1.0)      0.0000 (1.0)           0;0  0.2999 (1.0)           1           1
test_diff-diff-noop[main]       4.0880 (1.23)     4.0880 (1.23)     4.0880 (1.23)     0.0000 (1.0)      4.0880 (1.23)     0.0000 (1.0)           0;0  0.2446 (0.82)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2058 (1.0)       1.2058 (1.0)       1.2058 (1.0)      0.0000 (1.0)       1.2058 (1.0)      0.0000 (1.0)           0;0  0.8293 (1.0)           1           1
test_exp_show-exp[3.10.0]     13.2731 (11.01)    13.2731 (11.01)    13.2731 (11.01)    0.0000 (1.0)      13.2731 (11.01)    0.0000 (1.0)           0;0  0.0753 (0.09)          1           1
test_exp_show-exp[3.53.2]      8.2191 (6.82)      8.2191 (6.82)      8.2191 (6.82)     0.0000 (1.0)       8.2191 (6.82)     0.0000 (1.0)           0;0  0.1217 (0.15)          1           1
test_exp_show-exp[3.60.1]      8.5945 (7.13)      8.5945 (7.13)      8.5945 (7.13)     0.0000 (1.0)       8.5945 (7.13)     0.0000 (1.0)           0;0  0.1164 (0.14)          1           1
test_exp_show-exp[main]       12.1808 (10.10)    12.1808 (10.10)    12.1808 (10.10)    0.0000 (1.0)      12.1808 (10.10)    0.0000 (1.0)           0;0  0.0821 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     114.7572 (4.78)     114.7572 (4.78)     114.7572 (4.78)     0.0000 (1.0)      114.7572 (4.78)     0.0000 (1.0)           0;0  0.0087 (0.21)          1           1
test_fetch-fetch[3.10.0]     121.0324 (5.04)     121.0324 (5.04)     121.0324 (5.04)     0.0000 (1.0)      121.0324 (5.04)     0.0000 (1.0)           0;0  0.0083 (0.20)          1           1
test_fetch-fetch[3.53.2]      34.8391 (1.45)      34.8391 (1.45)      34.8391 (1.45)     0.0000 (1.0)       34.8391 (1.45)     0.0000 (1.0)           0;0  0.0287 (0.69)          1           1
test_fetch-fetch[3.60.1]      24.0260 (1.0)       24.0260 (1.0)       24.0260 (1.0)      0.0000 (1.0)       24.0260 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
test_fetch-fetch[main]        24.1953 (1.01)      24.1953 (1.01)      24.1953 (1.01)     0.0000 (1.0)       24.1953 (1.01)     0.0000 (1.0)           0;0  0.0413 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8480 (1.0)      2.8480 (1.0)      2.8480 (1.0)      0.0000 (1.0)      2.8480 (1.0)      0.0000 (1.0)           0;0  0.3511 (1.0)           1           1
test_gc-gc[3.10.0]     3.1041 (1.09)     3.1041 (1.09)     3.1041 (1.09)     0.0000 (1.0)      3.1041 (1.09)     0.0000 (1.0)           0;0  0.3222 (0.92)          1           1
test_gc-gc[3.53.2]     2.8677 (1.01)     2.8677 (1.01)     2.8677 (1.01)     0.0000 (1.0)      2.8677 (1.01)     0.0000 (1.0)           0;0  0.3487 (0.99)          1           1
test_gc-gc[3.60.1]     2.8859 (1.01)     2.8859 (1.01)     2.8859 (1.01)     0.0000 (1.0)      2.8859 (1.01)     0.0000 (1.0)           0;0  0.3465 (0.99)          1           1
test_gc-gc[main]       3.1438 (1.10)     3.1438 (1.10)     3.1438 (1.10)     0.0000 (1.0)      3.1438 (1.10)     0.0000 (1.0)           0;0  0.3181 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     186.3047 (3.28)     186.3047 (3.28)     186.3047 (3.28)     0.0000 (1.0)      186.3047 (3.28)     0.0000 (1.0)           0;0  0.0054 (0.30)          1           1
test_get-get[3.10.0]     229.9877 (4.05)     229.9877 (4.05)     229.9877 (4.05)     0.0000 (1.0)      229.9877 (4.05)     0.0000 (1.0)           0;0  0.0043 (0.25)          1           1
test_get-get[3.53.2]     182.8523 (3.22)     182.8523 (3.22)     182.8523 (3.22)     0.0000 (1.0)      182.8523 (3.22)     0.0000 (1.0)           0;0  0.0055 (0.31)          1           1
test_get-get[3.60.1]      57.5006 (1.01)      57.5006 (1.01)      57.5006 (1.01)     0.0000 (1.0)       57.5006 (1.01)     0.0000 (1.0)           0;0  0.0174 (0.99)          1           1
test_get-get[main]        56.7968 (1.0)       56.7968 (1.0)       56.7968 (1.0)      0.0000 (1.0)       56.7968 (1.0)      0.0000 (1.0)           0;0  0.0176 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     77.3005 (8.66)     77.3005 (8.66)     77.3005 (8.66)     0.0000 (1.0)      77.3005 (8.66)     0.0000 (1.0)           0;0  0.0129 (0.12)          1           1
test_get_url-get-url[3.10.0]     80.0312 (8.96)     80.0312 (8.96)     80.0312 (8.96)     0.0000 (1.0)      80.0312 (8.96)     0.0000 (1.0)           0;0  0.0125 (0.11)          1           1
test_get_url-get-url[3.53.2]      9.3187 (1.04)      9.3187 (1.04)      9.3187 (1.04)     0.0000 (1.0)       9.3187 (1.04)     0.0000 (1.0)           0;0  0.1073 (0.96)          1           1
test_get_url-get-url[3.60.1]      8.9303 (1.0)       8.9303 (1.0)       8.9303 (1.0)      0.0000 (1.0)       8.9303 (1.0)      0.0000 (1.0)           0;0  0.1120 (1.0)           1           1
test_get_url-get-url[main]        9.6041 (1.08)      9.6041 (1.08)      9.6041 (1.08)     0.0000 (1.0)       9.6041 (1.08)     0.0000 (1.0)           0;0  0.1041 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     152.6594 (1.05)     161.8009 (1.0)      156.2339 (1.04)     2.0461 (1.0)      156.1353 (1.04)     2.9419 (1.03)         34;0  6.4007 (0.97)        100           1
test_help---help[3.10.0]     151.8449 (1.05)     167.3897 (1.03)     157.1438 (1.04)     3.2640 (1.60)     156.8153 (1.04)     3.9518 (1.38)         32;2  6.3636 (0.96)        100           1
test_help---help[3.53.2]     154.2303 (1.06)     169.4957 (1.05)     160.5673 (1.06)     2.4221 (1.18)     160.3444 (1.07)     2.8557 (1.0)          28;4  6.2279 (0.94)        100           1
test_help---help[3.60.1]     153.8637 (1.06)     177.8754 (1.10)     159.3521 (1.06)     3.8680 (1.89)     158.2490 (1.05)     4.2973 (1.50)         22;3  6.2754 (0.95)        100           1
test_help---help[main]       145.1493 (1.0)      182.4517 (1.13)     150.8580 (1.0)      4.5758 (2.24)     150.1731 (1.0)      3.7036 (1.30)          7;3  6.6288 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     269.6984 (3.40)     269.6984 (3.40)     269.6984 (3.40)     0.0000 (1.0)      269.6984 (3.40)     0.0000 (1.0)           0;0  0.0037 (0.29)          1           1
test_import-import[3.10.0]     307.8925 (3.88)     307.8925 (3.88)     307.8925 (3.88)     0.0000 (1.0)      307.8925 (3.88)     0.0000 (1.0)           0;0  0.0032 (0.26)          1           1
test_import-import[3.60.1]      79.2719 (1.0)       79.2719 (1.0)       79.2719 (1.0)      0.0000 (1.0)       79.2719 (1.0)      0.0000 (1.0)           0;0  0.0126 (1.0)           1           1
test_import-import[main]        80.0729 (1.01)      80.0729 (1.01)      80.0729 (1.01)     0.0000 (1.0)       80.0729 (1.01)     0.0000 (1.0)           0;0  0.0125 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     203.0237 (4.31)     203.0237 (4.31)     203.0237 (4.31)     0.0000 (1.0)      203.0237 (4.31)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.10.0]     205.6763 (4.37)     205.6763 (4.37)     205.6763 (4.37)     0.0000 (1.0)      205.6763 (4.37)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.53.2]     114.9002 (2.44)     114.9002 (2.44)     114.9002 (2.44)     0.0000 (1.0)      114.9002 (2.44)     0.0000 (1.0)           0;0  0.0087 (0.41)          1           1
test_import_url-import-url[3.60.1]      47.0625 (1.0)       47.0625 (1.0)       47.0625 (1.0)      0.0000 (1.0)       47.0625 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
test_import_url-import-url[main]        49.1778 (1.04)      49.1778 (1.04)      49.1778 (1.04)     0.0000 (1.0)       49.1778 (1.04)     0.0000 (1.0)           0;0  0.0203 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     416.0361 (1.02)     442.8833 (1.01)     425.6315 (1.02)      5.8389 (1.04)     424.8576 (1.02)     6.6250 (1.16)         30;5  2.3495 (0.98)        100           1
test_init-init[3.10.0]     420.9639 (1.03)     506.7738 (1.15)     438.7312 (1.05)     11.9154 (2.12)     435.5894 (1.05)     9.4916 (1.66)         13;6  2.2793 (0.95)        100           1
test_init-init[3.53.2]     407.0173 (1.0)      439.6801 (1.0)      416.7268 (1.0)       5.6283 (1.0)      415.7727 (1.0)      5.7214 (1.0)          27;4  2.3997 (1.0)         100           1
test_init-init[3.60.1]     408.4660 (1.00)     507.1784 (1.15)     422.7490 (1.01)     13.8945 (2.47)     419.8770 (1.01)     8.1191 (1.42)          6;4  2.3655 (0.99)        100           1
test_init-init[main]       448.5930 (1.10)     513.8712 (1.17)     462.4891 (1.11)      9.1223 (1.62)     460.9899 (1.11)     8.2982 (1.45)         19;4  2.1622 (0.90)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     651.9983 (1.10)     651.9983 (1.10)     651.9983 (1.10)     0.0000 (1.0)      651.9983 (1.10)     0.0000 (1.0)           0;0  1.5337 (0.91)          1           1
test_list-list[3.10.0]     933.3007 (1.57)     933.3007 (1.57)     933.3007 (1.57)     0.0000 (1.0)      933.3007 (1.57)     0.0000 (1.0)           0;0  1.0715 (0.64)          1           1
test_list-list[3.53.2]     639.0557 (1.08)     639.0557 (1.08)     639.0557 (1.08)     0.0000 (1.0)      639.0557 (1.08)     0.0000 (1.0)           0;0  1.5648 (0.93)          1           1
test_list-list[3.60.1]     661.6841 (1.11)     661.6841 (1.11)     661.6841 (1.11)     0.0000 (1.0)      661.6841 (1.11)     0.0000 (1.0)           0;0  1.5113 (0.90)          1           1
test_list-list[main]       594.1436 (1.0)      594.1436 (1.0)      594.1436 (1.0)      0.0000 (1.0)      594.1436 (1.0)      0.0000 (1.0)           0;0  1.6831 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     437.4446 (1.07)     437.4446 (1.07)     437.4446 (1.07)     0.0000 (1.0)      437.4446 (1.07)     0.0000 (1.0)           0;0  2.2860 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     446.8205 (1.09)     446.8205 (1.09)     446.8205 (1.09)     0.0000 (1.0)      446.8205 (1.09)     0.0000 (1.0)           0;0  2.2380 (0.91)          1           1
test_list-list-dvc-only[3.53.2]     408.8068 (1.0)      408.8068 (1.0)      408.8068 (1.0)      0.0000 (1.0)      408.8068 (1.0)      0.0000 (1.0)           0;0  2.4461 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     416.6036 (1.02)     416.6036 (1.02)     416.6036 (1.02)     0.0000 (1.0)      416.6036 (1.02)     0.0000 (1.0)           0;0  2.4004 (0.98)          1           1
test_list-list-dvc-only[main]       418.1092 (1.02)     418.1092 (1.02)     418.1092 (1.02)     0.0000 (1.0)      418.1092 (1.02)     0.0000 (1.0)           0;0  2.3917 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4718 (1.0)      2.4718 (1.0)      2.4718 (1.0)      0.0000 (1.0)      2.4718 (1.0)      0.0000 (1.0)           0;0  0.4046 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5585 (1.04)     2.5585 (1.04)     2.5585 (1.04)     0.0000 (1.0)      2.5585 (1.04)     0.0000 (1.0)           0;0  0.3909 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.6601 (1.08)     2.6601 (1.08)     2.6601 (1.08)     0.0000 (1.0)      2.6601 (1.08)     0.0000 (1.0)           0;0  0.3759 (0.93)          1           1
test_list-list-recursive[3.60.1]     2.5348 (1.03)     2.5348 (1.03)     2.5348 (1.03)     0.0000 (1.0)      2.5348 (1.03)     0.0000 (1.0)           0;0  0.3945 (0.98)          1           1
test_list-list-recursive[main]       2.6957 (1.09)     2.6957 (1.09)     2.6957 (1.09)     0.0000 (1.0)      2.6957 (1.09)     0.0000 (1.0)           0;0  0.3710 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     437.7299 (1.07)     437.7299 (1.07)     437.7299 (1.07)     0.0000 (1.0)      437.7299 (1.07)     0.0000 (1.0)           0;0  2.2845 (0.93)          1           1
test_list-list-shallow[3.10.0]     443.1040 (1.08)     443.1040 (1.08)     443.1040 (1.08)     0.0000 (1.0)      443.1040 (1.08)     0.0000 (1.0)           0;0  2.2568 (0.92)          1           1
test_list-list-shallow[3.53.2]     409.0924 (1.0)      409.0924 (1.0)      409.0924 (1.0)      0.0000 (1.0)      409.0924 (1.0)      0.0000 (1.0)           0;0  2.4444 (1.0)           1           1
test_list-list-shallow[3.60.1]     429.5916 (1.05)     429.5916 (1.05)     429.5916 (1.05)     0.0000 (1.0)      429.5916 (1.05)     0.0000 (1.0)           0;0  2.3278 (0.95)          1           1
test_list-list-shallow[main]       427.9123 (1.05)     427.9123 (1.05)     427.9123 (1.05)     0.0000 (1.0)      427.9123 (1.05)     0.0000 (1.0)           0;0  2.3369 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     8.7883 (3.22)     8.7883 (3.22)     8.7883 (3.22)     0.0000 (1.0)      8.7883 (3.22)     0.0000 (1.0)           0;0  0.1138 (0.31)          1           1
test_partial_add-add[3.10.0]     9.3654 (3.43)     9.3654 (3.43)     9.3654 (3.43)     0.0000 (1.0)      9.3654 (3.43)     0.0000 (1.0)           0;0  0.1068 (0.29)          1           1
test_partial_add-add[3.53.2]     7.9872 (2.92)     7.9872 (2.92)     7.9872 (2.92)     0.0000 (1.0)      7.9872 (2.92)     0.0000 (1.0)           0;0  0.1252 (0.34)          1           1
test_partial_add-add[3.60.1]     2.7328 (1.0)      2.7328 (1.0)      2.7328 (1.0)      0.0000 (1.0)      2.7328 (1.0)      0.0000 (1.0)           0;0  0.3659 (1.0)           1           1
test_partial_add-add[main]       3.9083 (1.43)     3.9083 (1.43)     3.9083 (1.43)     0.0000 (1.0)      3.9083 (1.43)     0.0000 (1.0)           0;0  0.2559 (0.70)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     60.7410 (4.65)     60.7410 (4.65)     60.7410 (4.65)     0.0000 (1.0)      60.7410 (4.65)     0.0000 (1.0)           0;0  0.0165 (0.22)          1           1
test_partial_add-add-partial[3.10.0]     60.5486 (4.64)     60.5486 (4.64)     60.5486 (4.64)     0.0000 (1.0)      60.5486 (4.64)     0.0000 (1.0)           0;0  0.0165 (0.22)          1           1
test_partial_add-add-partial[3.53.2]     53.4952 (4.10)     53.4952 (4.10)     53.4952 (4.10)     0.0000 (1.0)      53.4952 (4.10)     0.0000 (1.0)           0;0  0.0187 (0.24)          1           1
test_partial_add-add-partial[3.60.1]     13.0617 (1.0)      13.0617 (1.0)      13.0617 (1.0)      0.0000 (1.0)      13.0617 (1.0)      0.0000 (1.0)           0;0  0.0766 (1.0)           1           1
test_partial_add-add-partial[main]       13.5275 (1.04)     13.5275 (1.04)     13.5275 (1.04)     0.0000 (1.0)      13.5275 (1.04)     0.0000 (1.0)           0;0  0.0739 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5010 (1.0)      4.5010 (1.0)      4.5010 (1.0)      0.0000 (1.0)      4.5010 (1.0)      0.0000 (1.0)           0;0  0.2222 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1104 (1.36)     6.1104 (1.36)     6.1104 (1.36)     0.0000 (1.0)      6.1104 (1.36)     0.0000 (1.0)           0;0  0.1637 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7606 (1.50)     6.7606 (1.50)     6.7606 (1.50)     0.0000 (1.0)      6.7606 (1.50)     0.0000 (1.0)           0;0  0.1479 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5969 (1.47)     6.5969 (1.47)     6.5969 (1.47)     0.0000 (1.0)      6.5969 (1.47)     0.0000 (1.0)           0;0  0.1516 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       5.8950 (1.31)     5.8950 (1.31)     5.8950 (1.31)     0.0000 (1.0)      5.8950 (1.31)     0.0000 (1.0)           0;0  0.1696 (0.76)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5290 (1.0)      2.5290 (1.0)      2.5290 (1.0)      0.0000 (1.0)      2.5290 (1.0)      0.0000 (1.0)           0;0  0.3954 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6766 (1.45)     3.6766 (1.45)     3.6766 (1.45)     0.0000 (1.0)      3.6766 (1.45)     0.0000 (1.0)           0;0  0.2720 (0.69)          1           1
test_partial_add-gc-noop[3.53.2]     3.6690 (1.45)     3.6690 (1.45)     3.6690 (1.45)     0.0000 (1.0)      3.6690 (1.45)     0.0000 (1.0)           0;0  0.2726 (0.69)          1           1
test_partial_add-gc-noop[3.60.1]     3.6962 (1.46)     3.6962 (1.46)     3.6962 (1.46)     0.0000 (1.0)      3.6962 (1.46)     0.0000 (1.0)           0;0  0.2705 (0.68)          1           1
test_partial_add-gc-noop[main]       2.8792 (1.14)     2.8792 (1.14)     2.8792 (1.14)     0.0000 (1.0)      2.8792 (1.14)     0.0000 (1.0)           0;0  0.3473 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     12.3108 (4.69)     12.3108 (4.69)     12.3108 (4.69)     0.0000 (1.0)      12.3108 (4.69)     0.0000 (1.0)           0;0  0.0812 (0.21)          1           1
test_partial_add-push[3.10.0]      5.3550 (2.04)      5.3550 (2.04)      5.3550 (2.04)     0.0000 (1.0)       5.3550 (2.04)     0.0000 (1.0)           0;0  0.1867 (0.49)          1           1
test_partial_add-push[3.53.2]      2.6503 (1.01)      2.6503 (1.01)      2.6503 (1.01)     0.0000 (1.0)       2.6503 (1.01)     0.0000 (1.0)           0;0  0.3773 (0.99)          1           1
test_partial_add-push[3.60.1]      2.6231 (1.0)       2.6231 (1.0)       2.6231 (1.0)      0.0000 (1.0)       2.6231 (1.0)      0.0000 (1.0)           0;0  0.3812 (1.0)           1           1
test_partial_add-push[main]        2.7402 (1.04)      2.7402 (1.04)      2.7402 (1.04)     0.0000 (1.0)       2.7402 (1.04)     0.0000 (1.0)           0;0  0.3649 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     72.5413 (5.26)     72.5413 (5.26)     72.5413 (5.26)     0.0000 (1.0)      72.5413 (5.26)     0.0000 (1.0)           0;0  0.0138 (0.19)          1           1
test_partial_add-push-partial[3.10.0]     30.8238 (2.23)     30.8238 (2.23)     30.8238 (2.23)     0.0000 (1.0)      30.8238 (2.23)     0.0000 (1.0)           0;0  0.0324 (0.45)          1           1
test_partial_add-push-partial[3.53.2]     14.4831 (1.05)     14.4831 (1.05)     14.4831 (1.05)     0.0000 (1.0)      14.4831 (1.05)     0.0000 (1.0)           0;0  0.0690 (0.95)          1           1
test_partial_add-push-partial[3.60.1]     14.1409 (1.02)     14.1409 (1.02)     14.1409 (1.02)     0.0000 (1.0)      14.1409 (1.02)     0.0000 (1.0)           0;0  0.0707 (0.98)          1           1
test_partial_add-push-partial[main]       13.7976 (1.0)      13.7976 (1.0)      13.7976 (1.0)      0.0000 (1.0)      13.7976 (1.0)      0.0000 (1.0)           0;0  0.0725 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     82.3897 (3.64)     82.3897 (3.64)     82.3897 (3.64)     0.0000 (1.0)      82.3897 (3.64)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_partial_remove-add[3.10.0]     83.4570 (3.69)     83.4570 (3.69)     83.4570 (3.69)     0.0000 (1.0)      83.4570 (3.69)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_partial_remove-add[3.53.2]     74.4506 (3.29)     74.4506 (3.29)     74.4506 (3.29)     0.0000 (1.0)      74.4506 (3.29)     0.0000 (1.0)           0;0  0.0134 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.6345 (1.0)      22.6345 (1.0)      22.6345 (1.0)      0.0000 (1.0)      22.6345 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_partial_remove-add[main]       23.8275 (1.05)     23.8275 (1.05)     23.8275 (1.05)     0.0000 (1.0)      23.8275 (1.05)     0.0000 (1.0)           0;0  0.0420 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     46.0031 (12.67)    46.0031 (12.67)    46.0031 (12.67)    0.0000 (1.0)      46.0031 (12.67)    0.0000 (1.0)           0;0  0.0217 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     46.0171 (12.67)    46.0171 (12.67)    46.0171 (12.67)    0.0000 (1.0)      46.0171 (12.67)    0.0000 (1.0)           0;0  0.0217 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     42.2370 (11.63)    42.2370 (11.63)    42.2370 (11.63)    0.0000 (1.0)      42.2370 (11.63)    0.0000 (1.0)           0;0  0.0237 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.6310 (1.0)       3.6310 (1.0)       3.6310 (1.0)      0.0000 (1.0)       3.6310 (1.0)      0.0000 (1.0)           0;0  0.2754 (1.0)           1           1
test_partial_remove-add-update[main]        3.6759 (1.01)      3.6759 (1.01)      3.6759 (1.01)     0.0000 (1.0)       3.6759 (1.01)     0.0000 (1.0)           0;0  0.2720 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6209 (1.0)      2.6209 (1.0)      2.6209 (1.0)      0.0000 (1.0)      2.6209 (1.0)      0.0000 (1.0)           0;0  0.3815 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6861 (1.41)     3.6861 (1.41)     3.6861 (1.41)     0.0000 (1.0)      3.6861 (1.41)     0.0000 (1.0)           0;0  0.2713 (0.71)          1           1
test_partial_remove-gc[3.53.2]     3.7250 (1.42)     3.7250 (1.42)     3.7250 (1.42)     0.0000 (1.0)      3.7250 (1.42)     0.0000 (1.0)           0;0  0.2685 (0.70)          1           1
test_partial_remove-gc[3.60.1]     3.7298 (1.42)     3.7298 (1.42)     3.7298 (1.42)     0.0000 (1.0)      3.7298 (1.42)     0.0000 (1.0)           0;0  0.2681 (0.70)          1           1
test_partial_remove-gc[main]       2.8671 (1.09)     2.8671 (1.09)     2.8671 (1.09)     0.0000 (1.0)      2.8671 (1.09)     0.0000 (1.0)           0;0  0.3488 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.4778 (1.0)      4.4778 (1.0)      4.4778 (1.0)      0.0000 (1.0)      4.4778 (1.0)      0.0000 (1.0)           0;0  0.2233 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.0161 (1.34)     6.0161 (1.34)     6.0161 (1.34)     0.0000 (1.0)      6.0161 (1.34)     0.0000 (1.0)           0;0  0.1662 (0.74)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.5474 (1.46)     6.5474 (1.46)     6.5474 (1.46)     0.0000 (1.0)      6.5474 (1.46)     0.0000 (1.0)           0;0  0.1527 (0.68)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.6624 (1.49)     6.6624 (1.49)     6.6624 (1.49)     0.0000 (1.0)      6.6624 (1.49)     0.0000 (1.0)           0;0  0.1501 (0.67)          1           1
test_partial_remove-gc-cloud[main]       5.5655 (1.24)     5.5655 (1.24)     5.5655 (1.24)     0.0000 (1.0)      5.5655 (1.24)     0.0000 (1.0)           0;0  0.1797 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     99.6760 (4.45)     99.6760 (4.45)     99.6760 (4.45)     0.0000 (1.0)      99.6760 (4.45)     0.0000 (1.0)           0;0  0.0100 (0.22)          1           1
test_partial_remove-push[3.10.0]     48.6989 (2.17)     48.6989 (2.17)     48.6989 (2.17)     0.0000 (1.0)      48.6989 (2.17)     0.0000 (1.0)           0;0  0.0205 (0.46)          1           1
test_partial_remove-push[3.53.2]     23.3529 (1.04)     23.3529 (1.04)     23.3529 (1.04)     0.0000 (1.0)      23.3529 (1.04)     0.0000 (1.0)           0;0  0.0428 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.8613 (1.02)     22.8613 (1.02)     22.8613 (1.02)     0.0000 (1.0)      22.8613 (1.02)     0.0000 (1.0)           0;0  0.0437 (0.98)          1           1
test_partial_remove-push[main]       22.4030 (1.0)      22.4030 (1.0)      22.4030 (1.0)      0.0000 (1.0)      22.4030 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9974 (1.0)      3.9974 (1.0)      3.9974 (1.0)      0.0000 (1.0)      3.9974 (1.0)      0.0000 (1.0)           0;0  0.2502 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.0770 (1.02)     4.0770 (1.02)     4.0770 (1.02)     0.0000 (1.0)      4.0770 (1.02)     0.0000 (1.0)           0;0  0.2453 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     7.2883 (1.82)     7.2883 (1.82)     7.2883 (1.82)     0.0000 (1.0)      7.2883 (1.82)     0.0000 (1.0)           0;0  0.1372 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.5458 (1.89)     7.5458 (1.89)     7.5458 (1.89)     0.0000 (1.0)      7.5458 (1.89)     0.0000 (1.0)           0;0  0.1325 (0.53)          1           1
test_partial_remove-push-update[main]       7.3276 (1.83)     7.3276 (1.83)     7.3276 (1.83)     0.0000 (1.0)      7.3276 (1.83)     0.0000 (1.0)           0;0  0.1365 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     491.4992 (1.0)      498.6226 (1.0)      494.5935 (1.0)      2.6846 (1.0)      494.0267 (1.0)       3.5013 (1.0)           2;0  2.0219 (1.0)           5           3
test_plots-plots-diff[3.10.0]     904.5858 (1.84)     917.4897 (1.84)     910.7882 (1.84)     5.4094 (2.01)     912.9302 (1.85)      8.5913 (2.45)          2;0  1.0980 (0.54)          5           3
test_plots-plots-diff[3.53.2]     858.8147 (1.75)     877.9495 (1.76)     867.6036 (1.75)     8.2090 (3.06)     867.6620 (1.76)     14.5023 (4.14)          2;0  1.1526 (0.57)          5           3
test_plots-plots-diff[3.60.1]     857.1686 (1.74)     864.7713 (1.73)     862.5699 (1.74)     3.2677 (1.22)     864.4814 (1.75)      4.0765 (1.16)          1;0  1.1593 (0.57)          5           3
test_plots-plots-diff[main]       866.5159 (1.76)     885.3315 (1.78)     875.5371 (1.77)     7.9202 (2.95)     877.4375 (1.78)     13.3481 (3.81)          2;0  1.1422 (0.56)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       502.5274 (1.0)        516.0610 (1.0)        508.2551 (1.0)       5.2430 (1.73)       507.0132 (1.0)       7.3977 (1.39)          2;0  1.9675 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,114.0923 (2.22)     1,127.1959 (2.18)     1,121.4265 (2.21)      5.0085 (1.65)     1,122.0685 (2.21)      7.0146 (1.32)          2;0  0.8917 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       934.5657 (1.86)       949.8275 (1.84)       942.5806 (1.85)      6.8430 (2.26)       940.7496 (1.86)     12.2888 (2.31)          3;0  1.0609 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]       930.7876 (1.85)       961.2183 (1.86)       947.4638 (1.86)     11.5122 (3.80)       949.1656 (1.87)     15.7686 (2.97)          2;0  1.0554 (0.54)          5           3
test_plots-plots-diff-json[main]         943.3925 (1.88)       950.3576 (1.84)       946.8814 (1.86)      3.0292 (1.0)        946.0285 (1.87)      5.3140 (1.0)           2;0  1.0561 (0.54)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     390.3130 (1.0)      401.9903 (1.0)      394.6806 (1.0)      4.8234 (1.0)      392.1120 (1.0)       6.8716 (1.01)          1;0  2.5337 (1.0)           5           3
test_plots-plots-show[3.10.0]     724.3442 (1.86)     740.4986 (1.84)     732.1454 (1.86)     6.2779 (1.30)     729.8868 (1.86)      8.8358 (1.30)          2;0  1.3658 (0.54)          5           3
test_plots-plots-show[3.53.2]     716.1170 (1.83)     729.4436 (1.81)     724.1296 (1.83)     5.6452 (1.17)     724.8635 (1.85)      9.3843 (1.38)          1;0  1.3810 (0.55)          5           3
test_plots-plots-show[3.60.1]     710.9402 (1.82)     727.6850 (1.81)     719.3942 (1.82)     7.0536 (1.46)     717.0903 (1.83)     11.7202 (1.72)          2;0  1.3901 (0.55)          5           3
test_plots-plots-show[main]       727.7459 (1.86)     744.6152 (1.85)     733.5871 (1.86)     6.5409 (1.36)     732.3742 (1.87)      6.8219 (1.0)           1;0  1.3632 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     410.8022 (1.0)      449.4769 (1.0)      426.6379 (1.0)      14.8781 (3.05)     421.1373 (1.0)      19.2534 (2.54)          2;0  2.3439 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     853.9953 (2.08)     866.4447 (1.93)     857.8469 (2.01)      5.6189 (1.15)     854.0508 (2.03)      8.1626 (1.08)          1;0  1.1657 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     752.2500 (1.83)     763.8578 (1.70)     758.8276 (1.78)      5.7353 (1.18)     761.3682 (1.81)     10.8435 (1.43)          2;0  1.3178 (0.56)          5           3
test_plots-plots-show-json[3.60.1]     753.5221 (1.83)     771.8874 (1.72)     764.5242 (1.79)      6.8893 (1.41)     765.0340 (1.82)      7.8480 (1.03)          2;0  1.3080 (0.56)          5           3
test_plots-plots-show-json[main]       765.4169 (1.86)     777.7027 (1.73)     772.1816 (1.81)      4.8796 (1.0)      772.0872 (1.83)      7.5834 (1.0)           2;0  1.2950 (0.55)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     103.1732 (4.36)     103.1732 (4.36)     103.1732 (4.36)     0.0000 (1.0)      103.1732 (4.36)     0.0000 (1.0)           0;0  0.0097 (0.23)          1           1
test_push-push[3.10.0]      49.9421 (2.11)      49.9421 (2.11)      49.9421 (2.11)     0.0000 (1.0)       49.9421 (2.11)     0.0000 (1.0)           0;0  0.0200 (0.47)          1           1
test_push-push[3.53.2]      24.5504 (1.04)      24.5504 (1.04)      24.5504 (1.04)     0.0000 (1.0)       24.5504 (1.04)     0.0000 (1.0)           0;0  0.0407 (0.96)          1           1
test_push-push[3.60.1]      23.6814 (1.0)       23.6814 (1.0)       23.6814 (1.0)      0.0000 (1.0)       23.6814 (1.0)      0.0000 (1.0)           0;0  0.0422 (1.0)           1           1
test_push-push[main]        24.1517 (1.02)      24.1517 (1.02)      24.1517 (1.02)     0.0000 (1.0)       24.1517 (1.02)     0.0000 (1.0)           0;0  0.0414 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     111.9936 (4.80)     111.9936 (4.80)     111.9936 (4.80)     0.0000 (1.0)      111.9936 (4.80)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_sharing-fetch[3.10.0]     117.0182 (5.02)     117.0182 (5.02)     117.0182 (5.02)     0.0000 (1.0)      117.0182 (5.02)     0.0000 (1.0)           0;0  0.0085 (0.20)          1           1
test_sharing-fetch[3.53.2]      33.6802 (1.44)      33.6802 (1.44)      33.6802 (1.44)     0.0000 (1.0)       33.6802 (1.44)     0.0000 (1.0)           0;0  0.0297 (0.69)          1           1
test_sharing-fetch[3.60.1]      23.4351 (1.00)      23.4351 (1.00)      23.4351 (1.00)     0.0000 (1.0)       23.4351 (1.00)     0.0000 (1.0)           0;0  0.0427 (1.00)          1           1
test_sharing-fetch[main]        23.3209 (1.0)       23.3209 (1.0)       23.3209 (1.0)      0.0000 (1.0)       23.3209 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2842 (1.0)      1.2842 (1.0)      1.2842 (1.0)      0.0000 (1.0)      1.2842 (1.0)      0.0000 (1.0)           0;0  0.7787 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7926 (2.95)     3.7926 (2.95)     3.7926 (2.95)     0.0000 (1.0)      3.7926 (2.95)     0.0000 (1.0)           0;0  0.2637 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.9280 (4.62)     5.9280 (4.62)     5.9280 (4.62)     0.0000 (1.0)      5.9280 (4.62)     0.0000 (1.0)           0;0  0.1687 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     6.2585 (4.87)     6.2585 (4.87)     6.2585 (4.87)     0.0000 (1.0)      6.2585 (4.87)     0.0000 (1.0)           0;0  0.1598 (0.21)          1           1
test_sharing-fetch-noop[main]       6.1542 (4.79)     6.1542 (4.79)     6.1542 (4.79)     0.0000 (1.0)      6.1542 (4.79)     0.0000 (1.0)           0;0  0.1625 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     100.8036 (4.37)     100.8036 (4.37)     100.8036 (4.37)     0.0000 (1.0)      100.8036 (4.37)     0.0000 (1.0)           0;0  0.0099 (0.23)          1           1
test_sharing-push[3.10.0]      49.0147 (2.12)      49.0147 (2.12)      49.0147 (2.12)     0.0000 (1.0)       49.0147 (2.12)     0.0000 (1.0)           0;0  0.0204 (0.47)          1           1
test_sharing-push[3.53.2]      23.7015 (1.03)      23.7015 (1.03)      23.7015 (1.03)     0.0000 (1.0)       23.7015 (1.03)     0.0000 (1.0)           0;0  0.0422 (0.97)          1           1
test_sharing-push[3.60.1]      23.0860 (1.0)       23.0860 (1.0)       23.0860 (1.0)      0.0000 (1.0)       23.0860 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
test_sharing-push[main]        23.3626 (1.01)      23.3626 (1.01)      23.3626 (1.01)     0.0000 (1.0)       23.3626 (1.01)     0.0000 (1.0)           0;0  0.0428 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2136 (1.05)     2.2136 (1.05)     2.2136 (1.05)     0.0000 (1.0)      2.2136 (1.05)     0.0000 (1.0)           0;0  0.4518 (0.95)          1           1
test_sharing-push-noop[3.10.0]     2.1039 (1.0)      2.1039 (1.0)      2.1039 (1.0)      0.0000 (1.0)      2.1039 (1.0)      0.0000 (1.0)           0;0  0.4753 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0945 (2.90)     6.0945 (2.90)     6.0945 (2.90)     0.0000 (1.0)      6.0945 (2.90)     0.0000 (1.0)           0;0  0.1641 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.4119 (3.05)     6.4119 (3.05)     6.4119 (3.05)     0.0000 (1.0)      6.4119 (3.05)     0.0000 (1.0)           0;0  0.1560 (0.33)          1           1
test_sharing-push-noop[main]       6.0170 (2.86)     6.0170 (2.86)     6.0170 (2.86)     0.0000 (1.0)      6.0170 (2.86)     0.0000 (1.0)           0;0  0.1662 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     163.1472 (1.06)     163.1472 (1.06)     163.1472 (1.06)     0.0000 (1.0)      163.1472 (1.06)     0.0000 (1.0)           0;0  0.0061 (0.94)          1           1
test_sharing_azure-fetch[main]       153.4507 (1.0)      153.4507 (1.0)      153.4507 (1.0)      0.0000 (1.0)      153.4507 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     5.7193 (1.0)      5.7193 (1.0)      5.7193 (1.0)      0.0000 (1.0)      5.7193 (1.0)      0.0000 (1.0)           0;0  0.1748 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       5.8587 (1.02)     5.8587 (1.02)     5.8587 (1.02)     0.0000 (1.0)      5.8587 (1.02)     0.0000 (1.0)           0;0  0.1707 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     153.7466 (1.0)      153.7466 (1.0)      153.7466 (1.0)      0.0000 (1.0)      153.7466 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
test_sharing_azure-push[main]       155.3242 (1.01)     155.3242 (1.01)     155.3242 (1.01)     0.0000 (1.0)      155.3242 (1.01)     0.0000 (1.0)           0;0  0.0064 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.0248 (1.0)      6.0248 (1.0)      6.0248 (1.0)      0.0000 (1.0)      6.0248 (1.0)      0.0000 (1.0)           0;0  0.1660 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.1183 (1.02)     6.1183 (1.02)     6.1183 (1.02)     0.0000 (1.0)      6.1183 (1.02)     0.0000 (1.0)           0;0  0.1634 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     716.6827 (1.03)     716.6827 (1.03)     716.6827 (1.03)     0.0000 (1.0)      716.6827 (1.03)     0.0000 (1.0)           0;0  0.0014 (0.97)          1           1
test_sharing_s3-fetch[main]       694.4698 (1.0)      694.4698 (1.0)      694.4698 (1.0)      0.0000 (1.0)      694.4698 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6651 (1.0)      6.6651 (1.0)      6.6651 (1.0)      0.0000 (1.0)      6.6651 (1.0)      0.0000 (1.0)           0;0  0.1500 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7758 (1.02)     6.7758 (1.02)     6.7758 (1.02)     0.0000 (1.0)      6.7758 (1.02)     0.0000 (1.0)           0;0  0.1476 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,024.2845 (1.0)      1,024.2845 (1.0)      1,024.2845 (1.0)      0.0000 (1.0)      1,024.2845 (1.0)      0.0000 (1.0)           0;0  0.0010 (1.0)           1           1
test_sharing_s3-push[main]       1,027.0501 (1.00)     1,027.0501 (1.00)     1,027.0501 (1.00)     0.0000 (1.0)      1,027.0501 (1.00)     0.0000 (1.0)           0;0  0.0010 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.2019 (1.0)      7.2019 (1.0)      7.2019 (1.0)      0.0000 (1.0)      7.2019 (1.0)      0.0000 (1.0)           0;0  0.1389 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.2986 (1.01)     7.2986 (1.01)     7.2986 (1.01)     0.0000 (1.0)      7.2986 (1.01)     0.0000 (1.0)           0;0  0.1370 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.7080 (3.60)     19.7080 (3.60)     19.7080 (3.60)     0.0000 (1.0)      19.7080 (3.60)     0.0000 (1.0)           0;0  0.0507 (0.28)          1           1
test_status-status[3.10.0]     20.5542 (3.76)     20.5542 (3.76)     20.5542 (3.76)     0.0000 (1.0)      20.5542 (3.76)     0.0000 (1.0)           0;0  0.0487 (0.27)          1           1
test_status-status[3.53.2]     18.3029 (3.35)     18.3029 (3.35)     18.3029 (3.35)     0.0000 (1.0)      18.3029 (3.35)     0.0000 (1.0)           0;0  0.0546 (0.30)          1           1
test_status-status[3.60.1]      5.4687 (1.0)       5.4687 (1.0)       5.4687 (1.0)      0.0000 (1.0)       5.4687 (1.0)      0.0000 (1.0)           0;0  0.1829 (1.0)           1           1
test_status-status[main]        5.8611 (1.07)      5.8611 (1.07)      5.8611 (1.07)     0.0000 (1.0)       5.8611 (1.07)     0.0000 (1.0)           0;0  0.1706 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9000 (1.85)     4.9000 (1.85)     4.9000 (1.85)     0.0000 (1.0)      4.9000 (1.85)     0.0000 (1.0)           0;0  0.2041 (0.54)          1           1
test_status-status-changed[3.10.0]     5.0863 (1.92)     5.0863 (1.92)     5.0863 (1.92)     0.0000 (1.0)      5.0863 (1.92)     0.0000 (1.0)           0;0  0.1966 (0.52)          1           1
test_status-status-changed[3.53.2]     5.2119 (1.97)     5.2119 (1.97)     5.2119 (1.97)     0.0000 (1.0)      5.2119 (1.97)     0.0000 (1.0)           0;0  0.1919 (0.51)          1           1
test_status-status-changed[3.60.1]     2.6484 (1.0)      2.6484 (1.0)      2.6484 (1.0)      0.0000 (1.0)      2.6484 (1.0)      0.0000 (1.0)           0;0  0.3776 (1.0)           1           1
test_status-status-changed[main]       2.9059 (1.10)     2.9059 (1.10)     2.9059 (1.10)     0.0000 (1.0)      2.9059 (1.10)     0.0000 (1.0)           0;0  0.3441 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0453 (1.98)     5.0453 (1.98)     5.0453 (1.98)     0.0000 (1.0)      5.0453 (1.98)     0.0000 (1.0)           0;0  0.1982 (0.50)          1           1
test_status-status-changed-noop[3.10.0]     5.3205 (2.09)     5.3205 (2.09)     5.3205 (2.09)     0.0000 (1.0)      5.3205 (2.09)     0.0000 (1.0)           0;0  0.1880 (0.48)          1           1
test_status-status-changed-noop[3.53.2]     4.9952 (1.96)     4.9952 (1.96)     4.9952 (1.96)     0.0000 (1.0)      4.9952 (1.96)     0.0000 (1.0)           0;0  0.2002 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.5463 (1.0)      2.5463 (1.0)      2.5463 (1.0)      0.0000 (1.0)      2.5463 (1.0)      0.0000 (1.0)           0;0  0.3927 (1.0)           1           1
test_status-status-changed-noop[main]       2.7151 (1.07)     2.7151 (1.07)     2.7151 (1.07)     0.0000 (1.0)      2.7151 (1.07)     0.0000 (1.0)           0;0  0.3683 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1084 (2.02)     5.1084 (2.02)     5.1084 (2.02)     0.0000 (1.0)      5.1084 (2.02)     0.0000 (1.0)           0;0  0.1958 (0.49)          1           1
test_status-status-noop[3.10.0]     5.2538 (2.08)     5.2538 (2.08)     5.2538 (2.08)     0.0000 (1.0)      5.2538 (2.08)     0.0000 (1.0)           0;0  0.1903 (0.48)          1           1
test_status-status-noop[3.53.2]     5.0036 (1.98)     5.0036 (1.98)     5.0036 (1.98)     0.0000 (1.0)      5.0036 (1.98)     0.0000 (1.0)           0;0  0.1999 (0.50)          1           1
test_status-status-noop[3.60.1]     2.5247 (1.0)      2.5247 (1.0)      2.5247 (1.0)      0.0000 (1.0)      2.5247 (1.0)      0.0000 (1.0)           0;0  0.3961 (1.0)           1           1
test_status-status-noop[main]       2.7256 (1.08)     2.7256 (1.08)     2.7256 (1.08)     0.0000 (1.0)      2.7256 (1.08)     0.0000 (1.0)           0;0  0.3669 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     205.7096 (4.31)     205.7096 (4.31)     205.7096 (4.31)     0.0000 (1.0)      205.7096 (4.31)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.10.0]     210.9780 (4.42)     210.9780 (4.42)     210.9780 (4.42)     0.0000 (1.0)      210.9780 (4.42)     0.0000 (1.0)           0;0  0.0047 (0.23)          1           1
test_update-import-url[3.53.2]     118.4125 (2.48)     118.4125 (2.48)     118.4125 (2.48)     0.0000 (1.0)      118.4125 (2.48)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_update-import-url[3.60.1]      47.7099 (1.0)       47.7099 (1.0)       47.7099 (1.0)      0.0000 (1.0)       47.7099 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
test_update-import-url[main]        49.0423 (1.03)      49.0423 (1.03)      49.0423 (1.03)     0.0000 (1.0)       49.0423 (1.03)     0.0000 (1.0)           0;0  0.0204 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     190.8824 (5.30)     190.8824 (5.30)     190.8824 (5.30)     0.0000 (1.0)      190.8824 (5.30)     0.0000 (1.0)           0;0  0.0052 (0.19)          1           1
test_update-update[3.10.0]     194.0444 (5.39)     194.0444 (5.39)     194.0444 (5.39)     0.0000 (1.0)      194.0444 (5.39)     0.0000 (1.0)           0;0  0.0052 (0.19)          1           1
test_update-update[3.53.2]     111.1589 (3.09)     111.1589 (3.09)     111.1589 (3.09)     0.0000 (1.0)      111.1589 (3.09)     0.0000 (1.0)           0;0  0.0090 (0.32)          1           1
test_update-update[3.60.1]      35.9890 (1.0)       35.9890 (1.0)       35.9890 (1.0)      0.0000 (1.0)       35.9890 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
test_update-update[main]        36.7278 (1.02)      36.7278 (1.02)      36.7278 (1.02)     0.0000 (1.0)       36.7278 (1.02)     0.0000 (1.0)           0;0  0.0272 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.5754 (2.29)     17.5754 (2.29)     17.5754 (2.29)     0.0000 (1.0)      17.5754 (2.29)     0.0000 (1.0)           0;0  0.0569 (0.44)          1           1
test_update-update-noop[3.10.0]     18.6672 (2.44)     18.6672 (2.44)     18.6672 (2.44)     0.0000 (1.0)      18.6672 (2.44)     0.0000 (1.0)           0;0  0.0536 (0.41)          1           1
test_update-update-noop[3.53.2]     17.6136 (2.30)     17.6136 (2.30)     17.6136 (2.30)     0.0000 (1.0)      17.6136 (2.30)     0.0000 (1.0)           0;0  0.0568 (0.44)          1           1
test_update-update-noop[3.60.1]      7.6653 (1.0)       7.6653 (1.0)       7.6653 (1.0)      0.0000 (1.0)       7.6653 (1.0)      0.0000 (1.0)           0;0  0.1305 (1.0)           1           1
test_update-update-noop[main]        8.3580 (1.09)      8.3580 (1.09)      8.3580 (1.09)     0.0000 (1.0)       8.3580 (1.09)     0.0000 (1.0)           0;0  0.1196 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean