Sat Aug 23 00:48:45 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     86.6073 (3.79)     86.6073 (3.79)     86.6073 (3.79)     0.0000 (1.0)      86.6073 (3.79)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_add_copy-add[3.10.0]     86.6856 (3.80)     86.6856 (3.80)     86.6856 (3.80)     0.0000 (1.0)      86.6856 (3.80)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_add_copy-add[3.53.2]     77.4721 (3.39)     77.4721 (3.39)     77.4721 (3.39)     0.0000 (1.0)      77.4721 (3.39)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_add_copy-add[3.60.1]     22.8243 (1.0)      22.8243 (1.0)      22.8243 (1.0)      0.0000 (1.0)      22.8243 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
test_add_copy-add[main]       23.4787 (1.03)     23.4787 (1.03)     23.4787 (1.03)     0.0000 (1.0)      23.4787 (1.03)     0.0000 (1.0)           0;0  0.0426 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.6297 (6.63)     29.6297 (6.63)     29.6297 (6.63)     0.0000 (1.0)      29.6297 (6.63)     0.0000 (1.0)           0;0  0.0337 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     30.0593 (6.72)     30.0593 (6.72)     30.0593 (6.72)     0.0000 (1.0)      30.0593 (6.72)     0.0000 (1.0)           0;0  0.0333 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.7902 (6.44)     28.7902 (6.44)     28.7902 (6.44)     0.0000 (1.0)      28.7902 (6.44)     0.0000 (1.0)           0;0  0.0347 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4723 (1.0)       4.4723 (1.0)       4.4723 (1.0)      0.0000 (1.0)       4.4723 (1.0)      0.0000 (1.0)           0;0  0.2236 (1.0)           1           1
test_add_copy-add-noop[main]        4.5908 (1.03)      4.5908 (1.03)      4.5908 (1.03)     0.0000 (1.0)       4.5908 (1.03)     0.0000 (1.0)           0;0  0.2178 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.3929 (4.30)     67.3929 (4.30)     67.3929 (4.30)     0.0000 (1.0)      67.3929 (4.30)     0.0000 (1.0)           0;0  0.0148 (0.23)          1           1
test_add_hardlink-add[3.10.0]     67.6426 (4.32)     67.6426 (4.32)     67.6426 (4.32)     0.0000 (1.0)      67.6426 (4.32)     0.0000 (1.0)           0;0  0.0148 (0.23)          1           1
test_add_hardlink-add[3.53.2]     62.3648 (3.98)     62.3648 (3.98)     62.3648 (3.98)     0.0000 (1.0)      62.3648 (3.98)     0.0000 (1.0)           0;0  0.0160 (0.25)          1           1
test_add_hardlink-add[3.60.1]     15.6732 (1.0)      15.6732 (1.0)      15.6732 (1.0)      0.0000 (1.0)      15.6732 (1.0)      0.0000 (1.0)           0;0  0.0638 (1.0)           1           1
test_add_hardlink-add[main]       16.9784 (1.08)     16.9784 (1.08)     16.9784 (1.08)     0.0000 (1.0)      16.9784 (1.08)     0.0000 (1.0)           0;0  0.0589 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.6559 (7.93)     34.6559 (7.93)     34.6559 (7.93)     0.0000 (1.0)      34.6559 (7.93)     0.0000 (1.0)           0;0  0.0289 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.3170 (8.08)     35.3170 (8.08)     35.3170 (8.08)     0.0000 (1.0)      35.3170 (8.08)     0.0000 (1.0)           0;0  0.0283 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     33.3504 (7.63)     33.3504 (7.63)     33.3504 (7.63)     0.0000 (1.0)      33.3504 (7.63)     0.0000 (1.0)           0;0  0.0300 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3723 (1.0)       4.3723 (1.0)       4.3723 (1.0)      0.0000 (1.0)       4.3723 (1.0)      0.0000 (1.0)           0;0  0.2287 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4306 (1.01)      4.4306 (1.01)      4.4306 (1.01)     0.0000 (1.0)       4.4306 (1.01)     0.0000 (1.0)           0;0  0.2257 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.9726 (2.03)     69.9726 (2.03)     69.9726 (2.03)     0.0000 (1.0)      69.9726 (2.03)     0.0000 (1.0)           0;0  0.0143 (0.49)          1           1
test_add_symlink-add[3.10.0]     70.4361 (2.04)     70.4361 (2.04)     70.4361 (2.04)     0.0000 (1.0)      70.4361 (2.04)     0.0000 (1.0)           0;0  0.0142 (0.49)          1           1
test_add_symlink-add[3.53.2]     65.2632 (1.89)     65.2632 (1.89)     65.2632 (1.89)     0.0000 (1.0)      65.2632 (1.89)     0.0000 (1.0)           0;0  0.0153 (0.53)          1           1
test_add_symlink-add[3.60.1]     34.5465 (1.0)      34.5465 (1.0)      34.5465 (1.0)      0.0000 (1.0)      34.5465 (1.0)      0.0000 (1.0)           0;0  0.0289 (1.0)           1           1
test_add_symlink-add[main]       35.3606 (1.02)     35.3606 (1.02)     35.3606 (1.02)     0.0000 (1.0)      35.3606 (1.02)     0.0000 (1.0)           0;0  0.0283 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.5333 (8.57)     47.5333 (8.57)     47.5333 (8.57)     0.0000 (1.0)      47.5333 (8.57)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.5867 (8.58)     47.5867 (8.58)     47.5867 (8.58)     0.0000 (1.0)      47.5867 (8.58)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.1334 (8.49)     47.1334 (8.49)     47.1334 (8.49)     0.0000 (1.0)      47.1334 (8.49)     0.0000 (1.0)           0;0  0.0212 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5795 (1.01)      5.5795 (1.01)      5.5795 (1.01)     0.0000 (1.0)       5.5795 (1.01)     0.0000 (1.0)           0;0  0.1792 (0.99)          1           1
test_add_symlink-add-noop[main]        5.5490 (1.0)       5.5490 (1.0)       5.5490 (1.0)      0.0000 (1.0)       5.5490 (1.0)      0.0000 (1.0)           0;0  0.1802 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.6192 (1.98)     41.6192 (1.98)     41.6192 (1.98)     0.0000 (1.0)      41.6192 (1.98)     0.0000 (1.0)           0;0  0.0240 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     60.5317 (2.88)     60.5317 (2.88)     60.5317 (2.88)     0.0000 (1.0)      60.5317 (2.88)     0.0000 (1.0)           0;0  0.0165 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     28.8069 (1.37)     28.8069 (1.37)     28.8069 (1.37)     0.0000 (1.0)      28.8069 (1.37)     0.0000 (1.0)           0;0  0.0347 (0.73)          1           1
test_checkout_copy-checkout[3.60.1]     21.0238 (1.0)      21.0238 (1.0)      21.0238 (1.0)      0.0000 (1.0)      21.0238 (1.0)      0.0000 (1.0)           0;0  0.0476 (1.0)           1           1
test_checkout_copy-checkout[main]       23.6867 (1.13)     23.6867 (1.13)     23.6867 (1.13)     0.0000 (1.0)      23.6867 (1.13)     0.0000 (1.0)           0;0  0.0422 (0.89)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5316 (1.62)     5.5316 (1.62)     5.5316 (1.62)     0.0000 (1.0)      5.5316 (1.62)     0.0000 (1.0)           0;0  0.1808 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7406 (1.68)     5.7406 (1.68)     5.7406 (1.68)     0.0000 (1.0)      5.7406 (1.68)     0.0000 (1.0)           0;0  0.1742 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6568 (1.65)     5.6568 (1.65)     5.6568 (1.65)     0.0000 (1.0)      5.6568 (1.65)     0.0000 (1.0)           0;0  0.1768 (0.61)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.4577 (1.01)     3.4577 (1.01)     3.4577 (1.01)     0.0000 (1.0)      3.4577 (1.01)     0.0000 (1.0)           0;0  0.2892 (0.99)          1           1
test_checkout_copy-checkout-noop[main]       3.4241 (1.0)      3.4241 (1.0)      3.4241 (1.0)      0.0000 (1.0)      3.4241 (1.0)      0.0000 (1.0)           0;0  0.2920 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.7029 (2.08)     8.7029 (2.08)     8.7029 (2.08)     0.0000 (1.0)      8.7029 (2.08)     0.0000 (1.0)           0;0  0.1149 (0.48)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5100 (1.56)     6.5100 (1.56)     6.5100 (1.56)     0.0000 (1.0)      6.5100 (1.56)     0.0000 (1.0)           0;0  0.1536 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4159 (1.53)     6.4159 (1.53)     6.4159 (1.53)     0.0000 (1.0)      6.4159 (1.53)     0.0000 (1.0)           0;0  0.1559 (0.65)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.1806 (1.0)      4.1806 (1.0)      4.1806 (1.0)      0.0000 (1.0)      4.1806 (1.0)      0.0000 (1.0)           0;0  0.2392 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.1956 (1.00)     4.1956 (1.00)     4.1956 (1.00)     0.0000 (1.0)      4.1956 (1.00)     0.0000 (1.0)           0;0  0.2383 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.0207 (3.05)     22.0207 (3.05)     22.0207 (3.05)     0.0000 (1.0)      22.0207 (3.05)     0.0000 (1.0)           0;0  0.0454 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7562 (2.18)     15.7562 (2.18)     15.7562 (2.18)     0.0000 (1.0)      15.7562 (2.18)     0.0000 (1.0)           0;0  0.0635 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.2278 (1.97)     14.2278 (1.97)     14.2278 (1.97)     0.0000 (1.0)      14.2278 (1.97)     0.0000 (1.0)           0;0  0.0703 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2275 (1.0)       7.2275 (1.0)       7.2275 (1.0)      0.0000 (1.0)       7.2275 (1.0)      0.0000 (1.0)           0;0  0.1384 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.9273 (1.10)      7.9273 (1.10)      7.9273 (1.10)     0.0000 (1.0)       7.9273 (1.10)     0.0000 (1.0)           0;0  0.1261 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3680 (1.61)     5.3680 (1.61)     5.3680 (1.61)     0.0000 (1.0)      5.3680 (1.61)     0.0000 (1.0)           0;0  0.1863 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6467 (1.70)     5.6467 (1.70)     5.6467 (1.70)     0.0000 (1.0)      5.6467 (1.70)     0.0000 (1.0)           0;0  0.1771 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4388 (1.64)     5.4388 (1.64)     5.4388 (1.64)     0.0000 (1.0)      5.4388 (1.64)     0.0000 (1.0)           0;0  0.1839 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3251 (1.0)      3.3251 (1.0)      3.3251 (1.0)      0.0000 (1.0)      3.3251 (1.0)      0.0000 (1.0)           0;0  0.3007 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3296 (1.00)     3.3296 (1.00)     3.3296 (1.00)     0.0000 (1.0)      3.3296 (1.00)     0.0000 (1.0)           0;0  0.3003 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7505 (2.23)     8.7505 (2.23)     8.7505 (2.23)     0.0000 (1.0)      8.7505 (2.23)     0.0000 (1.0)           0;0  0.1143 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3404 (1.61)     6.3404 (1.61)     6.3404 (1.61)     0.0000 (1.0)      6.3404 (1.61)     0.0000 (1.0)           0;0  0.1577 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3382 (1.61)     6.3382 (1.61)     6.3382 (1.61)     0.0000 (1.0)      6.3382 (1.61)     0.0000 (1.0)           0;0  0.1578 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9283 (1.0)      3.9283 (1.0)      3.9283 (1.0)      0.0000 (1.0)      3.9283 (1.0)      0.0000 (1.0)           0;0  0.2546 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.9610 (1.01)     3.9610 (1.01)     3.9610 (1.01)     0.0000 (1.0)      3.9610 (1.01)     0.0000 (1.0)           0;0  0.2525 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.6628 (2.59)     25.6628 (2.59)     25.6628 (2.59)     0.0000 (1.0)      25.6628 (2.59)     0.0000 (1.0)           0;0  0.0390 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     19.6099 (1.98)     19.6099 (1.98)     19.6099 (1.98)     0.0000 (1.0)      19.6099 (1.98)     0.0000 (1.0)           0;0  0.0510 (0.50)          1           1
test_checkout_symlink-checkout[3.53.2]     17.7828 (1.80)     17.7828 (1.80)     17.7828 (1.80)     0.0000 (1.0)      17.7828 (1.80)     0.0000 (1.0)           0;0  0.0562 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]      9.8987 (1.0)       9.8987 (1.0)       9.8987 (1.0)      0.0000 (1.0)       9.8987 (1.0)      0.0000 (1.0)           0;0  0.1010 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.7476 (1.09)     10.7476 (1.09)     10.7476 (1.09)     0.0000 (1.0)      10.7476 (1.09)     0.0000 (1.0)           0;0  0.0930 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8685 (1.60)     6.8685 (1.60)     6.8685 (1.60)     0.0000 (1.0)      6.8685 (1.60)     0.0000 (1.0)           0;0  0.1456 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8619 (1.60)     6.8619 (1.60)     6.8619 (1.60)     0.0000 (1.0)      6.8619 (1.60)     0.0000 (1.0)           0;0  0.1457 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6904 (1.56)     6.6904 (1.56)     6.6904 (1.56)     0.0000 (1.0)      6.6904 (1.56)     0.0000 (1.0)           0;0  0.1495 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2855 (1.0)      4.2855 (1.0)      4.2855 (1.0)      0.0000 (1.0)      4.2855 (1.0)      0.0000 (1.0)           0;0  0.2333 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4069 (1.03)     4.4069 (1.03)     4.4069 (1.03)     0.0000 (1.0)      4.4069 (1.03)     0.0000 (1.0)           0;0  0.2269 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.0471 (1.89)     11.0471 (1.89)     11.0471 (1.89)     0.0000 (1.0)      11.0471 (1.89)     0.0000 (1.0)           0;0  0.0905 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7954 (1.51)      8.7954 (1.51)      8.7954 (1.51)     0.0000 (1.0)       8.7954 (1.51)     0.0000 (1.0)           0;0  0.1137 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.4941 (1.46)      8.4941 (1.46)      8.4941 (1.46)     0.0000 (1.0)       8.4941 (1.46)     0.0000 (1.0)           0;0  0.1177 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.8314 (1.0)       5.8314 (1.0)       5.8314 (1.0)      0.0000 (1.0)       5.8314 (1.0)      0.0000 (1.0)           0;0  0.1715 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.8824 (1.01)      5.8824 (1.01)      5.8824 (1.01)     0.0000 (1.0)       5.8824 (1.01)     0.0000 (1.0)           0;0  0.1700 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1579 (1.77)     4.1579 (1.77)     4.1579 (1.77)     0.0000 (1.0)      4.1579 (1.77)     0.0000 (1.0)           0;0  0.2405 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.6428 (1.97)     4.6428 (1.97)     4.6428 (1.97)     0.0000 (1.0)      4.6428 (1.97)     0.0000 (1.0)           0;0  0.2154 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.5392 (1.93)     4.5392 (1.93)     4.5392 (1.93)     0.0000 (1.0)      4.5392 (1.93)     0.0000 (1.0)           0;0  0.2203 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.3539 (1.0)      2.3539 (1.0)      2.3539 (1.0)      0.0000 (1.0)      2.3539 (1.0)      0.0000 (1.0)           0;0  0.4248 (1.0)           1           1
test_data_status-data-changed[main]       2.3686 (1.01)     2.3686 (1.01)     2.3686 (1.01)     0.0000 (1.0)      2.3686 (1.01)     0.0000 (1.0)           0;0  0.4222 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2206 (1.81)     4.2206 (1.81)     4.2206 (1.81)     0.0000 (1.0)      4.2206 (1.81)     0.0000 (1.0)           0;0  0.2369 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9075 (2.10)     4.9075 (2.10)     4.9075 (2.10)     0.0000 (1.0)      4.9075 (2.10)     0.0000 (1.0)           0;0  0.2038 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6810 (2.00)     4.6810 (2.00)     4.6810 (2.00)     0.0000 (1.0)      4.6810 (2.00)     0.0000 (1.0)           0;0  0.2136 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3378 (1.0)      2.3378 (1.0)      2.3378 (1.0)      0.0000 (1.0)      2.3378 (1.0)      0.0000 (1.0)           0;0  0.4277 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.4500 (1.05)     2.4500 (1.05)     2.4500 (1.05)     0.0000 (1.0)      2.4500 (1.05)     0.0000 (1.0)           0;0  0.4082 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5186 (3.71)     18.5186 (3.71)     18.5186 (3.71)     0.0000 (1.0)      18.5186 (3.71)     0.0000 (1.0)           0;0  0.0540 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.3374 (3.88)     19.3374 (3.88)     19.3374 (3.88)     0.0000 (1.0)      19.3374 (3.88)     0.0000 (1.0)           0;0  0.0517 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.0157 (3.81)     19.0157 (3.81)     19.0157 (3.81)     0.0000 (1.0)      19.0157 (3.81)     0.0000 (1.0)           0;0  0.0526 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9865 (1.0)       4.9865 (1.0)       4.9865 (1.0)      0.0000 (1.0)       4.9865 (1.0)      0.0000 (1.0)           0;0  0.2005 (1.0)           1           1
test_data_status-data-new[main]        5.1309 (1.03)      5.1309 (1.03)      5.1309 (1.03)     0.0000 (1.0)       5.1309 (1.03)     0.0000 (1.0)           0;0  0.1949 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1365 (1.78)     4.1365 (1.78)     4.1365 (1.78)     0.0000 (1.0)      4.1365 (1.78)     0.0000 (1.0)           0;0  0.2417 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.8630 (2.09)     4.8630 (2.09)     4.8630 (2.09)     0.0000 (1.0)      4.8630 (2.09)     0.0000 (1.0)           0;0  0.2056 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6866 (2.01)     4.6866 (2.01)     4.6866 (2.01)     0.0000 (1.0)      4.6866 (2.01)     0.0000 (1.0)           0;0  0.2134 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.3277 (1.0)      2.3277 (1.0)      2.3277 (1.0)      0.0000 (1.0)      2.3277 (1.0)      0.0000 (1.0)           0;0  0.4296 (1.0)           1           1
test_data_status-data-noop[main]       2.4307 (1.04)     2.4307 (1.04)     2.4307 (1.04)     0.0000 (1.0)      2.4307 (1.04)     0.0000 (1.0)           0;0  0.4114 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1859 (1.29)     7.1859 (1.29)     7.1859 (1.29)     0.0000 (1.0)      7.1859 (1.29)     0.0000 (1.0)           0;0  0.1392 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8771 (1.41)     7.8771 (1.41)     7.8771 (1.41)     0.0000 (1.0)      7.8771 (1.41)     0.0000 (1.0)           0;0  0.1270 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8200 (1.40)     7.8200 (1.40)     7.8200 (1.40)     0.0000 (1.0)      7.8200 (1.40)     0.0000 (1.0)           0;0  0.1279 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6170 (1.01)     5.6170 (1.01)     5.6170 (1.01)     0.0000 (1.0)      5.6170 (1.01)     0.0000 (1.0)           0;0  0.1780 (0.99)          1           1
test_data_status_all_flags-data-changed[main]       5.5730 (1.0)      5.5730 (1.0)      5.5730 (1.0)      0.0000 (1.0)      5.5730 (1.0)      0.0000 (1.0)           0;0  0.1794 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2100 (1.31)     7.2100 (1.31)     7.2100 (1.31)     0.0000 (1.0)      7.2100 (1.31)     0.0000 (1.0)           0;0  0.1387 (0.77)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9057 (1.43)     7.9057 (1.43)     7.9057 (1.43)     0.0000 (1.0)      7.9057 (1.43)     0.0000 (1.0)           0;0  0.1265 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7529 (1.40)     7.7529 (1.40)     7.7529 (1.40)     0.0000 (1.0)      7.7529 (1.40)     0.0000 (1.0)           0;0  0.1290 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6012 (1.01)     5.6012 (1.01)     5.6012 (1.01)     0.0000 (1.0)      5.6012 (1.01)     0.0000 (1.0)           0;0  0.1785 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.5196 (1.0)      5.5196 (1.0)      5.5196 (1.0)      0.0000 (1.0)      5.5196 (1.0)      0.0000 (1.0)           0;0  0.1812 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.5352 (2.70)     21.5352 (2.70)     21.5352 (2.70)     0.0000 (1.0)      21.5352 (2.70)     0.0000 (1.0)           0;0  0.0464 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.4983 (2.83)     22.4983 (2.83)     22.4983 (2.83)     0.0000 (1.0)      22.4983 (2.83)     0.0000 (1.0)           0;0  0.0444 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.2909 (2.80)     22.2909 (2.80)     22.2909 (2.80)     0.0000 (1.0)      22.2909 (2.80)     0.0000 (1.0)           0;0  0.0449 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9630 (1.0)       7.9630 (1.0)       7.9630 (1.0)      0.0000 (1.0)       7.9630 (1.0)      0.0000 (1.0)           0;0  0.1256 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1283 (1.02)      8.1283 (1.02)      8.1283 (1.02)     0.0000 (1.0)       8.1283 (1.02)     0.0000 (1.0)           0;0  0.1230 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5705 (1.36)     6.5705 (1.36)     6.5705 (1.36)     0.0000 (1.0)      6.5705 (1.36)     0.0000 (1.0)           0;0  0.1522 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1866 (1.49)     7.1866 (1.49)     7.1866 (1.49)     0.0000 (1.0)      7.1866 (1.49)     0.0000 (1.0)           0;0  0.1391 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0360 (1.46)     7.0360 (1.46)     7.0360 (1.46)     0.0000 (1.0)      7.0360 (1.46)     0.0000 (1.0)           0;0  0.1421 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8141 (1.0)      4.8141 (1.0)      4.8141 (1.0)      0.0000 (1.0)      4.8141 (1.0)      0.0000 (1.0)           0;0  0.2077 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.9020 (1.02)     4.9020 (1.02)     4.9020 (1.02)     0.0000 (1.0)      4.9020 (1.02)     0.0000 (1.0)           0;0  0.2040 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.5927 (2.58)     17.5927 (2.58)     17.5927 (2.58)     0.0000 (1.0)      17.5927 (2.58)     0.0000 (1.0)           0;0  0.0568 (0.39)          1           1
test_diff-diff[3.10.0]     18.6946 (2.74)     18.6946 (2.74)     18.6946 (2.74)     0.0000 (1.0)      18.6946 (2.74)     0.0000 (1.0)           0;0  0.0535 (0.37)          1           1
test_diff-diff[3.53.2]     18.8499 (2.76)     18.8499 (2.76)     18.8499 (2.76)     0.0000 (1.0)      18.8499 (2.76)     0.0000 (1.0)           0;0  0.0531 (0.36)          1           1
test_diff-diff[3.60.1]      6.8258 (1.0)       6.8258 (1.0)       6.8258 (1.0)      0.0000 (1.0)       6.8258 (1.0)      0.0000 (1.0)           0;0  0.1465 (1.0)           1           1
test_diff-diff[main]        7.5485 (1.11)      7.5485 (1.11)      7.5485 (1.11)     0.0000 (1.0)       7.5485 (1.11)     0.0000 (1.0)           0;0  0.1325 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9412 (1.81)     5.9412 (1.81)     5.9412 (1.81)     0.0000 (1.0)      5.9412 (1.81)     0.0000 (1.0)           0;0  0.1683 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.6150 (2.01)     6.6150 (2.01)     6.6150 (2.01)     0.0000 (1.0)      6.6150 (2.01)     0.0000 (1.0)           0;0  0.1512 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.5409 (1.69)     5.5409 (1.69)     5.5409 (1.69)     0.0000 (1.0)      5.5409 (1.69)     0.0000 (1.0)           0;0  0.1805 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.2883 (1.0)      3.2883 (1.0)      3.2883 (1.0)      0.0000 (1.0)      3.2883 (1.0)      0.0000 (1.0)           0;0  0.3041 (1.0)           1           1
test_diff-diff-changed[main]       3.9188 (1.19)     3.9188 (1.19)     3.9188 (1.19)     0.0000 (1.0)      3.9188 (1.19)     0.0000 (1.0)           0;0  0.2552 (0.84)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1049 (1.55)     5.1049 (1.55)     5.1049 (1.55)     0.0000 (1.0)      5.1049 (1.55)     0.0000 (1.0)           0;0  0.1959 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7313 (1.74)     5.7313 (1.74)     5.7313 (1.74)     0.0000 (1.0)      5.7313 (1.74)     0.0000 (1.0)           0;0  0.1745 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5064 (1.67)     5.5064 (1.67)     5.5064 (1.67)     0.0000 (1.0)      5.5064 (1.67)     0.0000 (1.0)           0;0  0.1816 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2885 (1.0)      3.2885 (1.0)      3.2885 (1.0)      0.0000 (1.0)      3.2885 (1.0)      0.0000 (1.0)           0;0  0.3041 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.8315 (1.17)     3.8315 (1.17)     3.8315 (1.17)     0.0000 (1.0)      3.8315 (1.17)     0.0000 (1.0)           0;0  0.2610 (0.86)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0093 (1.22)     4.0093 (1.22)     4.0093 (1.22)     0.0000 (1.0)      4.0093 (1.22)     0.0000 (1.0)           0;0  0.2494 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.7299 (1.44)     4.7299 (1.44)     4.7299 (1.44)     0.0000 (1.0)      4.7299 (1.44)     0.0000 (1.0)           0;0  0.2114 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.4896 (1.67)     5.4896 (1.67)     5.4896 (1.67)     0.0000 (1.0)      5.4896 (1.67)     0.0000 (1.0)           0;0  0.1822 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.2912 (1.0)      3.2912 (1.0)      3.2912 (1.0)      0.0000 (1.0)      3.2912 (1.0)      0.0000 (1.0)           0;0  0.3038 (1.0)           1           1
test_diff-diff-noop[main]       3.9135 (1.19)     3.9135 (1.19)     3.9135 (1.19)     0.0000 (1.0)      3.9135 (1.19)     0.0000 (1.0)           0;0  0.2555 (0.84)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        985.2078 (1.0)         985.2078 (1.0)         985.2078 (1.0)      0.0000 (1.0)         985.2078 (1.0)      0.0000 (1.0)           0;0  1.0150 (1.0)           1           1
test_exp_show-exp[3.10.0]     14,637.3765 (14.86)    14,637.3765 (14.86)    14,637.3765 (14.86)    0.0000 (1.0)      14,637.3765 (14.86)    0.0000 (1.0)           0;0  0.0683 (0.07)          1           1
test_exp_show-exp[3.53.2]      8,203.8632 (8.33)      8,203.8632 (8.33)      8,203.8632 (8.33)     0.0000 (1.0)       8,203.8632 (8.33)     0.0000 (1.0)           0;0  0.1219 (0.12)          1           1
test_exp_show-exp[3.60.1]      8,090.3045 (8.21)      8,090.3045 (8.21)      8,090.3045 (8.21)     0.0000 (1.0)       8,090.3045 (8.21)     0.0000 (1.0)           0;0  0.1236 (0.12)          1           1
test_exp_show-exp[main]       11,726.8670 (11.90)    11,726.8670 (11.90)    11,726.8670 (11.90)    0.0000 (1.0)      11,726.8670 (11.90)    0.0000 (1.0)           0;0  0.0853 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.0053 (2.86)     66.0053 (2.86)     66.0053 (2.86)     0.0000 (1.0)      66.0053 (2.86)     0.0000 (1.0)           0;0  0.0152 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.8619 (3.11)     71.8619 (3.11)     71.8619 (3.11)     0.0000 (1.0)      71.8619 (3.11)     0.0000 (1.0)           0;0  0.0139 (0.32)          1           1
test_fetch-fetch[3.53.2]     33.3879 (1.45)     33.3879 (1.45)     33.3879 (1.45)     0.0000 (1.0)      33.3879 (1.45)     0.0000 (1.0)           0;0  0.0300 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.6044 (1.02)     23.6044 (1.02)     23.6044 (1.02)     0.0000 (1.0)      23.6044 (1.02)     0.0000 (1.0)           0;0  0.0424 (0.98)          1           1
test_fetch-fetch[main]       23.0945 (1.0)      23.0945 (1.0)      23.0945 (1.0)      0.0000 (1.0)      23.0945 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7977 (1.0)      2.7977 (1.0)      2.7977 (1.0)      0.0000 (1.0)      2.7977 (1.0)      0.0000 (1.0)           0;0  0.3574 (1.0)           1           1
test_gc-gc[3.10.0]     2.8933 (1.03)     2.8933 (1.03)     2.8933 (1.03)     0.0000 (1.0)      2.8933 (1.03)     0.0000 (1.0)           0;0  0.3456 (0.97)          1           1
test_gc-gc[3.53.2]     2.8473 (1.02)     2.8473 (1.02)     2.8473 (1.02)     0.0000 (1.0)      2.8473 (1.02)     0.0000 (1.0)           0;0  0.3512 (0.98)          1           1
test_gc-gc[3.60.1]     2.8069 (1.00)     2.8069 (1.00)     2.8069 (1.00)     0.0000 (1.0)      2.8069 (1.00)     0.0000 (1.0)           0;0  0.3563 (1.00)          1           1
test_gc-gc[main]       3.0362 (1.09)     3.0362 (1.09)     3.0362 (1.09)     0.0000 (1.0)      3.0362 (1.09)     0.0000 (1.0)           0;0  0.3294 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     144.9117 (2.83)     144.9117 (2.83)     144.9117 (2.83)     0.0000 (1.0)      144.9117 (2.83)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[3.10.0]     175.0465 (3.41)     175.0465 (3.41)     175.0465 (3.41)     0.0000 (1.0)      175.0465 (3.41)     0.0000 (1.0)           0;0  0.0057 (0.29)          1           1
test_get-get[3.53.2]     152.5357 (2.97)     152.5357 (2.97)     152.5357 (2.97)     0.0000 (1.0)      152.5357 (2.97)     0.0000 (1.0)           0;0  0.0066 (0.34)          1           1
test_get-get[3.60.1]      51.2858 (1.0)       51.2858 (1.0)       51.2858 (1.0)      0.0000 (1.0)       51.2858 (1.0)      0.0000 (1.0)           0;0  0.0195 (1.0)           1           1
test_get-get[main]        51.3570 (1.00)      51.3570 (1.00)      51.3570 (1.00)     0.0000 (1.0)       51.3570 (1.00)     0.0000 (1.0)           0;0  0.0195 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.2842 (2.63)     44.2842 (2.63)     44.2842 (2.63)     0.0000 (1.0)      44.2842 (2.63)     0.0000 (1.0)           0;0  0.0226 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.6245 (2.82)     47.6245 (2.82)     47.6245 (2.82)     0.0000 (1.0)      47.6245 (2.82)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.9250 (1.00)     16.9250 (1.00)     16.9250 (1.00)     0.0000 (1.0)      16.9250 (1.00)     0.0000 (1.0)           0;0  0.0591 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.8604 (1.0)      16.8604 (1.0)      16.8604 (1.0)      0.0000 (1.0)      16.8604 (1.0)      0.0000 (1.0)           0;0  0.0593 (1.0)           1           1
test_get_url-get-url[main]       16.9097 (1.00)     16.9097 (1.00)     16.9097 (1.00)     0.0000 (1.0)      16.9097 (1.00)     0.0000 (1.0)           0;0  0.0591 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.0143 (1.01)     127.4434 (1.01)     124.4920 (1.01)     0.7769 (1.36)     124.4872 (1.01)     0.8474 (1.05)         27;4  8.0326 (0.99)        100           1
test_help---help[3.10.0]     121.4237 (1.0)      128.2369 (1.02)     123.2766 (1.0)      0.9432 (1.66)     123.1112 (1.0)      0.8083 (1.0)          18;7  8.1118 (1.0)         100           1
test_help---help[3.53.2]     122.8289 (1.01)     130.1647 (1.03)     124.2362 (1.01)     1.1265 (1.98)     124.0126 (1.01)     0.8456 (1.05)         11;5  8.0492 (0.99)        100           1
test_help---help[3.60.1]     123.6136 (1.02)     126.1875 (1.0)      124.6549 (1.01)     0.5698 (1.0)      124.6331 (1.01)     0.8386 (1.04)         32;0  8.0221 (0.99)        100           1
test_help---help[main]       124.2660 (1.02)     158.5055 (1.26)     126.9545 (1.03)     4.9339 (8.66)     125.8530 (1.02)     1.0415 (1.29)         7;11  7.8768 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     224.0318 (2.89)     224.0318 (2.89)     224.0318 (2.89)     0.0000 (1.0)      224.0318 (2.89)     0.0000 (1.0)           0;0  0.0045 (0.35)          1           1
test_import-import[3.10.0]     256.9286 (3.32)     256.9286 (3.32)     256.9286 (3.32)     0.0000 (1.0)      256.9286 (3.32)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      77.4616 (1.0)       77.4616 (1.0)       77.4616 (1.0)      0.0000 (1.0)       77.4616 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
test_import-import[main]        77.8603 (1.01)      77.8603 (1.01)      77.8603 (1.01)     0.0000 (1.0)       77.8603 (1.01)     0.0000 (1.0)           0;0  0.0128 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     155.6780 (3.32)     155.6780 (3.32)     155.6780 (3.32)     0.0000 (1.0)      155.6780 (3.32)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     159.2647 (3.40)     159.2647 (3.40)     159.2647 (3.40)     0.0000 (1.0)      159.2647 (3.40)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     118.0556 (2.52)     118.0556 (2.52)     118.0556 (2.52)     0.0000 (1.0)      118.0556 (2.52)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_import_url-import-url[3.60.1]      47.1118 (1.00)      47.1118 (1.00)      47.1118 (1.00)     0.0000 (1.0)       47.1118 (1.00)     0.0000 (1.0)           0;0  0.0212 (1.00)          1           1
test_import_url-import-url[main]        46.8945 (1.0)       46.8945 (1.0)       46.8945 (1.0)      0.0000 (1.0)       46.8945 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     399.9207 (1.00)     457.6439 (1.03)     425.5606 (1.01)     11.4804 (1.52)     424.2279 (1.01)     15.3427 (1.47)         32;1  2.3498 (0.99)        100           1
test_init-init[3.10.0]     421.1754 (1.06)     494.8810 (1.11)     449.1111 (1.07)     10.8888 (1.44)     449.1480 (1.07)     12.9595 (1.24)         24;3  2.2266 (0.93)        100           1
test_init-init[3.53.2]     402.0095 (1.01)     444.3109 (1.0)      419.8246 (1.0)       7.5520 (1.0)      420.1041 (1.01)     10.4717 (1.0)          27;1  2.3819 (1.0)         100           1
test_init-init[3.60.1]     399.0822 (1.0)      446.9698 (1.01)     419.8904 (1.00)      9.7428 (1.29)     418.0029 (1.0)      14.7905 (1.41)         29;0  2.3816 (1.00)        100           1
test_init-init[main]       435.8357 (1.09)     635.7836 (1.43)     464.0488 (1.11)     23.6085 (3.13)     460.8719 (1.10)     15.8409 (1.51)         10;5  2.1549 (0.90)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     595.5883 (1.13)     595.5883 (1.13)     595.5883 (1.13)     0.0000 (1.0)      595.5883 (1.13)     0.0000 (1.0)           0;0  1.6790 (0.89)          1           1
test_list-list[3.10.0]     690.4059 (1.31)     690.4059 (1.31)     690.4059 (1.31)     0.0000 (1.0)      690.4059 (1.31)     0.0000 (1.0)           0;0  1.4484 (0.77)          1           1
test_list-list[3.53.2]     564.8370 (1.07)     564.8370 (1.07)     564.8370 (1.07)     0.0000 (1.0)      564.8370 (1.07)     0.0000 (1.0)           0;0  1.7704 (0.94)          1           1
test_list-list[3.60.1]     528.8160 (1.0)      528.8160 (1.0)      528.8160 (1.0)      0.0000 (1.0)      528.8160 (1.0)      0.0000 (1.0)           0;0  1.8910 (1.0)           1           1
test_list-list[main]       575.9551 (1.09)     575.9551 (1.09)     575.9551 (1.09)     0.0000 (1.0)      575.9551 (1.09)     0.0000 (1.0)           0;0  1.7362 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     422.5791 (1.07)     422.5791 (1.07)     422.5791 (1.07)     0.0000 (1.0)      422.5791 (1.07)     0.0000 (1.0)           0;0  2.3664 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     415.9971 (1.05)     415.9971 (1.05)     415.9971 (1.05)     0.0000 (1.0)      415.9971 (1.05)     0.0000 (1.0)           0;0  2.4039 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     395.0197 (1.0)      395.0197 (1.0)      395.0197 (1.0)      0.0000 (1.0)      395.0197 (1.0)      0.0000 (1.0)           0;0  2.5315 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     396.7464 (1.00)     396.7464 (1.00)     396.7464 (1.00)     0.0000 (1.0)      396.7464 (1.00)     0.0000 (1.0)           0;0  2.5205 (1.00)          1           1
test_list-list-dvc-only[main]       424.4738 (1.07)     424.4738 (1.07)     424.4738 (1.07)     0.0000 (1.0)      424.4738 (1.07)     0.0000 (1.0)           0;0  2.3559 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6963 (1.0)      2.6963 (1.0)      2.6963 (1.0)      0.0000 (1.0)      2.6963 (1.0)      0.0000 (1.0)           0;0  0.3709 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7869 (1.03)     2.7869 (1.03)     2.7869 (1.03)     0.0000 (1.0)      2.7869 (1.03)     0.0000 (1.0)           0;0  0.3588 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.7925 (1.04)     2.7925 (1.04)     2.7925 (1.04)     0.0000 (1.0)      2.7925 (1.04)     0.0000 (1.0)           0;0  0.3581 (0.97)          1           1
test_list-list-recursive[3.60.1]     2.8084 (1.04)     2.8084 (1.04)     2.8084 (1.04)     0.0000 (1.0)      2.8084 (1.04)     0.0000 (1.0)           0;0  0.3561 (0.96)          1           1
test_list-list-recursive[main]       2.8048 (1.04)     2.8048 (1.04)     2.8048 (1.04)     0.0000 (1.0)      2.8048 (1.04)     0.0000 (1.0)           0;0  0.3565 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     413.3424 (1.05)     413.3424 (1.05)     413.3424 (1.05)     0.0000 (1.0)      413.3424 (1.05)     0.0000 (1.0)           0;0  2.4193 (0.95)          1           1
test_list-list-shallow[3.10.0]     430.0218 (1.09)     430.0218 (1.09)     430.0218 (1.09)     0.0000 (1.0)      430.0218 (1.09)     0.0000 (1.0)           0;0  2.3255 (0.91)          1           1
test_list-list-shallow[3.53.2]     395.7496 (1.01)     395.7496 (1.01)     395.7496 (1.01)     0.0000 (1.0)      395.7496 (1.01)     0.0000 (1.0)           0;0  2.5269 (0.99)          1           1
test_list-list-shallow[3.60.1]     398.7215 (1.01)     398.7215 (1.01)     398.7215 (1.01)     0.0000 (1.0)      398.7215 (1.01)     0.0000 (1.0)           0;0  2.5080 (0.99)          1           1
test_list-list-shallow[main]       393.1374 (1.0)      393.1374 (1.0)      393.1374 (1.0)      0.0000 (1.0)      393.1374 (1.0)      0.0000 (1.0)           0;0  2.5436 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     73.6189 (3.72)     73.6189 (3.72)     73.6189 (3.72)     0.0000 (1.0)      73.6189 (3.72)     0.0000 (1.0)           0;0  0.0136 (0.27)          1           1
test_partial_add-add[3.10.0]     73.8769 (3.73)     73.8769 (3.73)     73.8769 (3.73)     0.0000 (1.0)      73.8769 (3.73)     0.0000 (1.0)           0;0  0.0135 (0.27)          1           1
test_partial_add-add[3.53.2]     67.5743 (3.41)     67.5743 (3.41)     67.5743 (3.41)     0.0000 (1.0)      67.5743 (3.41)     0.0000 (1.0)           0;0  0.0148 (0.29)          1           1
test_partial_add-add[3.60.1]     19.7909 (1.0)      19.7909 (1.0)      19.7909 (1.0)      0.0000 (1.0)      19.7909 (1.0)      0.0000 (1.0)           0;0  0.0505 (1.0)           1           1
test_partial_add-add[main]       20.5076 (1.04)     20.5076 (1.04)     20.5076 (1.04)     0.0000 (1.0)      20.5076 (1.04)     0.0000 (1.0)           0;0  0.0488 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     62.8743 (8.08)     62.8743 (8.08)     62.8743 (8.08)     0.0000 (1.0)      62.8743 (8.08)     0.0000 (1.0)           0;0  0.0159 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     63.9300 (8.22)     63.9300 (8.22)     63.9300 (8.22)     0.0000 (1.0)      63.9300 (8.22)     0.0000 (1.0)           0;0  0.0156 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     56.6386 (7.28)     56.6386 (7.28)     56.6386 (7.28)     0.0000 (1.0)      56.6386 (7.28)     0.0000 (1.0)           0;0  0.0177 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.7809 (1.0)       7.7809 (1.0)       7.7809 (1.0)      0.0000 (1.0)       7.7809 (1.0)      0.0000 (1.0)           0;0  0.1285 (1.0)           1           1
test_partial_add-add-partial[main]        7.8312 (1.01)      7.8312 (1.01)      7.8312 (1.01)     0.0000 (1.0)       7.8312 (1.01)     0.0000 (1.0)           0;0  0.1277 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4533 (1.0)      4.4533 (1.0)      4.4533 (1.0)      0.0000 (1.0)      4.4533 (1.0)      0.0000 (1.0)           0;0  0.2246 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8602 (1.32)     5.8602 (1.32)     5.8602 (1.32)     0.0000 (1.0)      5.8602 (1.32)     0.0000 (1.0)           0;0  0.1706 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7470 (1.52)     6.7470 (1.52)     6.7470 (1.52)     0.0000 (1.0)      6.7470 (1.52)     0.0000 (1.0)           0;0  0.1482 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5908 (1.48)     6.5908 (1.48)     6.5908 (1.48)     0.0000 (1.0)      6.5908 (1.48)     0.0000 (1.0)           0;0  0.1517 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       6.6449 (1.49)     6.6449 (1.49)     6.6449 (1.49)     0.0000 (1.0)      6.6449 (1.49)     0.0000 (1.0)           0;0  0.1505 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4467 (1.0)      2.4467 (1.0)      2.4467 (1.0)      0.0000 (1.0)      2.4467 (1.0)      0.0000 (1.0)           0;0  0.4087 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6697 (1.50)     3.6697 (1.50)     3.6697 (1.50)     0.0000 (1.0)      3.6697 (1.50)     0.0000 (1.0)           0;0  0.2725 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.6853 (1.51)     3.6853 (1.51)     3.6853 (1.51)     0.0000 (1.0)      3.6853 (1.51)     0.0000 (1.0)           0;0  0.2713 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.6728 (1.50)     3.6728 (1.50)     3.6728 (1.50)     0.0000 (1.0)      3.6728 (1.50)     0.0000 (1.0)           0;0  0.2723 (0.67)          1           1
test_partial_add-gc-noop[main]       3.6919 (1.51)     3.6919 (1.51)     3.6919 (1.51)     0.0000 (1.0)      3.6919 (1.51)     0.0000 (1.0)           0;0  0.2709 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.1195 (2.36)     45.1195 (2.36)     45.1195 (2.36)     0.0000 (1.0)      45.1195 (2.36)     0.0000 (1.0)           0;0  0.0222 (0.42)          1           1
test_partial_add-push[3.10.0]     40.2263 (2.11)     40.2263 (2.11)     40.2263 (2.11)     0.0000 (1.0)      40.2263 (2.11)     0.0000 (1.0)           0;0  0.0249 (0.47)          1           1
test_partial_add-push[3.53.2]     19.7896 (1.04)     19.7896 (1.04)     19.7896 (1.04)     0.0000 (1.0)      19.7896 (1.04)     0.0000 (1.0)           0;0  0.0505 (0.97)          1           1
test_partial_add-push[3.60.1]     19.3322 (1.01)     19.3322 (1.01)     19.3322 (1.01)     0.0000 (1.0)      19.3322 (1.01)     0.0000 (1.0)           0;0  0.0517 (0.99)          1           1
test_partial_add-push[main]       19.1038 (1.0)      19.1038 (1.0)      19.1038 (1.0)      0.0000 (1.0)      19.1038 (1.0)      0.0000 (1.0)           0;0  0.0523 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.4819 (1.11)     11.4819 (1.11)     11.4819 (1.11)     0.0000 (1.0)      11.4819 (1.11)     0.0000 (1.0)           0;0  0.0871 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.8479 (1.04)     10.8479 (1.04)     10.8479 (1.04)     0.0000 (1.0)      10.8479 (1.04)     0.0000 (1.0)           0;0  0.0922 (0.96)          1           1
test_partial_add-push-partial[3.53.2]     10.5572 (1.02)     10.5572 (1.02)     10.5572 (1.02)     0.0000 (1.0)      10.5572 (1.02)     0.0000 (1.0)           0;0  0.0947 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     10.3818 (1.0)      10.3818 (1.0)      10.3818 (1.0)      0.0000 (1.0)      10.3818 (1.0)      0.0000 (1.0)           0;0  0.0963 (1.0)           1           1
test_partial_add-push-partial[main]       10.3858 (1.00)     10.3858 (1.00)     10.3858 (1.00)     0.0000 (1.0)      10.3858 (1.00)     0.0000 (1.0)           0;0  0.0963 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     82.8041 (3.67)     82.8041 (3.67)     82.8041 (3.67)     0.0000 (1.0)      82.8041 (3.67)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_partial_remove-add[3.10.0]     82.5702 (3.66)     82.5702 (3.66)     82.5702 (3.66)     0.0000 (1.0)      82.5702 (3.66)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_partial_remove-add[3.53.2]     74.2897 (3.29)     74.2897 (3.29)     74.2897 (3.29)     0.0000 (1.0)      74.2897 (3.29)     0.0000 (1.0)           0;0  0.0135 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.5513 (1.0)      22.5513 (1.0)      22.5513 (1.0)      0.0000 (1.0)      22.5513 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_partial_remove-add[main]       23.2667 (1.03)     23.2667 (1.03)     23.2667 (1.03)     0.0000 (1.0)      23.2667 (1.03)     0.0000 (1.0)           0;0  0.0430 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.5024 (8.34)     8.5024 (8.34)     8.5024 (8.34)     0.0000 (1.0)      8.5024 (8.34)     0.0000 (1.0)           0;0  0.1176 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.3686 (8.21)     8.3686 (8.21)     8.3686 (8.21)     0.0000 (1.0)      8.3686 (8.21)     0.0000 (1.0)           0;0  0.1195 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.4924 (7.35)     7.4924 (7.35)     7.4924 (7.35)     0.0000 (1.0)      7.4924 (7.35)     0.0000 (1.0)           0;0  0.1335 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0193 (1.0)      1.0193 (1.0)      1.0193 (1.0)      0.0000 (1.0)      1.0193 (1.0)      0.0000 (1.0)           0;0  0.9811 (1.0)           1           1
test_partial_remove-add-update[main]       1.2050 (1.18)     1.2050 (1.18)     1.2050 (1.18)     0.0000 (1.0)      1.2050 (1.18)     0.0000 (1.0)           0;0  0.8299 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1211 (1.0)      3.1211 (1.0)      3.1211 (1.0)      0.0000 (1.0)      3.1211 (1.0)      0.0000 (1.0)           0;0  0.3204 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.4412 (1.10)     3.4412 (1.10)     3.4412 (1.10)     0.0000 (1.0)      3.4412 (1.10)     0.0000 (1.0)           0;0  0.2906 (0.91)          1           1
test_partial_remove-gc[3.53.2]     3.4840 (1.12)     3.4840 (1.12)     3.4840 (1.12)     0.0000 (1.0)      3.4840 (1.12)     0.0000 (1.0)           0;0  0.2870 (0.90)          1           1
test_partial_remove-gc[3.60.1]     3.8564 (1.24)     3.8564 (1.24)     3.8564 (1.24)     0.0000 (1.0)      3.8564 (1.24)     0.0000 (1.0)           0;0  0.2593 (0.81)          1           1
test_partial_remove-gc[main]       3.5921 (1.15)     3.5921 (1.15)     3.5921 (1.15)     0.0000 (1.0)      3.5921 (1.15)     0.0000 (1.0)           0;0  0.2784 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.5019 (1.0)      4.5019 (1.0)      4.5019 (1.0)      0.0000 (1.0)      4.5019 (1.0)      0.0000 (1.0)           0;0  0.2221 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     4.8312 (1.07)     4.8312 (1.07)     4.8312 (1.07)     0.0000 (1.0)      4.8312 (1.07)     0.0000 (1.0)           0;0  0.2070 (0.93)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.6522 (1.03)     4.6522 (1.03)     4.6522 (1.03)     0.0000 (1.0)      4.6522 (1.03)     0.0000 (1.0)           0;0  0.2150 (0.97)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.6344 (1.03)     4.6344 (1.03)     4.6344 (1.03)     0.0000 (1.0)      4.6344 (1.03)     0.0000 (1.0)           0;0  0.2158 (0.97)          1           1
test_partial_remove-gc-cloud[main]       4.7203 (1.05)     4.7203 (1.05)     4.7203 (1.05)     0.0000 (1.0)      4.7203 (1.05)     0.0000 (1.0)           0;0  0.2119 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.6003 (2.41)     52.6003 (2.41)     52.6003 (2.41)     0.0000 (1.0)      52.6003 (2.41)     0.0000 (1.0)           0;0  0.0190 (0.42)          1           1
test_partial_remove-push[3.10.0]     46.8845 (2.14)     46.8845 (2.14)     46.8845 (2.14)     0.0000 (1.0)      46.8845 (2.14)     0.0000 (1.0)           0;0  0.0213 (0.47)          1           1
test_partial_remove-push[3.53.2]     22.5704 (1.03)     22.5704 (1.03)     22.5704 (1.03)     0.0000 (1.0)      22.5704 (1.03)     0.0000 (1.0)           0;0  0.0443 (0.97)          1           1
test_partial_remove-push[3.60.1]     21.8649 (1.0)      21.8649 (1.0)      21.8649 (1.0)      0.0000 (1.0)      21.8649 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
test_partial_remove-push[main]       22.3992 (1.02)     22.3992 (1.02)     22.3992 (1.02)     0.0000 (1.0)      22.3992 (1.02)     0.0000 (1.0)           0;0  0.0446 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8082 (1.0)      1.8082 (1.0)      1.8082 (1.0)      0.0000 (1.0)      1.8082 (1.0)      0.0000 (1.0)           0;0  0.5530 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8232 (1.01)     1.8232 (1.01)     1.8232 (1.01)     0.0000 (1.0)      1.8232 (1.01)     0.0000 (1.0)           0;0  0.5485 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.3898 (1.32)     2.3898 (1.32)     2.3898 (1.32)     0.0000 (1.0)      2.3898 (1.32)     0.0000 (1.0)           0;0  0.4185 (0.76)          1           1
test_partial_remove-push-update[3.60.1]     2.4410 (1.35)     2.4410 (1.35)     2.4410 (1.35)     0.0000 (1.0)      2.4410 (1.35)     0.0000 (1.0)           0;0  0.4097 (0.74)          1           1
test_partial_remove-push-update[main]       2.4216 (1.34)     2.4216 (1.34)     2.4216 (1.34)     0.0000 (1.0)      2.4216 (1.34)     0.0000 (1.0)           0;0  0.4130 (0.75)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     492.8008 (1.0)      498.2689 (1.0)      495.1797 (1.0)      2.3337 (1.0)      494.0047 (1.0)      3.7607 (1.03)          2;0  2.0195 (1.0)           5           3
test_plots-plots-diff[3.10.0]     887.7673 (1.80)     898.9477 (1.80)     891.1628 (1.80)     4.4499 (1.91)     889.6975 (1.80)     3.6501 (1.0)           1;1  1.1221 (0.56)          5           3
test_plots-plots-diff[3.53.2]     814.9410 (1.65)     824.0149 (1.65)     819.3630 (1.65)     4.1007 (1.76)     820.2457 (1.66)     7.5367 (2.06)          2;0  1.2205 (0.60)          5           3
test_plots-plots-diff[3.60.1]     814.7148 (1.65)     822.2001 (1.65)     817.7216 (1.65)     3.1715 (1.36)     816.7036 (1.65)     5.2249 (1.43)          1;0  1.2229 (0.61)          5           3
test_plots-plots-diff[main]       812.0827 (1.65)     823.1777 (1.65)     816.3435 (1.65)     4.6404 (1.99)     814.5089 (1.65)     7.2278 (1.98)          1;0  1.2250 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       507.2968 (1.0)        534.3012 (1.0)        516.3713 (1.0)      10.6130 (4.89)       513.8838 (1.0)      11.5244 (2.86)          1;0  1.9366 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,122.1167 (2.21)     1,132.6554 (2.12)     1,126.9785 (2.18)      4.1222 (1.90)     1,125.5266 (2.19)      5.9543 (1.48)          2;0  0.8873 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       899.2253 (1.77)       925.9283 (1.73)       911.3794 (1.76)     12.8267 (5.91)       905.0115 (1.76)     23.4552 (5.82)          2;0  1.0972 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       893.8215 (1.76)       898.6318 (1.68)       896.1410 (1.74)      2.1702 (1.0)        895.7915 (1.74)      4.0322 (1.0)           2;0  1.1159 (0.58)          5           3
test_plots-plots-diff-json[main]         894.9054 (1.76)       900.1568 (1.68)       897.1441 (1.74)      2.7337 (1.26)       895.3151 (1.74)      4.9720 (1.23)          2;0  1.1146 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     408.2573 (1.0)      412.2140 (1.0)      411.0534 (1.0)      1.6208 (1.0)      411.4090 (1.0)       1.6578 (1.0)           1;0  2.4328 (1.0)           5           3
test_plots-plots-show[3.10.0]     716.6861 (1.76)     731.0347 (1.77)     724.1632 (1.76)     5.6807 (3.50)     725.5876 (1.76)      8.7391 (5.27)          2;0  1.3809 (0.57)          5           3
test_plots-plots-show[3.53.2]     695.6768 (1.70)     703.4416 (1.71)     698.8341 (1.70)     3.1740 (1.96)     698.9637 (1.70)      4.9102 (2.96)          1;0  1.4310 (0.59)          5           3
test_plots-plots-show[3.60.1]     694.4787 (1.70)     715.8595 (1.74)     703.9493 (1.71)     8.5603 (5.28)     703.4567 (1.71)     13.5223 (8.16)          2;0  1.4206 (0.58)          5           3
test_plots-plots-show[main]       698.9003 (1.71)     708.1633 (1.72)     703.1303 (1.71)     3.7222 (2.30)     703.0121 (1.71)      5.9817 (3.61)          2;0  1.4222 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     424.5166 (1.0)      431.9832 (1.0)      428.2398 (1.0)      2.7565 (1.72)     427.8135 (1.0)      3.4588 (1.72)          2;0  2.3351 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     849.5033 (2.00)     855.4164 (1.98)     852.7852 (1.99)     2.2527 (1.41)     853.5429 (2.00)     2.9877 (1.49)          2;0  1.1726 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     743.8331 (1.75)     755.3540 (1.75)     748.5207 (1.75)     5.0192 (3.14)     746.5766 (1.75)     8.5230 (4.24)          1;0  1.3360 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     745.7781 (1.76)     755.2183 (1.75)     750.3185 (1.75)     3.8057 (2.38)     750.1815 (1.75)     6.2234 (3.10)          2;0  1.3328 (0.57)          5           3
test_plots-plots-show-json[main]       743.5047 (1.75)     747.4318 (1.73)     744.7775 (1.74)     1.6004 (1.0)      744.2568 (1.74)     2.0096 (1.0)           1;0  1.3427 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.6711 (2.38)     51.6711 (2.38)     51.6711 (2.38)     0.0000 (1.0)      51.6711 (2.38)     0.0000 (1.0)           0;0  0.0194 (0.42)          1           1
test_push-push[3.10.0]     46.1299 (2.13)     46.1299 (2.13)     46.1299 (2.13)     0.0000 (1.0)      46.1299 (2.13)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_push-push[3.53.2]     23.1321 (1.07)     23.1321 (1.07)     23.1321 (1.07)     0.0000 (1.0)      23.1321 (1.07)     0.0000 (1.0)           0;0  0.0432 (0.94)          1           1
test_push-push[3.60.1]     21.6981 (1.0)      21.6981 (1.0)      21.6981 (1.0)      0.0000 (1.0)      21.6981 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
test_push-push[main]       21.7376 (1.00)     21.7376 (1.00)     21.7376 (1.00)     0.0000 (1.0)      21.7376 (1.00)     0.0000 (1.0)           0;0  0.0460 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     63.0017 (2.73)     63.0017 (2.73)     63.0017 (2.73)     0.0000 (1.0)      63.0017 (2.73)     0.0000 (1.0)           0;0  0.0159 (0.37)          1           1
test_sharing-fetch[3.10.0]     68.9873 (2.99)     68.9873 (2.99)     68.9873 (2.99)     0.0000 (1.0)      68.9873 (2.99)     0.0000 (1.0)           0;0  0.0145 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.3529 (1.44)     33.3529 (1.44)     33.3529 (1.44)     0.0000 (1.0)      33.3529 (1.44)     0.0000 (1.0)           0;0  0.0300 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.1191 (1.00)     23.1191 (1.00)     23.1191 (1.00)     0.0000 (1.0)      23.1191 (1.00)     0.0000 (1.0)           0;0  0.0433 (1.00)          1           1
test_sharing-fetch[main]       23.1012 (1.0)      23.1012 (1.0)      23.1012 (1.0)      0.0000 (1.0)      23.1012 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.1960 (1.0)      1.1960 (1.0)      1.1960 (1.0)      0.0000 (1.0)      1.1960 (1.0)      0.0000 (1.0)           0;0  0.8361 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5720 (2.99)     3.5720 (2.99)     3.5720 (2.99)     0.0000 (1.0)      3.5720 (2.99)     0.0000 (1.0)           0;0  0.2800 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     5.6132 (4.69)     5.6132 (4.69)     5.6132 (4.69)     0.0000 (1.0)      5.6132 (4.69)     0.0000 (1.0)           0;0  0.1782 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.7498 (4.81)     5.7498 (4.81)     5.7498 (4.81)     0.0000 (1.0)      5.7498 (4.81)     0.0000 (1.0)           0;0  0.1739 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7461 (4.80)     5.7461 (4.80)     5.7461 (4.80)     0.0000 (1.0)      5.7461 (4.80)     0.0000 (1.0)           0;0  0.1740 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.3848 (2.34)     51.3848 (2.34)     51.3848 (2.34)     0.0000 (1.0)      51.3848 (2.34)     0.0000 (1.0)           0;0  0.0195 (0.43)          1           1
test_sharing-push[3.10.0]     46.4641 (2.11)     46.4641 (2.11)     46.4641 (2.11)     0.0000 (1.0)      46.4641 (2.11)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_sharing-push[3.53.2]     22.5793 (1.03)     22.5793 (1.03)     22.5793 (1.03)     0.0000 (1.0)      22.5793 (1.03)     0.0000 (1.0)           0;0  0.0443 (0.97)          1           1
test_sharing-push[3.60.1]     22.1356 (1.01)     22.1356 (1.01)     22.1356 (1.01)     0.0000 (1.0)      22.1356 (1.01)     0.0000 (1.0)           0;0  0.0452 (0.99)          1           1
test_sharing-push[main]       21.9943 (1.0)      21.9943 (1.0)      21.9943 (1.0)      0.0000 (1.0)      21.9943 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0343 (1.00)     2.0343 (1.00)     2.0343 (1.00)     0.0000 (1.0)      2.0343 (1.00)     0.0000 (1.0)           0;0  0.4916 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.0292 (1.0)      2.0292 (1.0)      2.0292 (1.0)      0.0000 (1.0)      2.0292 (1.0)      0.0000 (1.0)           0;0  0.4928 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.7938 (2.86)     5.7938 (2.86)     5.7938 (2.86)     0.0000 (1.0)      5.7938 (2.86)     0.0000 (1.0)           0;0  0.1726 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.9887 (2.95)     5.9887 (2.95)     5.9887 (2.95)     0.0000 (1.0)      5.9887 (2.95)     0.0000 (1.0)           0;0  0.1670 (0.34)          1           1
test_sharing-push-noop[main]       6.1611 (3.04)     6.1611 (3.04)     6.1611 (3.04)     0.0000 (1.0)      6.1611 (3.04)     0.0000 (1.0)           0;0  0.1623 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     214.2098 (1.05)     214.2098 (1.05)     214.2098 (1.05)     0.0000 (1.0)      214.2098 (1.05)     0.0000 (1.0)           0;0  0.0047 (0.96)          1           1
test_sharing_azure-fetch[main]       204.7832 (1.0)      204.7832 (1.0)      204.7832 (1.0)      0.0000 (1.0)      204.7832 (1.0)      0.0000 (1.0)           0;0  0.0049 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4204 (1.0)      6.4204 (1.0)      6.4204 (1.0)      0.0000 (1.0)      6.4204 (1.0)      0.0000 (1.0)           0;0  0.1558 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5502 (1.02)     6.5502 (1.02)     6.5502 (1.02)     0.0000 (1.0)      6.5502 (1.02)     0.0000 (1.0)           0;0  0.1527 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     219.9286 (1.0)      219.9286 (1.0)      219.9286 (1.0)      0.0000 (1.0)      219.9286 (1.0)      0.0000 (1.0)           0;0  0.0045 (1.0)           1           1
test_sharing_azure-push[main]       220.0211 (1.00)     220.0211 (1.00)     220.0211 (1.00)     0.0000 (1.0)      220.0211 (1.00)     0.0000 (1.0)           0;0  0.0045 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.0035 (1.0)      7.0035 (1.0)      7.0035 (1.0)      0.0000 (1.0)      7.0035 (1.0)      0.0000 (1.0)           0;0  0.1428 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.0749 (1.01)     7.0749 (1.01)     7.0749 (1.01)     0.0000 (1.0)      7.0749 (1.01)     0.0000 (1.0)           0;0  0.1413 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     217.9470 (1.02)     217.9470 (1.02)     217.9470 (1.02)     0.0000 (1.0)      217.9470 (1.02)     0.0000 (1.0)           0;0  0.0046 (0.98)          1           1
test_sharing_gs-fetch[main]       213.6809 (1.0)      213.6809 (1.0)      213.6809 (1.0)      0.0000 (1.0)      213.6809 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     13.9193 (1.0)      13.9193 (1.0)      13.9193 (1.0)      0.0000 (1.0)      13.9193 (1.0)      0.0000 (1.0)           0;0  0.0718 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       14.0274 (1.01)     14.0274 (1.01)     14.0274 (1.01)     0.0000 (1.0)      14.0274 (1.01)     0.0000 (1.0)           0;0  0.0713 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     594.0290 (1.01)     594.0290 (1.01)     594.0290 (1.01)     0.0000 (1.0)      594.0290 (1.01)     0.0000 (1.0)           0;0  0.0017 (0.99)          1           1
test_sharing_gs-push[main]       587.6649 (1.0)      587.6649 (1.0)      587.6649 (1.0)      0.0000 (1.0)      587.6649 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.5339 (1.0)      6.5339 (1.0)      6.5339 (1.0)      0.0000 (1.0)      6.5339 (1.0)      0.0000 (1.0)           0;0  0.1530 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.5673 (1.01)     6.5673 (1.01)     6.5673 (1.01)     0.0000 (1.0)      6.5673 (1.01)     0.0000 (1.0)           0;0  0.1523 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     285.4415 (1.09)     285.4415 (1.09)     285.4415 (1.09)     0.0000 (1.0)      285.4415 (1.09)     0.0000 (1.0)           0;0  0.0035 (0.92)          1           1
test_sharing_s3-fetch[main]       262.1547 (1.0)      262.1547 (1.0)      262.1547 (1.0)      0.0000 (1.0)      262.1547 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.3027 (1.0)      6.3027 (1.0)      6.3027 (1.0)      0.0000 (1.0)      6.3027 (1.0)      0.0000 (1.0)           0;0  0.1587 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3928 (1.01)     6.3928 (1.01)     6.3928 (1.01)     0.0000 (1.0)      6.3928 (1.01)     0.0000 (1.0)           0;0  0.1564 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     305.7605 (1.05)     305.7605 (1.05)     305.7605 (1.05)     0.0000 (1.0)      305.7605 (1.05)     0.0000 (1.0)           0;0  0.0033 (0.95)          1           1
test_sharing_s3-push[main]       290.3570 (1.0)      290.3570 (1.0)      290.3570 (1.0)      0.0000 (1.0)      290.3570 (1.0)      0.0000 (1.0)           0;0  0.0034 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.4817 (1.0)      6.4817 (1.0)      6.4817 (1.0)      0.0000 (1.0)      6.4817 (1.0)      0.0000 (1.0)           0;0  0.1543 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.5821 (1.02)     6.5821 (1.02)     6.5821 (1.02)     0.0000 (1.0)      6.5821 (1.02)     0.0000 (1.0)           0;0  0.1519 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.2866 (3.74)     19.2866 (3.74)     19.2866 (3.74)     0.0000 (1.0)      19.2866 (3.74)     0.0000 (1.0)           0;0  0.0518 (0.27)          1           1
test_status-status[3.10.0]     20.0863 (3.90)     20.0863 (3.90)     20.0863 (3.90)     0.0000 (1.0)      20.0863 (3.90)     0.0000 (1.0)           0;0  0.0498 (0.26)          1           1
test_status-status[3.53.2]     17.7467 (3.45)     17.7467 (3.45)     17.7467 (3.45)     0.0000 (1.0)      17.7467 (3.45)     0.0000 (1.0)           0;0  0.0563 (0.29)          1           1
test_status-status[3.60.1]      5.1504 (1.0)       5.1504 (1.0)       5.1504 (1.0)      0.0000 (1.0)       5.1504 (1.0)      0.0000 (1.0)           0;0  0.1942 (1.0)           1           1
test_status-status[main]        5.1620 (1.00)      5.1620 (1.00)      5.1620 (1.00)     0.0000 (1.0)       5.1620 (1.00)     0.0000 (1.0)           0;0  0.1937 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.5809 (1.71)     4.5809 (1.71)     4.5809 (1.71)     0.0000 (1.0)      4.5809 (1.71)     0.0000 (1.0)           0;0  0.2183 (0.58)          1           1
test_status-status-changed[3.10.0]     4.9061 (1.84)     4.9061 (1.84)     4.9061 (1.84)     0.0000 (1.0)      4.9061 (1.84)     0.0000 (1.0)           0;0  0.2038 (0.54)          1           1
test_status-status-changed[3.53.2]     4.8312 (1.81)     4.8312 (1.81)     4.8312 (1.81)     0.0000 (1.0)      4.8312 (1.81)     0.0000 (1.0)           0;0  0.2070 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6717 (1.0)      2.6717 (1.0)      2.6717 (1.0)      0.0000 (1.0)      2.6717 (1.0)      0.0000 (1.0)           0;0  0.3743 (1.0)           1           1
test_status-status-changed[main]       2.7360 (1.02)     2.7360 (1.02)     2.7360 (1.02)     0.0000 (1.0)      2.7360 (1.02)     0.0000 (1.0)           0;0  0.3655 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7803 (1.88)     4.7803 (1.88)     4.7803 (1.88)     0.0000 (1.0)      4.7803 (1.88)     0.0000 (1.0)           0;0  0.2092 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     5.0074 (1.97)     5.0074 (1.97)     5.0074 (1.97)     0.0000 (1.0)      5.0074 (1.97)     0.0000 (1.0)           0;0  0.1997 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     4.8201 (1.89)     4.8201 (1.89)     4.8201 (1.89)     0.0000 (1.0)      4.8201 (1.89)     0.0000 (1.0)           0;0  0.2075 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.5833 (1.02)     2.5833 (1.02)     2.5833 (1.02)     0.0000 (1.0)      2.5833 (1.02)     0.0000 (1.0)           0;0  0.3871 (0.98)          1           1
test_status-status-changed-noop[main]       2.5437 (1.0)      2.5437 (1.0)      2.5437 (1.0)      0.0000 (1.0)      2.5437 (1.0)      0.0000 (1.0)           0;0  0.3931 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8307 (1.90)     4.8307 (1.90)     4.8307 (1.90)     0.0000 (1.0)      4.8307 (1.90)     0.0000 (1.0)           0;0  0.2070 (0.53)          1           1
test_status-status-noop[3.10.0]     4.9191 (1.94)     4.9191 (1.94)     4.9191 (1.94)     0.0000 (1.0)      4.9191 (1.94)     0.0000 (1.0)           0;0  0.2033 (0.52)          1           1
test_status-status-noop[3.53.2]     4.7973 (1.89)     4.7973 (1.89)     4.7973 (1.89)     0.0000 (1.0)      4.7973 (1.89)     0.0000 (1.0)           0;0  0.2085 (0.53)          1           1
test_status-status-noop[3.60.1]     2.5825 (1.02)     2.5825 (1.02)     2.5825 (1.02)     0.0000 (1.0)      2.5825 (1.02)     0.0000 (1.0)           0;0  0.3872 (0.98)          1           1
test_status-status-noop[main]       2.5404 (1.0)      2.5404 (1.0)      2.5404 (1.0)      0.0000 (1.0)      2.5404 (1.0)      0.0000 (1.0)           0;0  0.3936 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     152.9452 (3.30)     152.9452 (3.30)     152.9452 (3.30)     0.0000 (1.0)      152.9452 (3.30)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.10.0]     158.5390 (3.42)     158.5390 (3.42)     158.5390 (3.42)     0.0000 (1.0)      158.5390 (3.42)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.53.2]     116.6632 (2.51)     116.6632 (2.51)     116.6632 (2.51)     0.0000 (1.0)      116.6632 (2.51)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.3991 (1.0)       46.3991 (1.0)       46.3991 (1.0)      0.0000 (1.0)       46.3991 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        46.8015 (1.01)      46.8015 (1.01)      46.8015 (1.01)     0.0000 (1.0)       46.8015 (1.01)     0.0000 (1.0)           0;0  0.0214 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     138.2624 (3.94)     138.2624 (3.94)     138.2624 (3.94)     0.0000 (1.0)      138.2624 (3.94)     0.0000 (1.0)           0;0  0.0072 (0.25)          1           1
test_update-update[3.10.0]     142.4477 (4.06)     142.4477 (4.06)     142.4477 (4.06)     0.0000 (1.0)      142.4477 (4.06)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     108.2245 (3.08)     108.2245 (3.08)     108.2245 (3.08)     0.0000 (1.0)      108.2245 (3.08)     0.0000 (1.0)           0;0  0.0092 (0.32)          1           1
test_update-update[3.60.1]      35.3102 (1.01)      35.3102 (1.01)      35.3102 (1.01)     0.0000 (1.0)       35.3102 (1.01)     0.0000 (1.0)           0;0  0.0283 (0.99)          1           1
test_update-update[main]        35.1212 (1.0)       35.1212 (1.0)       35.1212 (1.0)      0.0000 (1.0)       35.1212 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0686 (2.11)     16.0686 (2.11)     16.0686 (2.11)     0.0000 (1.0)      16.0686 (2.11)     0.0000 (1.0)           0;0  0.0622 (0.47)          1           1
test_update-update-noop[3.10.0]     16.6785 (2.19)     16.6785 (2.19)     16.6785 (2.19)     0.0000 (1.0)      16.6785 (2.19)     0.0000 (1.0)           0;0  0.0600 (0.46)          1           1
test_update-update-noop[3.53.2]     15.7649 (2.07)     15.7649 (2.07)     15.7649 (2.07)     0.0000 (1.0)      15.7649 (2.07)     0.0000 (1.0)           0;0  0.0634 (0.48)          1           1
test_update-update-noop[3.60.1]      7.6380 (1.00)      7.6380 (1.00)      7.6380 (1.00)     0.0000 (1.0)       7.6380 (1.00)     0.0000 (1.0)           0;0  0.1309 (1.00)          1           1
test_update-update-noop[main]        7.6125 (1.0)       7.6125 (1.0)       7.6125 (1.0)      0.0000 (1.0)       7.6125 (1.0)      0.0000 (1.0)           0;0  0.1314 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean