Thu Oct  9 00:58:53 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     83.1082 (3.62)     83.1082 (3.62)     83.1082 (3.62)     0.0000 (1.0)      83.1082 (3.62)     0.0000 (1.0)           0;0  0.0120 (0.28)          1           1
test_add_copy-add[3.10.0]     83.5586 (3.64)     83.5586 (3.64)     83.5586 (3.64)     0.0000 (1.0)      83.5586 (3.64)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_add_copy-add[3.53.2]     75.5910 (3.29)     75.5910 (3.29)     75.5910 (3.29)     0.0000 (1.0)      75.5910 (3.29)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_add_copy-add[3.60.1]     22.9667 (1.0)      22.9667 (1.0)      22.9667 (1.0)      0.0000 (1.0)      22.9667 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_add_copy-add[main]       23.9822 (1.04)     23.9822 (1.04)     23.9822 (1.04)     0.0000 (1.0)      23.9822 (1.04)     0.0000 (1.0)           0;0  0.0417 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.6406 (6.10)     27.6406 (6.10)     27.6406 (6.10)     0.0000 (1.0)      27.6406 (6.10)     0.0000 (1.0)           0;0  0.0362 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     28.0408 (6.18)     28.0408 (6.18)     28.0408 (6.18)     0.0000 (1.0)      28.0408 (6.18)     0.0000 (1.0)           0;0  0.0357 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     26.3424 (5.81)     26.3424 (5.81)     26.3424 (5.81)     0.0000 (1.0)      26.3424 (5.81)     0.0000 (1.0)           0;0  0.0380 (0.17)          1           1
test_add_copy-add-noop[3.60.1]      4.5348 (1.0)       4.5348 (1.0)       4.5348 (1.0)      0.0000 (1.0)       4.5348 (1.0)      0.0000 (1.0)           0;0  0.2205 (1.0)           1           1
test_add_copy-add-noop[main]        4.8497 (1.07)      4.8497 (1.07)      4.8497 (1.07)     0.0000 (1.0)       4.8497 (1.07)     0.0000 (1.0)           0;0  0.2062 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     65.9186 (4.00)     65.9186 (4.00)     65.9186 (4.00)     0.0000 (1.0)      65.9186 (4.00)     0.0000 (1.0)           0;0  0.0152 (0.25)          1           1
test_add_hardlink-add[3.10.0]     67.3424 (4.09)     67.3424 (4.09)     67.3424 (4.09)     0.0000 (1.0)      67.3424 (4.09)     0.0000 (1.0)           0;0  0.0148 (0.24)          1           1
test_add_hardlink-add[3.53.2]     60.6151 (3.68)     60.6151 (3.68)     60.6151 (3.68)     0.0000 (1.0)      60.6151 (3.68)     0.0000 (1.0)           0;0  0.0165 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.4691 (1.0)      16.4691 (1.0)      16.4691 (1.0)      0.0000 (1.0)      16.4691 (1.0)      0.0000 (1.0)           0;0  0.0607 (1.0)           1           1
test_add_hardlink-add[main]       17.9404 (1.09)     17.9404 (1.09)     17.9404 (1.09)     0.0000 (1.0)      17.9404 (1.09)     0.0000 (1.0)           0;0  0.0557 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.7403 (7.25)     33.7403 (7.25)     33.7403 (7.25)     0.0000 (1.0)      33.7403 (7.25)     0.0000 (1.0)           0;0  0.0296 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     34.9412 (7.50)     34.9412 (7.50)     34.9412 (7.50)     0.0000 (1.0)      34.9412 (7.50)     0.0000 (1.0)           0;0  0.0286 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.8326 (6.84)     31.8326 (6.84)     31.8326 (6.84)     0.0000 (1.0)      31.8326 (6.84)     0.0000 (1.0)           0;0  0.0314 (0.15)          1           1
test_add_hardlink-add-noop[3.60.1]      4.6558 (1.0)       4.6558 (1.0)       4.6558 (1.0)      0.0000 (1.0)       4.6558 (1.0)      0.0000 (1.0)           0;0  0.2148 (1.0)           1           1
test_add_hardlink-add-noop[main]        5.1491 (1.11)      5.1491 (1.11)      5.1491 (1.11)     0.0000 (1.0)       5.1491 (1.11)     0.0000 (1.0)           0;0  0.1942 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     68.5427 (1.96)     68.5427 (1.96)     68.5427 (1.96)     0.0000 (1.0)      68.5427 (1.96)     0.0000 (1.0)           0;0  0.0146 (0.51)          1           1
test_add_symlink-add[3.10.0]     69.2878 (1.98)     69.2878 (1.98)     69.2878 (1.98)     0.0000 (1.0)      69.2878 (1.98)     0.0000 (1.0)           0;0  0.0144 (0.51)          1           1
test_add_symlink-add[3.53.2]     64.4305 (1.84)     64.4305 (1.84)     64.4305 (1.84)     0.0000 (1.0)      64.4305 (1.84)     0.0000 (1.0)           0;0  0.0155 (0.54)          1           1
test_add_symlink-add[3.60.1]     35.0113 (1.0)      35.0113 (1.0)      35.0113 (1.0)      0.0000 (1.0)      35.0113 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_add_symlink-add[main]       36.7158 (1.05)     36.7158 (1.05)     36.7158 (1.05)     0.0000 (1.0)      36.7158 (1.05)     0.0000 (1.0)           0;0  0.0272 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.7976 (7.44)     45.7976 (7.44)     45.7976 (7.44)     0.0000 (1.0)      45.7976 (7.44)     0.0000 (1.0)           0;0  0.0218 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     46.4342 (7.54)     46.4342 (7.54)     46.4342 (7.54)     0.0000 (1.0)      46.4342 (7.54)     0.0000 (1.0)           0;0  0.0215 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     45.3606 (7.37)     45.3606 (7.37)     45.3606 (7.37)     0.0000 (1.0)      45.3606 (7.37)     0.0000 (1.0)           0;0  0.0220 (0.14)          1           1
test_add_symlink-add-noop[3.60.1]      6.1568 (1.0)       6.1568 (1.0)       6.1568 (1.0)      0.0000 (1.0)       6.1568 (1.0)      0.0000 (1.0)           0;0  0.1624 (1.0)           1           1
test_add_symlink-add-noop[main]        6.1901 (1.01)      6.1901 (1.01)      6.1901 (1.01)     0.0000 (1.0)       6.1901 (1.01)     0.0000 (1.0)           0;0  0.1615 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.2699 (1.93)     40.2699 (1.93)     40.2699 (1.93)     0.0000 (1.0)      40.2699 (1.93)     0.0000 (1.0)           0;0  0.0248 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     61.4748 (2.94)     61.4748 (2.94)     61.4748 (2.94)     0.0000 (1.0)      61.4748 (2.94)     0.0000 (1.0)           0;0  0.0163 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     27.7404 (1.33)     27.7404 (1.33)     27.7404 (1.33)     0.0000 (1.0)      27.7404 (1.33)     0.0000 (1.0)           0;0  0.0360 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.8764 (1.0)      20.8764 (1.0)      20.8764 (1.0)      0.0000 (1.0)      20.8764 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]       21.9363 (1.05)     21.9363 (1.05)     21.9363 (1.05)     0.0000 (1.0)      21.9363 (1.05)     0.0000 (1.0)           0;0  0.0456 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5394 (1.67)     5.5394 (1.67)     5.5394 (1.67)     0.0000 (1.0)      5.5394 (1.67)     0.0000 (1.0)           0;0  0.1805 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9589 (1.80)     5.9589 (1.80)     5.9589 (1.80)     0.0000 (1.0)      5.9589 (1.80)     0.0000 (1.0)           0;0  0.1678 (0.56)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5569 (1.68)     5.5569 (1.68)     5.5569 (1.68)     0.0000 (1.0)      5.5569 (1.68)     0.0000 (1.0)           0;0  0.1800 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3156 (1.0)      3.3156 (1.0)      3.3156 (1.0)      0.0000 (1.0)      3.3156 (1.0)      0.0000 (1.0)           0;0  0.3016 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6704 (1.11)     3.6704 (1.11)     3.6704 (1.11)     0.0000 (1.0)      3.6704 (1.11)     0.0000 (1.0)           0;0  0.2725 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.8817 (2.00)     7.8817 (2.00)     7.8817 (2.00)     0.0000 (1.0)      7.8817 (2.00)     0.0000 (1.0)           0;0  0.1269 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6676 (1.69)     6.6676 (1.69)     6.6676 (1.69)     0.0000 (1.0)      6.6676 (1.69)     0.0000 (1.0)           0;0  0.1500 (0.59)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3441 (1.61)     6.3441 (1.61)     6.3441 (1.61)     0.0000 (1.0)      6.3441 (1.61)     0.0000 (1.0)           0;0  0.1576 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9413 (1.0)      3.9413 (1.0)      3.9413 (1.0)      0.0000 (1.0)      3.9413 (1.0)      0.0000 (1.0)           0;0  0.2537 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4526 (1.13)     4.4526 (1.13)     4.4526 (1.13)     0.0000 (1.0)      4.4526 (1.13)     0.0000 (1.0)           0;0  0.2246 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.5648 (3.00)     21.5648 (3.00)     21.5648 (3.00)     0.0000 (1.0)      21.5648 (3.00)     0.0000 (1.0)           0;0  0.0464 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.1674 (2.25)     16.1674 (2.25)     16.1674 (2.25)     0.0000 (1.0)      16.1674 (2.25)     0.0000 (1.0)           0;0  0.0619 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.4066 (2.00)     14.4066 (2.00)     14.4066 (2.00)     0.0000 (1.0)      14.4066 (2.00)     0.0000 (1.0)           0;0  0.0694 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.1955 (1.0)       7.1955 (1.0)       7.1955 (1.0)      0.0000 (1.0)       7.1955 (1.0)      0.0000 (1.0)           0;0  0.1390 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.0952 (1.13)      8.0952 (1.13)      8.0952 (1.13)     0.0000 (1.0)       8.0952 (1.13)     0.0000 (1.0)           0;0  0.1235 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3622 (1.64)     5.3622 (1.64)     5.3622 (1.64)     0.0000 (1.0)      5.3622 (1.64)     0.0000 (1.0)           0;0  0.1865 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5839 (1.70)     5.5839 (1.70)     5.5839 (1.70)     0.0000 (1.0)      5.5839 (1.70)     0.0000 (1.0)           0;0  0.1791 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3819 (1.64)     5.3819 (1.64)     5.3819 (1.64)     0.0000 (1.0)      5.3819 (1.64)     0.0000 (1.0)           0;0  0.1858 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2783 (1.0)      3.2783 (1.0)      3.2783 (1.0)      0.0000 (1.0)      3.2783 (1.0)      0.0000 (1.0)           0;0  0.3050 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5678 (1.09)     3.5678 (1.09)     3.5678 (1.09)     0.0000 (1.0)      3.5678 (1.09)     0.0000 (1.0)           0;0  0.2803 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6676 (1.98)     7.6676 (1.98)     7.6676 (1.98)     0.0000 (1.0)      7.6676 (1.98)     0.0000 (1.0)           0;0  0.1304 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4438 (1.66)     6.4438 (1.66)     6.4438 (1.66)     0.0000 (1.0)      6.4438 (1.66)     0.0000 (1.0)           0;0  0.1552 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1845 (1.59)     6.1845 (1.59)     6.1845 (1.59)     0.0000 (1.0)      6.1845 (1.59)     0.0000 (1.0)           0;0  0.1617 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8807 (1.0)      3.8807 (1.0)      3.8807 (1.0)      0.0000 (1.0)      3.8807 (1.0)      0.0000 (1.0)           0;0  0.2577 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4927 (1.16)     4.4927 (1.16)     4.4927 (1.16)     0.0000 (1.0)      4.4927 (1.16)     0.0000 (1.0)           0;0  0.2226 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.1048 (2.49)     26.1048 (2.49)     26.1048 (2.49)     0.0000 (1.0)      26.1048 (2.49)     0.0000 (1.0)           0;0  0.0383 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     20.0285 (1.91)     20.0285 (1.91)     20.0285 (1.91)     0.0000 (1.0)      20.0285 (1.91)     0.0000 (1.0)           0;0  0.0499 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     18.0329 (1.72)     18.0329 (1.72)     18.0329 (1.72)     0.0000 (1.0)      18.0329 (1.72)     0.0000 (1.0)           0;0  0.0555 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.4957 (1.0)      10.4957 (1.0)      10.4957 (1.0)      0.0000 (1.0)      10.4957 (1.0)      0.0000 (1.0)           0;0  0.0953 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.6998 (1.11)     11.6998 (1.11)     11.6998 (1.11)     0.0000 (1.0)      11.6998 (1.11)     0.0000 (1.0)           0;0  0.0855 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.1081 (1.53)     7.1081 (1.53)     7.1081 (1.53)     0.0000 (1.0)      7.1081 (1.53)     0.0000 (1.0)           0;0  0.1407 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.3010 (1.57)     7.3010 (1.57)     7.3010 (1.57)     0.0000 (1.0)      7.3010 (1.57)     0.0000 (1.0)           0;0  0.1370 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9743 (1.50)     6.9743 (1.50)     6.9743 (1.50)     0.0000 (1.0)      6.9743 (1.50)     0.0000 (1.0)           0;0  0.1434 (0.67)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.6434 (1.0)      4.6434 (1.0)      4.6434 (1.0)      0.0000 (1.0)      4.6434 (1.0)      0.0000 (1.0)           0;0  0.2154 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.9296 (1.06)     4.9296 (1.06)     4.9296 (1.06)     0.0000 (1.0)      4.9296 (1.06)     0.0000 (1.0)           0;0  0.2029 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.7237 (1.73)     10.7237 (1.73)     10.7237 (1.73)     0.0000 (1.0)      10.7237 (1.73)     0.0000 (1.0)           0;0  0.0933 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.0711 (1.47)      9.0711 (1.47)      9.0711 (1.47)     0.0000 (1.0)       9.0711 (1.47)     0.0000 (1.0)           0;0  0.1102 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      9.0168 (1.46)      9.0168 (1.46)      9.0168 (1.46)     0.0000 (1.0)       9.0168 (1.46)     0.0000 (1.0)           0;0  0.1109 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      6.1845 (1.0)       6.1845 (1.0)       6.1845 (1.0)      0.0000 (1.0)       6.1845 (1.0)      0.0000 (1.0)           0;0  0.1617 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.9659 (1.13)      6.9659 (1.13)      6.9659 (1.13)     0.0000 (1.0)       6.9659 (1.13)     0.0000 (1.0)           0;0  0.1436 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0237 (1.72)     4.0237 (1.72)     4.0237 (1.72)     0.0000 (1.0)      4.0237 (1.72)     0.0000 (1.0)           0;0  0.2485 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7590 (2.03)     4.7590 (2.03)     4.7590 (2.03)     0.0000 (1.0)      4.7590 (2.03)     0.0000 (1.0)           0;0  0.2101 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.6406 (1.98)     4.6406 (1.98)     4.6406 (1.98)     0.0000 (1.0)      4.6406 (1.98)     0.0000 (1.0)           0;0  0.2155 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3408 (1.0)      2.3408 (1.0)      2.3408 (1.0)      0.0000 (1.0)      2.3408 (1.0)      0.0000 (1.0)           0;0  0.4272 (1.0)           1           1
test_data_status-data-changed[main]       2.6322 (1.12)     2.6322 (1.12)     2.6322 (1.12)     0.0000 (1.0)      2.6322 (1.12)     0.0000 (1.0)           0;0  0.3799 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0218 (1.74)     4.0218 (1.74)     4.0218 (1.74)     0.0000 (1.0)      4.0218 (1.74)     0.0000 (1.0)           0;0  0.2486 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7670 (2.06)     4.7670 (2.06)     4.7670 (2.06)     0.0000 (1.0)      4.7670 (2.06)     0.0000 (1.0)           0;0  0.2098 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6132 (2.00)     4.6132 (2.00)     4.6132 (2.00)     0.0000 (1.0)      4.6132 (2.00)     0.0000 (1.0)           0;0  0.2168 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3113 (1.0)      2.3113 (1.0)      2.3113 (1.0)      0.0000 (1.0)      2.3113 (1.0)      0.0000 (1.0)           0;0  0.4327 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5520 (1.10)     2.5520 (1.10)     2.5520 (1.10)     0.0000 (1.0)      2.5520 (1.10)     0.0000 (1.0)           0;0  0.3919 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5583 (3.83)     18.5583 (3.83)     18.5583 (3.83)     0.0000 (1.0)      18.5583 (3.83)     0.0000 (1.0)           0;0  0.0539 (0.26)          1           1
test_data_status-data-new[3.10.0]     18.9375 (3.90)     18.9375 (3.90)     18.9375 (3.90)     0.0000 (1.0)      18.9375 (3.90)     0.0000 (1.0)           0;0  0.0528 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.9072 (3.90)     18.9072 (3.90)     18.9072 (3.90)     0.0000 (1.0)      18.9072 (3.90)     0.0000 (1.0)           0;0  0.0529 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8514 (1.0)       4.8514 (1.0)       4.8514 (1.0)      0.0000 (1.0)       4.8514 (1.0)      0.0000 (1.0)           0;0  0.2061 (1.0)           1           1
test_data_status-data-new[main]        5.1672 (1.07)      5.1672 (1.07)      5.1672 (1.07)     0.0000 (1.0)       5.1672 (1.07)     0.0000 (1.0)           0;0  0.1935 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1594 (1.79)     4.1594 (1.79)     4.1594 (1.79)     0.0000 (1.0)      4.1594 (1.79)     0.0000 (1.0)           0;0  0.2404 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.7411 (2.04)     4.7411 (2.04)     4.7411 (2.04)     0.0000 (1.0)      4.7411 (2.04)     0.0000 (1.0)           0;0  0.2109 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.6056 (1.98)     4.6056 (1.98)     4.6056 (1.98)     0.0000 (1.0)      4.6056 (1.98)     0.0000 (1.0)           0;0  0.2171 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.3245 (1.0)      2.3245 (1.0)      2.3245 (1.0)      0.0000 (1.0)      2.3245 (1.0)      0.0000 (1.0)           0;0  0.4302 (1.0)           1           1
test_data_status-data-noop[main]       2.5358 (1.09)     2.5358 (1.09)     2.5358 (1.09)     0.0000 (1.0)      2.5358 (1.09)     0.0000 (1.0)           0;0  0.3944 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1851 (1.30)     7.1851 (1.30)     7.1851 (1.30)     0.0000 (1.0)      7.1851 (1.30)     0.0000 (1.0)           0;0  0.1392 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7441 (1.40)     7.7441 (1.40)     7.7441 (1.40)     0.0000 (1.0)      7.7441 (1.40)     0.0000 (1.0)           0;0  0.1291 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8195 (1.41)     7.8195 (1.41)     7.8195 (1.41)     0.0000 (1.0)      7.8195 (1.41)     0.0000 (1.0)           0;0  0.1279 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5267 (1.0)      5.5267 (1.0)      5.5267 (1.0)      0.0000 (1.0)      5.5267 (1.0)      0.0000 (1.0)           0;0  0.1809 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9796 (1.08)     5.9796 (1.08)     5.9796 (1.08)     0.0000 (1.0)      5.9796 (1.08)     0.0000 (1.0)           0;0  0.1672 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2580 (1.30)     7.2580 (1.30)     7.2580 (1.30)     0.0000 (1.0)      7.2580 (1.30)     0.0000 (1.0)           0;0  0.1378 (0.77)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7967 (1.39)     7.7967 (1.39)     7.7967 (1.39)     0.0000 (1.0)      7.7967 (1.39)     0.0000 (1.0)           0;0  0.1283 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8122 (1.40)     7.8122 (1.40)     7.8122 (1.40)     0.0000 (1.0)      7.8122 (1.40)     0.0000 (1.0)           0;0  0.1280 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5905 (1.0)      5.5905 (1.0)      5.5905 (1.0)      0.0000 (1.0)      5.5905 (1.0)      0.0000 (1.0)           0;0  0.1789 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.0222 (1.08)     6.0222 (1.08)     6.0222 (1.08)     0.0000 (1.0)      6.0222 (1.08)     0.0000 (1.0)           0;0  0.1661 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.3662 (2.70)     21.3662 (2.70)     21.3662 (2.70)     0.0000 (1.0)      21.3662 (2.70)     0.0000 (1.0)           0;0  0.0468 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.7095 (2.87)     22.7095 (2.87)     22.7095 (2.87)     0.0000 (1.0)      22.7095 (2.87)     0.0000 (1.0)           0;0  0.0440 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.4856 (2.84)     22.4856 (2.84)     22.4856 (2.84)     0.0000 (1.0)      22.4856 (2.84)     0.0000 (1.0)           0;0  0.0445 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9247 (1.0)       7.9247 (1.0)       7.9247 (1.0)      0.0000 (1.0)       7.9247 (1.0)      0.0000 (1.0)           0;0  0.1262 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4904 (1.07)      8.4904 (1.07)      8.4904 (1.07)     0.0000 (1.0)       8.4904 (1.07)     0.0000 (1.0)           0;0  0.1178 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.6424 (1.39)     6.6424 (1.39)     6.6424 (1.39)     0.0000 (1.0)      6.6424 (1.39)     0.0000 (1.0)           0;0  0.1505 (0.72)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1479 (1.49)     7.1479 (1.49)     7.1479 (1.49)     0.0000 (1.0)      7.1479 (1.49)     0.0000 (1.0)           0;0  0.1399 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0291 (1.47)     7.0291 (1.47)     7.0291 (1.47)     0.0000 (1.0)      7.0291 (1.47)     0.0000 (1.0)           0;0  0.1423 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7901 (1.0)      4.7901 (1.0)      4.7901 (1.0)      0.0000 (1.0)      4.7901 (1.0)      0.0000 (1.0)           0;0  0.2088 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2685 (1.10)     5.2685 (1.10)     5.2685 (1.10)     0.0000 (1.0)      5.2685 (1.10)     0.0000 (1.0)           0;0  0.1898 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.7441 (2.62)     17.7441 (2.62)     17.7441 (2.62)     0.0000 (1.0)      17.7441 (2.62)     0.0000 (1.0)           0;0  0.0564 (0.38)          1           1
test_diff-diff[3.10.0]     18.9562 (2.79)     18.9562 (2.79)     18.9562 (2.79)     0.0000 (1.0)      18.9562 (2.79)     0.0000 (1.0)           0;0  0.0528 (0.36)          1           1
test_diff-diff[3.53.2]     18.8990 (2.79)     18.8990 (2.79)     18.8990 (2.79)     0.0000 (1.0)      18.8990 (2.79)     0.0000 (1.0)           0;0  0.0529 (0.36)          1           1
test_diff-diff[3.60.1]      6.7823 (1.0)       6.7823 (1.0)       6.7823 (1.0)      0.0000 (1.0)       6.7823 (1.0)      0.0000 (1.0)           0;0  0.1474 (1.0)           1           1
test_diff-diff[main]        7.7459 (1.14)      7.7459 (1.14)      7.7459 (1.14)     0.0000 (1.0)       7.7459 (1.14)     0.0000 (1.0)           0;0  0.1291 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0080 (1.81)     6.0080 (1.81)     6.0080 (1.81)     0.0000 (1.0)      6.0080 (1.81)     0.0000 (1.0)           0;0  0.1664 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.7897 (2.04)     6.7897 (2.04)     6.7897 (2.04)     0.0000 (1.0)      6.7897 (2.04)     0.0000 (1.0)           0;0  0.1473 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.6714 (1.70)     5.6714 (1.70)     5.6714 (1.70)     0.0000 (1.0)      5.6714 (1.70)     0.0000 (1.0)           0;0  0.1763 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.3272 (1.0)      3.3272 (1.0)      3.3272 (1.0)      0.0000 (1.0)      3.3272 (1.0)      0.0000 (1.0)           0;0  0.3006 (1.0)           1           1
test_diff-diff-changed[main]       4.1912 (1.26)     4.1912 (1.26)     4.1912 (1.26)     0.0000 (1.0)      4.1912 (1.26)     0.0000 (1.0)           0;0  0.2386 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2070 (1.56)     5.2070 (1.56)     5.2070 (1.56)     0.0000 (1.0)      5.2070 (1.56)     0.0000 (1.0)           0;0  0.1920 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7912 (1.74)     5.7912 (1.74)     5.7912 (1.74)     0.0000 (1.0)      5.7912 (1.74)     0.0000 (1.0)           0;0  0.1727 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6522 (1.70)     5.6522 (1.70)     5.6522 (1.70)     0.0000 (1.0)      5.6522 (1.70)     0.0000 (1.0)           0;0  0.1769 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3279 (1.0)      3.3279 (1.0)      3.3279 (1.0)      0.0000 (1.0)      3.3279 (1.0)      0.0000 (1.0)           0;0  0.3005 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1526 (1.25)     4.1526 (1.25)     4.1526 (1.25)     0.0000 (1.0)      4.1526 (1.25)     0.0000 (1.0)           0;0  0.2408 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.9198 (1.19)     3.9198 (1.19)     3.9198 (1.19)     0.0000 (1.0)      3.9198 (1.19)     0.0000 (1.0)           0;0  0.2551 (0.84)          1           1
test_diff-diff-noop[3.10.0]     4.7555 (1.44)     4.7555 (1.44)     4.7555 (1.44)     0.0000 (1.0)      4.7555 (1.44)     0.0000 (1.0)           0;0  0.2103 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.6609 (1.71)     5.6609 (1.71)     5.6609 (1.71)     0.0000 (1.0)      5.6609 (1.71)     0.0000 (1.0)           0;0  0.1767 (0.58)          1           1
test_diff-diff-noop[3.60.1]     3.3057 (1.0)      3.3057 (1.0)      3.3057 (1.0)      0.0000 (1.0)      3.3057 (1.0)      0.0000 (1.0)           0;0  0.3025 (1.0)           1           1
test_diff-diff-noop[main]       4.2903 (1.30)     4.2903 (1.30)     4.2903 (1.30)     0.0000 (1.0)      4.2903 (1.30)     0.0000 (1.0)           0;0  0.2331 (0.77)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0753 (1.0)       1.0753 (1.0)       1.0753 (1.0)      0.0000 (1.0)       1.0753 (1.0)      0.0000 (1.0)           0;0  0.9299 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.2070 (9.49)     10.2070 (9.49)     10.2070 (9.49)     0.0000 (1.0)      10.2070 (9.49)     0.0000 (1.0)           0;0  0.0980 (0.11)          1           1
test_exp_show-exp[3.53.2]      5.5364 (5.15)      5.5364 (5.15)      5.5364 (5.15)     0.0000 (1.0)       5.5364 (5.15)     0.0000 (1.0)           0;0  0.1806 (0.19)          1           1
test_exp_show-exp[3.60.1]      5.7727 (5.37)      5.7727 (5.37)      5.7727 (5.37)     0.0000 (1.0)       5.7727 (5.37)     0.0000 (1.0)           0;0  0.1732 (0.19)          1           1
test_exp_show-exp[main]        8.7115 (8.10)      8.7115 (8.10)      8.7115 (8.10)     0.0000 (1.0)       8.7115 (8.10)     0.0000 (1.0)           0;0  0.1148 (0.12)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     65.2750 (2.83)     65.2750 (2.83)     65.2750 (2.83)     0.0000 (1.0)      65.2750 (2.83)     0.0000 (1.0)           0;0  0.0153 (0.35)          1           1
test_fetch-fetch[3.10.0]     70.8195 (3.07)     70.8195 (3.07)     70.8195 (3.07)     0.0000 (1.0)      70.8195 (3.07)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.6193 (1.46)     33.6193 (1.46)     33.6193 (1.46)     0.0000 (1.0)      33.6193 (1.46)     0.0000 (1.0)           0;0  0.0297 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.0451 (1.0)      23.0451 (1.0)      23.0451 (1.0)      0.0000 (1.0)      23.0451 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
test_fetch-fetch[main]       23.2845 (1.01)     23.2845 (1.01)     23.2845 (1.01)     0.0000 (1.0)      23.2845 (1.01)     0.0000 (1.0)           0;0  0.0429 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8427 (1.0)      2.8427 (1.0)      2.8427 (1.0)      0.0000 (1.0)      2.8427 (1.0)      0.0000 (1.0)           0;0  0.3518 (1.0)           1           1
test_gc-gc[3.10.0]     2.9367 (1.03)     2.9367 (1.03)     2.9367 (1.03)     0.0000 (1.0)      2.9367 (1.03)     0.0000 (1.0)           0;0  0.3405 (0.97)          1           1
test_gc-gc[3.53.2]     2.9082 (1.02)     2.9082 (1.02)     2.9082 (1.02)     0.0000 (1.0)      2.9082 (1.02)     0.0000 (1.0)           0;0  0.3439 (0.98)          1           1
test_gc-gc[3.60.1]     2.8719 (1.01)     2.8719 (1.01)     2.8719 (1.01)     0.0000 (1.0)      2.8719 (1.01)     0.0000 (1.0)           0;0  0.3482 (0.99)          1           1
test_gc-gc[main]       2.9733 (1.05)     2.9733 (1.05)     2.9733 (1.05)     0.0000 (1.0)      2.9733 (1.05)     0.0000 (1.0)           0;0  0.3363 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     151.7427 (3.01)     151.7427 (3.01)     151.7427 (3.01)     0.0000 (1.0)      151.7427 (3.01)     0.0000 (1.0)           0;0  0.0066 (0.33)          1           1
test_get-get[3.10.0]     168.9022 (3.35)     168.9022 (3.35)     168.9022 (3.35)     0.0000 (1.0)      168.9022 (3.35)     0.0000 (1.0)           0;0  0.0059 (0.30)          1           1
test_get-get[3.53.2]     145.1043 (2.87)     145.1043 (2.87)     145.1043 (2.87)     0.0000 (1.0)      145.1043 (2.87)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[3.60.1]      50.4865 (1.0)       50.4865 (1.0)       50.4865 (1.0)      0.0000 (1.0)       50.4865 (1.0)      0.0000 (1.0)           0;0  0.0198 (1.0)           1           1
test_get-get[main]        50.9016 (1.01)      50.9016 (1.01)      50.9016 (1.01)     0.0000 (1.0)       50.9016 (1.01)     0.0000 (1.0)           0;0  0.0196 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.3788 (2.67)     44.3788 (2.67)     44.3788 (2.67)     0.0000 (1.0)      44.3788 (2.67)     0.0000 (1.0)           0;0  0.0225 (0.38)          1           1
test_get_url-get-url[3.10.0]     46.9400 (2.82)     46.9400 (2.82)     46.9400 (2.82)     0.0000 (1.0)      46.9400 (2.82)     0.0000 (1.0)           0;0  0.0213 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.6421 (1.0)      16.6421 (1.0)      16.6421 (1.0)      0.0000 (1.0)      16.6421 (1.0)      0.0000 (1.0)           0;0  0.0601 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.8533 (1.01)     16.8533 (1.01)     16.8533 (1.01)     0.0000 (1.0)      16.8533 (1.01)     0.0000 (1.0)           0;0  0.0593 (0.99)          1           1
test_get_url-get-url[main]       16.7351 (1.01)     16.7351 (1.01)     16.7351 (1.01)     0.0000 (1.0)      16.7351 (1.01)     0.0000 (1.0)           0;0  0.0598 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.9403 (1.07)     140.1238 (1.04)     130.9186 (1.04)     1.7574 (1.12)     130.7601 (1.06)     2.1219 (1.04)         25;2  7.6383 (0.96)        100           1
test_help---help[3.10.0]     127.0913 (1.06)     134.7994 (1.0)      130.1114 (1.04)     1.5656 (1.0)      129.9481 (1.05)     2.0438 (1.0)          27;3  7.6857 (0.97)        100           1
test_help---help[3.53.2]     128.9664 (1.08)     138.3974 (1.03)     133.2634 (1.06)     1.6930 (1.08)     132.9898 (1.07)     2.1799 (1.07)         26;2  7.5039 (0.94)        100           1
test_help---help[3.60.1]     130.7161 (1.09)     144.9712 (1.08)     135.9490 (1.08)     2.8152 (1.80)     135.4277 (1.09)     4.1066 (2.01)         33;2  7.3557 (0.92)        100           1
test_help---help[main]       119.7883 (1.0)      174.9489 (1.30)     125.6965 (1.0)      7.7139 (4.93)     123.8040 (1.0)      3.0172 (1.48)          7;8  7.9557 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     229.9136 (2.98)     229.9136 (2.98)     229.9136 (2.98)     0.0000 (1.0)      229.9136 (2.98)     0.0000 (1.0)           0;0  0.0043 (0.34)          1           1
test_import-import[3.10.0]     257.8429 (3.35)     257.8429 (3.35)     257.8429 (3.35)     0.0000 (1.0)      257.8429 (3.35)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      77.0280 (1.0)       77.0280 (1.0)       77.0280 (1.0)      0.0000 (1.0)       77.0280 (1.0)      0.0000 (1.0)           0;0  0.0130 (1.0)           1           1
test_import-import[main]        78.0465 (1.01)      78.0465 (1.01)      78.0465 (1.01)     0.0000 (1.0)       78.0465 (1.01)     0.0000 (1.0)           0;0  0.0128 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     154.1109 (3.30)     154.1109 (3.30)     154.1109 (3.30)     0.0000 (1.0)      154.1109 (3.30)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     157.6620 (3.37)     157.6620 (3.37)     157.6620 (3.37)     0.0000 (1.0)      157.6620 (3.37)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.53.2]     116.3469 (2.49)     116.3469 (2.49)     116.3469 (2.49)     0.0000 (1.0)      116.3469 (2.49)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.7668 (1.0)       46.7668 (1.0)       46.7668 (1.0)      0.0000 (1.0)       46.7668 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_import_url-import-url[main]        48.1875 (1.03)      48.1875 (1.03)      48.1875 (1.03)     0.0000 (1.0)       48.1875 (1.03)     0.0000 (1.0)           0;0  0.0208 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     393.2783 (1.01)     449.8501 (1.01)     406.2077 (1.01)     13.0644 (1.19)     401.0071 (1.00)     12.6577 (1.73)        16;10  2.4618 (0.99)        100           1
test_init-init[3.10.0]     405.6210 (1.04)     479.2973 (1.08)     417.6555 (1.04)     11.1790 (1.02)     413.7496 (1.03)     12.2191 (1.67)         19;2  2.3943 (0.96)        100           1
test_init-init[3.53.2]     391.1726 (1.0)      445.7602 (1.0)      403.0096 (1.0)      10.9725 (1.0)      400.1623 (1.0)       8.5477 (1.17)        14;10  2.4813 (1.0)         100           1
test_init-init[3.60.1]     391.7742 (1.00)     466.0176 (1.05)     406.0564 (1.01)     14.3455 (1.31)     401.3471 (1.00)      9.2715 (1.27)        13;12  2.4627 (0.99)        100           1
test_init-init[main]       420.5083 (1.07)     564.8097 (1.27)     433.7873 (1.08)     18.0039 (1.64)     429.1450 (1.07)      7.3143 (1.0)          7;11  2.3053 (0.93)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     588.6355 (1.06)     588.6355 (1.06)     588.6355 (1.06)     0.0000 (1.0)      588.6355 (1.06)     0.0000 (1.0)           0;0  1.6988 (0.94)          1           1
test_list-list[3.10.0]     680.8447 (1.23)     680.8447 (1.23)     680.8447 (1.23)     0.0000 (1.0)      680.8447 (1.23)     0.0000 (1.0)           0;0  1.4688 (0.81)          1           1
test_list-list[3.53.2]     582.2314 (1.05)     582.2314 (1.05)     582.2314 (1.05)     0.0000 (1.0)      582.2314 (1.05)     0.0000 (1.0)           0;0  1.7175 (0.95)          1           1
test_list-list[3.60.1]     554.5947 (1.00)     554.5947 (1.00)     554.5947 (1.00)     0.0000 (1.0)      554.5947 (1.00)     0.0000 (1.0)           0;0  1.8031 (1.00)          1           1
test_list-list[main]       553.2353 (1.0)      553.2353 (1.0)      553.2353 (1.0)      0.0000 (1.0)      553.2353 (1.0)      0.0000 (1.0)           0;0  1.8075 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     428.3568 (1.07)     428.3568 (1.07)     428.3568 (1.07)     0.0000 (1.0)      428.3568 (1.07)     0.0000 (1.0)           0;0  2.3345 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     434.9107 (1.08)     434.9107 (1.08)     434.9107 (1.08)     0.0000 (1.0)      434.9107 (1.08)     0.0000 (1.0)           0;0  2.2993 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     400.9846 (1.0)      400.9846 (1.0)      400.9846 (1.0)      0.0000 (1.0)      400.9846 (1.0)      0.0000 (1.0)           0;0  2.4939 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     456.0458 (1.14)     456.0458 (1.14)     456.0458 (1.14)     0.0000 (1.0)      456.0458 (1.14)     0.0000 (1.0)           0;0  2.1928 (0.88)          1           1
test_list-list-dvc-only[main]       410.6316 (1.02)     410.6316 (1.02)     410.6316 (1.02)     0.0000 (1.0)      410.6316 (1.02)     0.0000 (1.0)           0;0  2.4353 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.9256 (1.0)      2.9256 (1.0)      2.9256 (1.0)      0.0000 (1.0)      2.9256 (1.0)      0.0000 (1.0)           0;0  0.3418 (1.0)           1           1
test_list-list-recursive[3.10.0]     3.1200 (1.07)     3.1200 (1.07)     3.1200 (1.07)     0.0000 (1.0)      3.1200 (1.07)     0.0000 (1.0)           0;0  0.3205 (0.94)          1           1
test_list-list-recursive[3.53.2]     2.9987 (1.02)     2.9987 (1.02)     2.9987 (1.02)     0.0000 (1.0)      2.9987 (1.02)     0.0000 (1.0)           0;0  0.3335 (0.98)          1           1
test_list-list-recursive[3.60.1]     3.1333 (1.07)     3.1333 (1.07)     3.1333 (1.07)     0.0000 (1.0)      3.1333 (1.07)     0.0000 (1.0)           0;0  0.3191 (0.93)          1           1
test_list-list-recursive[main]       3.1057 (1.06)     3.1057 (1.06)     3.1057 (1.06)     0.0000 (1.0)      3.1057 (1.06)     0.0000 (1.0)           0;0  0.3220 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     434.7394 (1.09)     434.7394 (1.09)     434.7394 (1.09)     0.0000 (1.0)      434.7394 (1.09)     0.0000 (1.0)           0;0  2.3002 (0.92)          1           1
test_list-list-shallow[3.10.0]     429.6403 (1.08)     429.6403 (1.08)     429.6403 (1.08)     0.0000 (1.0)      429.6403 (1.08)     0.0000 (1.0)           0;0  2.3275 (0.93)          1           1
test_list-list-shallow[3.53.2]     402.1568 (1.01)     402.1568 (1.01)     402.1568 (1.01)     0.0000 (1.0)      402.1568 (1.01)     0.0000 (1.0)           0;0  2.4866 (0.99)          1           1
test_list-list-shallow[3.60.1]     428.3350 (1.08)     428.3350 (1.08)     428.3350 (1.08)     0.0000 (1.0)      428.3350 (1.08)     0.0000 (1.0)           0;0  2.3346 (0.93)          1           1
test_list-list-shallow[main]       398.3156 (1.0)      398.3156 (1.0)      398.3156 (1.0)      0.0000 (1.0)      398.3156 (1.0)      0.0000 (1.0)           0;0  2.5106 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.5670 (3.70)     71.5670 (3.70)     71.5670 (3.70)     0.0000 (1.0)      71.5670 (3.70)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.10.0]     71.7976 (3.71)     71.7976 (3.71)     71.7976 (3.71)     0.0000 (1.0)      71.7976 (3.71)     0.0000 (1.0)           0;0  0.0139 (0.27)          1           1
test_partial_add-add[3.53.2]     64.3418 (3.32)     64.3418 (3.32)     64.3418 (3.32)     0.0000 (1.0)      64.3418 (3.32)     0.0000 (1.0)           0;0  0.0155 (0.30)          1           1
test_partial_add-add[3.60.1]     19.3678 (1.0)      19.3678 (1.0)      19.3678 (1.0)      0.0000 (1.0)      19.3678 (1.0)      0.0000 (1.0)           0;0  0.0516 (1.0)           1           1
test_partial_add-add[main]       20.1309 (1.04)     20.1309 (1.04)     20.1309 (1.04)     0.0000 (1.0)      20.1309 (1.04)     0.0000 (1.0)           0;0  0.0497 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.4848 (7.66)     59.4848 (7.66)     59.4848 (7.66)     0.0000 (1.0)      59.4848 (7.66)     0.0000 (1.0)           0;0  0.0168 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     60.1471 (7.75)     60.1471 (7.75)     60.1471 (7.75)     0.0000 (1.0)      60.1471 (7.75)     0.0000 (1.0)           0;0  0.0166 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     54.2518 (6.99)     54.2518 (6.99)     54.2518 (6.99)     0.0000 (1.0)      54.2518 (6.99)     0.0000 (1.0)           0;0  0.0184 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.7623 (1.0)       7.7623 (1.0)       7.7623 (1.0)      0.0000 (1.0)       7.7623 (1.0)      0.0000 (1.0)           0;0  0.1288 (1.0)           1           1
test_partial_add-add-partial[main]        7.9260 (1.02)      7.9260 (1.02)      7.9260 (1.02)     0.0000 (1.0)       7.9260 (1.02)     0.0000 (1.0)           0;0  0.1262 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3119 (1.0)      4.3119 (1.0)      4.3119 (1.0)      0.0000 (1.0)      4.3119 (1.0)      0.0000 (1.0)           0;0  0.2319 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.6928 (1.32)     5.6928 (1.32)     5.6928 (1.32)     0.0000 (1.0)      5.6928 (1.32)     0.0000 (1.0)           0;0  0.1757 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.5354 (1.52)     6.5354 (1.52)     6.5354 (1.52)     0.0000 (1.0)      6.5354 (1.52)     0.0000 (1.0)           0;0  0.1530 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7515 (1.57)     6.7515 (1.57)     6.7515 (1.57)     0.0000 (1.0)      6.7515 (1.57)     0.0000 (1.0)           0;0  0.1481 (0.64)          1           1
test_partial_add-gc-cloud-noop[main]       6.6891 (1.55)     6.6891 (1.55)     6.6891 (1.55)     0.0000 (1.0)      6.6891 (1.55)     0.0000 (1.0)           0;0  0.1495 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3725 (1.0)      2.3725 (1.0)      2.3725 (1.0)      0.0000 (1.0)      2.3725 (1.0)      0.0000 (1.0)           0;0  0.4215 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.5691 (1.50)     3.5691 (1.50)     3.5691 (1.50)     0.0000 (1.0)      3.5691 (1.50)     0.0000 (1.0)           0;0  0.2802 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.6530 (1.54)     3.6530 (1.54)     3.6530 (1.54)     0.0000 (1.0)      3.6530 (1.54)     0.0000 (1.0)           0;0  0.2737 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.6499 (1.54)     3.6499 (1.54)     3.6499 (1.54)     0.0000 (1.0)      3.6499 (1.54)     0.0000 (1.0)           0;0  0.2740 (0.65)          1           1
test_partial_add-gc-noop[main]       3.7089 (1.56)     3.7089 (1.56)     3.7089 (1.56)     0.0000 (1.0)      3.7089 (1.56)     0.0000 (1.0)           0;0  0.2696 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.0521 (2.34)     44.0521 (2.34)     44.0521 (2.34)     0.0000 (1.0)      44.0521 (2.34)     0.0000 (1.0)           0;0  0.0227 (0.43)          1           1
test_partial_add-push[3.10.0]     38.9314 (2.07)     38.9314 (2.07)     38.9314 (2.07)     0.0000 (1.0)      38.9314 (2.07)     0.0000 (1.0)           0;0  0.0257 (0.48)          1           1
test_partial_add-push[3.53.2]     19.1297 (1.02)     19.1297 (1.02)     19.1297 (1.02)     0.0000 (1.0)      19.1297 (1.02)     0.0000 (1.0)           0;0  0.0523 (0.98)          1           1
test_partial_add-push[3.60.1]     18.8307 (1.0)      18.8307 (1.0)      18.8307 (1.0)      0.0000 (1.0)      18.8307 (1.0)      0.0000 (1.0)           0;0  0.0531 (1.0)           1           1
test_partial_add-push[main]       19.1121 (1.01)     19.1121 (1.01)     19.1121 (1.01)     0.0000 (1.0)      19.1121 (1.01)     0.0000 (1.0)           0;0  0.0523 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.1745 (1.12)     11.1745 (1.12)     11.1745 (1.12)     0.0000 (1.0)      11.1745 (1.12)     0.0000 (1.0)           0;0  0.0895 (0.89)          1           1
test_partial_add-push-partial[3.10.0]     10.4014 (1.04)     10.4014 (1.04)     10.4014 (1.04)     0.0000 (1.0)      10.4014 (1.04)     0.0000 (1.0)           0;0  0.0961 (0.96)          1           1
test_partial_add-push-partial[3.53.2]     10.3653 (1.04)     10.3653 (1.04)     10.3653 (1.04)     0.0000 (1.0)      10.3653 (1.04)     0.0000 (1.0)           0;0  0.0965 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     10.0009 (1.0)      10.0009 (1.0)      10.0009 (1.0)      0.0000 (1.0)      10.0009 (1.0)      0.0000 (1.0)           0;0  0.1000 (1.0)           1           1
test_partial_add-push-partial[main]       10.0412 (1.00)     10.0412 (1.00)     10.0412 (1.00)     0.0000 (1.0)      10.0412 (1.00)     0.0000 (1.0)           0;0  0.0996 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.9660 (3.73)     86.9660 (3.73)     86.9660 (3.73)     0.0000 (1.0)      86.9660 (3.73)     0.0000 (1.0)           0;0  0.0115 (0.27)          1           1
test_partial_remove-add[3.10.0]     87.9177 (3.77)     87.9177 (3.77)     87.9177 (3.77)     0.0000 (1.0)      87.9177 (3.77)     0.0000 (1.0)           0;0  0.0114 (0.27)          1           1
test_partial_remove-add[3.53.2]     77.4912 (3.33)     77.4912 (3.33)     77.4912 (3.33)     0.0000 (1.0)      77.4912 (3.33)     0.0000 (1.0)           0;0  0.0129 (0.30)          1           1
test_partial_remove-add[3.60.1]     23.3045 (1.0)      23.3045 (1.0)      23.3045 (1.0)      0.0000 (1.0)      23.3045 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_partial_remove-add[main]       24.7040 (1.06)     24.7040 (1.06)     24.7040 (1.06)     0.0000 (1.0)      24.7040 (1.06)     0.0000 (1.0)           0;0  0.0405 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.7706 (7.93)     8.7706 (7.93)     8.7706 (7.93)     0.0000 (1.0)      8.7706 (7.93)     0.0000 (1.0)           0;0  0.1140 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.3617 (7.56)     8.3617 (7.56)     8.3617 (7.56)     0.0000 (1.0)      8.3617 (7.56)     0.0000 (1.0)           0;0  0.1196 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.7001 (6.96)     7.7001 (6.96)     7.7001 (6.96)     0.0000 (1.0)      7.7001 (6.96)     0.0000 (1.0)           0;0  0.1299 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.1066 (1.0)      1.1066 (1.0)      1.1066 (1.0)      0.0000 (1.0)      1.1066 (1.0)      0.0000 (1.0)           0;0  0.9036 (1.0)           1           1
test_partial_remove-add-update[main]       1.1853 (1.07)     1.1853 (1.07)     1.1853 (1.07)     0.0000 (1.0)      1.1853 (1.07)     0.0000 (1.0)           0;0  0.8437 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.4397 (1.0)      3.4397 (1.0)      3.4397 (1.0)      0.0000 (1.0)      3.4397 (1.0)      0.0000 (1.0)           0;0  0.2907 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7375 (1.09)     3.7375 (1.09)     3.7375 (1.09)     0.0000 (1.0)      3.7375 (1.09)     0.0000 (1.0)           0;0  0.2676 (0.92)          1           1
test_partial_remove-gc[3.53.2]     3.6366 (1.06)     3.6366 (1.06)     3.6366 (1.06)     0.0000 (1.0)      3.6366 (1.06)     0.0000 (1.0)           0;0  0.2750 (0.95)          1           1
test_partial_remove-gc[3.60.1]     3.8069 (1.11)     3.8069 (1.11)     3.8069 (1.11)     0.0000 (1.0)      3.8069 (1.11)     0.0000 (1.0)           0;0  0.2627 (0.90)          1           1
test_partial_remove-gc[main]       3.6792 (1.07)     3.6792 (1.07)     3.6792 (1.07)     0.0000 (1.0)      3.6792 (1.07)     0.0000 (1.0)           0;0  0.2718 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.6965 (1.0)      4.6965 (1.0)      4.6965 (1.0)      0.0000 (1.0)      4.6965 (1.0)      0.0000 (1.0)           0;0  0.2129 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.0537 (1.08)     5.0537 (1.08)     5.0537 (1.08)     0.0000 (1.0)      5.0537 (1.08)     0.0000 (1.0)           0;0  0.1979 (0.93)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0113 (1.07)     5.0113 (1.07)     5.0113 (1.07)     0.0000 (1.0)      5.0113 (1.07)     0.0000 (1.0)           0;0  0.1995 (0.94)          1           1
test_partial_remove-gc-cloud[3.60.1]     5.0344 (1.07)     5.0344 (1.07)     5.0344 (1.07)     0.0000 (1.0)      5.0344 (1.07)     0.0000 (1.0)           0;0  0.1986 (0.93)          1           1
test_partial_remove-gc-cloud[main]       5.0136 (1.07)     5.0136 (1.07)     5.0136 (1.07)     0.0000 (1.0)      5.0136 (1.07)     0.0000 (1.0)           0;0  0.1995 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.4675 (2.36)     53.4675 (2.36)     53.4675 (2.36)     0.0000 (1.0)      53.4675 (2.36)     0.0000 (1.0)           0;0  0.0187 (0.42)          1           1
test_partial_remove-push[3.10.0]     47.7339 (2.11)     47.7339 (2.11)     47.7339 (2.11)     0.0000 (1.0)      47.7339 (2.11)     0.0000 (1.0)           0;0  0.0209 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.4848 (1.04)     23.4848 (1.04)     23.4848 (1.04)     0.0000 (1.0)      23.4848 (1.04)     0.0000 (1.0)           0;0  0.0426 (0.96)          1           1
test_partial_remove-push[3.60.1]     23.0652 (1.02)     23.0652 (1.02)     23.0652 (1.02)     0.0000 (1.0)      23.0652 (1.02)     0.0000 (1.0)           0;0  0.0434 (0.98)          1           1
test_partial_remove-push[main]       22.6406 (1.0)      22.6406 (1.0)      22.6406 (1.0)      0.0000 (1.0)      22.6406 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8947 (1.0)      1.8947 (1.0)      1.8947 (1.0)      0.0000 (1.0)      1.8947 (1.0)      0.0000 (1.0)           0;0  0.5278 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8956 (1.00)     1.8956 (1.00)     1.8956 (1.00)     0.0000 (1.0)      1.8956 (1.00)     0.0000 (1.0)           0;0  0.5275 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.5462 (1.34)     2.5462 (1.34)     2.5462 (1.34)     0.0000 (1.0)      2.5462 (1.34)     0.0000 (1.0)           0;0  0.3927 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.5233 (1.33)     2.5233 (1.33)     2.5233 (1.33)     0.0000 (1.0)      2.5233 (1.33)     0.0000 (1.0)           0;0  0.3963 (0.75)          1           1
test_partial_remove-push-update[main]       2.7122 (1.43)     2.7122 (1.43)     2.7122 (1.43)     0.0000 (1.0)      2.7122 (1.43)     0.0000 (1.0)           0;0  0.3687 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     499.7117 (1.0)      507.9820 (1.0)      504.3241 (1.0)      3.2948 (1.64)     504.8753 (1.0)       5.1386 (1.62)          2;0  1.9829 (1.0)           5           3
test_plots-plots-diff[3.10.0]     904.5368 (1.81)     916.1046 (1.80)     909.0779 (1.80)     4.9946 (2.49)     906.9141 (1.80)      8.2009 (2.58)          1;0  1.1000 (0.55)          5           3
test_plots-plots-diff[3.53.2]     821.1104 (1.64)     830.3386 (1.63)     824.5635 (1.63)     3.4740 (1.73)     824.1113 (1.63)      3.3918 (1.07)          1;0  1.2128 (0.61)          5           3
test_plots-plots-diff[3.60.1]     819.5629 (1.64)     833.0993 (1.64)     824.9653 (1.64)     5.9976 (2.98)     822.9685 (1.63)     10.4422 (3.29)          1;0  1.2122 (0.61)          5           3
test_plots-plots-diff[main]       821.9299 (1.64)     826.8813 (1.63)     824.3702 (1.63)     2.0094 (1.0)      823.7400 (1.63)      3.1751 (1.0)           2;0  1.2130 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       516.7772 (1.0)        526.0302 (1.0)        522.1660 (1.0)      3.5032 (1.52)       522.7481 (1.0)      4.5217 (1.92)          2;0  1.9151 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,130.8121 (2.19)     1,145.5792 (2.18)     1,138.8197 (2.18)     5.8474 (2.54)     1,137.4528 (2.18)     8.6292 (3.66)          2;0  0.8781 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       898.1857 (1.74)       904.5717 (1.72)       901.6666 (1.73)     2.3030 (1.0)        902.0118 (1.73)     2.3560 (1.0)           2;0  1.1091 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]       899.7786 (1.74)       911.2054 (1.73)       903.6388 (1.73)     5.1207 (2.22)       900.3354 (1.72)     7.8020 (3.31)          1;0  1.1066 (0.58)          5           3
test_plots-plots-diff-json[main]         897.3794 (1.74)       909.9336 (1.73)       901.6304 (1.73)     5.1731 (2.25)       899.7526 (1.72)     7.1273 (3.03)          1;0  1.1091 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     416.4816 (1.0)      436.6242 (1.0)      425.6352 (1.0)      7.6601 (1.69)     425.7799 (1.0)      10.6661 (1.90)          2;0  2.3494 (1.0)           5           3
test_plots-plots-show[3.10.0]     726.2885 (1.74)     739.7313 (1.69)     731.7043 (1.72)     5.1860 (1.14)     730.7334 (1.72)      6.9617 (1.24)          2;0  1.3667 (0.58)          5           3
test_plots-plots-show[3.53.2]     696.2710 (1.67)     708.4697 (1.62)     703.2100 (1.65)     4.5452 (1.0)      703.9997 (1.65)      5.6046 (1.0)           2;0  1.4221 (0.61)          5           3
test_plots-plots-show[3.60.1]     703.9992 (1.69)     721.8121 (1.65)     709.4340 (1.67)     7.4642 (1.64)     706.2128 (1.66)      9.5177 (1.70)          1;0  1.4096 (0.60)          5           3
test_plots-plots-show[main]       700.7132 (1.68)     711.8470 (1.63)     705.4984 (1.66)     4.7472 (1.04)     705.6031 (1.66)      8.1436 (1.45)          2;0  1.4174 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     430.0041 (1.0)      449.2678 (1.0)      437.8058 (1.0)       7.0966 (2.12)     435.9083 (1.0)       6.9498 (1.31)          2;0  2.2841 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     855.1138 (1.99)     893.5046 (1.99)     876.8978 (2.00)     16.2584 (4.87)     879.7571 (2.02)     27.8506 (5.25)          2;0  1.1404 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     743.8118 (1.73)     762.3304 (1.70)     751.4168 (1.72)      8.1575 (2.44)     748.4880 (1.72)     14.1513 (2.67)          1;0  1.3308 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     749.8540 (1.74)     762.9464 (1.70)     754.7428 (1.72)      5.2859 (1.58)     752.3092 (1.73)      7.2770 (1.37)          1;0  1.3250 (0.58)          5           3
test_plots-plots-show-json[main]       748.2777 (1.74)     756.1728 (1.68)     751.3164 (1.72)      3.3414 (1.0)      749.9532 (1.72)      5.3078 (1.0)           1;0  1.3310 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.5695 (2.38)     52.5695 (2.38)     52.5695 (2.38)     0.0000 (1.0)      52.5695 (2.38)     0.0000 (1.0)           0;0  0.0190 (0.42)          1           1
test_push-push[3.10.0]     47.1111 (2.13)     47.1111 (2.13)     47.1111 (2.13)     0.0000 (1.0)      47.1111 (2.13)     0.0000 (1.0)           0;0  0.0212 (0.47)          1           1
test_push-push[3.53.2]     22.8374 (1.03)     22.8374 (1.03)     22.8374 (1.03)     0.0000 (1.0)      22.8374 (1.03)     0.0000 (1.0)           0;0  0.0438 (0.97)          1           1
test_push-push[3.60.1]     22.1131 (1.0)      22.1131 (1.0)      22.1131 (1.0)      0.0000 (1.0)      22.1131 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_push-push[main]       22.1317 (1.00)     22.1317 (1.00)     22.1317 (1.00)     0.0000 (1.0)      22.1317 (1.00)     0.0000 (1.0)           0;0  0.0452 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.7694 (2.76)     64.7694 (2.76)     64.7694 (2.76)     0.0000 (1.0)      64.7694 (2.76)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.2175 (2.99)     70.2175 (2.99)     70.2175 (2.99)     0.0000 (1.0)      70.2175 (2.99)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_sharing-fetch[3.53.2]     34.1535 (1.45)     34.1535 (1.45)     34.1535 (1.45)     0.0000 (1.0)      34.1535 (1.45)     0.0000 (1.0)           0;0  0.0293 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.6458 (1.01)     23.6458 (1.01)     23.6458 (1.01)     0.0000 (1.0)      23.6458 (1.01)     0.0000 (1.0)           0;0  0.0423 (0.99)          1           1
test_sharing-fetch[main]       23.4935 (1.0)      23.4935 (1.0)      23.4935 (1.0)      0.0000 (1.0)      23.4935 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2987 (1.0)      1.2987 (1.0)      1.2987 (1.0)      0.0000 (1.0)      1.2987 (1.0)      0.0000 (1.0)           0;0  0.7700 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6071 (2.78)     3.6071 (2.78)     3.6071 (2.78)     0.0000 (1.0)      3.6071 (2.78)     0.0000 (1.0)           0;0  0.2772 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     5.8059 (4.47)     5.8059 (4.47)     5.8059 (4.47)     0.0000 (1.0)      5.8059 (4.47)     0.0000 (1.0)           0;0  0.1722 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9432 (4.58)     5.9432 (4.58)     5.9432 (4.58)     0.0000 (1.0)      5.9432 (4.58)     0.0000 (1.0)           0;0  0.1683 (0.22)          1           1
test_sharing-fetch-noop[main]       6.1184 (4.71)     6.1184 (4.71)     6.1184 (4.71)     0.0000 (1.0)      6.1184 (4.71)     0.0000 (1.0)           0;0  0.1634 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.6297 (2.38)     52.6297 (2.38)     52.6297 (2.38)     0.0000 (1.0)      52.6297 (2.38)     0.0000 (1.0)           0;0  0.0190 (0.42)          1           1
test_sharing-push[3.10.0]     47.1593 (2.13)     47.1593 (2.13)     47.1593 (2.13)     0.0000 (1.0)      47.1593 (2.13)     0.0000 (1.0)           0;0  0.0212 (0.47)          1           1
test_sharing-push[3.53.2]     23.0830 (1.04)     23.0830 (1.04)     23.0830 (1.04)     0.0000 (1.0)      23.0830 (1.04)     0.0000 (1.0)           0;0  0.0433 (0.96)          1           1
test_sharing-push[3.60.1]     22.1520 (1.00)     22.1520 (1.00)     22.1520 (1.00)     0.0000 (1.0)      22.1520 (1.00)     0.0000 (1.0)           0;0  0.0451 (1.00)          1           1
test_sharing-push[main]       22.0918 (1.0)      22.0918 (1.0)      22.0918 (1.0)      0.0000 (1.0)      22.0918 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1553 (1.0)      2.1553 (1.0)      2.1553 (1.0)      0.0000 (1.0)      2.1553 (1.0)      0.0000 (1.0)           0;0  0.4640 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1572 (1.00)     2.1572 (1.00)     2.1572 (1.00)     0.0000 (1.0)      2.1572 (1.00)     0.0000 (1.0)           0;0  0.4636 (1.00)          1           1
test_sharing-push-noop[3.53.2]     6.1557 (2.86)     6.1557 (2.86)     6.1557 (2.86)     0.0000 (1.0)      6.1557 (2.86)     0.0000 (1.0)           0;0  0.1624 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.1133 (2.84)     6.1133 (2.84)     6.1133 (2.84)     0.0000 (1.0)      6.1133 (2.84)     0.0000 (1.0)           0;0  0.1636 (0.35)          1           1
test_sharing-push-noop[main]       6.1606 (2.86)     6.1606 (2.86)     6.1606 (2.86)     0.0000 (1.0)      6.1606 (2.86)     0.0000 (1.0)           0;0  0.1623 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     220.2149 (1.05)     220.2149 (1.05)     220.2149 (1.05)     0.0000 (1.0)      220.2149 (1.05)     0.0000 (1.0)           0;0  0.0045 (0.96)          1           1
test_sharing_azure-fetch[main]       210.5724 (1.0)      210.5724 (1.0)      210.5724 (1.0)      0.0000 (1.0)      210.5724 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4116 (1.0)      6.4116 (1.0)      6.4116 (1.0)      0.0000 (1.0)      6.4116 (1.0)      0.0000 (1.0)           0;0  0.1560 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5590 (1.02)     6.5590 (1.02)     6.5590 (1.02)     0.0000 (1.0)      6.5590 (1.02)     0.0000 (1.0)           0;0  0.1525 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     223.1078 (1.02)     223.1078 (1.02)     223.1078 (1.02)     0.0000 (1.0)      223.1078 (1.02)     0.0000 (1.0)           0;0  0.0045 (0.98)          1           1
test_sharing_azure-push[main]       219.5330 (1.0)      219.5330 (1.0)      219.5330 (1.0)      0.0000 (1.0)      219.5330 (1.0)      0.0000 (1.0)           0;0  0.0046 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.2907 (1.01)     7.2907 (1.01)     7.2907 (1.01)     0.0000 (1.0)      7.2907 (1.01)     0.0000 (1.0)           0;0  0.1372 (0.99)          1           1
test_sharing_azure-push-noop[main]       7.2371 (1.0)      7.2371 (1.0)      7.2371 (1.0)      0.0000 (1.0)      7.2371 (1.0)      0.0000 (1.0)           0;0  0.1382 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     405.3064 (1.0)      405.3064 (1.0)      405.3064 (1.0)      0.0000 (1.0)      405.3064 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
test_sharing_gs-fetch[main]       406.2068 (1.00)     406.2068 (1.00)     406.2068 (1.00)     0.0000 (1.0)      406.2068 (1.00)     0.0000 (1.0)           0;0  0.0025 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     20.5329 (1.0)      20.5329 (1.0)      20.5329 (1.0)      0.0000 (1.0)      20.5329 (1.0)      0.0000 (1.0)           0;0  0.0487 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       20.6026 (1.00)     20.6026 (1.00)     20.6026 (1.00)     0.0000 (1.0)      20.6026 (1.00)     0.0000 (1.0)           0;0  0.0485 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     699.4326 (1.0)      699.4326 (1.0)      699.4326 (1.0)      0.0000 (1.0)      699.4326 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
test_sharing_gs-push[main]       724.3823 (1.04)     724.3823 (1.04)     724.3823 (1.04)     0.0000 (1.0)      724.3823 (1.04)     0.0000 (1.0)           0;0  0.0014 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8687 (1.0)      6.8687 (1.0)      6.8687 (1.0)      0.0000 (1.0)      6.8687 (1.0)      0.0000 (1.0)           0;0  0.1456 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.0425 (1.03)     7.0425 (1.03)     7.0425 (1.03)     0.0000 (1.0)      7.0425 (1.03)     0.0000 (1.0)           0;0  0.1420 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     487.6039 (1.0)      487.6039 (1.0)      487.6039 (1.0)      0.0000 (1.0)      487.6039 (1.0)      0.0000 (1.0)           0;0  0.0021 (1.0)           1           1
test_sharing_s3-fetch[main]       489.3554 (1.00)     489.3554 (1.00)     489.3554 (1.00)     0.0000 (1.0)      489.3554 (1.00)     0.0000 (1.0)           0;0  0.0020 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.3536 (1.0)      6.3536 (1.0)      6.3536 (1.0)      0.0000 (1.0)      6.3536 (1.0)      0.0000 (1.0)           0;0  0.1574 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3601 (1.00)     6.3601 (1.00)     6.3601 (1.00)     0.0000 (1.0)      6.3601 (1.00)     0.0000 (1.0)           0;0  0.1572 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     638.8376 (1.00)     638.8376 (1.00)     638.8376 (1.00)     0.0000 (1.0)      638.8376 (1.00)     0.0000 (1.0)           0;0  0.0016 (1.00)          1           1
test_sharing_s3-push[main]       637.5557 (1.0)      637.5557 (1.0)      637.5557 (1.0)      0.0000 (1.0)      637.5557 (1.0)      0.0000 (1.0)           0;0  0.0016 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.6640 (1.01)     6.6640 (1.01)     6.6640 (1.01)     0.0000 (1.0)      6.6640 (1.01)     0.0000 (1.0)           0;0  0.1501 (0.99)          1           1
test_sharing_s3-push-noop[main]       6.5969 (1.0)      6.5969 (1.0)      6.5969 (1.0)      0.0000 (1.0)      6.5969 (1.0)      0.0000 (1.0)           0;0  0.1516 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.3913 (3.73)     19.3913 (3.73)     19.3913 (3.73)     0.0000 (1.0)      19.3913 (3.73)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_status-status[3.10.0]     19.3339 (3.72)     19.3339 (3.72)     19.3339 (3.72)     0.0000 (1.0)      19.3339 (3.72)     0.0000 (1.0)           0;0  0.0517 (0.27)          1           1
test_status-status[3.53.2]     17.5724 (3.38)     17.5724 (3.38)     17.5724 (3.38)     0.0000 (1.0)      17.5724 (3.38)     0.0000 (1.0)           0;0  0.0569 (0.30)          1           1
test_status-status[3.60.1]      5.1970 (1.0)       5.1970 (1.0)       5.1970 (1.0)      0.0000 (1.0)       5.1970 (1.0)      0.0000 (1.0)           0;0  0.1924 (1.0)           1           1
test_status-status[main]        5.5092 (1.06)      5.5092 (1.06)      5.5092 (1.06)     0.0000 (1.0)       5.5092 (1.06)     0.0000 (1.0)           0;0  0.1815 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6546 (1.76)     4.6546 (1.76)     4.6546 (1.76)     0.0000 (1.0)      4.6546 (1.76)     0.0000 (1.0)           0;0  0.2148 (0.57)          1           1
test_status-status-changed[3.10.0]     4.9430 (1.87)     4.9430 (1.87)     4.9430 (1.87)     0.0000 (1.0)      4.9430 (1.87)     0.0000 (1.0)           0;0  0.2023 (0.53)          1           1
test_status-status-changed[3.53.2]     4.7634 (1.80)     4.7634 (1.80)     4.7634 (1.80)     0.0000 (1.0)      4.7634 (1.80)     0.0000 (1.0)           0;0  0.2099 (0.56)          1           1
test_status-status-changed[3.60.1]     2.6443 (1.0)      2.6443 (1.0)      2.6443 (1.0)      0.0000 (1.0)      2.6443 (1.0)      0.0000 (1.0)           0;0  0.3782 (1.0)           1           1
test_status-status-changed[main]       2.8942 (1.09)     2.8942 (1.09)     2.8942 (1.09)     0.0000 (1.0)      2.8942 (1.09)     0.0000 (1.0)           0;0  0.3455 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8357 (1.89)     4.8357 (1.89)     4.8357 (1.89)     0.0000 (1.0)      4.8357 (1.89)     0.0000 (1.0)           0;0  0.2068 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     4.8916 (1.91)     4.8916 (1.91)     4.8916 (1.91)     0.0000 (1.0)      4.8916 (1.91)     0.0000 (1.0)           0;0  0.2044 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.7159 (1.84)     4.7159 (1.84)     4.7159 (1.84)     0.0000 (1.0)      4.7159 (1.84)     0.0000 (1.0)           0;0  0.2120 (0.54)          1           1
test_status-status-changed-noop[3.60.1]     2.5565 (1.0)      2.5565 (1.0)      2.5565 (1.0)      0.0000 (1.0)      2.5565 (1.0)      0.0000 (1.0)           0;0  0.3912 (1.0)           1           1
test_status-status-changed-noop[main]       2.8300 (1.11)     2.8300 (1.11)     2.8300 (1.11)     0.0000 (1.0)      2.8300 (1.11)     0.0000 (1.0)           0;0  0.3534 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7613 (1.85)     4.7613 (1.85)     4.7613 (1.85)     0.0000 (1.0)      4.7613 (1.85)     0.0000 (1.0)           0;0  0.2100 (0.54)          1           1
test_status-status-noop[3.10.0]     4.8731 (1.89)     4.8731 (1.89)     4.8731 (1.89)     0.0000 (1.0)      4.8731 (1.89)     0.0000 (1.0)           0;0  0.2052 (0.53)          1           1
test_status-status-noop[3.53.2]     4.7015 (1.82)     4.7015 (1.82)     4.7015 (1.82)     0.0000 (1.0)      4.7015 (1.82)     0.0000 (1.0)           0;0  0.2127 (0.55)          1           1
test_status-status-noop[3.60.1]     2.5767 (1.0)      2.5767 (1.0)      2.5767 (1.0)      0.0000 (1.0)      2.5767 (1.0)      0.0000 (1.0)           0;0  0.3881 (1.0)           1           1
test_status-status-noop[main]       2.8896 (1.12)     2.8896 (1.12)     2.8896 (1.12)     0.0000 (1.0)      2.8896 (1.12)     0.0000 (1.0)           0;0  0.3461 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     149.6950 (3.16)     149.6950 (3.16)     149.6950 (3.16)     0.0000 (1.0)      149.6950 (3.16)     0.0000 (1.0)           0;0  0.0067 (0.32)          1           1
test_update-import-url[3.10.0]     154.6606 (3.26)     154.6606 (3.26)     154.6606 (3.26)     0.0000 (1.0)      154.6606 (3.26)     0.0000 (1.0)           0;0  0.0065 (0.31)          1           1
test_update-import-url[3.53.2]     115.8998 (2.45)     115.8998 (2.45)     115.8998 (2.45)     0.0000 (1.0)      115.8998 (2.45)     0.0000 (1.0)           0;0  0.0086 (0.41)          1           1
test_update-import-url[3.60.1]      47.3894 (1.0)       47.3894 (1.0)       47.3894 (1.0)      0.0000 (1.0)       47.3894 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
test_update-import-url[main]        48.3514 (1.02)      48.3514 (1.02)      48.3514 (1.02)     0.0000 (1.0)       48.3514 (1.02)     0.0000 (1.0)           0;0  0.0207 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     136.3992 (3.66)     136.3992 (3.66)     136.3992 (3.66)     0.0000 (1.0)      136.3992 (3.66)     0.0000 (1.0)           0;0  0.0073 (0.27)          1           1
test_update-update[3.10.0]     140.7344 (3.78)     140.7344 (3.78)     140.7344 (3.78)     0.0000 (1.0)      140.7344 (3.78)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.53.2]     105.2852 (2.83)     105.2852 (2.83)     105.2852 (2.83)     0.0000 (1.0)      105.2852 (2.83)     0.0000 (1.0)           0;0  0.0095 (0.35)          1           1
test_update-update[3.60.1]      37.2234 (1.0)       37.2234 (1.0)       37.2234 (1.0)      0.0000 (1.0)       37.2234 (1.0)      0.0000 (1.0)           0;0  0.0269 (1.0)           1           1
test_update-update[main]        38.1208 (1.02)      38.1208 (1.02)      38.1208 (1.02)     0.0000 (1.0)       38.1208 (1.02)     0.0000 (1.0)           0;0  0.0262 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0255 (1.90)     16.0255 (1.90)     16.0255 (1.90)     0.0000 (1.0)      16.0255 (1.90)     0.0000 (1.0)           0;0  0.0624 (0.53)          1           1
test_update-update-noop[3.10.0]     16.6557 (1.97)     16.6557 (1.97)     16.6557 (1.97)     0.0000 (1.0)      16.6557 (1.97)     0.0000 (1.0)           0;0  0.0600 (0.51)          1           1
test_update-update-noop[3.53.2]     16.1691 (1.92)     16.1691 (1.92)     16.1691 (1.92)     0.0000 (1.0)      16.1691 (1.92)     0.0000 (1.0)           0;0  0.0618 (0.52)          1           1
test_update-update-noop[3.60.1]      8.4345 (1.0)       8.4345 (1.0)       8.4345 (1.0)      0.0000 (1.0)       8.4345 (1.0)      0.0000 (1.0)           0;0  0.1186 (1.0)           1           1
test_update-update-noop[main]        9.1648 (1.09)      9.1648 (1.09)      9.1648 (1.09)     0.0000 (1.0)       9.1648 (1.09)     0.0000 (1.0)           0;0  0.1091 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean