Sun Aug  3 01:32:38 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.9638 (3.74)     85.9638 (3.74)     85.9638 (3.74)     0.0000 (1.0)      85.9638 (3.74)     0.0000 (1.0)           0;0  0.0116 (0.27)          1           1
test_add_copy-add[3.10.0]     87.0281 (3.79)     87.0281 (3.79)     87.0281 (3.79)     0.0000 (1.0)      87.0281 (3.79)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_add_copy-add[3.53.2]     76.7386 (3.34)     76.7386 (3.34)     76.7386 (3.34)     0.0000 (1.0)      76.7386 (3.34)     0.0000 (1.0)           0;0  0.0130 (0.30)          1           1
test_add_copy-add[3.60.1]     23.0277 (1.00)     23.0277 (1.00)     23.0277 (1.00)     0.0000 (1.0)      23.0277 (1.00)     0.0000 (1.0)           0;0  0.0434 (1.00)          1           1
test_add_copy-add[main]       22.9755 (1.0)      22.9755 (1.0)      22.9755 (1.0)      0.0000 (1.0)      22.9755 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.5348 (6.64)     29.5348 (6.64)     29.5348 (6.64)     0.0000 (1.0)      29.5348 (6.64)     0.0000 (1.0)           0;0  0.0339 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     30.3579 (6.82)     30.3579 (6.82)     30.3579 (6.82)     0.0000 (1.0)      30.3579 (6.82)     0.0000 (1.0)           0;0  0.0329 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.4574 (6.40)     28.4574 (6.40)     28.4574 (6.40)     0.0000 (1.0)      28.4574 (6.40)     0.0000 (1.0)           0;0  0.0351 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4835 (1.01)      4.4835 (1.01)      4.4835 (1.01)     0.0000 (1.0)       4.4835 (1.01)     0.0000 (1.0)           0;0  0.2230 (0.99)          1           1
test_add_copy-add-noop[main]        4.4495 (1.0)       4.4495 (1.0)       4.4495 (1.0)      0.0000 (1.0)       4.4495 (1.0)      0.0000 (1.0)           0;0  0.2247 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     68.8636 (4.21)     68.8636 (4.21)     68.8636 (4.21)     0.0000 (1.0)      68.8636 (4.21)     0.0000 (1.0)           0;0  0.0145 (0.24)          1           1
test_add_hardlink-add[3.10.0]     68.2542 (4.18)     68.2542 (4.18)     68.2542 (4.18)     0.0000 (1.0)      68.2542 (4.18)     0.0000 (1.0)           0;0  0.0147 (0.24)          1           1
test_add_hardlink-add[3.53.2]     61.7313 (3.78)     61.7313 (3.78)     61.7313 (3.78)     0.0000 (1.0)      61.7313 (3.78)     0.0000 (1.0)           0;0  0.0162 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.3462 (1.0)      16.3462 (1.0)      16.3462 (1.0)      0.0000 (1.0)      16.3462 (1.0)      0.0000 (1.0)           0;0  0.0612 (1.0)           1           1
test_add_hardlink-add[main]       17.0744 (1.04)     17.0744 (1.04)     17.0744 (1.04)     0.0000 (1.0)      17.0744 (1.04)     0.0000 (1.0)           0;0  0.0586 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     35.9559 (7.95)     35.9559 (7.95)     35.9559 (7.95)     0.0000 (1.0)      35.9559 (7.95)     0.0000 (1.0)           0;0  0.0278 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     36.1942 (8.00)     36.1942 (8.00)     36.1942 (8.00)     0.0000 (1.0)      36.1942 (8.00)     0.0000 (1.0)           0;0  0.0276 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     33.6033 (7.43)     33.6033 (7.43)     33.6033 (7.43)     0.0000 (1.0)      33.6033 (7.43)     0.0000 (1.0)           0;0  0.0298 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5247 (1.0)       4.5247 (1.0)       4.5247 (1.0)      0.0000 (1.0)       4.5247 (1.0)      0.0000 (1.0)           0;0  0.2210 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.5993 (1.02)      4.5993 (1.02)      4.5993 (1.02)     0.0000 (1.0)       4.5993 (1.02)     0.0000 (1.0)           0;0  0.2174 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.3970 (2.04)     71.3970 (2.04)     71.3970 (2.04)     0.0000 (1.0)      71.3970 (2.04)     0.0000 (1.0)           0;0  0.0140 (0.49)          1           1
test_add_symlink-add[3.10.0]     71.5667 (2.05)     71.5667 (2.05)     71.5667 (2.05)     0.0000 (1.0)      71.5667 (2.05)     0.0000 (1.0)           0;0  0.0140 (0.49)          1           1
test_add_symlink-add[3.53.2]     65.0952 (1.86)     65.0952 (1.86)     65.0952 (1.86)     0.0000 (1.0)      65.0952 (1.86)     0.0000 (1.0)           0;0  0.0154 (0.54)          1           1
test_add_symlink-add[3.60.1]     34.9237 (1.0)      34.9237 (1.0)      34.9237 (1.0)      0.0000 (1.0)      34.9237 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_add_symlink-add[main]       35.5160 (1.02)     35.5160 (1.02)     35.5160 (1.02)     0.0000 (1.0)      35.5160 (1.02)     0.0000 (1.0)           0;0  0.0282 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.6876 (8.37)     47.6876 (8.37)     47.6876 (8.37)     0.0000 (1.0)      47.6876 (8.37)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     48.2264 (8.46)     48.2264 (8.46)     48.2264 (8.46)     0.0000 (1.0)      48.2264 (8.46)     0.0000 (1.0)           0;0  0.0207 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.3389 (8.13)     46.3389 (8.13)     46.3389 (8.13)     0.0000 (1.0)      46.3389 (8.13)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.6988 (1.0)       5.6988 (1.0)       5.6988 (1.0)      0.0000 (1.0)       5.6988 (1.0)      0.0000 (1.0)           0;0  0.1755 (1.0)           1           1
test_add_symlink-add-noop[main]        5.8523 (1.03)      5.8523 (1.03)      5.8523 (1.03)     0.0000 (1.0)       5.8523 (1.03)     0.0000 (1.0)           0;0  0.1709 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.4617 (1.99)     41.4617 (1.99)     41.4617 (1.99)     0.0000 (1.0)      41.4617 (1.99)     0.0000 (1.0)           0;0  0.0241 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     60.4673 (2.90)     60.4673 (2.90)     60.4673 (2.90)     0.0000 (1.0)      60.4673 (2.90)     0.0000 (1.0)           0;0  0.0165 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     28.1108 (1.35)     28.1108 (1.35)     28.1108 (1.35)     0.0000 (1.0)      28.1108 (1.35)     0.0000 (1.0)           0;0  0.0356 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     20.8616 (1.0)      20.8616 (1.0)      20.8616 (1.0)      0.0000 (1.0)      20.8616 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]       21.7141 (1.04)     21.7141 (1.04)     21.7141 (1.04)     0.0000 (1.0)      21.7141 (1.04)     0.0000 (1.0)           0;0  0.0461 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3734 (1.64)     5.3734 (1.64)     5.3734 (1.64)     0.0000 (1.0)      5.3734 (1.64)     0.0000 (1.0)           0;0  0.1861 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7073 (1.74)     5.7073 (1.74)     5.7073 (1.74)     0.0000 (1.0)      5.7073 (1.74)     0.0000 (1.0)           0;0  0.1752 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4406 (1.66)     5.4406 (1.66)     5.4406 (1.66)     0.0000 (1.0)      5.4406 (1.66)     0.0000 (1.0)           0;0  0.1838 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2801 (1.0)      3.2801 (1.0)      3.2801 (1.0)      0.0000 (1.0)      3.2801 (1.0)      0.0000 (1.0)           0;0  0.3049 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3109 (1.01)     3.3109 (1.01)     3.3109 (1.01)     0.0000 (1.0)      3.3109 (1.01)     0.0000 (1.0)           0;0  0.3020 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6919 (2.20)     8.6919 (2.20)     8.6919 (2.20)     0.0000 (1.0)      8.6919 (2.20)     0.0000 (1.0)           0;0  0.1150 (0.45)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3908 (1.62)     6.3908 (1.62)     6.3908 (1.62)     0.0000 (1.0)      6.3908 (1.62)     0.0000 (1.0)           0;0  0.1565 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1677 (1.56)     6.1677 (1.56)     6.1677 (1.56)     0.0000 (1.0)      6.1677 (1.56)     0.0000 (1.0)           0;0  0.1621 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0207 (1.02)     4.0207 (1.02)     4.0207 (1.02)     0.0000 (1.0)      4.0207 (1.02)     0.0000 (1.0)           0;0  0.2487 (0.98)          1           1
test_checkout_copy-checkout-update[main]       3.9533 (1.0)      3.9533 (1.0)      3.9533 (1.0)      0.0000 (1.0)      3.9533 (1.0)      0.0000 (1.0)           0;0  0.2530 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     20.8375 (2.94)     20.8375 (2.94)     20.8375 (2.94)     0.0000 (1.0)      20.8375 (2.94)     0.0000 (1.0)           0;0  0.0480 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.2838 (2.15)     15.2838 (2.15)     15.2838 (2.15)     0.0000 (1.0)      15.2838 (2.15)     0.0000 (1.0)           0;0  0.0654 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.1288 (1.99)     14.1288 (1.99)     14.1288 (1.99)     0.0000 (1.0)      14.1288 (1.99)     0.0000 (1.0)           0;0  0.0708 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.0947 (1.0)       7.0947 (1.0)       7.0947 (1.0)      0.0000 (1.0)       7.0947 (1.0)      0.0000 (1.0)           0;0  0.1410 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.6101 (1.07)      7.6101 (1.07)      7.6101 (1.07)     0.0000 (1.0)       7.6101 (1.07)     0.0000 (1.0)           0;0  0.1314 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4066 (1.67)     5.4066 (1.67)     5.4066 (1.67)     0.0000 (1.0)      5.4066 (1.67)     0.0000 (1.0)           0;0  0.1850 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5302 (1.70)     5.5302 (1.70)     5.5302 (1.70)     0.0000 (1.0)      5.5302 (1.70)     0.0000 (1.0)           0;0  0.1808 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4654 (1.68)     5.4654 (1.68)     5.4654 (1.68)     0.0000 (1.0)      5.4654 (1.68)     0.0000 (1.0)           0;0  0.1830 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2460 (1.0)      3.2460 (1.0)      3.2460 (1.0)      0.0000 (1.0)      3.2460 (1.0)      0.0000 (1.0)           0;0  0.3081 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.2982 (1.02)     3.2982 (1.02)     3.2982 (1.02)     0.0000 (1.0)      3.2982 (1.02)     0.0000 (1.0)           0;0  0.3032 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.5457 (2.20)     8.5457 (2.20)     8.5457 (2.20)     0.0000 (1.0)      8.5457 (2.20)     0.0000 (1.0)           0;0  0.1170 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3306 (1.63)     6.3306 (1.63)     6.3306 (1.63)     0.0000 (1.0)      6.3306 (1.63)     0.0000 (1.0)           0;0  0.1580 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1573 (1.59)     6.1573 (1.59)     6.1573 (1.59)     0.0000 (1.0)      6.1573 (1.59)     0.0000 (1.0)           0;0  0.1624 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8789 (1.0)      3.8789 (1.0)      3.8789 (1.0)      0.0000 (1.0)      3.8789 (1.0)      0.0000 (1.0)           0;0  0.2578 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.9150 (1.01)     3.9150 (1.01)     3.9150 (1.01)     0.0000 (1.0)      3.9150 (1.01)     0.0000 (1.0)           0;0  0.2554 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9620 (2.46)     24.9620 (2.46)     24.9620 (2.46)     0.0000 (1.0)      24.9620 (2.46)     0.0000 (1.0)           0;0  0.0401 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     18.8261 (1.86)     18.8261 (1.86)     18.8261 (1.86)     0.0000 (1.0)      18.8261 (1.86)     0.0000 (1.0)           0;0  0.0531 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     17.4491 (1.72)     17.4491 (1.72)     17.4491 (1.72)     0.0000 (1.0)      17.4491 (1.72)     0.0000 (1.0)           0;0  0.0573 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1405 (1.0)      10.1405 (1.0)      10.1405 (1.0)      0.0000 (1.0)      10.1405 (1.0)      0.0000 (1.0)           0;0  0.0986 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.5472 (1.04)     10.5472 (1.04)     10.5472 (1.04)     0.0000 (1.0)      10.5472 (1.04)     0.0000 (1.0)           0;0  0.0948 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8921 (1.52)     6.8921 (1.52)     6.8921 (1.52)     0.0000 (1.0)      6.8921 (1.52)     0.0000 (1.0)           0;0  0.1451 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9638 (1.53)     6.9638 (1.53)     6.9638 (1.53)     0.0000 (1.0)      6.9638 (1.53)     0.0000 (1.0)           0;0  0.1436 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9015 (1.52)     6.9015 (1.52)     6.9015 (1.52)     0.0000 (1.0)      6.9015 (1.52)     0.0000 (1.0)           0;0  0.1449 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.5480 (1.0)      4.5480 (1.0)      4.5480 (1.0)      0.0000 (1.0)      4.5480 (1.0)      0.0000 (1.0)           0;0  0.2199 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5671 (1.00)     4.5671 (1.00)     4.5671 (1.00)     0.0000 (1.0)      4.5671 (1.00)     0.0000 (1.0)           0;0  0.2190 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.9700 (1.81)     10.9700 (1.81)     10.9700 (1.81)     0.0000 (1.0)      10.9700 (1.81)     0.0000 (1.0)           0;0  0.0912 (0.55)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7023 (1.44)      8.7023 (1.44)      8.7023 (1.44)     0.0000 (1.0)       8.7023 (1.44)     0.0000 (1.0)           0;0  0.1149 (0.70)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.8115 (1.46)      8.8115 (1.46)      8.8115 (1.46)     0.0000 (1.0)       8.8115 (1.46)     0.0000 (1.0)           0;0  0.1135 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      6.0517 (1.0)       6.0517 (1.0)       6.0517 (1.0)      0.0000 (1.0)       6.0517 (1.0)      0.0000 (1.0)           0;0  0.1652 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.1260 (1.01)      6.1260 (1.01)      6.1260 (1.01)     0.0000 (1.0)       6.1260 (1.01)     0.0000 (1.0)           0;0  0.1632 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0641 (1.72)     4.0641 (1.72)     4.0641 (1.72)     0.0000 (1.0)      4.0641 (1.72)     0.0000 (1.0)           0;0  0.2461 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7466 (2.01)     4.7466 (2.01)     4.7466 (2.01)     0.0000 (1.0)      4.7466 (2.01)     0.0000 (1.0)           0;0  0.2107 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.5707 (1.94)     4.5707 (1.94)     4.5707 (1.94)     0.0000 (1.0)      4.5707 (1.94)     0.0000 (1.0)           0;0  0.2188 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.3878 (1.01)     2.3878 (1.01)     2.3878 (1.01)     0.0000 (1.0)      2.3878 (1.01)     0.0000 (1.0)           0;0  0.4188 (0.99)          1           1
test_data_status-data-changed[main]       2.3605 (1.0)      2.3605 (1.0)      2.3605 (1.0)      0.0000 (1.0)      2.3605 (1.0)      0.0000 (1.0)           0;0  0.4236 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9963 (1.66)     3.9963 (1.66)     3.9963 (1.66)     0.0000 (1.0)      3.9963 (1.66)     0.0000 (1.0)           0;0  0.2502 (0.60)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7239 (1.97)     4.7239 (1.97)     4.7239 (1.97)     0.0000 (1.0)      4.7239 (1.97)     0.0000 (1.0)           0;0  0.2117 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6253 (1.93)     4.6253 (1.93)     4.6253 (1.93)     0.0000 (1.0)      4.6253 (1.93)     0.0000 (1.0)           0;0  0.2162 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4004 (1.0)      2.4004 (1.0)      2.4004 (1.0)      0.0000 (1.0)      2.4004 (1.0)      0.0000 (1.0)           0;0  0.4166 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.4822 (1.03)     2.4822 (1.03)     2.4822 (1.03)     0.0000 (1.0)      2.4822 (1.03)     0.0000 (1.0)           0;0  0.4029 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.7575 (3.77)     18.7575 (3.77)     18.7575 (3.77)     0.0000 (1.0)      18.7575 (3.77)     0.0000 (1.0)           0;0  0.0533 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.8973 (4.00)     19.8973 (4.00)     19.8973 (4.00)     0.0000 (1.0)      19.8973 (4.00)     0.0000 (1.0)           0;0  0.0503 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.6969 (3.96)     19.6969 (3.96)     19.6969 (3.96)     0.0000 (1.0)      19.6969 (3.96)     0.0000 (1.0)           0;0  0.0508 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.9706 (1.0)       4.9706 (1.0)       4.9706 (1.0)      0.0000 (1.0)       4.9706 (1.0)      0.0000 (1.0)           0;0  0.2012 (1.0)           1           1
test_data_status-data-new[main]        5.0607 (1.02)      5.0607 (1.02)      5.0607 (1.02)     0.0000 (1.0)       5.0607 (1.02)     0.0000 (1.0)           0;0  0.1976 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2276 (1.78)     4.2276 (1.78)     4.2276 (1.78)     0.0000 (1.0)      4.2276 (1.78)     0.0000 (1.0)           0;0  0.2365 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.7194 (1.99)     4.7194 (1.99)     4.7194 (1.99)     0.0000 (1.0)      4.7194 (1.99)     0.0000 (1.0)           0;0  0.2119 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.6136 (1.95)     4.6136 (1.95)     4.6136 (1.95)     0.0000 (1.0)      4.6136 (1.95)     0.0000 (1.0)           0;0  0.2168 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.3696 (1.0)      2.3696 (1.0)      2.3696 (1.0)      0.0000 (1.0)      2.3696 (1.0)      0.0000 (1.0)           0;0  0.4220 (1.0)           1           1
test_data_status-data-noop[main]       2.4252 (1.02)     2.4252 (1.02)     2.4252 (1.02)     0.0000 (1.0)      2.4252 (1.02)     0.0000 (1.0)           0;0  0.4123 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.3485 (1.33)     7.3485 (1.33)     7.3485 (1.33)     0.0000 (1.0)      7.3485 (1.33)     0.0000 (1.0)           0;0  0.1361 (0.75)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7567 (1.41)     7.7567 (1.41)     7.7567 (1.41)     0.0000 (1.0)      7.7567 (1.41)     0.0000 (1.0)           0;0  0.1289 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7400 (1.40)     7.7400 (1.40)     7.7400 (1.40)     0.0000 (1.0)      7.7400 (1.40)     0.0000 (1.0)           0;0  0.1292 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5207 (1.0)      5.5207 (1.0)      5.5207 (1.0)      0.0000 (1.0)      5.5207 (1.0)      0.0000 (1.0)           0;0  0.1811 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5259 (1.00)     5.5259 (1.00)     5.5259 (1.00)     0.0000 (1.0)      5.5259 (1.00)     0.0000 (1.0)           0;0  0.1810 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.0875 (1.29)     7.0875 (1.29)     7.0875 (1.29)     0.0000 (1.0)      7.0875 (1.29)     0.0000 (1.0)           0;0  0.1411 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7324 (1.41)     7.7324 (1.41)     7.7324 (1.41)     0.0000 (1.0)      7.7324 (1.41)     0.0000 (1.0)           0;0  0.1293 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6682 (1.39)     7.6682 (1.39)     7.6682 (1.39)     0.0000 (1.0)      7.6682 (1.39)     0.0000 (1.0)           0;0  0.1304 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6066 (1.02)     5.6066 (1.02)     5.6066 (1.02)     0.0000 (1.0)      5.6066 (1.02)     0.0000 (1.0)           0;0  0.1784 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.5022 (1.0)      5.5022 (1.0)      5.5022 (1.0)      0.0000 (1.0)      5.5022 (1.0)      0.0000 (1.0)           0;0  0.1817 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.2570 (2.69)     21.2570 (2.69)     21.2570 (2.69)     0.0000 (1.0)      21.2570 (2.69)     0.0000 (1.0)           0;0  0.0470 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.1923 (2.80)     22.1923 (2.80)     22.1923 (2.80)     0.0000 (1.0)      22.1923 (2.80)     0.0000 (1.0)           0;0  0.0451 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.2248 (2.81)     22.2248 (2.81)     22.2248 (2.81)     0.0000 (1.0)      22.2248 (2.81)     0.0000 (1.0)           0;0  0.0450 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9148 (1.0)       7.9148 (1.0)       7.9148 (1.0)      0.0000 (1.0)       7.9148 (1.0)      0.0000 (1.0)           0;0  0.1263 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1092 (1.02)      8.1092 (1.02)      8.1092 (1.02)     0.0000 (1.0)       8.1092 (1.02)     0.0000 (1.0)           0;0  0.1233 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4051 (1.33)     6.4051 (1.33)     6.4051 (1.33)     0.0000 (1.0)      6.4051 (1.33)     0.0000 (1.0)           0;0  0.1561 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0298 (1.46)     7.0298 (1.46)     7.0298 (1.46)     0.0000 (1.0)      7.0298 (1.46)     0.0000 (1.0)           0;0  0.1423 (0.69)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9079 (1.43)     6.9079 (1.43)     6.9079 (1.43)     0.0000 (1.0)      6.9079 (1.43)     0.0000 (1.0)           0;0  0.1448 (0.70)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8267 (1.0)      4.8267 (1.0)      4.8267 (1.0)      0.0000 (1.0)      4.8267 (1.0)      0.0000 (1.0)           0;0  0.2072 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.8596 (1.01)     4.8596 (1.01)     4.8596 (1.01)     0.0000 (1.0)      4.8596 (1.01)     0.0000 (1.0)           0;0  0.2058 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.8809 (2.66)     18.8809 (2.66)     18.8809 (2.66)     0.0000 (1.0)      18.8809 (2.66)     0.0000 (1.0)           0;0  0.0530 (0.38)          1           1
test_diff-diff[3.10.0]     20.2684 (2.86)     20.2684 (2.86)     20.2684 (2.86)     0.0000 (1.0)      20.2684 (2.86)     0.0000 (1.0)           0;0  0.0493 (0.35)          1           1
test_diff-diff[3.53.2]     19.9760 (2.82)     19.9760 (2.82)     19.9760 (2.82)     0.0000 (1.0)      19.9760 (2.82)     0.0000 (1.0)           0;0  0.0501 (0.35)          1           1
test_diff-diff[3.60.1]      7.0889 (1.0)       7.0889 (1.0)       7.0889 (1.0)      0.0000 (1.0)       7.0889 (1.0)      0.0000 (1.0)           0;0  0.1411 (1.0)           1           1
test_diff-diff[main]        7.3324 (1.03)      7.3324 (1.03)      7.3324 (1.03)     0.0000 (1.0)       7.3324 (1.03)     0.0000 (1.0)           0;0  0.1364 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2720 (1.80)     6.2720 (1.80)     6.2720 (1.80)     0.0000 (1.0)      6.2720 (1.80)     0.0000 (1.0)           0;0  0.1594 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.8657 (1.97)     6.8657 (1.97)     6.8657 (1.97)     0.0000 (1.0)      6.8657 (1.97)     0.0000 (1.0)           0;0  0.1457 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.7498 (1.65)     5.7498 (1.65)     5.7498 (1.65)     0.0000 (1.0)      5.7498 (1.65)     0.0000 (1.0)           0;0  0.1739 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4810 (1.0)      3.4810 (1.0)      3.4810 (1.0)      0.0000 (1.0)      3.4810 (1.0)      0.0000 (1.0)           0;0  0.2873 (1.0)           1           1
test_diff-diff-changed[main]       3.5392 (1.02)     3.5392 (1.02)     3.5392 (1.02)     0.0000 (1.0)      3.5392 (1.02)     0.0000 (1.0)           0;0  0.2826 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2725 (1.53)     5.2725 (1.53)     5.2725 (1.53)     0.0000 (1.0)      5.2725 (1.53)     0.0000 (1.0)           0;0  0.1897 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9147 (1.71)     5.9147 (1.71)     5.9147 (1.71)     0.0000 (1.0)      5.9147 (1.71)     0.0000 (1.0)           0;0  0.1691 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6757 (1.64)     5.6757 (1.64)     5.6757 (1.64)     0.0000 (1.0)      5.6757 (1.64)     0.0000 (1.0)           0;0  0.1762 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4566 (1.0)      3.4566 (1.0)      3.4566 (1.0)      0.0000 (1.0)      3.4566 (1.0)      0.0000 (1.0)           0;0  0.2893 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.5130 (1.02)     3.5130 (1.02)     3.5130 (1.02)     0.0000 (1.0)      3.5130 (1.02)     0.0000 (1.0)           0;0  0.2847 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1768 (1.20)     4.1768 (1.20)     4.1768 (1.20)     0.0000 (1.0)      4.1768 (1.20)     0.0000 (1.0)           0;0  0.2394 (0.83)          1           1
test_diff-diff-noop[3.10.0]     4.8612 (1.40)     4.8612 (1.40)     4.8612 (1.40)     0.0000 (1.0)      4.8612 (1.40)     0.0000 (1.0)           0;0  0.2057 (0.72)          1           1
test_diff-diff-noop[3.53.2]     5.6754 (1.63)     5.6754 (1.63)     5.6754 (1.63)     0.0000 (1.0)      5.6754 (1.63)     0.0000 (1.0)           0;0  0.1762 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.4772 (1.0)      3.4772 (1.0)      3.4772 (1.0)      0.0000 (1.0)      3.4772 (1.0)      0.0000 (1.0)           0;0  0.2876 (1.0)           1           1
test_diff-diff-noop[main]       3.4781 (1.00)     3.4781 (1.00)     3.4781 (1.00)     0.0000 (1.0)      3.4781 (1.00)     0.0000 (1.0)           0;0  0.2875 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       994.8450 (1.0)        994.8450 (1.0)        994.8450 (1.0)      0.0000 (1.0)        994.8450 (1.0)      0.0000 (1.0)           0;0  1.0052 (1.0)           1           1
test_exp_show-exp[3.10.0]     5,349.2517 (5.38)     5,349.2517 (5.38)     5,349.2517 (5.38)     0.0000 (1.0)      5,349.2517 (5.38)     0.0000 (1.0)           0;0  0.1869 (0.19)          1           1
test_exp_show-exp[3.53.2]     3,017.4935 (3.03)     3,017.4935 (3.03)     3,017.4935 (3.03)     0.0000 (1.0)      3,017.4935 (3.03)     0.0000 (1.0)           0;0  0.3314 (0.33)          1           1
test_exp_show-exp[3.60.1]     2,990.0869 (3.01)     2,990.0869 (3.01)     2,990.0869 (3.01)     0.0000 (1.0)      2,990.0869 (3.01)     0.0000 (1.0)           0;0  0.3344 (0.33)          1           1
test_exp_show-exp[main]       7,202.2993 (7.24)     7,202.2993 (7.24)     7,202.2993 (7.24)     0.0000 (1.0)      7,202.2993 (7.24)     0.0000 (1.0)           0;0  0.1388 (0.14)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.0049 (2.85)     66.0049 (2.85)     66.0049 (2.85)     0.0000 (1.0)      66.0049 (2.85)     0.0000 (1.0)           0;0  0.0152 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.6428 (3.09)     71.6428 (3.09)     71.6428 (3.09)     0.0000 (1.0)      71.6428 (3.09)     0.0000 (1.0)           0;0  0.0140 (0.32)          1           1
test_fetch-fetch[3.53.2]     33.0868 (1.43)     33.0868 (1.43)     33.0868 (1.43)     0.0000 (1.0)      33.0868 (1.43)     0.0000 (1.0)           0;0  0.0302 (0.70)          1           1
test_fetch-fetch[3.60.1]     23.3544 (1.01)     23.3544 (1.01)     23.3544 (1.01)     0.0000 (1.0)      23.3544 (1.01)     0.0000 (1.0)           0;0  0.0428 (0.99)          1           1
test_fetch-fetch[main]       23.1990 (1.0)      23.1990 (1.0)      23.1990 (1.0)      0.0000 (1.0)      23.1990 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7972 (1.0)      2.7972 (1.0)      2.7972 (1.0)      0.0000 (1.0)      2.7972 (1.0)      0.0000 (1.0)           0;0  0.3575 (1.0)           1           1
test_gc-gc[3.10.0]     2.9424 (1.05)     2.9424 (1.05)     2.9424 (1.05)     0.0000 (1.0)      2.9424 (1.05)     0.0000 (1.0)           0;0  0.3399 (0.95)          1           1
test_gc-gc[3.53.2]     2.8313 (1.01)     2.8313 (1.01)     2.8313 (1.01)     0.0000 (1.0)      2.8313 (1.01)     0.0000 (1.0)           0;0  0.3532 (0.99)          1           1
test_gc-gc[3.60.1]     2.8005 (1.00)     2.8005 (1.00)     2.8005 (1.00)     0.0000 (1.0)      2.8005 (1.00)     0.0000 (1.0)           0;0  0.3571 (1.00)          1           1
test_gc-gc[main]       2.9589 (1.06)     2.9589 (1.06)     2.9589 (1.06)     0.0000 (1.0)      2.9589 (1.06)     0.0000 (1.0)           0;0  0.3380 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.7162 (2.71)     137.7162 (2.71)     137.7162 (2.71)     0.0000 (1.0)      137.7162 (2.71)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     167.8173 (3.31)     167.8173 (3.31)     167.8173 (3.31)     0.0000 (1.0)      167.8173 (3.31)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     146.7280 (2.89)     146.7280 (2.89)     146.7280 (2.89)     0.0000 (1.0)      146.7280 (2.89)     0.0000 (1.0)           0;0  0.0068 (0.35)          1           1
test_get-get[3.60.1]      50.7400 (1.0)       50.7400 (1.0)       50.7400 (1.0)      0.0000 (1.0)       50.7400 (1.0)      0.0000 (1.0)           0;0  0.0197 (1.0)           1           1
test_get-get[main]        51.0153 (1.01)      51.0153 (1.01)      51.0153 (1.01)     0.0000 (1.0)       51.0153 (1.01)     0.0000 (1.0)           0;0  0.0196 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.2157 (2.65)     44.2157 (2.65)     44.2157 (2.65)     0.0000 (1.0)      44.2157 (2.65)     0.0000 (1.0)           0;0  0.0226 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.1766 (2.83)     47.1766 (2.83)     47.1766 (2.83)     0.0000 (1.0)      47.1766 (2.83)     0.0000 (1.0)           0;0  0.0212 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.9305 (1.02)     16.9305 (1.02)     16.9305 (1.02)     0.0000 (1.0)      16.9305 (1.02)     0.0000 (1.0)           0;0  0.0591 (0.98)          1           1
test_get_url-get-url[3.60.1]     16.8485 (1.01)     16.8485 (1.01)     16.8485 (1.01)     0.0000 (1.0)      16.8485 (1.01)     0.0000 (1.0)           0;0  0.0594 (0.99)          1           1
test_get_url-get-url[main]       16.6589 (1.0)      16.6589 (1.0)      16.6589 (1.0)      0.0000 (1.0)      16.6589 (1.0)      0.0000 (1.0)           0;0  0.0600 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.0141 (1.01)     132.2526 (1.0)      126.4936 (1.0)      1.8949 (1.22)     125.8466 (1.0)      2.2588 (1.55)         24;4  7.9055 (1.0)         100           1
test_help---help[3.10.0]     123.1252 (1.0)      133.2342 (1.01)     127.1495 (1.01)     2.1836 (1.41)     127.0701 (1.01)     2.9782 (2.05)         33;1  7.8648 (0.99)        100           1
test_help---help[3.53.2]     124.1953 (1.01)     142.2388 (1.08)     127.5741 (1.01)     2.5878 (1.67)     126.7687 (1.01)     2.6366 (1.81)         20;4  7.8386 (0.99)        100           1
test_help---help[3.60.1]     125.2059 (1.02)     134.0603 (1.01)     127.2458 (1.01)     1.5480 (1.0)      126.8222 (1.01)     1.4563 (1.0)          22;9  7.8588 (0.99)        100           1
test_help---help[main]       124.2094 (1.01)     158.2925 (1.20)     128.6492 (1.02)     5.6288 (3.64)     126.7745 (1.01)     4.1030 (2.82)          7;6  7.7731 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     219.6664 (2.92)     219.6664 (2.92)     219.6664 (2.92)     0.0000 (1.0)      219.6664 (2.92)     0.0000 (1.0)           0;0  0.0046 (0.34)          1           1
test_import-import[3.10.0]     252.8143 (3.36)     252.8143 (3.36)     252.8143 (3.36)     0.0000 (1.0)      252.8143 (3.36)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      75.2250 (1.0)       75.2250 (1.0)       75.2250 (1.0)      0.0000 (1.0)       75.2250 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        75.6105 (1.01)      75.6105 (1.01)      75.6105 (1.01)     0.0000 (1.0)       75.6105 (1.01)     0.0000 (1.0)           0;0  0.0132 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     155.5083 (3.34)     155.5083 (3.34)     155.5083 (3.34)     0.0000 (1.0)      155.5083 (3.34)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     160.4957 (3.44)     160.4957 (3.44)     160.4957 (3.44)     0.0000 (1.0)      160.4957 (3.44)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.0245 (2.51)     117.0245 (2.51)     117.0245 (2.51)     0.0000 (1.0)      117.0245 (2.51)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.5891 (1.0)       46.5891 (1.0)       46.5891 (1.0)      0.0000 (1.0)       46.5891 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_import_url-import-url[main]        47.2881 (1.02)      47.2881 (1.02)      47.2881 (1.02)     0.0000 (1.0)       47.2881 (1.02)     0.0000 (1.0)           0;0  0.0211 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     384.4911 (1.00)     413.5812 (1.0)      391.6682 (1.0)      4.9322 (1.0)      390.7647 (1.0)       6.2904 (1.16)         27;2  2.5532 (1.0)         100           1
test_init-init[3.10.0]     395.3667 (1.03)     440.1409 (1.06)     407.3216 (1.04)     7.9845 (1.62)     404.9604 (1.04)      9.2733 (1.72)         26;5  2.4551 (0.96)        100           1
test_init-init[3.53.2]     383.0694 (1.0)      425.2315 (1.03)     394.4539 (1.01)     9.5334 (1.93)     390.9653 (1.00)     10.8344 (2.01)         21;3  2.5352 (0.99)        100           1
test_init-init[3.60.1]     386.5294 (1.01)     422.8011 (1.02)     394.1187 (1.01)     5.8089 (1.18)     392.6482 (1.00)      5.4036 (1.0)          20;3  2.5373 (0.99)        100           1
test_init-init[main]       387.4943 (1.01)     428.1021 (1.04)     399.6346 (1.02)     8.2301 (1.67)     398.3998 (1.02)      9.0190 (1.67)         29;6  2.5023 (0.98)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     597.9186 (1.08)     597.9186 (1.08)     597.9186 (1.08)     0.0000 (1.0)      597.9186 (1.08)     0.0000 (1.0)           0;0  1.6725 (0.92)          1           1
test_list-list[3.10.0]     687.4236 (1.25)     687.4236 (1.25)     687.4236 (1.25)     0.0000 (1.0)      687.4236 (1.25)     0.0000 (1.0)           0;0  1.4547 (0.80)          1           1
test_list-list[3.53.2]     594.8743 (1.08)     594.8743 (1.08)     594.8743 (1.08)     0.0000 (1.0)      594.8743 (1.08)     0.0000 (1.0)           0;0  1.6810 (0.93)          1           1
test_list-list[3.60.1]     551.6031 (1.0)      551.6031 (1.0)      551.6031 (1.0)      0.0000 (1.0)      551.6031 (1.0)      0.0000 (1.0)           0;0  1.8129 (1.0)           1           1
test_list-list[main]       554.6951 (1.01)     554.6951 (1.01)     554.6951 (1.01)     0.0000 (1.0)      554.6951 (1.01)     0.0000 (1.0)           0;0  1.8028 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     436.0556 (1.05)     436.0556 (1.05)     436.0556 (1.05)     0.0000 (1.0)      436.0556 (1.05)     0.0000 (1.0)           0;0  2.2933 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     434.0797 (1.05)     434.0797 (1.05)     434.0797 (1.05)     0.0000 (1.0)      434.0797 (1.05)     0.0000 (1.0)           0;0  2.3037 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     414.9946 (1.0)      414.9946 (1.0)      414.9946 (1.0)      0.0000 (1.0)      414.9946 (1.0)      0.0000 (1.0)           0;0  2.4097 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     422.6759 (1.02)     422.6759 (1.02)     422.6759 (1.02)     0.0000 (1.0)      422.6759 (1.02)     0.0000 (1.0)           0;0  2.3659 (0.98)          1           1
test_list-list-dvc-only[main]       419.6104 (1.01)     419.6104 (1.01)     419.6104 (1.01)     0.0000 (1.0)      419.6104 (1.01)     0.0000 (1.0)           0;0  2.3832 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8127 (1.0)      2.8127 (1.0)      2.8127 (1.0)      0.0000 (1.0)      2.8127 (1.0)      0.0000 (1.0)           0;0  0.3555 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8322 (1.01)     2.8322 (1.01)     2.8322 (1.01)     0.0000 (1.0)      2.8322 (1.01)     0.0000 (1.0)           0;0  0.3531 (0.99)          1           1
test_list-list-recursive[3.53.2]     2.8846 (1.03)     2.8846 (1.03)     2.8846 (1.03)     0.0000 (1.0)      2.8846 (1.03)     0.0000 (1.0)           0;0  0.3467 (0.98)          1           1
test_list-list-recursive[3.60.1]     3.0032 (1.07)     3.0032 (1.07)     3.0032 (1.07)     0.0000 (1.0)      3.0032 (1.07)     0.0000 (1.0)           0;0  0.3330 (0.94)          1           1
test_list-list-recursive[main]       3.0050 (1.07)     3.0050 (1.07)     3.0050 (1.07)     0.0000 (1.0)      3.0050 (1.07)     0.0000 (1.0)           0;0  0.3328 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     431.2189 (1.05)     431.2189 (1.05)     431.2189 (1.05)     0.0000 (1.0)      431.2189 (1.05)     0.0000 (1.0)           0;0  2.3190 (0.95)          1           1
test_list-list-shallow[3.10.0]     438.3946 (1.07)     438.3946 (1.07)     438.3946 (1.07)     0.0000 (1.0)      438.3946 (1.07)     0.0000 (1.0)           0;0  2.2811 (0.94)          1           1
test_list-list-shallow[3.53.2]     411.6234 (1.0)      411.6234 (1.0)      411.6234 (1.0)      0.0000 (1.0)      411.6234 (1.0)      0.0000 (1.0)           0;0  2.4294 (1.0)           1           1
test_list-list-shallow[3.60.1]     424.6837 (1.03)     424.6837 (1.03)     424.6837 (1.03)     0.0000 (1.0)      424.6837 (1.03)     0.0000 (1.0)           0;0  2.3547 (0.97)          1           1
test_list-list-shallow[main]       413.9001 (1.01)     413.9001 (1.01)     413.9001 (1.01)     0.0000 (1.0)      413.9001 (1.01)     0.0000 (1.0)           0;0  2.4160 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.0812 (3.21)     12.0812 (3.21)     12.0812 (3.21)     0.0000 (1.0)      12.0812 (3.21)     0.0000 (1.0)           0;0  0.0828 (0.31)          1           1
test_partial_add-add[3.10.0]     12.4343 (3.31)     12.4343 (3.31)     12.4343 (3.31)     0.0000 (1.0)      12.4343 (3.31)     0.0000 (1.0)           0;0  0.0804 (0.30)          1           1
test_partial_add-add[3.53.2]     11.1500 (2.97)     11.1500 (2.97)     11.1500 (2.97)     0.0000 (1.0)      11.1500 (2.97)     0.0000 (1.0)           0;0  0.0897 (0.34)          1           1
test_partial_add-add[3.60.1]      3.7579 (1.0)       3.7579 (1.0)       3.7579 (1.0)      0.0000 (1.0)       3.7579 (1.0)      0.0000 (1.0)           0;0  0.2661 (1.0)           1           1
test_partial_add-add[main]        4.2766 (1.14)      4.2766 (1.14)      4.2766 (1.14)     0.0000 (1.0)       4.2766 (1.14)     0.0000 (1.0)           0;0  0.2338 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     81.8558 (4.06)     81.8558 (4.06)     81.8558 (4.06)     0.0000 (1.0)      81.8558 (4.06)     0.0000 (1.0)           0;0  0.0122 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     82.2277 (4.08)     82.2277 (4.08)     82.2277 (4.08)     0.0000 (1.0)      82.2277 (4.08)     0.0000 (1.0)           0;0  0.0122 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     74.4656 (3.69)     74.4656 (3.69)     74.4656 (3.69)     0.0000 (1.0)      74.4656 (3.69)     0.0000 (1.0)           0;0  0.0134 (0.27)          1           1
test_partial_add-add-partial[3.60.1]     20.2442 (1.00)     20.2442 (1.00)     20.2442 (1.00)     0.0000 (1.0)      20.2442 (1.00)     0.0000 (1.0)           0;0  0.0494 (1.00)          1           1
test_partial_add-add-partial[main]       20.1768 (1.0)      20.1768 (1.0)      20.1768 (1.0)      0.0000 (1.0)      20.1768 (1.0)      0.0000 (1.0)           0;0  0.0496 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4811 (1.0)      4.4811 (1.0)      4.4811 (1.0)      0.0000 (1.0)      4.4811 (1.0)      0.0000 (1.0)           0;0  0.2232 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9058 (1.32)     5.9058 (1.32)     5.9058 (1.32)     0.0000 (1.0)      5.9058 (1.32)     0.0000 (1.0)           0;0  0.1693 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9115 (1.54)     6.9115 (1.54)     6.9115 (1.54)     0.0000 (1.0)      6.9115 (1.54)     0.0000 (1.0)           0;0  0.1447 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7532 (1.51)     6.7532 (1.51)     6.7532 (1.51)     0.0000 (1.0)      6.7532 (1.51)     0.0000 (1.0)           0;0  0.1481 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.7680 (1.51)     6.7680 (1.51)     6.7680 (1.51)     0.0000 (1.0)      6.7680 (1.51)     0.0000 (1.0)           0;0  0.1478 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5575 (1.0)      2.5575 (1.0)      2.5575 (1.0)      0.0000 (1.0)      2.5575 (1.0)      0.0000 (1.0)           0;0  0.3910 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7923 (1.48)     3.7923 (1.48)     3.7923 (1.48)     0.0000 (1.0)      3.7923 (1.48)     0.0000 (1.0)           0;0  0.2637 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.8467 (1.50)     3.8467 (1.50)     3.8467 (1.50)     0.0000 (1.0)      3.8467 (1.50)     0.0000 (1.0)           0;0  0.2600 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.8152 (1.49)     3.8152 (1.49)     3.8152 (1.49)     0.0000 (1.0)      3.8152 (1.49)     0.0000 (1.0)           0;0  0.2621 (0.67)          1           1
test_partial_add-gc-noop[main]       3.9074 (1.53)     3.9074 (1.53)     3.9074 (1.53)     0.0000 (1.0)      3.9074 (1.53)     0.0000 (1.0)           0;0  0.2559 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.8000 (2.16)     7.8000 (2.16)     7.8000 (2.16)     0.0000 (1.0)      7.8000 (2.16)     0.0000 (1.0)           0;0  0.1282 (0.46)          1           1
test_partial_add-push[3.10.0]     6.9655 (1.93)     6.9655 (1.93)     6.9655 (1.93)     0.0000 (1.0)      6.9655 (1.93)     0.0000 (1.0)           0;0  0.1436 (0.52)          1           1
test_partial_add-push[3.53.2]     3.7208 (1.03)     3.7208 (1.03)     3.7208 (1.03)     0.0000 (1.0)      3.7208 (1.03)     0.0000 (1.0)           0;0  0.2688 (0.97)          1           1
test_partial_add-push[3.60.1]     3.6176 (1.0)      3.6176 (1.0)      3.6176 (1.0)      0.0000 (1.0)      3.6176 (1.0)      0.0000 (1.0)           0;0  0.2764 (1.0)           1           1
test_partial_add-push[main]       3.6256 (1.00)     3.6256 (1.00)     3.6256 (1.00)     0.0000 (1.0)      3.6256 (1.00)     0.0000 (1.0)           0;0  0.2758 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.5475 (2.24)     45.5475 (2.24)     45.5475 (2.24)     0.0000 (1.0)      45.5475 (2.24)     0.0000 (1.0)           0;0  0.0220 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     40.3591 (1.99)     40.3591 (1.99)     40.3591 (1.99)     0.0000 (1.0)      40.3591 (1.99)     0.0000 (1.0)           0;0  0.0248 (0.50)          1           1
test_partial_add-push-partial[3.53.2]     20.7802 (1.02)     20.7802 (1.02)     20.7802 (1.02)     0.0000 (1.0)      20.7802 (1.02)     0.0000 (1.0)           0;0  0.0481 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     20.3313 (1.0)      20.3313 (1.0)      20.3313 (1.0)      0.0000 (1.0)      20.3313 (1.0)      0.0000 (1.0)           0;0  0.0492 (1.0)           1           1
test_partial_add-push-partial[main]       20.4307 (1.00)     20.4307 (1.00)     20.4307 (1.00)     0.0000 (1.0)      20.4307 (1.00)     0.0000 (1.0)           0;0  0.0489 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.5402 (3.72)     83.5402 (3.72)     83.5402 (3.72)     0.0000 (1.0)      83.5402 (3.72)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_partial_remove-add[3.10.0]     83.2665 (3.71)     83.2665 (3.71)     83.2665 (3.71)     0.0000 (1.0)      83.2665 (3.71)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_partial_remove-add[3.53.2]     73.8450 (3.29)     73.8450 (3.29)     73.8450 (3.29)     0.0000 (1.0)      73.8450 (3.29)     0.0000 (1.0)           0;0  0.0135 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.4322 (1.0)      22.4322 (1.0)      22.4322 (1.0)      0.0000 (1.0)      22.4322 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_partial_remove-add[main]       23.4187 (1.04)     23.4187 (1.04)     23.4187 (1.04)     0.0000 (1.0)      23.4187 (1.04)     0.0000 (1.0)           0;0  0.0427 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     47.7607 (12.64)    47.7607 (12.64)    47.7607 (12.64)    0.0000 (1.0)      47.7607 (12.64)    0.0000 (1.0)           0;0  0.0209 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     47.1799 (12.49)    47.1799 (12.49)    47.1799 (12.49)    0.0000 (1.0)      47.1799 (12.49)    0.0000 (1.0)           0;0  0.0212 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     42.4455 (11.23)    42.4455 (11.23)    42.4455 (11.23)    0.0000 (1.0)      42.4455 (11.23)    0.0000 (1.0)           0;0  0.0236 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.7788 (1.0)       3.7788 (1.0)       3.7788 (1.0)      0.0000 (1.0)       3.7788 (1.0)      0.0000 (1.0)           0;0  0.2646 (1.0)           1           1
test_partial_remove-add-update[main]        3.9606 (1.05)      3.9606 (1.05)      3.9606 (1.05)     0.0000 (1.0)       3.9606 (1.05)     0.0000 (1.0)           0;0  0.2525 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6269 (1.0)      2.6269 (1.0)      2.6269 (1.0)      0.0000 (1.0)      2.6269 (1.0)      0.0000 (1.0)           0;0  0.3807 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6431 (1.39)     3.6431 (1.39)     3.6431 (1.39)     0.0000 (1.0)      3.6431 (1.39)     0.0000 (1.0)           0;0  0.2745 (0.72)          1           1
test_partial_remove-gc[3.53.2]     3.6518 (1.39)     3.6518 (1.39)     3.6518 (1.39)     0.0000 (1.0)      3.6518 (1.39)     0.0000 (1.0)           0;0  0.2738 (0.72)          1           1
test_partial_remove-gc[3.60.1]     3.7317 (1.42)     3.7317 (1.42)     3.7317 (1.42)     0.0000 (1.0)      3.7317 (1.42)     0.0000 (1.0)           0;0  0.2680 (0.70)          1           1
test_partial_remove-gc[main]       3.6748 (1.40)     3.6748 (1.40)     3.6748 (1.40)     0.0000 (1.0)      3.6748 (1.40)     0.0000 (1.0)           0;0  0.2721 (0.71)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.9499 (1.0)      4.9499 (1.0)      4.9499 (1.0)      0.0000 (1.0)      4.9499 (1.0)      0.0000 (1.0)           0;0  0.2020 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.7131 (1.15)     5.7131 (1.15)     5.7131 (1.15)     0.0000 (1.0)      5.7131 (1.15)     0.0000 (1.0)           0;0  0.1750 (0.87)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.4197 (1.30)     6.4197 (1.30)     6.4197 (1.30)     0.0000 (1.0)      6.4197 (1.30)     0.0000 (1.0)           0;0  0.1558 (0.77)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.3862 (1.29)     6.3862 (1.29)     6.3862 (1.29)     0.0000 (1.0)      6.3862 (1.29)     0.0000 (1.0)           0;0  0.1566 (0.78)          1           1
test_partial_remove-gc-cloud[main]       6.3887 (1.29)     6.3887 (1.29)     6.3887 (1.29)     0.0000 (1.0)      6.3887 (1.29)     0.0000 (1.0)           0;0  0.1565 (0.77)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.1653 (2.41)     53.1653 (2.41)     53.1653 (2.41)     0.0000 (1.0)      53.1653 (2.41)     0.0000 (1.0)           0;0  0.0188 (0.42)          1           1
test_partial_remove-push[3.10.0]     47.1909 (2.14)     47.1909 (2.14)     47.1909 (2.14)     0.0000 (1.0)      47.1909 (2.14)     0.0000 (1.0)           0;0  0.0212 (0.47)          1           1
test_partial_remove-push[3.53.2]     22.9128 (1.04)     22.9128 (1.04)     22.9128 (1.04)     0.0000 (1.0)      22.9128 (1.04)     0.0000 (1.0)           0;0  0.0436 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.4560 (1.02)     22.4560 (1.02)     22.4560 (1.02)     0.0000 (1.0)      22.4560 (1.02)     0.0000 (1.0)           0;0  0.0445 (0.98)          1           1
test_partial_remove-push[main]       22.0648 (1.0)      22.0648 (1.0)      22.0648 (1.0)      0.0000 (1.0)      22.0648 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8893 (1.01)     3.8893 (1.01)     3.8893 (1.01)     0.0000 (1.0)      3.8893 (1.01)     0.0000 (1.0)           0;0  0.2571 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     3.8499 (1.0)      3.8499 (1.0)      3.8499 (1.0)      0.0000 (1.0)      3.8499 (1.0)      0.0000 (1.0)           0;0  0.2597 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.0480 (1.83)     7.0480 (1.83)     7.0480 (1.83)     0.0000 (1.0)      7.0480 (1.83)     0.0000 (1.0)           0;0  0.1419 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.0554 (1.83)     7.0554 (1.83)     7.0554 (1.83)     0.0000 (1.0)      7.0554 (1.83)     0.0000 (1.0)           0;0  0.1417 (0.55)          1           1
test_partial_remove-push-update[main]       7.2503 (1.88)     7.2503 (1.88)     7.2503 (1.88)     0.0000 (1.0)      7.2503 (1.88)     0.0000 (1.0)           0;0  0.1379 (0.53)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     505.6963 (1.0)      516.3032 (1.0)      510.1239 (1.0)      4.3407 (2.12)     510.3822 (1.0)       6.8264 (2.72)          2;0  1.9603 (1.0)           5           3
test_plots-plots-diff[3.10.0]     892.6249 (1.77)     910.2331 (1.76)     901.1294 (1.77)     7.0160 (3.43)     902.8566 (1.77)     10.7666 (4.29)          2;0  1.1097 (0.57)          5           3
test_plots-plots-diff[3.53.2]     801.4036 (1.58)     812.5391 (1.57)     807.4357 (1.58)     4.2519 (2.08)     809.0021 (1.59)      5.6348 (2.24)          2;0  1.2385 (0.63)          5           3
test_plots-plots-diff[3.60.1]     800.5511 (1.58)     806.1460 (1.56)     803.2778 (1.57)     2.0475 (1.0)      803.2293 (1.57)      2.5114 (1.0)           2;0  1.2449 (0.64)          5           3
test_plots-plots-diff[main]       802.5065 (1.59)     809.2388 (1.57)     804.7553 (1.58)     2.6706 (1.30)     804.0345 (1.58)      3.0682 (1.22)          1;0  1.2426 (0.63)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       530.8842 (1.0)        548.1019 (1.0)        539.3533 (1.0)       7.9030 (3.07)       540.6379 (1.0)      14.8415 (3.55)          2;0  1.8541 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,158.1371 (2.18)     1,186.4759 (2.16)     1,169.7448 (2.17)     11.6199 (4.51)     1,169.7511 (2.16)     18.3227 (4.38)          1;0  0.8549 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       881.4915 (1.66)       906.8314 (1.65)       893.8890 (1.66)     10.4987 (4.08)       895.5786 (1.66)     17.6763 (4.23)          2;0  1.1187 (0.60)          5           3
test_plots-plots-diff-json[3.60.1]       880.6960 (1.66)       886.8971 (1.62)       883.2185 (1.64)      2.5739 (1.0)        882.9204 (1.63)      4.1800 (1.0)           1;0  1.1322 (0.61)          5           3
test_plots-plots-diff-json[main]         881.6555 (1.66)       892.3014 (1.63)       887.4385 (1.65)      4.1910 (1.63)       887.2172 (1.64)      6.4065 (1.53)          2;0  1.1268 (0.61)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     423.0180 (1.0)      432.9054 (1.0)      426.5620 (1.0)      3.7506 (2.78)     425.6089 (1.0)       3.4540 (1.88)          1;0  2.3443 (1.0)           5           3
test_plots-plots-show[3.10.0]     725.4327 (1.71)     749.8399 (1.73)     738.2449 (1.73)     9.1434 (6.77)     737.6652 (1.73)     12.2740 (6.67)          2;0  1.3546 (0.58)          5           3
test_plots-plots-show[3.53.2]     688.1052 (1.63)     691.6903 (1.60)     689.9727 (1.62)     1.3508 (1.0)      690.2249 (1.62)      1.8402 (1.0)           2;0  1.4493 (0.62)          5           3
test_plots-plots-show[3.60.1]     686.5965 (1.62)     693.7705 (1.60)     689.3150 (1.62)     2.7389 (2.03)     689.1874 (1.62)      3.0716 (1.67)          1;0  1.4507 (0.62)          5           3
test_plots-plots-show[main]       689.3889 (1.63)     699.8156 (1.62)     692.7647 (1.62)     4.2213 (3.13)     691.9418 (1.63)      5.0768 (2.76)          1;0  1.4435 (0.62)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     438.3377 (1.0)      460.4395 (1.0)      447.5022 (1.0)      10.6769 (11.14)    441.4510 (1.0)      19.1670 (21.91)         1;0  2.2346 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     853.3580 (1.95)     920.8016 (2.00)     874.7092 (1.95)     26.5884 (27.75)    864.2103 (1.96)     23.2016 (26.52)         1;1  1.1432 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     732.9662 (1.67)     741.2693 (1.61)     736.7015 (1.65)      3.1674 (3.31)     736.0805 (1.67)      4.4247 (5.06)          2;0  1.3574 (0.61)          5           3
test_plots-plots-show-json[3.60.1]     732.3901 (1.67)     741.0616 (1.61)     736.4429 (1.65)      3.0937 (3.23)     736.0568 (1.67)      2.8046 (3.21)          2;0  1.3579 (0.61)          5           3
test_plots-plots-show-json[main]       736.7914 (1.68)     739.3650 (1.61)     738.3840 (1.65)      0.9580 (1.0)      738.5752 (1.67)      0.8749 (1.0)           2;0  1.3543 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.1117 (2.34)     52.1117 (2.34)     52.1117 (2.34)     0.0000 (1.0)      52.1117 (2.34)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_push-push[3.10.0]     46.3695 (2.08)     46.3695 (2.08)     46.3695 (2.08)     0.0000 (1.0)      46.3695 (2.08)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_push-push[3.53.2]     22.9325 (1.03)     22.9325 (1.03)     22.9325 (1.03)     0.0000 (1.0)      22.9325 (1.03)     0.0000 (1.0)           0;0  0.0436 (0.97)          1           1
test_push-push[3.60.1]     22.2912 (1.0)      22.2912 (1.0)      22.2912 (1.0)      0.0000 (1.0)      22.2912 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
test_push-push[main]       22.2917 (1.00)     22.2917 (1.00)     22.2917 (1.00)     0.0000 (1.0)      22.2917 (1.00)     0.0000 (1.0)           0;0  0.0449 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.0303 (2.77)     64.0303 (2.77)     64.0303 (2.77)     0.0000 (1.0)      64.0303 (2.77)     0.0000 (1.0)           0;0  0.0156 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.0889 (3.03)     70.0889 (3.03)     70.0889 (3.03)     0.0000 (1.0)      70.0889 (3.03)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     34.3559 (1.48)     34.3559 (1.48)     34.3559 (1.48)     0.0000 (1.0)      34.3559 (1.48)     0.0000 (1.0)           0;0  0.0291 (0.67)          1           1
test_sharing-fetch[3.60.1]     23.2048 (1.00)     23.2048 (1.00)     23.2048 (1.00)     0.0000 (1.0)      23.2048 (1.00)     0.0000 (1.0)           0;0  0.0431 (1.00)          1           1
test_sharing-fetch[main]       23.1548 (1.0)      23.1548 (1.0)      23.1548 (1.0)      0.0000 (1.0)      23.1548 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2478 (1.0)      1.2478 (1.0)      1.2478 (1.0)      0.0000 (1.0)      1.2478 (1.0)      0.0000 (1.0)           0;0  0.8014 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5995 (2.88)     3.5995 (2.88)     3.5995 (2.88)     0.0000 (1.0)      3.5995 (2.88)     0.0000 (1.0)           0;0  0.2778 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.7178 (4.58)     5.7178 (4.58)     5.7178 (4.58)     0.0000 (1.0)      5.7178 (4.58)     0.0000 (1.0)           0;0  0.1749 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8077 (4.65)     5.8077 (4.65)     5.8077 (4.65)     0.0000 (1.0)      5.8077 (4.65)     0.0000 (1.0)           0;0  0.1722 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7760 (4.63)     5.7760 (4.63)     5.7760 (4.63)     0.0000 (1.0)      5.7760 (4.63)     0.0000 (1.0)           0;0  0.1731 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.2923 (2.38)     52.2923 (2.38)     52.2923 (2.38)     0.0000 (1.0)      52.2923 (2.38)     0.0000 (1.0)           0;0  0.0191 (0.42)          1           1
test_sharing-push[3.10.0]     46.6768 (2.12)     46.6768 (2.12)     46.6768 (2.12)     0.0000 (1.0)      46.6768 (2.12)     0.0000 (1.0)           0;0  0.0214 (0.47)          1           1
test_sharing-push[3.53.2]     22.8555 (1.04)     22.8555 (1.04)     22.8555 (1.04)     0.0000 (1.0)      22.8555 (1.04)     0.0000 (1.0)           0;0  0.0438 (0.96)          1           1
test_sharing-push[3.60.1]     22.0017 (1.0)      22.0017 (1.0)      22.0017 (1.0)      0.0000 (1.0)      22.0017 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
test_sharing-push[main]       22.3539 (1.02)     22.3539 (1.02)     22.3539 (1.02)     0.0000 (1.0)      22.3539 (1.02)     0.0000 (1.0)           0;0  0.0447 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0481 (1.01)     2.0481 (1.01)     2.0481 (1.01)     0.0000 (1.0)      2.0481 (1.01)     0.0000 (1.0)           0;0  0.4883 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.0232 (1.0)      2.0232 (1.0)      2.0232 (1.0)      0.0000 (1.0)      2.0232 (1.0)      0.0000 (1.0)           0;0  0.4943 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0429 (2.99)     6.0429 (2.99)     6.0429 (2.99)     0.0000 (1.0)      6.0429 (2.99)     0.0000 (1.0)           0;0  0.1655 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.0626 (3.00)     6.0626 (3.00)     6.0626 (3.00)     0.0000 (1.0)      6.0626 (3.00)     0.0000 (1.0)           0;0  0.1649 (0.33)          1           1
test_sharing-push-noop[main]       5.8729 (2.90)     5.8729 (2.90)     5.8729 (2.90)     0.0000 (1.0)      5.8729 (2.90)     0.0000 (1.0)           0;0  0.1703 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     157.4746 (1.07)     157.4746 (1.07)     157.4746 (1.07)     0.0000 (1.0)      157.4746 (1.07)     0.0000 (1.0)           0;0  0.0064 (0.93)          1           1
test_sharing_azure-fetch[main]       147.1324 (1.0)      147.1324 (1.0)      147.1324 (1.0)      0.0000 (1.0)      147.1324 (1.0)      0.0000 (1.0)           0;0  0.0068 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3861 (1.0)      6.3861 (1.0)      6.3861 (1.0)      0.0000 (1.0)      6.3861 (1.0)      0.0000 (1.0)           0;0  0.1566 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4424 (1.01)     6.4424 (1.01)     6.4424 (1.01)     0.0000 (1.0)      6.4424 (1.01)     0.0000 (1.0)           0;0  0.1552 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     152.8606 (1.0)      152.8606 (1.0)      152.8606 (1.0)      0.0000 (1.0)      152.8606 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
test_sharing_azure-push[main]       154.0090 (1.01)     154.0090 (1.01)     154.0090 (1.01)     0.0000 (1.0)      154.0090 (1.01)     0.0000 (1.0)           0;0  0.0065 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.8578 (1.0)      6.8578 (1.0)      6.8578 (1.0)      0.0000 (1.0)      6.8578 (1.0)      0.0000 (1.0)           0;0  0.1458 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.9367 (1.01)     6.9367 (1.01)     6.9367 (1.01)     0.0000 (1.0)      6.9367 (1.01)     0.0000 (1.0)           0;0  0.1442 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     264.0870 (1.0)      264.0870 (1.0)      264.0870 (1.0)      0.0000 (1.0)      264.0870 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
test_sharing_gs-fetch[main]       279.7394 (1.06)     279.7394 (1.06)     279.7394 (1.06)     0.0000 (1.0)      279.7394 (1.06)     0.0000 (1.0)           0;0  0.0036 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     18.7605 (1.01)     18.7605 (1.01)     18.7605 (1.01)     0.0000 (1.0)      18.7605 (1.01)     0.0000 (1.0)           0;0  0.0533 (0.99)          1           1
test_sharing_gs-fetch-noop[main]       18.5937 (1.0)      18.5937 (1.0)      18.5937 (1.0)      0.0000 (1.0)      18.5937 (1.0)      0.0000 (1.0)           0;0  0.0538 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     758.0803 (1.05)     758.0803 (1.05)     758.0803 (1.05)     0.0000 (1.0)      758.0803 (1.05)     0.0000 (1.0)           0;0  0.0013 (0.95)          1           1
test_sharing_gs-push[main]       721.1071 (1.0)      721.1071 (1.0)      721.1071 (1.0)      0.0000 (1.0)      721.1071 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.6897 (1.0)      6.6897 (1.0)      6.6897 (1.0)      0.0000 (1.0)      6.6897 (1.0)      0.0000 (1.0)           0;0  0.1495 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.8157 (1.02)     6.8157 (1.02)     6.8157 (1.02)     0.0000 (1.0)      6.8157 (1.02)     0.0000 (1.0)           0;0  0.1467 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     765.4551 (1.01)     765.4551 (1.01)     765.4551 (1.01)     0.0000 (1.0)      765.4551 (1.01)     0.0000 (1.0)           0;0  0.0013 (0.99)          1           1
test_sharing_s3-fetch[main]       757.6172 (1.0)      757.6172 (1.0)      757.6172 (1.0)      0.0000 (1.0)      757.6172 (1.0)      0.0000 (1.0)           0;0  0.0013 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5624 (1.0)      6.5624 (1.0)      6.5624 (1.0)      0.0000 (1.0)      6.5624 (1.0)      0.0000 (1.0)           0;0  0.1524 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.6356 (1.01)     6.6356 (1.01)     6.6356 (1.01)     0.0000 (1.0)      6.6356 (1.01)     0.0000 (1.0)           0;0  0.1507 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,194.4573 (1.0)      1,194.4573 (1.0)      1,194.4573 (1.0)      0.0000 (1.0)      1,194.4573 (1.0)      0.0000 (1.0)           0;0  0.0008 (1.0)           1           1
test_sharing_s3-push[main]       1,195.9474 (1.00)     1,195.9474 (1.00)     1,195.9474 (1.00)     0.0000 (1.0)      1,195.9474 (1.00)     0.0000 (1.0)           0;0  0.0008 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.2678 (1.0)      7.2678 (1.0)      7.2678 (1.0)      0.0000 (1.0)      7.2678 (1.0)      0.0000 (1.0)           0;0  0.1376 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.3363 (1.01)     7.3363 (1.01)     7.3363 (1.01)     0.0000 (1.0)      7.3363 (1.01)     0.0000 (1.0)           0;0  0.1363 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.6142 (3.83)     19.6142 (3.83)     19.6142 (3.83)     0.0000 (1.0)      19.6142 (3.83)     0.0000 (1.0)           0;0  0.0510 (0.26)          1           1
test_status-status[3.10.0]     19.8169 (3.87)     19.8169 (3.87)     19.8169 (3.87)     0.0000 (1.0)      19.8169 (3.87)     0.0000 (1.0)           0;0  0.0505 (0.26)          1           1
test_status-status[3.53.2]     17.8466 (3.48)     17.8466 (3.48)     17.8466 (3.48)     0.0000 (1.0)      17.8466 (3.48)     0.0000 (1.0)           0;0  0.0560 (0.29)          1           1
test_status-status[3.60.1]      5.1259 (1.0)       5.1259 (1.0)       5.1259 (1.0)      0.0000 (1.0)       5.1259 (1.0)      0.0000 (1.0)           0;0  0.1951 (1.0)           1           1
test_status-status[main]        5.3937 (1.05)      5.3937 (1.05)      5.3937 (1.05)     0.0000 (1.0)       5.3937 (1.05)     0.0000 (1.0)           0;0  0.1854 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6649 (1.78)     4.6649 (1.78)     4.6649 (1.78)     0.0000 (1.0)      4.6649 (1.78)     0.0000 (1.0)           0;0  0.2144 (0.56)          1           1
test_status-status-changed[3.10.0]     4.9595 (1.89)     4.9595 (1.89)     4.9595 (1.89)     0.0000 (1.0)      4.9595 (1.89)     0.0000 (1.0)           0;0  0.2016 (0.53)          1           1
test_status-status-changed[3.53.2]     4.6752 (1.78)     4.6752 (1.78)     4.6752 (1.78)     0.0000 (1.0)      4.6752 (1.78)     0.0000 (1.0)           0;0  0.2139 (0.56)          1           1
test_status-status-changed[3.60.1]     2.6442 (1.01)     2.6442 (1.01)     2.6442 (1.01)     0.0000 (1.0)      2.6442 (1.01)     0.0000 (1.0)           0;0  0.3782 (0.99)          1           1
test_status-status-changed[main]       2.6260 (1.0)      2.6260 (1.0)      2.6260 (1.0)      0.0000 (1.0)      2.6260 (1.0)      0.0000 (1.0)           0;0  0.3808 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7370 (1.84)     4.7370 (1.84)     4.7370 (1.84)     0.0000 (1.0)      4.7370 (1.84)     0.0000 (1.0)           0;0  0.2111 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.8665 (1.89)     4.8665 (1.89)     4.8665 (1.89)     0.0000 (1.0)      4.8665 (1.89)     0.0000 (1.0)           0;0  0.2055 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.7406 (1.84)     4.7406 (1.84)     4.7406 (1.84)     0.0000 (1.0)      4.7406 (1.84)     0.0000 (1.0)           0;0  0.2109 (0.54)          1           1
test_status-status-changed-noop[3.60.1]     2.5739 (1.0)      2.5739 (1.0)      2.5739 (1.0)      0.0000 (1.0)      2.5739 (1.0)      0.0000 (1.0)           0;0  0.3885 (1.0)           1           1
test_status-status-changed-noop[main]       2.6225 (1.02)     2.6225 (1.02)     2.6225 (1.02)     0.0000 (1.0)      2.6225 (1.02)     0.0000 (1.0)           0;0  0.3813 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.5999 (1.79)     4.5999 (1.79)     4.5999 (1.79)     0.0000 (1.0)      4.5999 (1.79)     0.0000 (1.0)           0;0  0.2174 (0.56)          1           1
test_status-status-noop[3.10.0]     4.9058 (1.91)     4.9058 (1.91)     4.9058 (1.91)     0.0000 (1.0)      4.9058 (1.91)     0.0000 (1.0)           0;0  0.2038 (0.52)          1           1
test_status-status-noop[3.53.2]     4.6908 (1.83)     4.6908 (1.83)     4.6908 (1.83)     0.0000 (1.0)      4.6908 (1.83)     0.0000 (1.0)           0;0  0.2132 (0.55)          1           1
test_status-status-noop[3.60.1]     2.5659 (1.0)      2.5659 (1.0)      2.5659 (1.0)      0.0000 (1.0)      2.5659 (1.0)      0.0000 (1.0)           0;0  0.3897 (1.0)           1           1
test_status-status-noop[main]       2.6164 (1.02)     2.6164 (1.02)     2.6164 (1.02)     0.0000 (1.0)      2.6164 (1.02)     0.0000 (1.0)           0;0  0.3822 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     155.0341 (3.30)     155.0341 (3.30)     155.0341 (3.30)     0.0000 (1.0)      155.0341 (3.30)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.10.0]     159.3482 (3.39)     159.3482 (3.39)     159.3482 (3.39)     0.0000 (1.0)      159.3482 (3.39)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.53.2]     117.2006 (2.50)     117.2006 (2.50)     117.2006 (2.50)     0.0000 (1.0)      117.2006 (2.50)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_update-import-url[3.60.1]      46.9556 (1.0)       46.9556 (1.0)       46.9556 (1.0)      0.0000 (1.0)       46.9556 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_update-import-url[main]        47.2460 (1.01)      47.2460 (1.01)      47.2460 (1.01)     0.0000 (1.0)       47.2460 (1.01)     0.0000 (1.0)           0;0  0.0212 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     138.6598 (3.88)     138.6598 (3.88)     138.6598 (3.88)     0.0000 (1.0)      138.6598 (3.88)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     143.5568 (4.02)     143.5568 (4.02)     143.5568 (4.02)     0.0000 (1.0)      143.5568 (4.02)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     109.3753 (3.06)     109.3753 (3.06)     109.3753 (3.06)     0.0000 (1.0)      109.3753 (3.06)     0.0000 (1.0)           0;0  0.0091 (0.33)          1           1
test_update-update[3.60.1]      35.8995 (1.00)      35.8995 (1.00)      35.8995 (1.00)     0.0000 (1.0)       35.8995 (1.00)     0.0000 (1.0)           0;0  0.0279 (1.00)          1           1
test_update-update[main]        35.7342 (1.0)       35.7342 (1.0)       35.7342 (1.0)      0.0000 (1.0)       35.7342 (1.0)      0.0000 (1.0)           0;0  0.0280 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.8697 (2.04)     15.8697 (2.04)     15.8697 (2.04)     0.0000 (1.0)      15.8697 (2.04)     0.0000 (1.0)           0;0  0.0630 (0.49)          1           1
test_update-update-noop[3.10.0]     16.6901 (2.15)     16.6901 (2.15)     16.6901 (2.15)     0.0000 (1.0)      16.6901 (2.15)     0.0000 (1.0)           0;0  0.0599 (0.47)          1           1
test_update-update-noop[3.53.2]     15.9002 (2.05)     15.9002 (2.05)     15.9002 (2.05)     0.0000 (1.0)      15.9002 (2.05)     0.0000 (1.0)           0;0  0.0629 (0.49)          1           1
test_update-update-noop[3.60.1]      7.7618 (1.0)       7.7618 (1.0)       7.7618 (1.0)      0.0000 (1.0)       7.7618 (1.0)      0.0000 (1.0)           0;0  0.1288 (1.0)           1           1
test_update-update-noop[main]        7.7792 (1.00)      7.7792 (1.00)      7.7792 (1.00)     0.0000 (1.0)       7.7792 (1.00)     0.0000 (1.0)           0;0  0.1285 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean