Mon Sep  1 01:31:28 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.0986 (3.74)     85.0986 (3.74)     85.0986 (3.74)     0.0000 (1.0)      85.0986 (3.74)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.10.0]     86.3458 (3.80)     86.3458 (3.80)     86.3458 (3.80)     0.0000 (1.0)      86.3458 (3.80)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.53.2]     78.0214 (3.43)     78.0214 (3.43)     78.0214 (3.43)     0.0000 (1.0)      78.0214 (3.43)     0.0000 (1.0)           0;0  0.0128 (0.29)          1           1
test_add_copy-add[3.60.1]     22.7266 (1.0)      22.7266 (1.0)      22.7266 (1.0)      0.0000 (1.0)      22.7266 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_add_copy-add[main]       23.7385 (1.04)     23.7385 (1.04)     23.7385 (1.04)     0.0000 (1.0)      23.7385 (1.04)     0.0000 (1.0)           0;0  0.0421 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.5128 (6.71)     29.5128 (6.71)     29.5128 (6.71)     0.0000 (1.0)      29.5128 (6.71)     0.0000 (1.0)           0;0  0.0339 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     30.0355 (6.83)     30.0355 (6.83)     30.0355 (6.83)     0.0000 (1.0)      30.0355 (6.83)     0.0000 (1.0)           0;0  0.0333 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.5578 (6.49)     28.5578 (6.49)     28.5578 (6.49)     0.0000 (1.0)      28.5578 (6.49)     0.0000 (1.0)           0;0  0.0350 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.3982 (1.0)       4.3982 (1.0)       4.3982 (1.0)      0.0000 (1.0)       4.3982 (1.0)      0.0000 (1.0)           0;0  0.2274 (1.0)           1           1
test_add_copy-add-noop[main]        4.6995 (1.07)      4.6995 (1.07)      4.6995 (1.07)     0.0000 (1.0)       4.6995 (1.07)     0.0000 (1.0)           0;0  0.2128 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.3416 (4.26)     67.3416 (4.26)     67.3416 (4.26)     0.0000 (1.0)      67.3416 (4.26)     0.0000 (1.0)           0;0  0.0148 (0.23)          1           1
test_add_hardlink-add[3.10.0]     69.2772 (4.39)     69.2772 (4.39)     69.2772 (4.39)     0.0000 (1.0)      69.2772 (4.39)     0.0000 (1.0)           0;0  0.0144 (0.23)          1           1
test_add_hardlink-add[3.53.2]     62.2356 (3.94)     62.2356 (3.94)     62.2356 (3.94)     0.0000 (1.0)      62.2356 (3.94)     0.0000 (1.0)           0;0  0.0161 (0.25)          1           1
test_add_hardlink-add[3.60.1]     15.7985 (1.0)      15.7985 (1.0)      15.7985 (1.0)      0.0000 (1.0)      15.7985 (1.0)      0.0000 (1.0)           0;0  0.0633 (1.0)           1           1
test_add_hardlink-add[main]       16.9235 (1.07)     16.9235 (1.07)     16.9235 (1.07)     0.0000 (1.0)      16.9235 (1.07)     0.0000 (1.0)           0;0  0.0591 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.8289 (7.79)     34.8289 (7.79)     34.8289 (7.79)     0.0000 (1.0)      34.8289 (7.79)     0.0000 (1.0)           0;0  0.0287 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     36.0052 (8.05)     36.0052 (8.05)     36.0052 (8.05)     0.0000 (1.0)      36.0052 (8.05)     0.0000 (1.0)           0;0  0.0278 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     33.2639 (7.44)     33.2639 (7.44)     33.2639 (7.44)     0.0000 (1.0)      33.2639 (7.44)     0.0000 (1.0)           0;0  0.0301 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.4736 (1.0)       4.4736 (1.0)       4.4736 (1.0)      0.0000 (1.0)       4.4736 (1.0)      0.0000 (1.0)           0;0  0.2235 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8258 (1.08)      4.8258 (1.08)      4.8258 (1.08)     0.0000 (1.0)       4.8258 (1.08)     0.0000 (1.0)           0;0  0.2072 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.5680 (2.06)     71.5680 (2.06)     71.5680 (2.06)     0.0000 (1.0)      71.5680 (2.06)     0.0000 (1.0)           0;0  0.0140 (0.49)          1           1
test_add_symlink-add[3.10.0]     71.9681 (2.07)     71.9681 (2.07)     71.9681 (2.07)     0.0000 (1.0)      71.9681 (2.07)     0.0000 (1.0)           0;0  0.0139 (0.48)          1           1
test_add_symlink-add[3.53.2]     66.5870 (1.92)     66.5870 (1.92)     66.5870 (1.92)     0.0000 (1.0)      66.5870 (1.92)     0.0000 (1.0)           0;0  0.0150 (0.52)          1           1
test_add_symlink-add[3.60.1]     34.7622 (1.0)      34.7622 (1.0)      34.7622 (1.0)      0.0000 (1.0)      34.7622 (1.0)      0.0000 (1.0)           0;0  0.0288 (1.0)           1           1
test_add_symlink-add[main]       35.4423 (1.02)     35.4423 (1.02)     35.4423 (1.02)     0.0000 (1.0)      35.4423 (1.02)     0.0000 (1.0)           0;0  0.0282 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.0103 (8.45)     48.0103 (8.45)     48.0103 (8.45)     0.0000 (1.0)      48.0103 (8.45)     0.0000 (1.0)           0;0  0.0208 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     48.9344 (8.62)     48.9344 (8.62)     48.9344 (8.62)     0.0000 (1.0)      48.9344 (8.62)     0.0000 (1.0)           0;0  0.0204 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.3174 (8.33)     47.3174 (8.33)     47.3174 (8.33)     0.0000 (1.0)      47.3174 (8.33)     0.0000 (1.0)           0;0  0.0211 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.6789 (1.0)       5.6789 (1.0)       5.6789 (1.0)      0.0000 (1.0)       5.6789 (1.0)      0.0000 (1.0)           0;0  0.1761 (1.0)           1           1
test_add_symlink-add-noop[main]        6.0414 (1.06)      6.0414 (1.06)      6.0414 (1.06)     0.0000 (1.0)       6.0414 (1.06)     0.0000 (1.0)           0;0  0.1655 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.0483 (2.00)     41.0483 (2.00)     41.0483 (2.00)     0.0000 (1.0)      41.0483 (2.00)     0.0000 (1.0)           0;0  0.0244 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     59.8684 (2.91)     59.8684 (2.91)     59.8684 (2.91)     0.0000 (1.0)      59.8684 (2.91)     0.0000 (1.0)           0;0  0.0167 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     28.3757 (1.38)     28.3757 (1.38)     28.3757 (1.38)     0.0000 (1.0)      28.3757 (1.38)     0.0000 (1.0)           0;0  0.0352 (0.72)          1           1
test_checkout_copy-checkout[3.60.1]     20.5591 (1.0)      20.5591 (1.0)      20.5591 (1.0)      0.0000 (1.0)      20.5591 (1.0)      0.0000 (1.0)           0;0  0.0486 (1.0)           1           1
test_checkout_copy-checkout[main]       21.7488 (1.06)     21.7488 (1.06)     21.7488 (1.06)     0.0000 (1.0)      21.7488 (1.06)     0.0000 (1.0)           0;0  0.0460 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4215 (1.68)     5.4215 (1.68)     5.4215 (1.68)     0.0000 (1.0)      5.4215 (1.68)     0.0000 (1.0)           0;0  0.1845 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6369 (1.74)     5.6369 (1.74)     5.6369 (1.74)     0.0000 (1.0)      5.6369 (1.74)     0.0000 (1.0)           0;0  0.1774 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4283 (1.68)     5.4283 (1.68)     5.4283 (1.68)     0.0000 (1.0)      5.4283 (1.68)     0.0000 (1.0)           0;0  0.1842 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2305 (1.0)      3.2305 (1.0)      3.2305 (1.0)      0.0000 (1.0)      3.2305 (1.0)      0.0000 (1.0)           0;0  0.3095 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5448 (1.10)     3.5448 (1.10)     3.5448 (1.10)     0.0000 (1.0)      3.5448 (1.10)     0.0000 (1.0)           0;0  0.2821 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.7126 (2.25)     8.7126 (2.25)     8.7126 (2.25)     0.0000 (1.0)      8.7126 (2.25)     0.0000 (1.0)           0;0  0.1148 (0.44)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3630 (1.64)     6.3630 (1.64)     6.3630 (1.64)     0.0000 (1.0)      6.3630 (1.64)     0.0000 (1.0)           0;0  0.1572 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2438 (1.61)     6.2438 (1.61)     6.2438 (1.61)     0.0000 (1.0)      6.2438 (1.61)     0.0000 (1.0)           0;0  0.1602 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8721 (1.0)      3.8721 (1.0)      3.8721 (1.0)      0.0000 (1.0)      3.8721 (1.0)      0.0000 (1.0)           0;0  0.2583 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3801 (1.13)     4.3801 (1.13)     4.3801 (1.13)     0.0000 (1.0)      4.3801 (1.13)     0.0000 (1.0)           0;0  0.2283 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.2177 (3.06)     22.2177 (3.06)     22.2177 (3.06)     0.0000 (1.0)      22.2177 (3.06)     0.0000 (1.0)           0;0  0.0450 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.9931 (2.20)     15.9931 (2.20)     15.9931 (2.20)     0.0000 (1.0)      15.9931 (2.20)     0.0000 (1.0)           0;0  0.0625 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.4150 (1.98)     14.4150 (1.98)     14.4150 (1.98)     0.0000 (1.0)      14.4150 (1.98)     0.0000 (1.0)           0;0  0.0694 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2693 (1.0)       7.2693 (1.0)       7.2693 (1.0)      0.0000 (1.0)       7.2693 (1.0)      0.0000 (1.0)           0;0  0.1376 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.9612 (1.10)      7.9612 (1.10)      7.9612 (1.10)     0.0000 (1.0)       7.9612 (1.10)     0.0000 (1.0)           0;0  0.1256 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5098 (1.67)     5.5098 (1.67)     5.5098 (1.67)     0.0000 (1.0)      5.5098 (1.67)     0.0000 (1.0)           0;0  0.1815 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7154 (1.73)     5.7154 (1.73)     5.7154 (1.73)     0.0000 (1.0)      5.7154 (1.73)     0.0000 (1.0)           0;0  0.1750 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5205 (1.67)     5.5205 (1.67)     5.5205 (1.67)     0.0000 (1.0)      5.5205 (1.67)     0.0000 (1.0)           0;0  0.1811 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2993 (1.0)      3.2993 (1.0)      3.2993 (1.0)      0.0000 (1.0)      3.2993 (1.0)      0.0000 (1.0)           0;0  0.3031 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6552 (1.11)     3.6552 (1.11)     3.6552 (1.11)     0.0000 (1.0)      3.6552 (1.11)     0.0000 (1.0)           0;0  0.2736 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7846 (2.26)     8.7846 (2.26)     8.7846 (2.26)     0.0000 (1.0)      8.7846 (2.26)     0.0000 (1.0)           0;0  0.1138 (0.44)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3998 (1.64)     6.3998 (1.64)     6.3998 (1.64)     0.0000 (1.0)      6.3998 (1.64)     0.0000 (1.0)           0;0  0.1563 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2406 (1.60)     6.2406 (1.60)     6.2406 (1.60)     0.0000 (1.0)      6.2406 (1.60)     0.0000 (1.0)           0;0  0.1602 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8952 (1.0)      3.8952 (1.0)      3.8952 (1.0)      0.0000 (1.0)      3.8952 (1.0)      0.0000 (1.0)           0;0  0.2567 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.5294 (1.16)     4.5294 (1.16)     4.5294 (1.16)     0.0000 (1.0)      4.5294 (1.16)     0.0000 (1.0)           0;0  0.2208 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.1741 (2.44)     24.1741 (2.44)     24.1741 (2.44)     0.0000 (1.0)      24.1741 (2.44)     0.0000 (1.0)           0;0  0.0414 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     18.7767 (1.90)     18.7767 (1.90)     18.7767 (1.90)     0.0000 (1.0)      18.7767 (1.90)     0.0000 (1.0)           0;0  0.0533 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.1403 (1.73)     17.1403 (1.73)     17.1403 (1.73)     0.0000 (1.0)      17.1403 (1.73)     0.0000 (1.0)           0;0  0.0583 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]      9.8925 (1.0)       9.8925 (1.0)       9.8925 (1.0)      0.0000 (1.0)       9.8925 (1.0)      0.0000 (1.0)           0;0  0.1011 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.7024 (1.08)     10.7024 (1.08)     10.7024 (1.08)     0.0000 (1.0)      10.7024 (1.08)     0.0000 (1.0)           0;0  0.0934 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.5588 (1.56)     6.5588 (1.56)     6.5588 (1.56)     0.0000 (1.0)      6.5588 (1.56)     0.0000 (1.0)           0;0  0.1525 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8345 (1.62)     6.8345 (1.62)     6.8345 (1.62)     0.0000 (1.0)      6.8345 (1.62)     0.0000 (1.0)           0;0  0.1463 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.5527 (1.56)     6.5527 (1.56)     6.5527 (1.56)     0.0000 (1.0)      6.5527 (1.56)     0.0000 (1.0)           0;0  0.1526 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2082 (1.0)      4.2082 (1.0)      4.2082 (1.0)      0.0000 (1.0)      4.2082 (1.0)      0.0000 (1.0)           0;0  0.2376 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5027 (1.07)     4.5027 (1.07)     4.5027 (1.07)     0.0000 (1.0)      4.5027 (1.07)     0.0000 (1.0)           0;0  0.2221 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6491 (1.88)     10.6491 (1.88)     10.6491 (1.88)     0.0000 (1.0)      10.6491 (1.88)     0.0000 (1.0)           0;0  0.0939 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4706 (1.50)      8.4706 (1.50)      8.4706 (1.50)     0.0000 (1.0)       8.4706 (1.50)     0.0000 (1.0)           0;0  0.1181 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.2019 (1.45)      8.2019 (1.45)      8.2019 (1.45)     0.0000 (1.0)       8.2019 (1.45)     0.0000 (1.0)           0;0  0.1219 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.6561 (1.0)       5.6561 (1.0)       5.6561 (1.0)      0.0000 (1.0)       5.6561 (1.0)      0.0000 (1.0)           0;0  0.1768 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.2998 (1.11)      6.2998 (1.11)      6.2998 (1.11)     0.0000 (1.0)       6.2998 (1.11)     0.0000 (1.0)           0;0  0.1587 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.4700 (1.81)     4.4700 (1.81)     4.4700 (1.81)     0.0000 (1.0)      4.4700 (1.81)     0.0000 (1.0)           0;0  0.2237 (0.55)          1           1
test_data_status-data-changed[3.10.0]     4.8413 (1.96)     4.8413 (1.96)     4.8413 (1.96)     0.0000 (1.0)      4.8413 (1.96)     0.0000 (1.0)           0;0  0.2066 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.6940 (1.90)     4.6940 (1.90)     4.6940 (1.90)     0.0000 (1.0)      4.6940 (1.90)     0.0000 (1.0)           0;0  0.2130 (0.53)          1           1
test_data_status-data-changed[3.60.1]     2.4704 (1.0)      2.4704 (1.0)      2.4704 (1.0)      0.0000 (1.0)      2.4704 (1.0)      0.0000 (1.0)           0;0  0.4048 (1.0)           1           1
test_data_status-data-changed[main]       2.6929 (1.09)     2.6929 (1.09)     2.6929 (1.09)     0.0000 (1.0)      2.6929 (1.09)     0.0000 (1.0)           0;0  0.3713 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.3192 (1.72)     4.3192 (1.72)     4.3192 (1.72)     0.0000 (1.0)      4.3192 (1.72)     0.0000 (1.0)           0;0  0.2315 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9917 (1.98)     4.9917 (1.98)     4.9917 (1.98)     0.0000 (1.0)      4.9917 (1.98)     0.0000 (1.0)           0;0  0.2003 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8475 (1.93)     4.8475 (1.93)     4.8475 (1.93)     0.0000 (1.0)      4.8475 (1.93)     0.0000 (1.0)           0;0  0.2063 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.5148 (1.0)      2.5148 (1.0)      2.5148 (1.0)      0.0000 (1.0)      2.5148 (1.0)      0.0000 (1.0)           0;0  0.3977 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.7402 (1.09)     2.7402 (1.09)     2.7402 (1.09)     0.0000 (1.0)      2.7402 (1.09)     0.0000 (1.0)           0;0  0.3649 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.6734 (3.65)     18.6734 (3.65)     18.6734 (3.65)     0.0000 (1.0)      18.6734 (3.65)     0.0000 (1.0)           0;0  0.0536 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.3475 (3.79)     19.3475 (3.79)     19.3475 (3.79)     0.0000 (1.0)      19.3475 (3.79)     0.0000 (1.0)           0;0  0.0517 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.1335 (3.74)     19.1335 (3.74)     19.1335 (3.74)     0.0000 (1.0)      19.1335 (3.74)     0.0000 (1.0)           0;0  0.0523 (0.27)          1           1
test_data_status-data-new[3.60.1]      5.1099 (1.0)       5.1099 (1.0)       5.1099 (1.0)      0.0000 (1.0)       5.1099 (1.0)      0.0000 (1.0)           0;0  0.1957 (1.0)           1           1
test_data_status-data-new[main]        5.3771 (1.05)      5.3771 (1.05)      5.3771 (1.05)     0.0000 (1.0)       5.3771 (1.05)     0.0000 (1.0)           0;0  0.1860 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1839 (1.70)     4.1839 (1.70)     4.1839 (1.70)     0.0000 (1.0)      4.1839 (1.70)     0.0000 (1.0)           0;0  0.2390 (0.59)          1           1
test_data_status-data-noop[3.10.0]     4.9430 (2.01)     4.9430 (2.01)     4.9430 (2.01)     0.0000 (1.0)      4.9430 (2.01)     0.0000 (1.0)           0;0  0.2023 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.8339 (1.96)     4.8339 (1.96)     4.8339 (1.96)     0.0000 (1.0)      4.8339 (1.96)     0.0000 (1.0)           0;0  0.2069 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.4636 (1.0)      2.4636 (1.0)      2.4636 (1.0)      0.0000 (1.0)      2.4636 (1.0)      0.0000 (1.0)           0;0  0.4059 (1.0)           1           1
test_data_status-data-noop[main]       2.7628 (1.12)     2.7628 (1.12)     2.7628 (1.12)     0.0000 (1.0)      2.7628 (1.12)     0.0000 (1.0)           0;0  0.3620 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2906 (1.25)     7.2906 (1.25)     7.2906 (1.25)     0.0000 (1.0)      7.2906 (1.25)     0.0000 (1.0)           0;0  0.1372 (0.80)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8298 (1.35)     7.8298 (1.35)     7.8298 (1.35)     0.0000 (1.0)      7.8298 (1.35)     0.0000 (1.0)           0;0  0.1277 (0.74)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8416 (1.35)     7.8416 (1.35)     7.8416 (1.35)     0.0000 (1.0)      7.8416 (1.35)     0.0000 (1.0)           0;0  0.1275 (0.74)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.8206 (1.0)      5.8206 (1.0)      5.8206 (1.0)      0.0000 (1.0)      5.8206 (1.0)      0.0000 (1.0)           0;0  0.1718 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.1512 (1.06)     6.1512 (1.06)     6.1512 (1.06)     0.0000 (1.0)      6.1512 (1.06)     0.0000 (1.0)           0;0  0.1626 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.3501 (1.30)     7.3501 (1.30)     7.3501 (1.30)     0.0000 (1.0)      7.3501 (1.30)     0.0000 (1.0)           0;0  0.1361 (0.77)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9180 (1.40)     7.9180 (1.40)     7.9180 (1.40)     0.0000 (1.0)      7.9180 (1.40)     0.0000 (1.0)           0;0  0.1263 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8445 (1.39)     7.8445 (1.39)     7.8445 (1.39)     0.0000 (1.0)      7.8445 (1.39)     0.0000 (1.0)           0;0  0.1275 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6638 (1.0)      5.6638 (1.0)      5.6638 (1.0)      0.0000 (1.0)      5.6638 (1.0)      0.0000 (1.0)           0;0  0.1766 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.0113 (1.06)     6.0113 (1.06)     6.0113 (1.06)     0.0000 (1.0)      6.0113 (1.06)     0.0000 (1.0)           0;0  0.1664 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.7672 (2.71)     21.7672 (2.71)     21.7672 (2.71)     0.0000 (1.0)      21.7672 (2.71)     0.0000 (1.0)           0;0  0.0459 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.1257 (2.75)     22.1257 (2.75)     22.1257 (2.75)     0.0000 (1.0)      22.1257 (2.75)     0.0000 (1.0)           0;0  0.0452 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.1075 (2.75)     22.1075 (2.75)     22.1075 (2.75)     0.0000 (1.0)      22.1075 (2.75)     0.0000 (1.0)           0;0  0.0452 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0331 (1.0)       8.0331 (1.0)       8.0331 (1.0)      0.0000 (1.0)       8.0331 (1.0)      0.0000 (1.0)           0;0  0.1245 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6746 (1.08)      8.6746 (1.08)      8.6746 (1.08)     0.0000 (1.0)       8.6746 (1.08)     0.0000 (1.0)           0;0  0.1153 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4727 (1.34)     6.4727 (1.34)     6.4727 (1.34)     0.0000 (1.0)      6.4727 (1.34)     0.0000 (1.0)           0;0  0.1545 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1769 (1.48)     7.1769 (1.48)     7.1769 (1.48)     0.0000 (1.0)      7.1769 (1.48)     0.0000 (1.0)           0;0  0.1393 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1687 (1.48)     7.1687 (1.48)     7.1687 (1.48)     0.0000 (1.0)      7.1687 (1.48)     0.0000 (1.0)           0;0  0.1395 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8357 (1.0)      4.8357 (1.0)      4.8357 (1.0)      0.0000 (1.0)      4.8357 (1.0)      0.0000 (1.0)           0;0  0.2068 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.3435 (1.11)     5.3435 (1.11)     5.3435 (1.11)     0.0000 (1.0)      5.3435 (1.11)     0.0000 (1.0)           0;0  0.1871 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0498 (2.55)     18.0498 (2.55)     18.0498 (2.55)     0.0000 (1.0)      18.0498 (2.55)     0.0000 (1.0)           0;0  0.0554 (0.39)          1           1
test_diff-diff[3.10.0]     19.0300 (2.69)     19.0300 (2.69)     19.0300 (2.69)     0.0000 (1.0)      19.0300 (2.69)     0.0000 (1.0)           0;0  0.0525 (0.37)          1           1
test_diff-diff[3.53.2]     19.5339 (2.77)     19.5339 (2.77)     19.5339 (2.77)     0.0000 (1.0)      19.5339 (2.77)     0.0000 (1.0)           0;0  0.0512 (0.36)          1           1
test_diff-diff[3.60.1]      7.0646 (1.0)       7.0646 (1.0)       7.0646 (1.0)      0.0000 (1.0)       7.0646 (1.0)      0.0000 (1.0)           0;0  0.1416 (1.0)           1           1
test_diff-diff[main]        8.1797 (1.16)      8.1797 (1.16)      8.1797 (1.16)     0.0000 (1.0)       8.1797 (1.16)     0.0000 (1.0)           0;0  0.1223 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0664 (1.75)     6.0664 (1.75)     6.0664 (1.75)     0.0000 (1.0)      6.0664 (1.75)     0.0000 (1.0)           0;0  0.1648 (0.57)          1           1
test_diff-diff-changed[3.10.0]     6.8535 (1.98)     6.8535 (1.98)     6.8535 (1.98)     0.0000 (1.0)      6.8535 (1.98)     0.0000 (1.0)           0;0  0.1459 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.7354 (1.66)     5.7354 (1.66)     5.7354 (1.66)     0.0000 (1.0)      5.7354 (1.66)     0.0000 (1.0)           0;0  0.1744 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.4594 (1.0)      3.4594 (1.0)      3.4594 (1.0)      0.0000 (1.0)      3.4594 (1.0)      0.0000 (1.0)           0;0  0.2891 (1.0)           1           1
test_diff-diff-changed[main]       4.3170 (1.25)     4.3170 (1.25)     4.3170 (1.25)     0.0000 (1.0)      4.3170 (1.25)     0.0000 (1.0)           0;0  0.2316 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2936 (1.52)     5.2936 (1.52)     5.2936 (1.52)     0.0000 (1.0)      5.2936 (1.52)     0.0000 (1.0)           0;0  0.1889 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0137 (1.73)     6.0137 (1.73)     6.0137 (1.73)     0.0000 (1.0)      6.0137 (1.73)     0.0000 (1.0)           0;0  0.1663 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5546 (1.60)     5.5546 (1.60)     5.5546 (1.60)     0.0000 (1.0)      5.5546 (1.60)     0.0000 (1.0)           0;0  0.1800 (0.63)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4735 (1.0)      3.4735 (1.0)      3.4735 (1.0)      0.0000 (1.0)      3.4735 (1.0)      0.0000 (1.0)           0;0  0.2879 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2999 (1.24)     4.2999 (1.24)     4.2999 (1.24)     0.0000 (1.0)      4.2999 (1.24)     0.0000 (1.0)           0;0  0.2326 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0809 (1.18)     4.0809 (1.18)     4.0809 (1.18)     0.0000 (1.0)      4.0809 (1.18)     0.0000 (1.0)           0;0  0.2450 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.9029 (1.42)     4.9029 (1.42)     4.9029 (1.42)     0.0000 (1.0)      4.9029 (1.42)     0.0000 (1.0)           0;0  0.2040 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.7548 (1.66)     5.7548 (1.66)     5.7548 (1.66)     0.0000 (1.0)      5.7548 (1.66)     0.0000 (1.0)           0;0  0.1738 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.4603 (1.0)      3.4603 (1.0)      3.4603 (1.0)      0.0000 (1.0)      3.4603 (1.0)      0.0000 (1.0)           0;0  0.2890 (1.0)           1           1
test_diff-diff-noop[main]       4.2583 (1.23)     4.2583 (1.23)     4.2583 (1.23)     0.0000 (1.0)      4.2583 (1.23)     0.0000 (1.0)           0;0  0.2348 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       983.9777 (1.0)        983.9777 (1.0)        983.9777 (1.0)      0.0000 (1.0)        983.9777 (1.0)      0.0000 (1.0)           0;0  1.0163 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,559.8991 (4.63)     4,559.8991 (4.63)     4,559.8991 (4.63)     0.0000 (1.0)      4,559.8991 (4.63)     0.0000 (1.0)           0;0  0.2193 (0.22)          1           1
test_exp_show-exp[3.53.2]     2,813.6234 (2.86)     2,813.6234 (2.86)     2,813.6234 (2.86)     0.0000 (1.0)      2,813.6234 (2.86)     0.0000 (1.0)           0;0  0.3554 (0.35)          1           1
test_exp_show-exp[3.60.1]     3,047.0593 (3.10)     3,047.0593 (3.10)     3,047.0593 (3.10)     0.0000 (1.0)      3,047.0593 (3.10)     0.0000 (1.0)           0;0  0.3282 (0.32)          1           1
test_exp_show-exp[main]       5,961.4189 (6.06)     5,961.4189 (6.06)     5,961.4189 (6.06)     0.0000 (1.0)      5,961.4189 (6.06)     0.0000 (1.0)           0;0  0.1677 (0.17)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     64.8625 (2.79)     64.8625 (2.79)     64.8625 (2.79)     0.0000 (1.0)      64.8625 (2.79)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.4330 (3.03)     70.4330 (3.03)     70.4330 (3.03)     0.0000 (1.0)      70.4330 (3.03)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.5154 (1.44)     33.5154 (1.44)     33.5154 (1.44)     0.0000 (1.0)      33.5154 (1.44)     0.0000 (1.0)           0;0  0.0298 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.3183 (1.00)     23.3183 (1.00)     23.3183 (1.00)     0.0000 (1.0)      23.3183 (1.00)     0.0000 (1.0)           0;0  0.0429 (1.00)          1           1
test_fetch-fetch[main]       23.2412 (1.0)      23.2412 (1.0)      23.2412 (1.0)      0.0000 (1.0)      23.2412 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7862 (1.00)     2.7862 (1.00)     2.7862 (1.00)     0.0000 (1.0)      2.7862 (1.00)     0.0000 (1.0)           0;0  0.3589 (1.00)          1           1
test_gc-gc[3.10.0]     2.8866 (1.04)     2.8866 (1.04)     2.8866 (1.04)     0.0000 (1.0)      2.8866 (1.04)     0.0000 (1.0)           0;0  0.3464 (0.96)          1           1
test_gc-gc[3.53.2]     2.8061 (1.01)     2.8061 (1.01)     2.8061 (1.01)     0.0000 (1.0)      2.8061 (1.01)     0.0000 (1.0)           0;0  0.3564 (0.99)          1           1
test_gc-gc[3.60.1]     2.7840 (1.0)      2.7840 (1.0)      2.7840 (1.0)      0.0000 (1.0)      2.7840 (1.0)      0.0000 (1.0)           0;0  0.3592 (1.0)           1           1
test_gc-gc[main]       2.9670 (1.07)     2.9670 (1.07)     2.9670 (1.07)     0.0000 (1.0)      2.9670 (1.07)     0.0000 (1.0)           0;0  0.3370 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     140.1487 (2.74)     140.1487 (2.74)     140.1487 (2.74)     0.0000 (1.0)      140.1487 (2.74)     0.0000 (1.0)           0;0  0.0071 (0.36)          1           1
test_get-get[3.10.0]     166.4218 (3.26)     166.4218 (3.26)     166.4218 (3.26)     0.0000 (1.0)      166.4218 (3.26)     0.0000 (1.0)           0;0  0.0060 (0.31)          1           1
test_get-get[3.53.2]     147.4757 (2.89)     147.4757 (2.89)     147.4757 (2.89)     0.0000 (1.0)      147.4757 (2.89)     0.0000 (1.0)           0;0  0.0068 (0.35)          1           1
test_get-get[3.60.1]      51.0934 (1.0)       51.0934 (1.0)       51.0934 (1.0)      0.0000 (1.0)       51.0934 (1.0)      0.0000 (1.0)           0;0  0.0196 (1.0)           1           1
test_get-get[main]        51.4169 (1.01)      51.4169 (1.01)      51.4169 (1.01)     0.0000 (1.0)       51.4169 (1.01)     0.0000 (1.0)           0;0  0.0194 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.3457 (2.67)     44.3457 (2.67)     44.3457 (2.67)     0.0000 (1.0)      44.3457 (2.67)     0.0000 (1.0)           0;0  0.0226 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.7311 (2.88)     47.7311 (2.88)     47.7311 (2.88)     0.0000 (1.0)      47.7311 (2.88)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.6634 (1.00)     16.6634 (1.00)     16.6634 (1.00)     0.0000 (1.0)      16.6634 (1.00)     0.0000 (1.0)           0;0  0.0600 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.6403 (1.00)     16.6403 (1.00)     16.6403 (1.00)     0.0000 (1.0)      16.6403 (1.00)     0.0000 (1.0)           0;0  0.0601 (1.00)          1           1
test_get_url-get-url[main]       16.5862 (1.0)      16.5862 (1.0)      16.5862 (1.0)      0.0000 (1.0)      16.5862 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.4970 (1.02)     144.9486 (1.09)     132.3659 (1.02)     2.7401 (1.48)     132.1151 (1.02)     2.4604 (1.41)         23;8  7.5548 (0.98)        100           1
test_help---help[3.10.0]     125.4156 (1.00)     133.5540 (1.0)      129.3965 (1.0)      1.8524 (1.0)      129.2856 (1.0)      2.6088 (1.50)         33;0  7.7282 (1.0)         100           1
test_help---help[3.53.2]     125.0826 (1.0)      142.7298 (1.07)     130.4020 (1.01)     2.7387 (1.48)     130.5760 (1.01)     3.1108 (1.78)         27;2  7.6686 (0.99)        100           1
test_help---help[3.60.1]     126.4100 (1.01)     157.6750 (1.18)     133.0406 (1.03)     4.8873 (2.64)     132.2912 (1.02)     2.1828 (1.25)          7;8  7.5165 (0.97)        100           1
test_help---help[main]       129.6037 (1.04)     156.6701 (1.17)     133.7029 (1.03)     3.3121 (1.79)     133.1651 (1.03)     1.7443 (1.0)           7;7  7.4793 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     228.0613 (2.99)     228.0613 (2.99)     228.0613 (2.99)     0.0000 (1.0)      228.0613 (2.99)     0.0000 (1.0)           0;0  0.0044 (0.33)          1           1
test_import-import[3.10.0]     255.8075 (3.36)     255.8075 (3.36)     255.8075 (3.36)     0.0000 (1.0)      255.8075 (3.36)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      76.2212 (1.0)       76.2212 (1.0)       76.2212 (1.0)      0.0000 (1.0)       76.2212 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
test_import-import[main]        78.6477 (1.03)      78.6477 (1.03)      78.6477 (1.03)     0.0000 (1.0)       78.6477 (1.03)     0.0000 (1.0)           0;0  0.0127 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     155.7172 (3.38)     155.7172 (3.38)     155.7172 (3.38)     0.0000 (1.0)      155.7172 (3.38)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     158.0597 (3.43)     158.0597 (3.43)     158.0597 (3.43)     0.0000 (1.0)      158.0597 (3.43)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.4669 (2.55)     117.4669 (2.55)     117.4669 (2.55)     0.0000 (1.0)      117.4669 (2.55)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_import_url-import-url[3.60.1]      46.0351 (1.0)       46.0351 (1.0)       46.0351 (1.0)      0.0000 (1.0)       46.0351 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_import_url-import-url[main]        47.6192 (1.03)      47.6192 (1.03)      47.6192 (1.03)     0.0000 (1.0)       47.6192 (1.03)     0.0000 (1.0)           0;0  0.0210 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     397.4346 (1.00)     441.0370 (1.00)     411.8697 (1.0)      10.0296 (1.40)     408.1868 (1.0)      13.7922 (1.81)         35;1  2.4280 (1.0)         100           1
test_init-init[3.10.0]     405.1168 (1.02)     439.9240 (1.00)     419.1272 (1.02)      7.1811 (1.0)      418.0404 (1.02)      7.6288 (1.0)          25;6  2.3859 (0.98)        100           1
test_init-init[3.53.2]     396.5694 (1.0)      439.2802 (1.0)      421.2814 (1.02)      8.1992 (1.14)     420.3725 (1.03)     10.5949 (1.39)         31;1  2.3737 (0.98)        100           1
test_init-init[3.60.1]     411.3636 (1.04)     453.0643 (1.03)     429.9521 (1.04)      9.4471 (1.32)     429.0609 (1.05)     11.7356 (1.54)         31;1  2.3258 (0.96)        100           1
test_init-init[main]       443.9810 (1.12)     528.3431 (1.20)     479.0443 (1.16)     17.1567 (2.39)     477.8732 (1.17)     18.4063 (2.41)         27;6  2.0875 (0.86)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     571.7107 (1.08)     571.7107 (1.08)     571.7107 (1.08)     0.0000 (1.0)      571.7107 (1.08)     0.0000 (1.0)           0;0  1.7491 (0.93)          1           1
test_list-list[3.10.0]     653.8248 (1.23)     653.8248 (1.23)     653.8248 (1.23)     0.0000 (1.0)      653.8248 (1.23)     0.0000 (1.0)           0;0  1.5295 (0.81)          1           1
test_list-list[3.53.2]     574.6176 (1.08)     574.6176 (1.08)     574.6176 (1.08)     0.0000 (1.0)      574.6176 (1.08)     0.0000 (1.0)           0;0  1.7403 (0.92)          1           1
test_list-list[3.60.1]     531.1658 (1.0)      531.1658 (1.0)      531.1658 (1.0)      0.0000 (1.0)      531.1658 (1.0)      0.0000 (1.0)           0;0  1.8827 (1.0)           1           1
test_list-list[main]       538.2107 (1.01)     538.2107 (1.01)     538.2107 (1.01)     0.0000 (1.0)      538.2107 (1.01)     0.0000 (1.0)           0;0  1.8580 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     417.8242 (1.08)     417.8242 (1.08)     417.8242 (1.08)     0.0000 (1.0)      417.8242 (1.08)     0.0000 (1.0)           0;0  2.3934 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     414.6336 (1.08)     414.6336 (1.08)     414.6336 (1.08)     0.0000 (1.0)      414.6336 (1.08)     0.0000 (1.0)           0;0  2.4118 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     385.1622 (1.0)      385.1622 (1.0)      385.1622 (1.0)      0.0000 (1.0)      385.1622 (1.0)      0.0000 (1.0)           0;0  2.5963 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     401.7712 (1.04)     401.7712 (1.04)     401.7712 (1.04)     0.0000 (1.0)      401.7712 (1.04)     0.0000 (1.0)           0;0  2.4890 (0.96)          1           1
test_list-list-dvc-only[main]       391.1984 (1.02)     391.1984 (1.02)     391.1984 (1.02)     0.0000 (1.0)      391.1984 (1.02)     0.0000 (1.0)           0;0  2.5562 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6654 (1.0)      2.6654 (1.0)      2.6654 (1.0)      0.0000 (1.0)      2.6654 (1.0)      0.0000 (1.0)           0;0  0.3752 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6798 (1.01)     2.6798 (1.01)     2.6798 (1.01)     0.0000 (1.0)      2.6798 (1.01)     0.0000 (1.0)           0;0  0.3732 (0.99)          1           1
test_list-list-recursive[3.53.2]     2.7396 (1.03)     2.7396 (1.03)     2.7396 (1.03)     0.0000 (1.0)      2.7396 (1.03)     0.0000 (1.0)           0;0  0.3650 (0.97)          1           1
test_list-list-recursive[3.60.1]     2.7933 (1.05)     2.7933 (1.05)     2.7933 (1.05)     0.0000 (1.0)      2.7933 (1.05)     0.0000 (1.0)           0;0  0.3580 (0.95)          1           1
test_list-list-recursive[main]       2.7791 (1.04)     2.7791 (1.04)     2.7791 (1.04)     0.0000 (1.0)      2.7791 (1.04)     0.0000 (1.0)           0;0  0.3598 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     409.0136 (1.06)     409.0136 (1.06)     409.0136 (1.06)     0.0000 (1.0)      409.0136 (1.06)     0.0000 (1.0)           0;0  2.4449 (0.95)          1           1
test_list-list-shallow[3.10.0]     423.1158 (1.09)     423.1158 (1.09)     423.1158 (1.09)     0.0000 (1.0)      423.1158 (1.09)     0.0000 (1.0)           0;0  2.3634 (0.91)          1           1
test_list-list-shallow[3.53.2]     389.5514 (1.01)     389.5514 (1.01)     389.5514 (1.01)     0.0000 (1.0)      389.5514 (1.01)     0.0000 (1.0)           0;0  2.5671 (0.99)          1           1
test_list-list-shallow[3.60.1]     386.8583 (1.0)      386.8583 (1.0)      386.8583 (1.0)      0.0000 (1.0)      386.8583 (1.0)      0.0000 (1.0)           0;0  2.5849 (1.0)           1           1
test_list-list-shallow[main]       401.0443 (1.04)     401.0443 (1.04)     401.0443 (1.04)     0.0000 (1.0)      401.0443 (1.04)     0.0000 (1.0)           0;0  2.4935 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.0582 (3.64)     71.0582 (3.64)     71.0582 (3.64)     0.0000 (1.0)      71.0582 (3.64)     0.0000 (1.0)           0;0  0.0141 (0.28)          1           1
test_partial_add-add[3.10.0]     70.5483 (3.61)     70.5483 (3.61)     70.5483 (3.61)     0.0000 (1.0)      70.5483 (3.61)     0.0000 (1.0)           0;0  0.0142 (0.28)          1           1
test_partial_add-add[3.53.2]     63.5058 (3.25)     63.5058 (3.25)     63.5058 (3.25)     0.0000 (1.0)      63.5058 (3.25)     0.0000 (1.0)           0;0  0.0157 (0.31)          1           1
test_partial_add-add[3.60.1]     19.5477 (1.0)      19.5477 (1.0)      19.5477 (1.0)      0.0000 (1.0)      19.5477 (1.0)      0.0000 (1.0)           0;0  0.0512 (1.0)           1           1
test_partial_add-add[main]       20.3340 (1.04)     20.3340 (1.04)     20.3340 (1.04)     0.0000 (1.0)      20.3340 (1.04)     0.0000 (1.0)           0;0  0.0492 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.7849 (7.90)     59.7849 (7.90)     59.7849 (7.90)     0.0000 (1.0)      59.7849 (7.90)     0.0000 (1.0)           0;0  0.0167 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     60.7155 (8.03)     60.7155 (8.03)     60.7155 (8.03)     0.0000 (1.0)      60.7155 (8.03)     0.0000 (1.0)           0;0  0.0165 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     54.3277 (7.18)     54.3277 (7.18)     54.3277 (7.18)     0.0000 (1.0)      54.3277 (7.18)     0.0000 (1.0)           0;0  0.0184 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.5636 (1.0)       7.5636 (1.0)       7.5636 (1.0)      0.0000 (1.0)       7.5636 (1.0)      0.0000 (1.0)           0;0  0.1322 (1.0)           1           1
test_partial_add-add-partial[main]        7.9065 (1.05)      7.9065 (1.05)      7.9065 (1.05)     0.0000 (1.0)       7.9065 (1.05)     0.0000 (1.0)           0;0  0.1265 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3306 (1.0)      4.3306 (1.0)      4.3306 (1.0)      0.0000 (1.0)      4.3306 (1.0)      0.0000 (1.0)           0;0  0.2309 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.6698 (1.31)     5.6698 (1.31)     5.6698 (1.31)     0.0000 (1.0)      5.6698 (1.31)     0.0000 (1.0)           0;0  0.1764 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.4392 (1.49)     6.4392 (1.49)     6.4392 (1.49)     0.0000 (1.0)      6.4392 (1.49)     0.0000 (1.0)           0;0  0.1553 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.4866 (1.50)     6.4866 (1.50)     6.4866 (1.50)     0.0000 (1.0)      6.4866 (1.50)     0.0000 (1.0)           0;0  0.1542 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.5337 (1.51)     6.5337 (1.51)     6.5337 (1.51)     0.0000 (1.0)      6.5337 (1.51)     0.0000 (1.0)           0;0  0.1531 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4063 (1.0)      2.4063 (1.0)      2.4063 (1.0)      0.0000 (1.0)      2.4063 (1.0)      0.0000 (1.0)           0;0  0.4156 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6310 (1.51)     3.6310 (1.51)     3.6310 (1.51)     0.0000 (1.0)      3.6310 (1.51)     0.0000 (1.0)           0;0  0.2754 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.6061 (1.50)     3.6061 (1.50)     3.6061 (1.50)     0.0000 (1.0)      3.6061 (1.50)     0.0000 (1.0)           0;0  0.2773 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.6363 (1.51)     3.6363 (1.51)     3.6363 (1.51)     0.0000 (1.0)      3.6363 (1.51)     0.0000 (1.0)           0;0  0.2750 (0.66)          1           1
test_partial_add-gc-noop[main]       3.6684 (1.52)     3.6684 (1.52)     3.6684 (1.52)     0.0000 (1.0)      3.6684 (1.52)     0.0000 (1.0)           0;0  0.2726 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.2332 (2.41)     45.2332 (2.41)     45.2332 (2.41)     0.0000 (1.0)      45.2332 (2.41)     0.0000 (1.0)           0;0  0.0221 (0.41)          1           1
test_partial_add-push[3.10.0]     40.5082 (2.16)     40.5082 (2.16)     40.5082 (2.16)     0.0000 (1.0)      40.5082 (2.16)     0.0000 (1.0)           0;0  0.0247 (0.46)          1           1
test_partial_add-push[3.53.2]     19.6522 (1.05)     19.6522 (1.05)     19.6522 (1.05)     0.0000 (1.0)      19.6522 (1.05)     0.0000 (1.0)           0;0  0.0509 (0.95)          1           1
test_partial_add-push[3.60.1]     18.7382 (1.0)      18.7382 (1.0)      18.7382 (1.0)      0.0000 (1.0)      18.7382 (1.0)      0.0000 (1.0)           0;0  0.0534 (1.0)           1           1
test_partial_add-push[main]       19.2171 (1.03)     19.2171 (1.03)     19.2171 (1.03)     0.0000 (1.0)      19.2171 (1.03)     0.0000 (1.0)           0;0  0.0520 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.3918 (1.14)     11.3918 (1.14)     11.3918 (1.14)     0.0000 (1.0)      11.3918 (1.14)     0.0000 (1.0)           0;0  0.0878 (0.88)          1           1
test_partial_add-push-partial[3.10.0]     10.5978 (1.06)     10.5978 (1.06)     10.5978 (1.06)     0.0000 (1.0)      10.5978 (1.06)     0.0000 (1.0)           0;0  0.0944 (0.94)          1           1
test_partial_add-push-partial[3.53.2]     10.3536 (1.04)     10.3536 (1.04)     10.3536 (1.04)     0.0000 (1.0)      10.3536 (1.04)     0.0000 (1.0)           0;0  0.0966 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     10.0930 (1.01)     10.0930 (1.01)     10.0930 (1.01)     0.0000 (1.0)      10.0930 (1.01)     0.0000 (1.0)           0;0  0.0991 (0.99)          1           1
test_partial_add-push-partial[main]        9.9744 (1.0)       9.9744 (1.0)       9.9744 (1.0)      0.0000 (1.0)       9.9744 (1.0)      0.0000 (1.0)           0;0  0.1003 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     88.0256 (3.91)     88.0256 (3.91)     88.0256 (3.91)     0.0000 (1.0)      88.0256 (3.91)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_partial_remove-add[3.10.0]     88.9624 (3.95)     88.9624 (3.95)     88.9624 (3.95)     0.0000 (1.0)      88.9624 (3.95)     0.0000 (1.0)           0;0  0.0112 (0.25)          1           1
test_partial_remove-add[3.53.2]     78.0559 (3.47)     78.0559 (3.47)     78.0559 (3.47)     0.0000 (1.0)      78.0559 (3.47)     0.0000 (1.0)           0;0  0.0128 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.5147 (1.0)      22.5147 (1.0)      22.5147 (1.0)      0.0000 (1.0)      22.5147 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_partial_remove-add[main]       23.5117 (1.04)     23.5117 (1.04)     23.5117 (1.04)     0.0000 (1.0)      23.5117 (1.04)     0.0000 (1.0)           0;0  0.0425 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.9124 (8.76)     8.9124 (8.76)     8.9124 (8.76)     0.0000 (1.0)      8.9124 (8.76)     0.0000 (1.0)           0;0  0.1122 (0.11)          1           1
test_partial_remove-add-update[3.10.0]     9.1035 (8.95)     9.1035 (8.95)     9.1035 (8.95)     0.0000 (1.0)      9.1035 (8.95)     0.0000 (1.0)           0;0  0.1098 (0.11)          1           1
test_partial_remove-add-update[3.53.2]     7.7945 (7.66)     7.7945 (7.66)     7.7945 (7.66)     0.0000 (1.0)      7.7945 (7.66)     0.0000 (1.0)           0;0  0.1283 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.0172 (1.0)      1.0172 (1.0)      1.0172 (1.0)      0.0000 (1.0)      1.0172 (1.0)      0.0000 (1.0)           0;0  0.9831 (1.0)           1           1
test_partial_remove-add-update[main]       1.0538 (1.04)     1.0538 (1.04)     1.0538 (1.04)     0.0000 (1.0)      1.0538 (1.04)     0.0000 (1.0)           0;0  0.9490 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3075 (1.0)      3.3075 (1.0)      3.3075 (1.0)      0.0000 (1.0)      3.3075 (1.0)      0.0000 (1.0)           0;0  0.3023 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5441 (1.07)     3.5441 (1.07)     3.5441 (1.07)     0.0000 (1.0)      3.5441 (1.07)     0.0000 (1.0)           0;0  0.2822 (0.93)          1           1
test_partial_remove-gc[3.53.2]     3.7697 (1.14)     3.7697 (1.14)     3.7697 (1.14)     0.0000 (1.0)      3.7697 (1.14)     0.0000 (1.0)           0;0  0.2653 (0.88)          1           1
test_partial_remove-gc[3.60.1]     3.5289 (1.07)     3.5289 (1.07)     3.5289 (1.07)     0.0000 (1.0)      3.5289 (1.07)     0.0000 (1.0)           0;0  0.2834 (0.94)          1           1
test_partial_remove-gc[main]       3.4554 (1.04)     3.4554 (1.04)     3.4554 (1.04)     0.0000 (1.0)      3.4554 (1.04)     0.0000 (1.0)           0;0  0.2894 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8042 (1.06)     4.8042 (1.06)     4.8042 (1.06)     0.0000 (1.0)      4.8042 (1.06)     0.0000 (1.0)           0;0  0.2082 (0.94)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1337 (1.13)     5.1337 (1.13)     5.1337 (1.13)     0.0000 (1.0)      5.1337 (1.13)     0.0000 (1.0)           0;0  0.1948 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.1003 (1.13)     5.1003 (1.13)     5.1003 (1.13)     0.0000 (1.0)      5.1003 (1.13)     0.0000 (1.0)           0;0  0.1961 (0.89)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.6413 (1.02)     4.6413 (1.02)     4.6413 (1.02)     0.0000 (1.0)      4.6413 (1.02)     0.0000 (1.0)           0;0  0.2155 (0.98)          1           1
test_partial_remove-gc-cloud[main]       4.5320 (1.0)      4.5320 (1.0)      4.5320 (1.0)      0.0000 (1.0)      4.5320 (1.0)      0.0000 (1.0)           0;0  0.2207 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.7642 (2.40)     52.7642 (2.40)     52.7642 (2.40)     0.0000 (1.0)      52.7642 (2.40)     0.0000 (1.0)           0;0  0.0190 (0.42)          1           1
test_partial_remove-push[3.10.0]     46.5681 (2.11)     46.5681 (2.11)     46.5681 (2.11)     0.0000 (1.0)      46.5681 (2.11)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.7737 (1.08)     23.7737 (1.08)     23.7737 (1.08)     0.0000 (1.0)      23.7737 (1.08)     0.0000 (1.0)           0;0  0.0421 (0.93)          1           1
test_partial_remove-push[3.60.1]     22.2434 (1.01)     22.2434 (1.01)     22.2434 (1.01)     0.0000 (1.0)      22.2434 (1.01)     0.0000 (1.0)           0;0  0.0450 (0.99)          1           1
test_partial_remove-push[main]       22.0184 (1.0)      22.0184 (1.0)      22.0184 (1.0)      0.0000 (1.0)      22.0184 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8934 (1.03)     1.8934 (1.03)     1.8934 (1.03)     0.0000 (1.0)      1.8934 (1.03)     0.0000 (1.0)           0;0  0.5282 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     1.8349 (1.0)      1.8349 (1.0)      1.8349 (1.0)      0.0000 (1.0)      1.8349 (1.0)      0.0000 (1.0)           0;0  0.5450 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5343 (1.38)     2.5343 (1.38)     2.5343 (1.38)     0.0000 (1.0)      2.5343 (1.38)     0.0000 (1.0)           0;0  0.3946 (0.72)          1           1
test_partial_remove-push-update[3.60.1]     2.6209 (1.43)     2.6209 (1.43)     2.6209 (1.43)     0.0000 (1.0)      2.6209 (1.43)     0.0000 (1.0)           0;0  0.3815 (0.70)          1           1
test_partial_remove-push-update[main]       2.7571 (1.50)     2.7571 (1.50)     2.7571 (1.50)     0.0000 (1.0)      2.7571 (1.50)     0.0000 (1.0)           0;0  0.3627 (0.67)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     507.9687 (1.0)      532.4957 (1.0)      518.9863 (1.0)       8.9617 (1.19)     519.6635 (1.0)       9.7868 (1.00)          2;0  1.9268 (1.0)           5           3
test_plots-plots-diff[3.10.0]     911.5652 (1.79)     935.6109 (1.76)     924.6729 (1.78)     11.0052 (1.47)     925.0210 (1.78)     20.6787 (2.12)          1;0  1.0815 (0.56)          5           3
test_plots-plots-diff[3.53.2]     851.3049 (1.68)     953.4059 (1.79)     876.7538 (1.69)     43.3389 (5.78)     857.4179 (1.65)     36.5599 (3.75)          1;1  1.1406 (0.59)          5           3
test_plots-plots-diff[3.60.1]     840.7206 (1.66)     865.9858 (1.63)     851.5033 (1.64)     10.5966 (1.41)     852.5350 (1.64)     17.4850 (1.79)          2;0  1.1744 (0.61)          5           3
test_plots-plots-diff[main]       843.4204 (1.66)     862.1895 (1.62)     850.1282 (1.64)      7.5043 (1.0)      849.6476 (1.63)      9.7442 (1.0)           1;0  1.1763 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       529.0971 (1.0)        540.1314 (1.0)        533.3428 (1.0)       4.1368 (1.20)       532.2879 (1.0)       4.3035 (1.01)          2;0  1.8750 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,161.8095 (2.20)     1,169.9025 (2.17)     1,164.1819 (2.18)      3.4332 (1.0)      1,162.3996 (2.18)      4.2457 (1.0)           1;0  0.8590 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       917.1874 (1.73)       927.1062 (1.72)       921.5215 (1.73)      3.7754 (1.10)       921.6903 (1.73)      5.0789 (1.20)          2;0  1.0852 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]       915.9378 (1.73)       942.4173 (1.74)       929.2139 (1.74)     10.0559 (2.93)       930.0653 (1.75)     14.3321 (3.38)          2;0  1.0762 (0.57)          5           3
test_plots-plots-diff-json[main]         930.0318 (1.76)       971.2977 (1.80)       947.8640 (1.78)     16.3985 (4.78)       940.8293 (1.77)     23.6488 (5.57)          2;0  1.0550 (0.56)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     427.9962 (1.0)      433.8515 (1.0)      430.6569 (1.0)       2.4430 (1.0)      431.3880 (1.0)       3.8947 (1.0)           2;0  2.3220 (1.0)           5           3
test_plots-plots-show[3.10.0]     747.6457 (1.75)     754.6453 (1.74)     750.8904 (1.74)      3.4136 (1.40)     749.5326 (1.74)      6.4671 (1.66)          2;0  1.3318 (0.57)          5           3
test_plots-plots-show[3.53.2]     721.6198 (1.69)     729.4952 (1.68)     725.7565 (1.69)      3.1928 (1.31)     725.7093 (1.68)      5.2525 (1.35)          2;0  1.3779 (0.59)          5           3
test_plots-plots-show[3.60.1]     732.6848 (1.71)     748.5581 (1.73)     737.5178 (1.71)      6.4742 (2.65)     735.1767 (1.70)      7.2305 (1.86)          1;0  1.3559 (0.58)          5           3
test_plots-plots-show[main]       736.9981 (1.72)     789.9633 (1.82)     751.9997 (1.75)     22.0640 (9.03)     744.5142 (1.73)     24.1206 (6.19)          1;0  1.3298 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     439.4498 (1.0)      471.8683 (1.0)      454.8299 (1.0)      13.3703 (2.45)     454.2696 (1.0)      22.6200 (2.99)          2;0  2.1986 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     878.1834 (2.00)     891.4778 (1.89)     882.6932 (1.94)      5.4666 (1.0)      881.3095 (1.94)      7.5574 (1.0)           1;0  1.1329 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     771.6602 (1.76)     796.9103 (1.69)     782.1522 (1.72)      9.5632 (1.75)     780.6309 (1.72)     12.2987 (1.63)          2;0  1.2785 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     774.7913 (1.76)     815.1830 (1.73)     790.1655 (1.74)     16.2776 (2.98)     788.4827 (1.74)     23.6432 (3.13)          1;0  1.2656 (0.58)          5           3
test_plots-plots-show-json[main]       779.5267 (1.77)     800.6373 (1.70)     786.7369 (1.73)      9.2986 (1.70)     781.1288 (1.72)     14.0636 (1.86)          1;0  1.2711 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.7235 (2.36)     51.7235 (2.36)     51.7235 (2.36)     0.0000 (1.0)      51.7235 (2.36)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_push-push[3.10.0]     46.3885 (2.12)     46.3885 (2.12)     46.3885 (2.12)     0.0000 (1.0)      46.3885 (2.12)     0.0000 (1.0)           0;0  0.0216 (0.47)          1           1
test_push-push[3.53.2]     22.6796 (1.04)     22.6796 (1.04)     22.6796 (1.04)     0.0000 (1.0)      22.6796 (1.04)     0.0000 (1.0)           0;0  0.0441 (0.97)          1           1
test_push-push[3.60.1]     21.8908 (1.0)      21.8908 (1.0)      21.8908 (1.0)      0.0000 (1.0)      21.8908 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
test_push-push[main]       22.2676 (1.02)     22.2676 (1.02)     22.2676 (1.02)     0.0000 (1.0)      22.2676 (1.02)     0.0000 (1.0)           0;0  0.0449 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     63.9078 (2.77)     63.9078 (2.77)     63.9078 (2.77)     0.0000 (1.0)      63.9078 (2.77)     0.0000 (1.0)           0;0  0.0156 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.1175 (2.99)     69.1175 (2.99)     69.1175 (2.99)     0.0000 (1.0)      69.1175 (2.99)     0.0000 (1.0)           0;0  0.0145 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.0596 (1.43)     33.0596 (1.43)     33.0596 (1.43)     0.0000 (1.0)      33.0596 (1.43)     0.0000 (1.0)           0;0  0.0302 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.1130 (1.0)      23.1130 (1.0)      23.1130 (1.0)      0.0000 (1.0)      23.1130 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
test_sharing-fetch[main]       23.4840 (1.02)     23.4840 (1.02)     23.4840 (1.02)     0.0000 (1.0)      23.4840 (1.02)     0.0000 (1.0)           0;0  0.0426 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2257 (1.0)      1.2257 (1.0)      1.2257 (1.0)      0.0000 (1.0)      1.2257 (1.0)      0.0000 (1.0)           0;0  0.8159 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5668 (2.91)     3.5668 (2.91)     3.5668 (2.91)     0.0000 (1.0)      3.5668 (2.91)     0.0000 (1.0)           0;0  0.2804 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.7291 (4.67)     5.7291 (4.67)     5.7291 (4.67)     0.0000 (1.0)      5.7291 (4.67)     0.0000 (1.0)           0;0  0.1745 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.8862 (4.80)     5.8862 (4.80)     5.8862 (4.80)     0.0000 (1.0)      5.8862 (4.80)     0.0000 (1.0)           0;0  0.1699 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8367 (4.76)     5.8367 (4.76)     5.8367 (4.76)     0.0000 (1.0)      5.8367 (4.76)     0.0000 (1.0)           0;0  0.1713 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.1220 (2.38)     52.1220 (2.38)     52.1220 (2.38)     0.0000 (1.0)      52.1220 (2.38)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_sharing-push[3.10.0]     46.1322 (2.11)     46.1322 (2.11)     46.1322 (2.11)     0.0000 (1.0)      46.1322 (2.11)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_sharing-push[3.53.2]     22.5390 (1.03)     22.5390 (1.03)     22.5390 (1.03)     0.0000 (1.0)      22.5390 (1.03)     0.0000 (1.0)           0;0  0.0444 (0.97)          1           1
test_sharing-push[3.60.1]     22.0327 (1.01)     22.0327 (1.01)     22.0327 (1.01)     0.0000 (1.0)      22.0327 (1.01)     0.0000 (1.0)           0;0  0.0454 (0.99)          1           1
test_sharing-push[main]       21.8976 (1.0)      21.8976 (1.0)      21.8976 (1.0)      0.0000 (1.0)      21.8976 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0697 (1.00)     2.0697 (1.00)     2.0697 (1.00)     0.0000 (1.0)      2.0697 (1.00)     0.0000 (1.0)           0;0  0.4832 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.0644 (1.0)      2.0644 (1.0)      2.0644 (1.0)      0.0000 (1.0)      2.0644 (1.0)      0.0000 (1.0)           0;0  0.4844 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.8792 (2.85)     5.8792 (2.85)     5.8792 (2.85)     0.0000 (1.0)      5.8792 (2.85)     0.0000 (1.0)           0;0  0.1701 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.0029 (2.91)     6.0029 (2.91)     6.0029 (2.91)     0.0000 (1.0)      6.0029 (2.91)     0.0000 (1.0)           0;0  0.1666 (0.34)          1           1
test_sharing-push-noop[main]       5.9855 (2.90)     5.9855 (2.90)     5.9855 (2.90)     0.0000 (1.0)      5.9855 (2.90)     0.0000 (1.0)           0;0  0.1671 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     156.8872 (1.07)     156.8872 (1.07)     156.8872 (1.07)     0.0000 (1.0)      156.8872 (1.07)     0.0000 (1.0)           0;0  0.0064 (0.93)          1           1
test_sharing_azure-fetch[main]       145.9749 (1.0)      145.9749 (1.0)      145.9749 (1.0)      0.0000 (1.0)      145.9749 (1.0)      0.0000 (1.0)           0;0  0.0069 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.2818 (1.0)      6.2818 (1.0)      6.2818 (1.0)      0.0000 (1.0)      6.2818 (1.0)      0.0000 (1.0)           0;0  0.1592 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.3407 (1.01)     6.3407 (1.01)     6.3407 (1.01)     0.0000 (1.0)      6.3407 (1.01)     0.0000 (1.0)           0;0  0.1577 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     154.1292 (1.0)      154.1292 (1.0)      154.1292 (1.0)      0.0000 (1.0)      154.1292 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
test_sharing_azure-push[main]       155.1820 (1.01)     155.1820 (1.01)     155.1820 (1.01)     0.0000 (1.0)      155.1820 (1.01)     0.0000 (1.0)           0;0  0.0064 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6583 (1.0)      6.6583 (1.0)      6.6583 (1.0)      0.0000 (1.0)      6.6583 (1.0)      0.0000 (1.0)           0;0  0.1502 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.8411 (1.03)     6.8411 (1.03)     6.8411 (1.03)     0.0000 (1.0)      6.8411 (1.03)     0.0000 (1.0)           0;0  0.1462 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     389.2541 (1.0)      389.2541 (1.0)      389.2541 (1.0)      0.0000 (1.0)      389.2541 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
test_sharing_gs-fetch[main]       389.5734 (1.00)     389.5734 (1.00)     389.5734 (1.00)     0.0000 (1.0)      389.5734 (1.00)     0.0000 (1.0)           0;0  0.0026 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     22.1473 (1.03)     22.1473 (1.03)     22.1473 (1.03)     0.0000 (1.0)      22.1473 (1.03)     0.0000 (1.0)           0;0  0.0452 (0.97)          1           1
test_sharing_gs-fetch-noop[main]       21.5107 (1.0)      21.5107 (1.0)      21.5107 (1.0)      0.0000 (1.0)      21.5107 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     915.4246 (1.0)      915.4246 (1.0)      915.4246 (1.0)      0.0000 (1.0)      915.4246 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
test_sharing_gs-push[main]       968.1541 (1.06)     968.1541 (1.06)     968.1541 (1.06)     0.0000 (1.0)      968.1541 (1.06)     0.0000 (1.0)           0;0  0.0010 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.1696 (1.03)     7.1696 (1.03)     7.1696 (1.03)     0.0000 (1.0)      7.1696 (1.03)     0.0000 (1.0)           0;0  0.1395 (0.97)          1           1
test_sharing_gs-push-noop[main]       6.9470 (1.0)      6.9470 (1.0)      6.9470 (1.0)      0.0000 (1.0)      6.9470 (1.0)      0.0000 (1.0)           0;0  0.1439 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     750.9718 (1.02)     750.9718 (1.02)     750.9718 (1.02)     0.0000 (1.0)      750.9718 (1.02)     0.0000 (1.0)           0;0  0.0013 (0.98)          1           1
test_sharing_s3-fetch[main]       735.7088 (1.0)      735.7088 (1.0)      735.7088 (1.0)      0.0000 (1.0)      735.7088 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6598 (1.0)      6.6598 (1.0)      6.6598 (1.0)      0.0000 (1.0)      6.6598 (1.0)      0.0000 (1.0)           0;0  0.1502 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.8200 (1.02)     6.8200 (1.02)     6.8200 (1.02)     0.0000 (1.0)      6.8200 (1.02)     0.0000 (1.0)           0;0  0.1466 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,205.8112 (1.0)      1,205.8112 (1.0)      1,205.8112 (1.0)      0.0000 (1.0)      1,205.8112 (1.0)      0.0000 (1.0)           0;0  0.0008 (1.0)           1           1
test_sharing_s3-push[main]       1,212.0059 (1.01)     1,212.0059 (1.01)     1,212.0059 (1.01)     0.0000 (1.0)      1,212.0059 (1.01)     0.0000 (1.0)           0;0  0.0008 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.2749 (1.0)      7.2749 (1.0)      7.2749 (1.0)      0.0000 (1.0)      7.2749 (1.0)      0.0000 (1.0)           0;0  0.1375 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.5164 (1.03)     7.5164 (1.03)     7.5164 (1.03)     0.0000 (1.0)      7.5164 (1.03)     0.0000 (1.0)           0;0  0.1330 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.0922 (3.62)     19.0922 (3.62)     19.0922 (3.62)     0.0000 (1.0)      19.0922 (3.62)     0.0000 (1.0)           0;0  0.0524 (0.28)          1           1
test_status-status[3.10.0]     19.5772 (3.71)     19.5772 (3.71)     19.5772 (3.71)     0.0000 (1.0)      19.5772 (3.71)     0.0000 (1.0)           0;0  0.0511 (0.27)          1           1
test_status-status[3.53.2]     17.4331 (3.30)     17.4331 (3.30)     17.4331 (3.30)     0.0000 (1.0)      17.4331 (3.30)     0.0000 (1.0)           0;0  0.0574 (0.30)          1           1
test_status-status[3.60.1]      5.2813 (1.0)       5.2813 (1.0)       5.2813 (1.0)      0.0000 (1.0)       5.2813 (1.0)      0.0000 (1.0)           0;0  0.1893 (1.0)           1           1
test_status-status[main]        5.4752 (1.04)      5.4752 (1.04)      5.4752 (1.04)     0.0000 (1.0)       5.4752 (1.04)     0.0000 (1.0)           0;0  0.1826 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8091 (1.78)     4.8091 (1.78)     4.8091 (1.78)     0.0000 (1.0)      4.8091 (1.78)     0.0000 (1.0)           0;0  0.2079 (0.56)          1           1
test_status-status-changed[3.10.0]     5.1321 (1.90)     5.1321 (1.90)     5.1321 (1.90)     0.0000 (1.0)      5.1321 (1.90)     0.0000 (1.0)           0;0  0.1949 (0.53)          1           1
test_status-status-changed[3.53.2]     4.8947 (1.82)     4.8947 (1.82)     4.8947 (1.82)     0.0000 (1.0)      4.8947 (1.82)     0.0000 (1.0)           0;0  0.2043 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6947 (1.0)      2.6947 (1.0)      2.6947 (1.0)      0.0000 (1.0)      2.6947 (1.0)      0.0000 (1.0)           0;0  0.3711 (1.0)           1           1
test_status-status-changed[main]       2.9993 (1.11)     2.9993 (1.11)     2.9993 (1.11)     0.0000 (1.0)      2.9993 (1.11)     0.0000 (1.0)           0;0  0.3334 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7670 (1.84)     4.7670 (1.84)     4.7670 (1.84)     0.0000 (1.0)      4.7670 (1.84)     0.0000 (1.0)           0;0  0.2098 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.9360 (1.91)     4.9360 (1.91)     4.9360 (1.91)     0.0000 (1.0)      4.9360 (1.91)     0.0000 (1.0)           0;0  0.2026 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.7467 (1.83)     4.7467 (1.83)     4.7467 (1.83)     0.0000 (1.0)      4.7467 (1.83)     0.0000 (1.0)           0;0  0.2107 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.5895 (1.0)      2.5895 (1.0)      2.5895 (1.0)      0.0000 (1.0)      2.5895 (1.0)      0.0000 (1.0)           0;0  0.3862 (1.0)           1           1
test_status-status-changed-noop[main]       2.8989 (1.12)     2.8989 (1.12)     2.8989 (1.12)     0.0000 (1.0)      2.8989 (1.12)     0.0000 (1.0)           0;0  0.3450 (0.89)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7927 (1.85)     4.7927 (1.85)     4.7927 (1.85)     0.0000 (1.0)      4.7927 (1.85)     0.0000 (1.0)           0;0  0.2087 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9703 (1.92)     4.9703 (1.92)     4.9703 (1.92)     0.0000 (1.0)      4.9703 (1.92)     0.0000 (1.0)           0;0  0.2012 (0.52)          1           1
test_status-status-noop[3.53.2]     4.7670 (1.84)     4.7670 (1.84)     4.7670 (1.84)     0.0000 (1.0)      4.7670 (1.84)     0.0000 (1.0)           0;0  0.2098 (0.54)          1           1
test_status-status-noop[3.60.1]     2.5861 (1.0)      2.5861 (1.0)      2.5861 (1.0)      0.0000 (1.0)      2.5861 (1.0)      0.0000 (1.0)           0;0  0.3867 (1.0)           1           1
test_status-status-noop[main]       2.8713 (1.11)     2.8713 (1.11)     2.8713 (1.11)     0.0000 (1.0)      2.8713 (1.11)     0.0000 (1.0)           0;0  0.3483 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     155.3711 (3.33)     155.3711 (3.33)     155.3711 (3.33)     0.0000 (1.0)      155.3711 (3.33)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     161.1630 (3.45)     161.1630 (3.45)     161.1630 (3.45)     0.0000 (1.0)      161.1630 (3.45)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.53.2]     118.6084 (2.54)     118.6084 (2.54)     118.6084 (2.54)     0.0000 (1.0)      118.6084 (2.54)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_update-import-url[3.60.1]      46.7051 (1.0)       46.7051 (1.0)       46.7051 (1.0)      0.0000 (1.0)       46.7051 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_update-import-url[main]        48.3253 (1.03)      48.3253 (1.03)      48.3253 (1.03)     0.0000 (1.0)       48.3253 (1.03)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     140.2588 (3.90)     140.2588 (3.90)     140.2588 (3.90)     0.0000 (1.0)      140.2588 (3.90)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.10.0]     145.2587 (4.04)     145.2587 (4.04)     145.2587 (4.04)     0.0000 (1.0)      145.2587 (4.04)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.53.2]     110.7798 (3.08)     110.7798 (3.08)     110.7798 (3.08)     0.0000 (1.0)      110.7798 (3.08)     0.0000 (1.0)           0;0  0.0090 (0.32)          1           1
test_update-update[3.60.1]      35.9705 (1.0)       35.9705 (1.0)       35.9705 (1.0)      0.0000 (1.0)       35.9705 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
test_update-update[main]        36.9320 (1.03)      36.9320 (1.03)      36.9320 (1.03)     0.0000 (1.0)       36.9320 (1.03)     0.0000 (1.0)           0;0  0.0271 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0388 (2.05)     16.0388 (2.05)     16.0388 (2.05)     0.0000 (1.0)      16.0388 (2.05)     0.0000 (1.0)           0;0  0.0623 (0.49)          1           1
test_update-update-noop[3.10.0]     16.9470 (2.17)     16.9470 (2.17)     16.9470 (2.17)     0.0000 (1.0)      16.9470 (2.17)     0.0000 (1.0)           0;0  0.0590 (0.46)          1           1
test_update-update-noop[3.53.2]     16.3680 (2.09)     16.3680 (2.09)     16.3680 (2.09)     0.0000 (1.0)      16.3680 (2.09)     0.0000 (1.0)           0;0  0.0611 (0.48)          1           1
test_update-update-noop[3.60.1]      7.8185 (1.0)       7.8185 (1.0)       7.8185 (1.0)      0.0000 (1.0)       7.8185 (1.0)      0.0000 (1.0)           0;0  0.1279 (1.0)           1           1
test_update-update-noop[main]        8.7444 (1.12)      8.7444 (1.12)      8.7444 (1.12)     0.0000 (1.0)       8.7444 (1.12)     0.0000 (1.0)           0;0  0.1144 (0.89)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean