Fri Sep 12 00:51:40 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     86.8700 (3.76)     86.8700 (3.76)     86.8700 (3.76)     0.0000 (1.0)      86.8700 (3.76)     0.0000 (1.0)           0;0  0.0115 (0.27)          1           1
test_add_copy-add[3.10.0]     87.5987 (3.80)     87.5987 (3.80)     87.5987 (3.80)     0.0000 (1.0)      87.5987 (3.80)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_add_copy-add[3.53.2]     78.2046 (3.39)     78.2046 (3.39)     78.2046 (3.39)     0.0000 (1.0)      78.2046 (3.39)     0.0000 (1.0)           0;0  0.0128 (0.30)          1           1
test_add_copy-add[3.60.1]     23.0758 (1.0)      23.0758 (1.0)      23.0758 (1.0)      0.0000 (1.0)      23.0758 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
test_add_copy-add[main]       24.0071 (1.04)     24.0071 (1.04)     24.0071 (1.04)     0.0000 (1.0)      24.0071 (1.04)     0.0000 (1.0)           0;0  0.0417 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.8180 (6.69)     29.8180 (6.69)     29.8180 (6.69)     0.0000 (1.0)      29.8180 (6.69)     0.0000 (1.0)           0;0  0.0335 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     30.1684 (6.77)     30.1684 (6.77)     30.1684 (6.77)     0.0000 (1.0)      30.1684 (6.77)     0.0000 (1.0)           0;0  0.0331 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.8425 (6.47)     28.8425 (6.47)     28.8425 (6.47)     0.0000 (1.0)      28.8425 (6.47)     0.0000 (1.0)           0;0  0.0347 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.4563 (1.0)       4.4563 (1.0)       4.4563 (1.0)      0.0000 (1.0)       4.4563 (1.0)      0.0000 (1.0)           0;0  0.2244 (1.0)           1           1
test_add_copy-add-noop[main]        4.7978 (1.08)      4.7978 (1.08)      4.7978 (1.08)     0.0000 (1.0)       4.7978 (1.08)     0.0000 (1.0)           0;0  0.2084 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     65.0699 (4.09)     65.0699 (4.09)     65.0699 (4.09)     0.0000 (1.0)      65.0699 (4.09)     0.0000 (1.0)           0;0  0.0154 (0.24)          1           1
test_add_hardlink-add[3.10.0]     65.8916 (4.14)     65.8916 (4.14)     65.8916 (4.14)     0.0000 (1.0)      65.8916 (4.14)     0.0000 (1.0)           0;0  0.0152 (0.24)          1           1
test_add_hardlink-add[3.53.2]     61.5442 (3.87)     61.5442 (3.87)     61.5442 (3.87)     0.0000 (1.0)      61.5442 (3.87)     0.0000 (1.0)           0;0  0.0162 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.9086 (1.0)      15.9086 (1.0)      15.9086 (1.0)      0.0000 (1.0)      15.9086 (1.0)      0.0000 (1.0)           0;0  0.0629 (1.0)           1           1
test_add_hardlink-add[main]       16.9682 (1.07)     16.9682 (1.07)     16.9682 (1.07)     0.0000 (1.0)      16.9682 (1.07)     0.0000 (1.0)           0;0  0.0589 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.1350 (7.56)     34.1350 (7.56)     34.1350 (7.56)     0.0000 (1.0)      34.1350 (7.56)     0.0000 (1.0)           0;0  0.0293 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     34.5119 (7.65)     34.5119 (7.65)     34.5119 (7.65)     0.0000 (1.0)      34.5119 (7.65)     0.0000 (1.0)           0;0  0.0290 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     32.9314 (7.30)     32.9314 (7.30)     32.9314 (7.30)     0.0000 (1.0)      32.9314 (7.30)     0.0000 (1.0)           0;0  0.0304 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5132 (1.0)       4.5132 (1.0)       4.5132 (1.0)      0.0000 (1.0)       4.5132 (1.0)      0.0000 (1.0)           0;0  0.2216 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8010 (1.06)      4.8010 (1.06)      4.8010 (1.06)     0.0000 (1.0)       4.8010 (1.06)     0.0000 (1.0)           0;0  0.2083 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.4203 (2.01)     71.4203 (2.01)     71.4203 (2.01)     0.0000 (1.0)      71.4203 (2.01)     0.0000 (1.0)           0;0  0.0140 (0.50)          1           1
test_add_symlink-add[3.10.0]     73.0699 (2.06)     73.0699 (2.06)     73.0699 (2.06)     0.0000 (1.0)      73.0699 (2.06)     0.0000 (1.0)           0;0  0.0137 (0.49)          1           1
test_add_symlink-add[3.53.2]     67.7058 (1.91)     67.7058 (1.91)     67.7058 (1.91)     0.0000 (1.0)      67.7058 (1.91)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.60.1]     35.5372 (1.0)      35.5372 (1.0)      35.5372 (1.0)      0.0000 (1.0)      35.5372 (1.0)      0.0000 (1.0)           0;0  0.0281 (1.0)           1           1
test_add_symlink-add[main]       36.4489 (1.03)     36.4489 (1.03)     36.4489 (1.03)     0.0000 (1.0)      36.4489 (1.03)     0.0000 (1.0)           0;0  0.0274 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.9535 (7.88)     47.9535 (7.88)     47.9535 (7.88)     0.0000 (1.0)      47.9535 (7.88)     0.0000 (1.0)           0;0  0.0209 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     48.5673 (7.98)     48.5673 (7.98)     48.5673 (7.98)     0.0000 (1.0)      48.5673 (7.98)     0.0000 (1.0)           0;0  0.0206 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     48.1848 (7.92)     48.1848 (7.92)     48.1848 (7.92)     0.0000 (1.0)      48.1848 (7.92)     0.0000 (1.0)           0;0  0.0208 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      6.0858 (1.0)       6.0858 (1.0)       6.0858 (1.0)      0.0000 (1.0)       6.0858 (1.0)      0.0000 (1.0)           0;0  0.1643 (1.0)           1           1
test_add_symlink-add-noop[main]        6.4902 (1.07)      6.4902 (1.07)      6.4902 (1.07)     0.0000 (1.0)       6.4902 (1.07)     0.0000 (1.0)           0;0  0.1541 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.9280 (2.01)     41.9280 (2.01)     41.9280 (2.01)     0.0000 (1.0)      41.9280 (2.01)     0.0000 (1.0)           0;0  0.0239 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     61.8187 (2.96)     61.8187 (2.96)     61.8187 (2.96)     0.0000 (1.0)      61.8187 (2.96)     0.0000 (1.0)           0;0  0.0162 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     29.0023 (1.39)     29.0023 (1.39)     29.0023 (1.39)     0.0000 (1.0)      29.0023 (1.39)     0.0000 (1.0)           0;0  0.0345 (0.72)          1           1
test_checkout_copy-checkout[3.60.1]     20.8895 (1.0)      20.8895 (1.0)      20.8895 (1.0)      0.0000 (1.0)      20.8895 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]       21.8126 (1.04)     21.8126 (1.04)     21.8126 (1.04)     0.0000 (1.0)      21.8126 (1.04)     0.0000 (1.0)           0;0  0.0458 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6106 (1.66)     5.6106 (1.66)     5.6106 (1.66)     0.0000 (1.0)      5.6106 (1.66)     0.0000 (1.0)           0;0  0.1782 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8384 (1.73)     5.8384 (1.73)     5.8384 (1.73)     0.0000 (1.0)      5.8384 (1.73)     0.0000 (1.0)           0;0  0.1713 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6023 (1.66)     5.6023 (1.66)     5.6023 (1.66)     0.0000 (1.0)      5.6023 (1.66)     0.0000 (1.0)           0;0  0.1785 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3823 (1.0)      3.3823 (1.0)      3.3823 (1.0)      0.0000 (1.0)      3.3823 (1.0)      0.0000 (1.0)           0;0  0.2957 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.7427 (1.11)     3.7427 (1.11)     3.7427 (1.11)     0.0000 (1.0)      3.7427 (1.11)     0.0000 (1.0)           0;0  0.2672 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.8910 (2.09)     8.8910 (2.09)     8.8910 (2.09)     0.0000 (1.0)      8.8910 (2.09)     0.0000 (1.0)           0;0  0.1125 (0.48)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6239 (1.56)     6.6239 (1.56)     6.6239 (1.56)     0.0000 (1.0)      6.6239 (1.56)     0.0000 (1.0)           0;0  0.1510 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3542 (1.49)     6.3542 (1.49)     6.3542 (1.49)     0.0000 (1.0)      6.3542 (1.49)     0.0000 (1.0)           0;0  0.1574 (0.67)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.2566 (1.0)      4.2566 (1.0)      4.2566 (1.0)      0.0000 (1.0)      4.2566 (1.0)      0.0000 (1.0)           0;0  0.2349 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.6851 (1.10)     4.6851 (1.10)     4.6851 (1.10)     0.0000 (1.0)      4.6851 (1.10)     0.0000 (1.0)           0;0  0.2134 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.1084 (2.90)     21.1084 (2.90)     21.1084 (2.90)     0.0000 (1.0)      21.1084 (2.90)     0.0000 (1.0)           0;0  0.0474 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.4365 (2.12)     15.4365 (2.12)     15.4365 (2.12)     0.0000 (1.0)      15.4365 (2.12)     0.0000 (1.0)           0;0  0.0648 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.2439 (1.96)     14.2439 (1.96)     14.2439 (1.96)     0.0000 (1.0)      14.2439 (1.96)     0.0000 (1.0)           0;0  0.0702 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2825 (1.0)       7.2825 (1.0)       7.2825 (1.0)      0.0000 (1.0)       7.2825 (1.0)      0.0000 (1.0)           0;0  0.1373 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1169 (1.11)      8.1169 (1.11)      8.1169 (1.11)     0.0000 (1.0)       8.1169 (1.11)     0.0000 (1.0)           0;0  0.1232 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3941 (1.62)     5.3941 (1.62)     5.3941 (1.62)     0.0000 (1.0)      5.3941 (1.62)     0.0000 (1.0)           0;0  0.1854 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6107 (1.69)     5.6107 (1.69)     5.6107 (1.69)     0.0000 (1.0)      5.6107 (1.69)     0.0000 (1.0)           0;0  0.1782 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4187 (1.63)     5.4187 (1.63)     5.4187 (1.63)     0.0000 (1.0)      5.4187 (1.63)     0.0000 (1.0)           0;0  0.1845 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3284 (1.0)      3.3284 (1.0)      3.3284 (1.0)      0.0000 (1.0)      3.3284 (1.0)      0.0000 (1.0)           0;0  0.3004 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5650 (1.07)     3.5650 (1.07)     3.5650 (1.07)     0.0000 (1.0)      3.5650 (1.07)     0.0000 (1.0)           0;0  0.2805 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.9373 (2.27)     8.9373 (2.27)     8.9373 (2.27)     0.0000 (1.0)      8.9373 (2.27)     0.0000 (1.0)           0;0  0.1119 (0.44)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4173 (1.63)     6.4173 (1.63)     6.4173 (1.63)     0.0000 (1.0)      6.4173 (1.63)     0.0000 (1.0)           0;0  0.1558 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2781 (1.59)     6.2781 (1.59)     6.2781 (1.59)     0.0000 (1.0)      6.2781 (1.59)     0.0000 (1.0)           0;0  0.1593 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9380 (1.0)      3.9380 (1.0)      3.9380 (1.0)      0.0000 (1.0)      3.9380 (1.0)      0.0000 (1.0)           0;0  0.2539 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.5057 (1.14)     4.5057 (1.14)     4.5057 (1.14)     0.0000 (1.0)      4.5057 (1.14)     0.0000 (1.0)           0;0  0.2219 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.1090 (2.54)     25.1090 (2.54)     25.1090 (2.54)     0.0000 (1.0)      25.1090 (2.54)     0.0000 (1.0)           0;0  0.0398 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     18.9232 (1.92)     18.9232 (1.92)     18.9232 (1.92)     0.0000 (1.0)      18.9232 (1.92)     0.0000 (1.0)           0;0  0.0528 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.6210 (1.78)     17.6210 (1.78)     17.6210 (1.78)     0.0000 (1.0)      17.6210 (1.78)     0.0000 (1.0)           0;0  0.0568 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]      9.8803 (1.0)       9.8803 (1.0)       9.8803 (1.0)      0.0000 (1.0)       9.8803 (1.0)      0.0000 (1.0)           0;0  0.1012 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.5402 (1.07)     10.5402 (1.07)     10.5402 (1.07)     0.0000 (1.0)      10.5402 (1.07)     0.0000 (1.0)           0;0  0.0949 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.5328 (1.56)     6.5328 (1.56)     6.5328 (1.56)     0.0000 (1.0)      6.5328 (1.56)     0.0000 (1.0)           0;0  0.1531 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.6715 (1.59)     6.6715 (1.59)     6.6715 (1.59)     0.0000 (1.0)      6.6715 (1.59)     0.0000 (1.0)           0;0  0.1499 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.5544 (1.56)     6.5544 (1.56)     6.5544 (1.56)     0.0000 (1.0)      6.5544 (1.56)     0.0000 (1.0)           0;0  0.1526 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1985 (1.0)      4.1985 (1.0)      4.1985 (1.0)      0.0000 (1.0)      4.1985 (1.0)      0.0000 (1.0)           0;0  0.2382 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5923 (1.09)     4.5923 (1.09)     4.5923 (1.09)     0.0000 (1.0)      4.5923 (1.09)     0.0000 (1.0)           0;0  0.2178 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6896 (1.87)     10.6896 (1.87)     10.6896 (1.87)     0.0000 (1.0)      10.6896 (1.87)     0.0000 (1.0)           0;0  0.0935 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4780 (1.48)      8.4780 (1.48)      8.4780 (1.48)     0.0000 (1.0)       8.4780 (1.48)     0.0000 (1.0)           0;0  0.1180 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.4546 (1.48)      8.4546 (1.48)      8.4546 (1.48)     0.0000 (1.0)       8.4546 (1.48)     0.0000 (1.0)           0;0  0.1183 (0.68)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7201 (1.0)       5.7201 (1.0)       5.7201 (1.0)      0.0000 (1.0)       5.7201 (1.0)      0.0000 (1.0)           0;0  0.1748 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.2934 (1.10)      6.2934 (1.10)      6.2934 (1.10)     0.0000 (1.0)       6.2934 (1.10)     0.0000 (1.0)           0;0  0.1589 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0593 (1.64)     4.0593 (1.64)     4.0593 (1.64)     0.0000 (1.0)      4.0593 (1.64)     0.0000 (1.0)           0;0  0.2463 (0.61)          1           1
test_data_status-data-changed[3.10.0]     4.8391 (1.96)     4.8391 (1.96)     4.8391 (1.96)     0.0000 (1.0)      4.8391 (1.96)     0.0000 (1.0)           0;0  0.2067 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.5684 (1.85)     4.5684 (1.85)     4.5684 (1.85)     0.0000 (1.0)      4.5684 (1.85)     0.0000 (1.0)           0;0  0.2189 (0.54)          1           1
test_data_status-data-changed[3.60.1]     2.4712 (1.0)      2.4712 (1.0)      2.4712 (1.0)      0.0000 (1.0)      2.4712 (1.0)      0.0000 (1.0)           0;0  0.4047 (1.0)           1           1
test_data_status-data-changed[main]       2.7329 (1.11)     2.7329 (1.11)     2.7329 (1.11)     0.0000 (1.0)      2.7329 (1.11)     0.0000 (1.0)           0;0  0.3659 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2524 (1.74)     4.2524 (1.74)     4.2524 (1.74)     0.0000 (1.0)      4.2524 (1.74)     0.0000 (1.0)           0;0  0.2352 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8781 (2.00)     4.8781 (2.00)     4.8781 (2.00)     0.0000 (1.0)      4.8781 (2.00)     0.0000 (1.0)           0;0  0.2050 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6627 (1.91)     4.6627 (1.91)     4.6627 (1.91)     0.0000 (1.0)      4.6627 (1.91)     0.0000 (1.0)           0;0  0.2145 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4406 (1.0)      2.4406 (1.0)      2.4406 (1.0)      0.0000 (1.0)      2.4406 (1.0)      0.0000 (1.0)           0;0  0.4097 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.7542 (1.13)     2.7542 (1.13)     2.7542 (1.13)     0.0000 (1.0)      2.7542 (1.13)     0.0000 (1.0)           0;0  0.3631 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.8115 (3.70)     18.8115 (3.70)     18.8115 (3.70)     0.0000 (1.0)      18.8115 (3.70)     0.0000 (1.0)           0;0  0.0532 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.4884 (3.84)     19.4884 (3.84)     19.4884 (3.84)     0.0000 (1.0)      19.4884 (3.84)     0.0000 (1.0)           0;0  0.0513 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.5065 (3.84)     19.5065 (3.84)     19.5065 (3.84)     0.0000 (1.0)      19.5065 (3.84)     0.0000 (1.0)           0;0  0.0513 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.0779 (1.0)       5.0779 (1.0)       5.0779 (1.0)      0.0000 (1.0)       5.0779 (1.0)      0.0000 (1.0)           0;0  0.1969 (1.0)           1           1
test_data_status-data-new[main]        5.4346 (1.07)      5.4346 (1.07)      5.4346 (1.07)     0.0000 (1.0)       5.4346 (1.07)     0.0000 (1.0)           0;0  0.1840 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.3186 (1.77)     4.3186 (1.77)     4.3186 (1.77)     0.0000 (1.0)      4.3186 (1.77)     0.0000 (1.0)           0;0  0.2316 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.8886 (2.01)     4.8886 (2.01)     4.8886 (2.01)     0.0000 (1.0)      4.8886 (2.01)     0.0000 (1.0)           0;0  0.2046 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.7533 (1.95)     4.7533 (1.95)     4.7533 (1.95)     0.0000 (1.0)      4.7533 (1.95)     0.0000 (1.0)           0;0  0.2104 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.4370 (1.0)      2.4370 (1.0)      2.4370 (1.0)      0.0000 (1.0)      2.4370 (1.0)      0.0000 (1.0)           0;0  0.4103 (1.0)           1           1
test_data_status-data-noop[main]       2.6653 (1.09)     2.6653 (1.09)     2.6653 (1.09)     0.0000 (1.0)      2.6653 (1.09)     0.0000 (1.0)           0;0  0.3752 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     8.1016 (1.28)     8.1016 (1.28)     8.1016 (1.28)     0.0000 (1.0)      8.1016 (1.28)     0.0000 (1.0)           0;0  0.1234 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     9.2131 (1.45)     9.2131 (1.45)     9.2131 (1.45)     0.0000 (1.0)      9.2131 (1.45)     0.0000 (1.0)           0;0  0.1085 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     8.7762 (1.38)     8.7762 (1.38)     8.7762 (1.38)     0.0000 (1.0)      8.7762 (1.38)     0.0000 (1.0)           0;0  0.1139 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     6.3385 (1.0)      6.3385 (1.0)      6.3385 (1.0)      0.0000 (1.0)      6.3385 (1.0)      0.0000 (1.0)           0;0  0.1578 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.7159 (1.06)     6.7159 (1.06)     6.7159 (1.06)     0.0000 (1.0)      6.7159 (1.06)     0.0000 (1.0)           0;0  0.1489 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     8.0284 (1.27)     8.0284 (1.27)     8.0284 (1.27)     0.0000 (1.0)      8.0284 (1.27)     0.0000 (1.0)           0;0  0.1246 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     8.6437 (1.37)     8.6437 (1.37)     8.6437 (1.37)     0.0000 (1.0)      8.6437 (1.37)     0.0000 (1.0)           0;0  0.1157 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     8.6931 (1.38)     8.6931 (1.38)     8.6931 (1.38)     0.0000 (1.0)      8.6931 (1.38)     0.0000 (1.0)           0;0  0.1150 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     6.3069 (1.0)      6.3069 (1.0)      6.3069 (1.0)      0.0000 (1.0)      6.3069 (1.0)      0.0000 (1.0)           0;0  0.1586 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.8917 (1.09)     6.8917 (1.09)     6.8917 (1.09)     0.0000 (1.0)      6.8917 (1.09)     0.0000 (1.0)           0;0  0.1451 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     22.4670 (2.62)     22.4670 (2.62)     22.4670 (2.62)     0.0000 (1.0)      22.4670 (2.62)     0.0000 (1.0)           0;0  0.0445 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.6382 (2.76)     23.6382 (2.76)     23.6382 (2.76)     0.0000 (1.0)      23.6382 (2.76)     0.0000 (1.0)           0;0  0.0423 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.9897 (2.68)     22.9897 (2.68)     22.9897 (2.68)     0.0000 (1.0)      22.9897 (2.68)     0.0000 (1.0)           0;0  0.0435 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.5693 (1.0)       8.5693 (1.0)       8.5693 (1.0)      0.0000 (1.0)       8.5693 (1.0)      0.0000 (1.0)           0;0  0.1167 (1.0)           1           1
test_data_status_all_flags-data-new[main]        9.2425 (1.08)      9.2425 (1.08)      9.2425 (1.08)     0.0000 (1.0)       9.2425 (1.08)     0.0000 (1.0)           0;0  0.1082 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.9871 (1.32)     6.9871 (1.32)     6.9871 (1.32)     0.0000 (1.0)      6.9871 (1.32)     0.0000 (1.0)           0;0  0.1431 (0.76)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.9875 (1.51)     7.9875 (1.51)     7.9875 (1.51)     0.0000 (1.0)      7.9875 (1.51)     0.0000 (1.0)           0;0  0.1252 (0.66)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.8872 (1.49)     7.8872 (1.49)     7.8872 (1.49)     0.0000 (1.0)      7.8872 (1.49)     0.0000 (1.0)           0;0  0.1268 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     5.3015 (1.0)      5.3015 (1.0)      5.3015 (1.0)      0.0000 (1.0)      5.3015 (1.0)      0.0000 (1.0)           0;0  0.1886 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.9175 (1.12)     5.9175 (1.12)     5.9175 (1.12)     0.0000 (1.0)      5.9175 (1.12)     0.0000 (1.0)           0;0  0.1690 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.1609 (2.61)     18.1609 (2.61)     18.1609 (2.61)     0.0000 (1.0)      18.1609 (2.61)     0.0000 (1.0)           0;0  0.0551 (0.38)          1           1
test_diff-diff[3.10.0]     19.0100 (2.73)     19.0100 (2.73)     19.0100 (2.73)     0.0000 (1.0)      19.0100 (2.73)     0.0000 (1.0)           0;0  0.0526 (0.37)          1           1
test_diff-diff[3.53.2]     19.5923 (2.81)     19.5923 (2.81)     19.5923 (2.81)     0.0000 (1.0)      19.5923 (2.81)     0.0000 (1.0)           0;0  0.0510 (0.36)          1           1
test_diff-diff[3.60.1]      6.9709 (1.0)       6.9709 (1.0)       6.9709 (1.0)      0.0000 (1.0)       6.9709 (1.0)      0.0000 (1.0)           0;0  0.1435 (1.0)           1           1
test_diff-diff[main]        8.0216 (1.15)      8.0216 (1.15)      8.0216 (1.15)     0.0000 (1.0)       8.0216 (1.15)     0.0000 (1.0)           0;0  0.1247 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1301 (1.79)     6.1301 (1.79)     6.1301 (1.79)     0.0000 (1.0)      6.1301 (1.79)     0.0000 (1.0)           0;0  0.1631 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.6668 (1.95)     6.6668 (1.95)     6.6668 (1.95)     0.0000 (1.0)      6.6668 (1.95)     0.0000 (1.0)           0;0  0.1500 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.6210 (1.64)     5.6210 (1.64)     5.6210 (1.64)     0.0000 (1.0)      5.6210 (1.64)     0.0000 (1.0)           0;0  0.1779 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4231 (1.0)      3.4231 (1.0)      3.4231 (1.0)      0.0000 (1.0)      3.4231 (1.0)      0.0000 (1.0)           0;0  0.2921 (1.0)           1           1
test_diff-diff-changed[main]       4.2696 (1.25)     4.2696 (1.25)     4.2696 (1.25)     0.0000 (1.0)      4.2696 (1.25)     0.0000 (1.0)           0;0  0.2342 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2375 (1.54)     5.2375 (1.54)     5.2375 (1.54)     0.0000 (1.0)      5.2375 (1.54)     0.0000 (1.0)           0;0  0.1909 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9151 (1.73)     5.9151 (1.73)     5.9151 (1.73)     0.0000 (1.0)      5.9151 (1.73)     0.0000 (1.0)           0;0  0.1691 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5493 (1.63)     5.5493 (1.63)     5.5493 (1.63)     0.0000 (1.0)      5.5493 (1.63)     0.0000 (1.0)           0;0  0.1802 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4095 (1.0)      3.4095 (1.0)      3.4095 (1.0)      0.0000 (1.0)      3.4095 (1.0)      0.0000 (1.0)           0;0  0.2933 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.3700 (1.28)     4.3700 (1.28)     4.3700 (1.28)     0.0000 (1.0)      4.3700 (1.28)     0.0000 (1.0)           0;0  0.2288 (0.78)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0938 (1.19)     4.0938 (1.19)     4.0938 (1.19)     0.0000 (1.0)      4.0938 (1.19)     0.0000 (1.0)           0;0  0.2443 (0.84)          1           1
test_diff-diff-noop[3.10.0]     4.7948 (1.40)     4.7948 (1.40)     4.7948 (1.40)     0.0000 (1.0)      4.7948 (1.40)     0.0000 (1.0)           0;0  0.2086 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.6476 (1.65)     5.6476 (1.65)     5.6476 (1.65)     0.0000 (1.0)      5.6476 (1.65)     0.0000 (1.0)           0;0  0.1771 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.4277 (1.0)      3.4277 (1.0)      3.4277 (1.0)      0.0000 (1.0)      3.4277 (1.0)      0.0000 (1.0)           0;0  0.2917 (1.0)           1           1
test_diff-diff-noop[main]       4.3091 (1.26)     4.3091 (1.26)     4.3091 (1.26)     0.0000 (1.0)      4.3091 (1.26)     0.0000 (1.0)           0;0  0.2321 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0055 (1.0)      1.0055 (1.0)      1.0055 (1.0)      0.0000 (1.0)      1.0055 (1.0)      0.0000 (1.0)           0;0  0.9946 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.1890 (4.17)     4.1890 (4.17)     4.1890 (4.17)     0.0000 (1.0)      4.1890 (4.17)     0.0000 (1.0)           0;0  0.2387 (0.24)          1           1
test_exp_show-exp[3.53.2]     2.5584 (2.54)     2.5584 (2.54)     2.5584 (2.54)     0.0000 (1.0)      2.5584 (2.54)     0.0000 (1.0)           0;0  0.3909 (0.39)          1           1
test_exp_show-exp[3.60.1]     2.4335 (2.42)     2.4335 (2.42)     2.4335 (2.42)     0.0000 (1.0)      2.4335 (2.42)     0.0000 (1.0)           0;0  0.4109 (0.41)          1           1
test_exp_show-exp[main]       5.0834 (5.06)     5.0834 (5.06)     5.0834 (5.06)     0.0000 (1.0)      5.0834 (5.06)     0.0000 (1.0)           0;0  0.1967 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.1780 (2.84)     66.1780 (2.84)     66.1780 (2.84)     0.0000 (1.0)      66.1780 (2.84)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.6453 (3.08)     71.6453 (3.08)     71.6453 (3.08)     0.0000 (1.0)      71.6453 (3.08)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.5589 (1.44)     33.5589 (1.44)     33.5589 (1.44)     0.0000 (1.0)      33.5589 (1.44)     0.0000 (1.0)           0;0  0.0298 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.2918 (1.0)      23.2918 (1.0)      23.2918 (1.0)      0.0000 (1.0)      23.2918 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_fetch-fetch[main]       23.6693 (1.02)     23.6693 (1.02)     23.6693 (1.02)     0.0000 (1.0)      23.6693 (1.02)     0.0000 (1.0)           0;0  0.0422 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7465 (1.0)      2.7465 (1.0)      2.7465 (1.0)      0.0000 (1.0)      2.7465 (1.0)      0.0000 (1.0)           0;0  0.3641 (1.0)           1           1
test_gc-gc[3.10.0]     2.8792 (1.05)     2.8792 (1.05)     2.8792 (1.05)     0.0000 (1.0)      2.8792 (1.05)     0.0000 (1.0)           0;0  0.3473 (0.95)          1           1
test_gc-gc[3.53.2]     2.8026 (1.02)     2.8026 (1.02)     2.8026 (1.02)     0.0000 (1.0)      2.8026 (1.02)     0.0000 (1.0)           0;0  0.3568 (0.98)          1           1
test_gc-gc[3.60.1]     2.8388 (1.03)     2.8388 (1.03)     2.8388 (1.03)     0.0000 (1.0)      2.8388 (1.03)     0.0000 (1.0)           0;0  0.3523 (0.97)          1           1
test_gc-gc[main]       2.9367 (1.07)     2.9367 (1.07)     2.9367 (1.07)     0.0000 (1.0)      2.9367 (1.07)     0.0000 (1.0)           0;0  0.3405 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.1988 (2.70)     134.1988 (2.70)     134.1988 (2.70)     0.0000 (1.0)      134.1988 (2.70)     0.0000 (1.0)           0;0  0.0075 (0.37)          1           1
test_get-get[3.10.0]     163.2595 (3.28)     163.2595 (3.28)     163.2595 (3.28)     0.0000 (1.0)      163.2595 (3.28)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.0313 (2.88)     143.0313 (2.88)     143.0313 (2.88)     0.0000 (1.0)      143.0313 (2.88)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      50.0665 (1.01)      50.0665 (1.01)      50.0665 (1.01)     0.0000 (1.0)       50.0665 (1.01)     0.0000 (1.0)           0;0  0.0200 (0.99)          1           1
test_get-get[main]        49.7457 (1.0)       49.7457 (1.0)       49.7457 (1.0)      0.0000 (1.0)       49.7457 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.4151 (2.67)     44.4151 (2.67)     44.4151 (2.67)     0.0000 (1.0)      44.4151 (2.67)     0.0000 (1.0)           0;0  0.0225 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.4321 (2.85)     47.4321 (2.85)     47.4321 (2.85)     0.0000 (1.0)      47.4321 (2.85)     0.0000 (1.0)           0;0  0.0211 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.9270 (1.02)     16.9270 (1.02)     16.9270 (1.02)     0.0000 (1.0)      16.9270 (1.02)     0.0000 (1.0)           0;0  0.0591 (0.98)          1           1
test_get_url-get-url[3.60.1]     16.6545 (1.0)      16.6545 (1.0)      16.6545 (1.0)      0.0000 (1.0)      16.6545 (1.0)      0.0000 (1.0)           0;0  0.0600 (1.0)           1           1
test_get_url-get-url[main]       16.9451 (1.02)     16.9451 (1.02)     16.9451 (1.02)     0.0000 (1.0)      16.9451 (1.02)     0.0000 (1.0)           0;0  0.0590 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.1347 (1.02)     135.2224 (1.00)     130.9353 (1.01)     1.5542 (1.0)      130.5445 (1.01)     2.3023 (1.17)         26;0  7.6374 (0.99)        100           1
test_help---help[3.10.0]     126.2209 (1.0)      135.1890 (1.0)      129.4185 (1.0)      1.6839 (1.08)     129.2957 (1.0)      2.0856 (1.06)         32;2  7.7269 (1.0)         100           1
test_help---help[3.53.2]     128.5706 (1.02)     140.0140 (1.04)     131.8711 (1.02)     1.7835 (1.15)     131.4878 (1.02)     1.9729 (1.0)          28;4  7.5832 (0.98)        100           1
test_help---help[3.60.1]     129.4833 (1.03)     137.9744 (1.02)     132.4848 (1.02)     1.7000 (1.09)     132.2746 (1.02)     2.2956 (1.16)         27;2  7.5480 (0.98)        100           1
test_help---help[main]       129.5333 (1.03)     166.0578 (1.23)     134.2210 (1.04)     6.5285 (4.20)     132.4212 (1.02)     2.3447 (1.19)         7;10  7.4504 (0.96)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     226.8954 (2.91)     226.8954 (2.91)     226.8954 (2.91)     0.0000 (1.0)      226.8954 (2.91)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     257.5910 (3.31)     257.5910 (3.31)     257.5910 (3.31)     0.0000 (1.0)      257.5910 (3.31)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      77.9277 (1.0)       77.9277 (1.0)       77.9277 (1.0)      0.0000 (1.0)       77.9277 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
test_import-import[main]        79.0497 (1.01)      79.0497 (1.01)      79.0497 (1.01)     0.0000 (1.0)       79.0497 (1.01)     0.0000 (1.0)           0;0  0.0127 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     155.4944 (3.32)     155.4944 (3.32)     155.4944 (3.32)     0.0000 (1.0)      155.4944 (3.32)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     159.7895 (3.41)     159.7895 (3.41)     159.7895 (3.41)     0.0000 (1.0)      159.7895 (3.41)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     118.0623 (2.52)     118.0623 (2.52)     118.0623 (2.52)     0.0000 (1.0)      118.0623 (2.52)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.8815 (1.0)       46.8815 (1.0)       46.8815 (1.0)      0.0000 (1.0)       46.8815 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_import_url-import-url[main]        48.0464 (1.02)      48.0464 (1.02)      48.0464 (1.02)     0.0000 (1.0)       48.0464 (1.02)     0.0000 (1.0)           0;0  0.0208 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     387.2100 (1.01)     423.0908 (1.04)     397.8247 (1.02)      6.9715 (1.56)     395.8543 (1.01)     6.3201 (1.27)        24;10  2.5137 (0.98)        100           1
test_init-init[3.10.0]     397.6668 (1.04)     424.7772 (1.04)     406.4027 (1.04)      5.9447 (1.33)     404.9398 (1.04)     5.2062 (1.04)        25;10  2.4606 (0.96)        100           1
test_init-init[3.53.2]     382.9246 (1.0)      406.7880 (1.0)      390.9826 (1.0)       4.4659 (1.0)      390.4151 (1.0)      4.9829 (1.0)          25;5  2.5577 (1.0)         100           1
test_init-init[3.60.1]     384.9868 (1.01)     413.8258 (1.02)     393.2975 (1.01)      5.4134 (1.21)     391.9451 (1.00)     5.6548 (1.13)         26;4  2.5426 (0.99)        100           1
test_init-init[main]       417.0493 (1.09)     528.4231 (1.30)     428.1611 (1.10)     13.8681 (3.11)     425.1293 (1.09)     6.0336 (1.21)          4;8  2.3356 (0.91)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     561.1437 (1.08)     561.1437 (1.08)     561.1437 (1.08)     0.0000 (1.0)      561.1437 (1.08)     0.0000 (1.0)           0;0  1.7821 (0.93)          1           1
test_list-list[3.10.0]     644.1005 (1.24)     644.1005 (1.24)     644.1005 (1.24)     0.0000 (1.0)      644.1005 (1.24)     0.0000 (1.0)           0;0  1.5526 (0.81)          1           1
test_list-list[3.53.2]     561.1677 (1.08)     561.1677 (1.08)     561.1677 (1.08)     0.0000 (1.0)      561.1677 (1.08)     0.0000 (1.0)           0;0  1.7820 (0.93)          1           1
test_list-list[3.60.1]     519.6859 (1.0)      519.6859 (1.0)      519.6859 (1.0)      0.0000 (1.0)      519.6859 (1.0)      0.0000 (1.0)           0;0  1.9242 (1.0)           1           1
test_list-list[main]       526.9024 (1.01)     526.9024 (1.01)     526.9024 (1.01)     0.0000 (1.0)      526.9024 (1.01)     0.0000 (1.0)           0;0  1.8979 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     404.9587 (1.05)     404.9587 (1.05)     404.9587 (1.05)     0.0000 (1.0)      404.9587 (1.05)     0.0000 (1.0)           0;0  2.4694 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     411.1814 (1.06)     411.1814 (1.06)     411.1814 (1.06)     0.0000 (1.0)      411.1814 (1.06)     0.0000 (1.0)           0;0  2.4320 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     391.8219 (1.01)     391.8219 (1.01)     391.8219 (1.01)     0.0000 (1.0)      391.8219 (1.01)     0.0000 (1.0)           0;0  2.5522 (0.99)          1           1
test_list-list-dvc-only[3.60.1]     386.8371 (1.0)      386.8371 (1.0)      386.8371 (1.0)      0.0000 (1.0)      386.8371 (1.0)      0.0000 (1.0)           0;0  2.5851 (1.0)           1           1
test_list-list-dvc-only[main]       402.1212 (1.04)     402.1212 (1.04)     402.1212 (1.04)     0.0000 (1.0)      402.1212 (1.04)     0.0000 (1.0)           0;0  2.4868 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5499 (1.0)      2.5499 (1.0)      2.5499 (1.0)      0.0000 (1.0)      2.5499 (1.0)      0.0000 (1.0)           0;0  0.3922 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6513 (1.04)     2.6513 (1.04)     2.6513 (1.04)     0.0000 (1.0)      2.6513 (1.04)     0.0000 (1.0)           0;0  0.3772 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.7548 (1.08)     2.7548 (1.08)     2.7548 (1.08)     0.0000 (1.0)      2.7548 (1.08)     0.0000 (1.0)           0;0  0.3630 (0.93)          1           1
test_list-list-recursive[3.60.1]     2.7665 (1.08)     2.7665 (1.08)     2.7665 (1.08)     0.0000 (1.0)      2.7665 (1.08)     0.0000 (1.0)           0;0  0.3615 (0.92)          1           1
test_list-list-recursive[main]       2.6345 (1.03)     2.6345 (1.03)     2.6345 (1.03)     0.0000 (1.0)      2.6345 (1.03)     0.0000 (1.0)           0;0  0.3796 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     407.1806 (1.05)     407.1806 (1.05)     407.1806 (1.05)     0.0000 (1.0)      407.1806 (1.05)     0.0000 (1.0)           0;0  2.4559 (0.96)          1           1
test_list-list-shallow[3.10.0]     406.5611 (1.04)     406.5611 (1.04)     406.5611 (1.04)     0.0000 (1.0)      406.5611 (1.04)     0.0000 (1.0)           0;0  2.4597 (0.96)          1           1
test_list-list-shallow[3.53.2]     389.0575 (1.0)      389.0575 (1.0)      389.0575 (1.0)      0.0000 (1.0)      389.0575 (1.0)      0.0000 (1.0)           0;0  2.5703 (1.0)           1           1
test_list-list-shallow[3.60.1]     392.3832 (1.01)     392.3832 (1.01)     392.3832 (1.01)     0.0000 (1.0)      392.3832 (1.01)     0.0000 (1.0)           0;0  2.5485 (0.99)          1           1
test_list-list-shallow[main]       389.6755 (1.00)     389.6755 (1.00)     389.6755 (1.00)     0.0000 (1.0)      389.6755 (1.00)     0.0000 (1.0)           0;0  2.5662 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     74.0548 (3.78)     74.0548 (3.78)     74.0548 (3.78)     0.0000 (1.0)      74.0548 (3.78)     0.0000 (1.0)           0;0  0.0135 (0.26)          1           1
test_partial_add-add[3.10.0]     74.1227 (3.79)     74.1227 (3.79)     74.1227 (3.79)     0.0000 (1.0)      74.1227 (3.79)     0.0000 (1.0)           0;0  0.0135 (0.26)          1           1
test_partial_add-add[3.53.2]     66.9713 (3.42)     66.9713 (3.42)     66.9713 (3.42)     0.0000 (1.0)      66.9713 (3.42)     0.0000 (1.0)           0;0  0.0149 (0.29)          1           1
test_partial_add-add[3.60.1]     19.5696 (1.0)      19.5696 (1.0)      19.5696 (1.0)      0.0000 (1.0)      19.5696 (1.0)      0.0000 (1.0)           0;0  0.0511 (1.0)           1           1
test_partial_add-add[main]       20.5971 (1.05)     20.5971 (1.05)     20.5971 (1.05)     0.0000 (1.0)      20.5971 (1.05)     0.0000 (1.0)           0;0  0.0486 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     62.2095 (8.09)     62.2095 (8.09)     62.2095 (8.09)     0.0000 (1.0)      62.2095 (8.09)     0.0000 (1.0)           0;0  0.0161 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     63.3849 (8.24)     63.3849 (8.24)     63.3849 (8.24)     0.0000 (1.0)      63.3849 (8.24)     0.0000 (1.0)           0;0  0.0158 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     56.4430 (7.34)     56.4430 (7.34)     56.4430 (7.34)     0.0000 (1.0)      56.4430 (7.34)     0.0000 (1.0)           0;0  0.0177 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.6926 (1.0)       7.6926 (1.0)       7.6926 (1.0)      0.0000 (1.0)       7.6926 (1.0)      0.0000 (1.0)           0;0  0.1300 (1.0)           1           1
test_partial_add-add-partial[main]        8.0484 (1.05)      8.0484 (1.05)      8.0484 (1.05)     0.0000 (1.0)       8.0484 (1.05)     0.0000 (1.0)           0;0  0.1242 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4363 (1.0)      4.4363 (1.0)      4.4363 (1.0)      0.0000 (1.0)      4.4363 (1.0)      0.0000 (1.0)           0;0  0.2254 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8831 (1.33)     5.8831 (1.33)     5.8831 (1.33)     0.0000 (1.0)      5.8831 (1.33)     0.0000 (1.0)           0;0  0.1700 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6876 (1.51)     6.6876 (1.51)     6.6876 (1.51)     0.0000 (1.0)      6.6876 (1.51)     0.0000 (1.0)           0;0  0.1495 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6153 (1.49)     6.6153 (1.49)     6.6153 (1.49)     0.0000 (1.0)      6.6153 (1.49)     0.0000 (1.0)           0;0  0.1512 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.6640 (1.50)     6.6640 (1.50)     6.6640 (1.50)     0.0000 (1.0)      6.6640 (1.50)     0.0000 (1.0)           0;0  0.1501 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3947 (1.0)      2.3947 (1.0)      2.3947 (1.0)      0.0000 (1.0)      2.3947 (1.0)      0.0000 (1.0)           0;0  0.4176 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7052 (1.55)     3.7052 (1.55)     3.7052 (1.55)     0.0000 (1.0)      3.7052 (1.55)     0.0000 (1.0)           0;0  0.2699 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.6246 (1.51)     3.6246 (1.51)     3.6246 (1.51)     0.0000 (1.0)      3.6246 (1.51)     0.0000 (1.0)           0;0  0.2759 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.6849 (1.54)     3.6849 (1.54)     3.6849 (1.54)     0.0000 (1.0)      3.6849 (1.54)     0.0000 (1.0)           0;0  0.2714 (0.65)          1           1
test_partial_add-gc-noop[main]       3.7239 (1.56)     3.7239 (1.56)     3.7239 (1.56)     0.0000 (1.0)      3.7239 (1.56)     0.0000 (1.0)           0;0  0.2685 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.4306 (2.37)     44.4306 (2.37)     44.4306 (2.37)     0.0000 (1.0)      44.4306 (2.37)     0.0000 (1.0)           0;0  0.0225 (0.42)          1           1
test_partial_add-push[3.10.0]     39.2641 (2.09)     39.2641 (2.09)     39.2641 (2.09)     0.0000 (1.0)      39.2641 (2.09)     0.0000 (1.0)           0;0  0.0255 (0.48)          1           1
test_partial_add-push[3.53.2]     19.7505 (1.05)     19.7505 (1.05)     19.7505 (1.05)     0.0000 (1.0)      19.7505 (1.05)     0.0000 (1.0)           0;0  0.0506 (0.95)          1           1
test_partial_add-push[3.60.1]     18.9492 (1.01)     18.9492 (1.01)     18.9492 (1.01)     0.0000 (1.0)      18.9492 (1.01)     0.0000 (1.0)           0;0  0.0528 (0.99)          1           1
test_partial_add-push[main]       18.7756 (1.0)      18.7756 (1.0)      18.7756 (1.0)      0.0000 (1.0)      18.7756 (1.0)      0.0000 (1.0)           0;0  0.0533 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.3470 (1.11)     11.3470 (1.11)     11.3470 (1.11)     0.0000 (1.0)      11.3470 (1.11)     0.0000 (1.0)           0;0  0.0881 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.5357 (1.03)     10.5357 (1.03)     10.5357 (1.03)     0.0000 (1.0)      10.5357 (1.03)     0.0000 (1.0)           0;0  0.0949 (0.97)          1           1
test_partial_add-push-partial[3.53.2]     10.5379 (1.03)     10.5379 (1.03)     10.5379 (1.03)     0.0000 (1.0)      10.5379 (1.03)     0.0000 (1.0)           0;0  0.0949 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.2050 (1.0)      10.2050 (1.0)      10.2050 (1.0)      0.0000 (1.0)      10.2050 (1.0)      0.0000 (1.0)           0;0  0.0980 (1.0)           1           1
test_partial_add-push-partial[main]       10.3159 (1.01)     10.3159 (1.01)     10.3159 (1.01)     0.0000 (1.0)      10.3159 (1.01)     0.0000 (1.0)           0;0  0.0969 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.0593 (3.81)     86.0593 (3.81)     86.0593 (3.81)     0.0000 (1.0)      86.0593 (3.81)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.10.0]     86.7459 (3.84)     86.7459 (3.84)     86.7459 (3.84)     0.0000 (1.0)      86.7459 (3.84)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_partial_remove-add[3.53.2]     77.7214 (3.44)     77.7214 (3.44)     77.7214 (3.44)     0.0000 (1.0)      77.7214 (3.44)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.6061 (1.0)      22.6061 (1.0)      22.6061 (1.0)      0.0000 (1.0)      22.6061 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_partial_remove-add[main]       24.2068 (1.07)     24.2068 (1.07)     24.2068 (1.07)     0.0000 (1.0)      24.2068 (1.07)     0.0000 (1.0)           0;0  0.0413 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.7445 (8.54)     8.7445 (8.54)     8.7445 (8.54)     0.0000 (1.0)      8.7445 (8.54)     0.0000 (1.0)           0;0  0.1144 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.4985 (8.30)     8.4985 (8.30)     8.4985 (8.30)     0.0000 (1.0)      8.4985 (8.30)     0.0000 (1.0)           0;0  0.1177 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.6464 (7.47)     7.6464 (7.47)     7.6464 (7.47)     0.0000 (1.0)      7.6464 (7.47)     0.0000 (1.0)           0;0  0.1308 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.0239 (1.0)      1.0239 (1.0)      1.0239 (1.0)      0.0000 (1.0)      1.0239 (1.0)      0.0000 (1.0)           0;0  0.9766 (1.0)           1           1
test_partial_remove-add-update[main]       1.0501 (1.03)     1.0501 (1.03)     1.0501 (1.03)     0.0000 (1.0)      1.0501 (1.03)     0.0000 (1.0)           0;0  0.9523 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1405 (1.0)      3.1405 (1.0)      3.1405 (1.0)      0.0000 (1.0)      3.1405 (1.0)      0.0000 (1.0)           0;0  0.3184 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.4693 (1.10)     3.4693 (1.10)     3.4693 (1.10)     0.0000 (1.0)      3.4693 (1.10)     0.0000 (1.0)           0;0  0.2882 (0.91)          1           1
test_partial_remove-gc[3.53.2]     3.4465 (1.10)     3.4465 (1.10)     3.4465 (1.10)     0.0000 (1.0)      3.4465 (1.10)     0.0000 (1.0)           0;0  0.2901 (0.91)          1           1
test_partial_remove-gc[3.60.1]     3.6731 (1.17)     3.6731 (1.17)     3.6731 (1.17)     0.0000 (1.0)      3.6731 (1.17)     0.0000 (1.0)           0;0  0.2723 (0.86)          1           1
test_partial_remove-gc[main]       3.5619 (1.13)     3.5619 (1.13)     3.5619 (1.13)     0.0000 (1.0)      3.5619 (1.13)     0.0000 (1.0)           0;0  0.2807 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7230 (1.03)     4.7230 (1.03)     4.7230 (1.03)     0.0000 (1.0)      4.7230 (1.03)     0.0000 (1.0)           0;0  0.2117 (0.97)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1071 (1.12)     5.1071 (1.12)     5.1071 (1.12)     0.0000 (1.0)      5.1071 (1.12)     0.0000 (1.0)           0;0  0.1958 (0.90)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.9010 (1.07)     4.9010 (1.07)     4.9010 (1.07)     0.0000 (1.0)      4.9010 (1.07)     0.0000 (1.0)           0;0  0.2040 (0.93)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.6900 (1.03)     4.6900 (1.03)     4.6900 (1.03)     0.0000 (1.0)      4.6900 (1.03)     0.0000 (1.0)           0;0  0.2132 (0.97)          1           1
test_partial_remove-gc-cloud[main]       4.5719 (1.0)      4.5719 (1.0)      4.5719 (1.0)      0.0000 (1.0)      4.5719 (1.0)      0.0000 (1.0)           0;0  0.2187 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.0714 (2.37)     52.0714 (2.37)     52.0714 (2.37)     0.0000 (1.0)      52.0714 (2.37)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_partial_remove-push[3.10.0]     46.4451 (2.11)     46.4451 (2.11)     46.4451 (2.11)     0.0000 (1.0)      46.4451 (2.11)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.0723 (1.05)     23.0723 (1.05)     23.0723 (1.05)     0.0000 (1.0)      23.0723 (1.05)     0.0000 (1.0)           0;0  0.0433 (0.95)          1           1
test_partial_remove-push[3.60.1]     22.4295 (1.02)     22.4295 (1.02)     22.4295 (1.02)     0.0000 (1.0)      22.4295 (1.02)     0.0000 (1.0)           0;0  0.0446 (0.98)          1           1
test_partial_remove-push[main]       21.9635 (1.0)      21.9635 (1.0)      21.9635 (1.0)      0.0000 (1.0)      21.9635 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8296 (1.01)     1.8296 (1.01)     1.8296 (1.01)     0.0000 (1.0)      1.8296 (1.01)     0.0000 (1.0)           0;0  0.5466 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     1.8161 (1.0)      1.8161 (1.0)      1.8161 (1.0)      0.0000 (1.0)      1.8161 (1.0)      0.0000 (1.0)           0;0  0.5506 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.4959 (1.37)     2.4959 (1.37)     2.4959 (1.37)     0.0000 (1.0)      2.4959 (1.37)     0.0000 (1.0)           0;0  0.4007 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.5827 (1.42)     2.5827 (1.42)     2.5827 (1.42)     0.0000 (1.0)      2.5827 (1.42)     0.0000 (1.0)           0;0  0.3872 (0.70)          1           1
test_partial_remove-push-update[main]       2.4676 (1.36)     2.4676 (1.36)     2.4676 (1.36)     0.0000 (1.0)      2.4676 (1.36)     0.0000 (1.0)           0;0  0.4052 (0.74)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     490.4258 (1.0)      499.8623 (1.0)      495.2293 (1.0)      4.5511 (1.96)     494.9388 (1.0)      8.9079 (3.35)          3;0  2.0193 (1.0)           5           3
test_plots-plots-diff[3.10.0]     887.7490 (1.81)     896.6885 (1.79)     893.1920 (1.80)     3.9936 (1.72)     894.7286 (1.81)     6.9184 (2.60)          1;0  1.1196 (0.55)          5           3
test_plots-plots-diff[3.53.2]     810.2682 (1.65)     820.1680 (1.64)     814.8950 (1.65)     4.7201 (2.03)     814.0202 (1.64)     9.1084 (3.43)          1;0  1.2272 (0.61)          5           3
test_plots-plots-diff[3.60.1]     812.3873 (1.66)     821.7399 (1.64)     817.1200 (1.65)     3.3483 (1.44)     816.9642 (1.65)     3.4212 (1.29)          2;0  1.2238 (0.61)          5           3
test_plots-plots-diff[main]       819.6273 (1.67)     825.9764 (1.65)     822.4930 (1.66)     2.3218 (1.0)      822.4984 (1.66)     2.6593 (1.0)           2;0  1.2158 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       507.1780 (1.0)        522.0918 (1.0)        512.0100 (1.0)      5.9535 (1.38)       510.1000 (1.0)      6.6452 (1.59)          1;0  1.9531 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,118.0518 (2.20)     1,129.6859 (2.16)     1,125.2894 (2.20)     4.9561 (1.15)     1,127.2659 (2.21)     7.9126 (1.90)          1;0  0.8887 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       888.0818 (1.75)       907.7817 (1.74)       894.6360 (1.75)     7.7075 (1.78)       893.4856 (1.75)     7.4638 (1.79)          1;0  1.1178 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       891.3183 (1.76)       901.7513 (1.73)       896.7611 (1.75)     4.8416 (1.12)       897.5344 (1.76)     9.1972 (2.21)          2;0  1.1151 (0.57)          5           3
test_plots-plots-diff-json[main]         891.4991 (1.76)       903.5693 (1.73)       897.9164 (1.75)     4.3254 (1.0)        897.7044 (1.76)     4.1687 (1.0)           2;0  1.1137 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     408.0494 (1.0)      410.2810 (1.0)      409.0192 (1.0)      0.8447 (1.0)      408.8366 (1.0)      1.1212 (1.0)           2;0  2.4449 (1.0)           5           3
test_plots-plots-show[3.10.0]     719.7151 (1.76)     730.0730 (1.78)     724.0210 (1.77)     3.7756 (4.47)     723.7904 (1.77)     3.4462 (3.07)          2;0  1.3812 (0.56)          5           3
test_plots-plots-show[3.53.2]     695.9017 (1.71)     698.9348 (1.70)     696.9410 (1.70)     1.2361 (1.46)     696.7161 (1.70)     1.6703 (1.49)          1;0  1.4348 (0.59)          5           3
test_plots-plots-show[3.60.1]     694.1247 (1.70)     699.2860 (1.70)     697.3387 (1.70)     2.1278 (2.52)     698.2712 (1.71)     3.1465 (2.81)          1;0  1.4340 (0.59)          5           3
test_plots-plots-show[main]       699.6595 (1.71)     710.1779 (1.73)     703.6920 (1.72)     4.5754 (5.42)     701.3516 (1.72)     7.3642 (6.57)          1;0  1.4211 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     424.8439 (1.0)      438.6702 (1.0)      429.4294 (1.0)      5.5485 (1.07)     426.7488 (1.0)       6.3791 (1.20)          1;0  2.3287 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     853.5062 (2.01)     868.8294 (1.98)     860.8876 (2.00)     6.2368 (1.20)     859.9474 (2.02)     10.2891 (1.93)          2;0  1.1616 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     738.6934 (1.74)     752.0724 (1.71)     743.3011 (1.73)     5.2032 (1.0)      741.1713 (1.74)      5.3356 (1.0)           1;0  1.3453 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     739.5904 (1.74)     752.4292 (1.72)     746.4971 (1.74)     5.4679 (1.05)     746.0606 (1.75)      9.5305 (1.79)          2;0  1.3396 (0.58)          5           3
test_plots-plots-show-json[main]       746.5804 (1.76)     764.1022 (1.74)     753.0288 (1.75)     6.9536 (1.34)     750.4819 (1.76)      9.1900 (1.72)          1;0  1.3280 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.3454 (2.36)     52.3454 (2.36)     52.3454 (2.36)     0.0000 (1.0)      52.3454 (2.36)     0.0000 (1.0)           0;0  0.0191 (0.42)          1           1
test_push-push[3.10.0]     46.3908 (2.09)     46.3908 (2.09)     46.3908 (2.09)     0.0000 (1.0)      46.3908 (2.09)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_push-push[3.53.2]     22.8964 (1.03)     22.8964 (1.03)     22.8964 (1.03)     0.0000 (1.0)      22.8964 (1.03)     0.0000 (1.0)           0;0  0.0437 (0.97)          1           1
test_push-push[3.60.1]     22.1684 (1.0)      22.1684 (1.0)      22.1684 (1.0)      0.0000 (1.0)      22.1684 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
test_push-push[main]       22.2882 (1.01)     22.2882 (1.01)     22.2882 (1.01)     0.0000 (1.0)      22.2882 (1.01)     0.0000 (1.0)           0;0  0.0449 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.0007 (2.75)     64.0007 (2.75)     64.0007 (2.75)     0.0000 (1.0)      64.0007 (2.75)     0.0000 (1.0)           0;0  0.0156 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.2203 (2.98)     69.2203 (2.98)     69.2203 (2.98)     0.0000 (1.0)      69.2203 (2.98)     0.0000 (1.0)           0;0  0.0144 (0.34)          1           1
test_sharing-fetch[3.53.2]     33.4260 (1.44)     33.4260 (1.44)     33.4260 (1.44)     0.0000 (1.0)      33.4260 (1.44)     0.0000 (1.0)           0;0  0.0299 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.2404 (1.0)      23.2404 (1.0)      23.2404 (1.0)      0.0000 (1.0)      23.2404 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
test_sharing-fetch[main]       23.4429 (1.01)     23.4429 (1.01)     23.4429 (1.01)     0.0000 (1.0)      23.4429 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2015 (1.0)      1.2015 (1.0)      1.2015 (1.0)      0.0000 (1.0)      1.2015 (1.0)      0.0000 (1.0)           0;0  0.8323 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5872 (2.99)     3.5872 (2.99)     3.5872 (2.99)     0.0000 (1.0)      3.5872 (2.99)     0.0000 (1.0)           0;0  0.2788 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     5.6678 (4.72)     5.6678 (4.72)     5.6678 (4.72)     0.0000 (1.0)      5.6678 (4.72)     0.0000 (1.0)           0;0  0.1764 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.8065 (4.83)     5.8065 (4.83)     5.8065 (4.83)     0.0000 (1.0)      5.8065 (4.83)     0.0000 (1.0)           0;0  0.1722 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7821 (4.81)     5.7821 (4.81)     5.7821 (4.81)     0.0000 (1.0)      5.7821 (4.81)     0.0000 (1.0)           0;0  0.1729 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.9878 (2.37)     51.9878 (2.37)     51.9878 (2.37)     0.0000 (1.0)      51.9878 (2.37)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_sharing-push[3.10.0]     46.0680 (2.10)     46.0680 (2.10)     46.0680 (2.10)     0.0000 (1.0)      46.0680 (2.10)     0.0000 (1.0)           0;0  0.0217 (0.48)          1           1
test_sharing-push[3.53.2]     23.0990 (1.05)     23.0990 (1.05)     23.0990 (1.05)     0.0000 (1.0)      23.0990 (1.05)     0.0000 (1.0)           0;0  0.0433 (0.95)          1           1
test_sharing-push[3.60.1]     21.9290 (1.0)      21.9290 (1.0)      21.9290 (1.0)      0.0000 (1.0)      21.9290 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
test_sharing-push[main]       22.2087 (1.01)     22.2087 (1.01)     22.2087 (1.01)     0.0000 (1.0)      22.2087 (1.01)     0.0000 (1.0)           0;0  0.0450 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0417 (1.01)     2.0417 (1.01)     2.0417 (1.01)     0.0000 (1.0)      2.0417 (1.01)     0.0000 (1.0)           0;0  0.4898 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.0182 (1.0)      2.0182 (1.0)      2.0182 (1.0)      0.0000 (1.0)      2.0182 (1.0)      0.0000 (1.0)           0;0  0.4955 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9869 (2.97)     5.9869 (2.97)     5.9869 (2.97)     0.0000 (1.0)      5.9869 (2.97)     0.0000 (1.0)           0;0  0.1670 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0158 (2.98)     6.0158 (2.98)     6.0158 (2.98)     0.0000 (1.0)      6.0158 (2.98)     0.0000 (1.0)           0;0  0.1662 (0.34)          1           1
test_sharing-push-noop[main]       6.0649 (3.01)     6.0649 (3.01)     6.0649 (3.01)     0.0000 (1.0)      6.0649 (3.01)     0.0000 (1.0)           0;0  0.1649 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     351.5072 (1.03)     351.5072 (1.03)     351.5072 (1.03)     0.0000 (1.0)      351.5072 (1.03)     0.0000 (1.0)           0;0  0.0028 (0.97)          1           1
test_sharing_azure-fetch[main]       340.0439 (1.0)      340.0439 (1.0)      340.0439 (1.0)      0.0000 (1.0)      340.0439 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3560 (1.0)      6.3560 (1.0)      6.3560 (1.0)      0.0000 (1.0)      6.3560 (1.0)      0.0000 (1.0)           0;0  0.1573 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7509 (1.06)     6.7509 (1.06)     6.7509 (1.06)     0.0000 (1.0)      6.7509 (1.06)     0.0000 (1.0)           0;0  0.1481 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     350.8742 (1.0)      350.8742 (1.0)      350.8742 (1.0)      0.0000 (1.0)      350.8742 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
test_sharing_azure-push[main]       351.8700 (1.00)     351.8700 (1.00)     351.8700 (1.00)     0.0000 (1.0)      351.8700 (1.00)     0.0000 (1.0)           0;0  0.0028 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.8111 (1.0)      7.8111 (1.0)      7.8111 (1.0)      0.0000 (1.0)      7.8111 (1.0)      0.0000 (1.0)           0;0  0.1280 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.9779 (1.02)     7.9779 (1.02)     7.9779 (1.02)     0.0000 (1.0)      7.9779 (1.02)     0.0000 (1.0)           0;0  0.1253 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     360.7002 (1.02)     360.7002 (1.02)     360.7002 (1.02)     0.0000 (1.0)      360.7002 (1.02)     0.0000 (1.0)           0;0  0.0028 (0.98)          1           1
test_sharing_gs-fetch[main]       353.0661 (1.0)      353.0661 (1.0)      353.0661 (1.0)      0.0000 (1.0)      353.0661 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     18.5567 (1.01)     18.5567 (1.01)     18.5567 (1.01)     0.0000 (1.0)      18.5567 (1.01)     0.0000 (1.0)           0;0  0.0539 (0.99)          1           1
test_sharing_gs-fetch-noop[main]       18.4048 (1.0)      18.4048 (1.0)      18.4048 (1.0)      0.0000 (1.0)      18.4048 (1.0)      0.0000 (1.0)           0;0  0.0543 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     539.8573 (1.0)      539.8573 (1.0)      539.8573 (1.0)      0.0000 (1.0)      539.8573 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
test_sharing_gs-push[main]       540.2399 (1.00)     540.2399 (1.00)     540.2399 (1.00)     0.0000 (1.0)      540.2399 (1.00)     0.0000 (1.0)           0;0  0.0019 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8850 (1.00)     6.8850 (1.00)     6.8850 (1.00)     0.0000 (1.0)      6.8850 (1.00)     0.0000 (1.0)           0;0  0.1452 (1.00)          1           1
test_sharing_gs-push-noop[main]       6.8619 (1.0)      6.8619 (1.0)      6.8619 (1.0)      0.0000 (1.0)      6.8619 (1.0)      0.0000 (1.0)           0;0  0.1457 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     272.4101 (1.08)     272.4101 (1.08)     272.4101 (1.08)     0.0000 (1.0)      272.4101 (1.08)     0.0000 (1.0)           0;0  0.0037 (0.93)          1           1
test_sharing_s3-fetch[main]       252.3037 (1.0)      252.3037 (1.0)      252.3037 (1.0)      0.0000 (1.0)      252.3037 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.4032 (1.02)     6.4032 (1.02)     6.4032 (1.02)     0.0000 (1.0)      6.4032 (1.02)     0.0000 (1.0)           0;0  0.1562 (0.98)          1           1
test_sharing_s3-fetch-noop[main]       6.2868 (1.0)      6.2868 (1.0)      6.2868 (1.0)      0.0000 (1.0)      6.2868 (1.0)      0.0000 (1.0)           0;0  0.1591 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     299.6978 (1.01)     299.6978 (1.01)     299.6978 (1.01)     0.0000 (1.0)      299.6978 (1.01)     0.0000 (1.0)           0;0  0.0033 (0.99)          1           1
test_sharing_s3-push[main]       297.4281 (1.0)      297.4281 (1.0)      297.4281 (1.0)      0.0000 (1.0)      297.4281 (1.0)      0.0000 (1.0)           0;0  0.0034 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5585 (1.02)     6.5585 (1.02)     6.5585 (1.02)     0.0000 (1.0)      6.5585 (1.02)     0.0000 (1.0)           0;0  0.1525 (0.98)          1           1
test_sharing_s3-push-noop[main]       6.4185 (1.0)      6.4185 (1.0)      6.4185 (1.0)      0.0000 (1.0)      6.4185 (1.0)      0.0000 (1.0)           0;0  0.1558 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.1298 (3.71)     19.1298 (3.71)     19.1298 (3.71)     0.0000 (1.0)      19.1298 (3.71)     0.0000 (1.0)           0;0  0.0523 (0.27)          1           1
test_status-status[3.10.0]     19.3765 (3.76)     19.3765 (3.76)     19.3765 (3.76)     0.0000 (1.0)      19.3765 (3.76)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_status-status[3.53.2]     17.5483 (3.40)     17.5483 (3.40)     17.5483 (3.40)     0.0000 (1.0)      17.5483 (3.40)     0.0000 (1.0)           0;0  0.0570 (0.29)          1           1
test_status-status[3.60.1]      5.1571 (1.0)       5.1571 (1.0)       5.1571 (1.0)      0.0000 (1.0)       5.1571 (1.0)      0.0000 (1.0)           0;0  0.1939 (1.0)           1           1
test_status-status[main]        5.6482 (1.10)      5.6482 (1.10)      5.6482 (1.10)     0.0000 (1.0)       5.6482 (1.10)     0.0000 (1.0)           0;0  0.1770 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6860 (1.75)     4.6860 (1.75)     4.6860 (1.75)     0.0000 (1.0)      4.6860 (1.75)     0.0000 (1.0)           0;0  0.2134 (0.57)          1           1
test_status-status-changed[3.10.0]     5.0472 (1.89)     5.0472 (1.89)     5.0472 (1.89)     0.0000 (1.0)      5.0472 (1.89)     0.0000 (1.0)           0;0  0.1981 (0.53)          1           1
test_status-status-changed[3.53.2]     4.8399 (1.81)     4.8399 (1.81)     4.8399 (1.81)     0.0000 (1.0)      4.8399 (1.81)     0.0000 (1.0)           0;0  0.2066 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6737 (1.0)      2.6737 (1.0)      2.6737 (1.0)      0.0000 (1.0)      2.6737 (1.0)      0.0000 (1.0)           0;0  0.3740 (1.0)           1           1
test_status-status-changed[main]       2.8876 (1.08)     2.8876 (1.08)     2.8876 (1.08)     0.0000 (1.0)      2.8876 (1.08)     0.0000 (1.0)           0;0  0.3463 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7477 (1.84)     4.7477 (1.84)     4.7477 (1.84)     0.0000 (1.0)      4.7477 (1.84)     0.0000 (1.0)           0;0  0.2106 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.9078 (1.90)     4.9078 (1.90)     4.9078 (1.90)     0.0000 (1.0)      4.9078 (1.90)     0.0000 (1.0)           0;0  0.2038 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.6520 (1.80)     4.6520 (1.80)     4.6520 (1.80)     0.0000 (1.0)      4.6520 (1.80)     0.0000 (1.0)           0;0  0.2150 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.5818 (1.0)      2.5818 (1.0)      2.5818 (1.0)      0.0000 (1.0)      2.5818 (1.0)      0.0000 (1.0)           0;0  0.3873 (1.0)           1           1
test_status-status-changed-noop[main]       2.8378 (1.10)     2.8378 (1.10)     2.8378 (1.10)     0.0000 (1.0)      2.8378 (1.10)     0.0000 (1.0)           0;0  0.3524 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7946 (1.86)     4.7946 (1.86)     4.7946 (1.86)     0.0000 (1.0)      4.7946 (1.86)     0.0000 (1.0)           0;0  0.2086 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9833 (1.93)     4.9833 (1.93)     4.9833 (1.93)     0.0000 (1.0)      4.9833 (1.93)     0.0000 (1.0)           0;0  0.2007 (0.52)          1           1
test_status-status-noop[3.53.2]     4.8211 (1.87)     4.8211 (1.87)     4.8211 (1.87)     0.0000 (1.0)      4.8211 (1.87)     0.0000 (1.0)           0;0  0.2074 (0.54)          1           1
test_status-status-noop[3.60.1]     2.5816 (1.0)      2.5816 (1.0)      2.5816 (1.0)      0.0000 (1.0)      2.5816 (1.0)      0.0000 (1.0)           0;0  0.3874 (1.0)           1           1
test_status-status-noop[main]       2.8589 (1.11)     2.8589 (1.11)     2.8589 (1.11)     0.0000 (1.0)      2.8589 (1.11)     0.0000 (1.0)           0;0  0.3498 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     156.0196 (3.33)     156.0196 (3.33)     156.0196 (3.33)     0.0000 (1.0)      156.0196 (3.33)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     158.0505 (3.37)     158.0505 (3.37)     158.0505 (3.37)     0.0000 (1.0)      158.0505 (3.37)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_update-import-url[3.53.2]     117.4162 (2.51)     117.4162 (2.51)     117.4162 (2.51)     0.0000 (1.0)      117.4162 (2.51)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_update-import-url[3.60.1]      46.8338 (1.0)       46.8338 (1.0)       46.8338 (1.0)      0.0000 (1.0)       46.8338 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_update-import-url[main]        47.9732 (1.02)      47.9732 (1.02)      47.9732 (1.02)     0.0000 (1.0)       47.9732 (1.02)     0.0000 (1.0)           0;0  0.0208 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     138.7393 (3.90)     138.7393 (3.90)     138.7393 (3.90)     0.0000 (1.0)      138.7393 (3.90)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     142.1768 (4.00)     142.1768 (4.00)     142.1768 (4.00)     0.0000 (1.0)      142.1768 (4.00)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     109.5553 (3.08)     109.5553 (3.08)     109.5553 (3.08)     0.0000 (1.0)      109.5553 (3.08)     0.0000 (1.0)           0;0  0.0091 (0.32)          1           1
test_update-update[3.60.1]      35.5562 (1.0)       35.5562 (1.0)       35.5562 (1.0)      0.0000 (1.0)       35.5562 (1.0)      0.0000 (1.0)           0;0  0.0281 (1.0)           1           1
test_update-update[main]        36.5885 (1.03)      36.5885 (1.03)      36.5885 (1.03)     0.0000 (1.0)       36.5885 (1.03)     0.0000 (1.0)           0;0  0.0273 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.6744 (1.97)     15.6744 (1.97)     15.6744 (1.97)     0.0000 (1.0)      15.6744 (1.97)     0.0000 (1.0)           0;0  0.0638 (0.51)          1           1
test_update-update-noop[3.10.0]     16.6565 (2.10)     16.6565 (2.10)     16.6565 (2.10)     0.0000 (1.0)      16.6565 (2.10)     0.0000 (1.0)           0;0  0.0600 (0.48)          1           1
test_update-update-noop[3.53.2]     15.9379 (2.01)     15.9379 (2.01)     15.9379 (2.01)     0.0000 (1.0)      15.9379 (2.01)     0.0000 (1.0)           0;0  0.0627 (0.50)          1           1
test_update-update-noop[3.60.1]      7.9377 (1.0)       7.9377 (1.0)       7.9377 (1.0)      0.0000 (1.0)       7.9377 (1.0)      0.0000 (1.0)           0;0  0.1260 (1.0)           1           1
test_update-update-noop[main]        8.5059 (1.07)      8.5059 (1.07)      8.5059 (1.07)     0.0000 (1.0)       8.5059 (1.07)     0.0000 (1.0)           0;0  0.1176 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean