Tue Aug 12 00:52:17 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.5142 (3.75)     84.5142 (3.75)     84.5142 (3.75)     0.0000 (1.0)      84.5142 (3.75)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.10.0]     85.2984 (3.79)     85.2984 (3.79)     85.2984 (3.79)     0.0000 (1.0)      85.2984 (3.79)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_add_copy-add[3.53.2]     76.7477 (3.41)     76.7477 (3.41)     76.7477 (3.41)     0.0000 (1.0)      76.7477 (3.41)     0.0000 (1.0)           0;0  0.0130 (0.29)          1           1
test_add_copy-add[3.60.1]     22.5307 (1.0)      22.5307 (1.0)      22.5307 (1.0)      0.0000 (1.0)      22.5307 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_add_copy-add[main]       23.5636 (1.05)     23.5636 (1.05)     23.5636 (1.05)     0.0000 (1.0)      23.5636 (1.05)     0.0000 (1.0)           0;0  0.0424 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.9048 (6.50)     28.9048 (6.50)     28.9048 (6.50)     0.0000 (1.0)      28.9048 (6.50)     0.0000 (1.0)           0;0  0.0346 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.8596 (6.72)     29.8596 (6.72)     29.8596 (6.72)     0.0000 (1.0)      29.8596 (6.72)     0.0000 (1.0)           0;0  0.0335 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.2277 (6.35)     28.2277 (6.35)     28.2277 (6.35)     0.0000 (1.0)      28.2277 (6.35)     0.0000 (1.0)           0;0  0.0354 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4460 (1.0)       4.4460 (1.0)       4.4460 (1.0)      0.0000 (1.0)       4.4460 (1.0)      0.0000 (1.0)           0;0  0.2249 (1.0)           1           1
test_add_copy-add-noop[main]        4.4999 (1.01)      4.4999 (1.01)      4.4999 (1.01)     0.0000 (1.0)       4.4999 (1.01)     0.0000 (1.0)           0;0  0.2222 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.1574 (4.13)     67.1574 (4.13)     67.1574 (4.13)     0.0000 (1.0)      67.1574 (4.13)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.10.0]     68.4208 (4.20)     68.4208 (4.20)     68.4208 (4.20)     0.0000 (1.0)      68.4208 (4.20)     0.0000 (1.0)           0;0  0.0146 (0.24)          1           1
test_add_hardlink-add[3.53.2]     63.4930 (3.90)     63.4930 (3.90)     63.4930 (3.90)     0.0000 (1.0)      63.4930 (3.90)     0.0000 (1.0)           0;0  0.0157 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.2717 (1.0)      16.2717 (1.0)      16.2717 (1.0)      0.0000 (1.0)      16.2717 (1.0)      0.0000 (1.0)           0;0  0.0615 (1.0)           1           1
test_add_hardlink-add[main]       16.9844 (1.04)     16.9844 (1.04)     16.9844 (1.04)     0.0000 (1.0)      16.9844 (1.04)     0.0000 (1.0)           0;0  0.0589 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.9632 (7.90)     34.9632 (7.90)     34.9632 (7.90)     0.0000 (1.0)      34.9632 (7.90)     0.0000 (1.0)           0;0  0.0286 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.3257 (7.98)     35.3257 (7.98)     35.3257 (7.98)     0.0000 (1.0)      35.3257 (7.98)     0.0000 (1.0)           0;0  0.0283 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     33.4293 (7.55)     33.4293 (7.55)     33.4293 (7.55)     0.0000 (1.0)      33.4293 (7.55)     0.0000 (1.0)           0;0  0.0299 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5352 (1.02)      4.5352 (1.02)      4.5352 (1.02)     0.0000 (1.0)       4.5352 (1.02)     0.0000 (1.0)           0;0  0.2205 (0.98)          1           1
test_add_hardlink-add-noop[main]        4.4265 (1.0)       4.4265 (1.0)       4.4265 (1.0)      0.0000 (1.0)       4.4265 (1.0)      0.0000 (1.0)           0;0  0.2259 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.3609 (2.05)     72.3609 (2.05)     72.3609 (2.05)     0.0000 (1.0)      72.3609 (2.05)     0.0000 (1.0)           0;0  0.0138 (0.49)          1           1
test_add_symlink-add[3.10.0]     72.4640 (2.05)     72.4640 (2.05)     72.4640 (2.05)     0.0000 (1.0)      72.4640 (2.05)     0.0000 (1.0)           0;0  0.0138 (0.49)          1           1
test_add_symlink-add[3.53.2]     66.8033 (1.89)     66.8033 (1.89)     66.8033 (1.89)     0.0000 (1.0)      66.8033 (1.89)     0.0000 (1.0)           0;0  0.0150 (0.53)          1           1
test_add_symlink-add[3.60.1]     35.3270 (1.0)      35.3270 (1.0)      35.3270 (1.0)      0.0000 (1.0)      35.3270 (1.0)      0.0000 (1.0)           0;0  0.0283 (1.0)           1           1
test_add_symlink-add[main]       36.5036 (1.03)     36.5036 (1.03)     36.5036 (1.03)     0.0000 (1.0)      36.5036 (1.03)     0.0000 (1.0)           0;0  0.0274 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.9905 (8.17)     47.9905 (8.17)     47.9905 (8.17)     0.0000 (1.0)      47.9905 (8.17)     0.0000 (1.0)           0;0  0.0208 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     48.8297 (8.31)     48.8297 (8.31)     48.8297 (8.31)     0.0000 (1.0)      48.8297 (8.31)     0.0000 (1.0)           0;0  0.0205 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.7146 (8.12)     47.7146 (8.12)     47.7146 (8.12)     0.0000 (1.0)      47.7146 (8.12)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.8768 (1.0)       5.8768 (1.0)       5.8768 (1.0)      0.0000 (1.0)       5.8768 (1.0)      0.0000 (1.0)           0;0  0.1702 (1.0)           1           1
test_add_symlink-add-noop[main]        5.9595 (1.01)      5.9595 (1.01)      5.9595 (1.01)     0.0000 (1.0)       5.9595 (1.01)     0.0000 (1.0)           0;0  0.1678 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.5180 (1.95)     40.5180 (1.95)     40.5180 (1.95)     0.0000 (1.0)      40.5180 (1.95)     0.0000 (1.0)           0;0  0.0247 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     59.9415 (2.88)     59.9415 (2.88)     59.9415 (2.88)     0.0000 (1.0)      59.9415 (2.88)     0.0000 (1.0)           0;0  0.0167 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     27.9740 (1.34)     27.9740 (1.34)     27.9740 (1.34)     0.0000 (1.0)      27.9740 (1.34)     0.0000 (1.0)           0;0  0.0357 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     20.8069 (1.0)      20.8069 (1.0)      20.8069 (1.0)      0.0000 (1.0)      20.8069 (1.0)      0.0000 (1.0)           0;0  0.0481 (1.0)           1           1
test_checkout_copy-checkout[main]       21.2702 (1.02)     21.2702 (1.02)     21.2702 (1.02)     0.0000 (1.0)      21.2702 (1.02)     0.0000 (1.0)           0;0  0.0470 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3311 (1.65)     5.3311 (1.65)     5.3311 (1.65)     0.0000 (1.0)      5.3311 (1.65)     0.0000 (1.0)           0;0  0.1876 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6047 (1.74)     5.6047 (1.74)     5.6047 (1.74)     0.0000 (1.0)      5.6047 (1.74)     0.0000 (1.0)           0;0  0.1784 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.3871 (1.67)     5.3871 (1.67)     5.3871 (1.67)     0.0000 (1.0)      5.3871 (1.67)     0.0000 (1.0)           0;0  0.1856 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2264 (1.0)      3.2264 (1.0)      3.2264 (1.0)      0.0000 (1.0)      3.2264 (1.0)      0.0000 (1.0)           0;0  0.3099 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.2893 (1.02)     3.2893 (1.02)     3.2893 (1.02)     0.0000 (1.0)      3.2893 (1.02)     0.0000 (1.0)           0;0  0.3040 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.4882 (2.17)     8.4882 (2.17)     8.4882 (2.17)     0.0000 (1.0)      8.4882 (2.17)     0.0000 (1.0)           0;0  0.1178 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.2585 (1.60)     6.2585 (1.60)     6.2585 (1.60)     0.0000 (1.0)      6.2585 (1.60)     0.0000 (1.0)           0;0  0.1598 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1216 (1.56)     6.1216 (1.56)     6.1216 (1.56)     0.0000 (1.0)      6.1216 (1.56)     0.0000 (1.0)           0;0  0.1634 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9319 (1.00)     3.9319 (1.00)     3.9319 (1.00)     0.0000 (1.0)      3.9319 (1.00)     0.0000 (1.0)           0;0  0.2543 (1.00)          1           1
test_checkout_copy-checkout-update[main]       3.9139 (1.0)      3.9139 (1.0)      3.9139 (1.0)      0.0000 (1.0)      3.9139 (1.0)      0.0000 (1.0)           0;0  0.2555 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.0226 (3.00)     22.0226 (3.00)     22.0226 (3.00)     0.0000 (1.0)      22.0226 (3.00)     0.0000 (1.0)           0;0  0.0454 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7599 (2.15)     15.7599 (2.15)     15.7599 (2.15)     0.0000 (1.0)      15.7599 (2.15)     0.0000 (1.0)           0;0  0.0635 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.3342 (1.95)     14.3342 (1.95)     14.3342 (1.95)     0.0000 (1.0)      14.3342 (1.95)     0.0000 (1.0)           0;0  0.0698 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3327 (1.0)       7.3327 (1.0)       7.3327 (1.0)      0.0000 (1.0)       7.3327 (1.0)      0.0000 (1.0)           0;0  0.1364 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.0047 (1.09)      8.0047 (1.09)      8.0047 (1.09)     0.0000 (1.0)       8.0047 (1.09)     0.0000 (1.0)           0;0  0.1249 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5190 (1.68)     5.5190 (1.68)     5.5190 (1.68)     0.0000 (1.0)      5.5190 (1.68)     0.0000 (1.0)           0;0  0.1812 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6919 (1.73)     5.6919 (1.73)     5.6919 (1.73)     0.0000 (1.0)      5.6919 (1.73)     0.0000 (1.0)           0;0  0.1757 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4363 (1.65)     5.4363 (1.65)     5.4363 (1.65)     0.0000 (1.0)      5.4363 (1.65)     0.0000 (1.0)           0;0  0.1839 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2934 (1.0)      3.2934 (1.0)      3.2934 (1.0)      0.0000 (1.0)      3.2934 (1.0)      0.0000 (1.0)           0;0  0.3036 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3630 (1.02)     3.3630 (1.02)     3.3630 (1.02)     0.0000 (1.0)      3.3630 (1.02)     0.0000 (1.0)           0;0  0.2974 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8287 (2.25)     8.8287 (2.25)     8.8287 (2.25)     0.0000 (1.0)      8.8287 (2.25)     0.0000 (1.0)           0;0  0.1133 (0.44)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4247 (1.64)     6.4247 (1.64)     6.4247 (1.64)     0.0000 (1.0)      6.4247 (1.64)     0.0000 (1.0)           0;0  0.1556 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2465 (1.59)     6.2465 (1.59)     6.2465 (1.59)     0.0000 (1.0)      6.2465 (1.59)     0.0000 (1.0)           0;0  0.1601 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9185 (1.0)      3.9185 (1.0)      3.9185 (1.0)      0.0000 (1.0)      3.9185 (1.0)      0.0000 (1.0)           0;0  0.2552 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.9693 (1.01)     3.9693 (1.01)     3.9693 (1.01)     0.0000 (1.0)      3.9693 (1.01)     0.0000 (1.0)           0;0  0.2519 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.3980 (2.50)     25.3980 (2.50)     25.3980 (2.50)     0.0000 (1.0)      25.3980 (2.50)     0.0000 (1.0)           0;0  0.0394 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     18.7843 (1.85)     18.7843 (1.85)     18.7843 (1.85)     0.0000 (1.0)      18.7843 (1.85)     0.0000 (1.0)           0;0  0.0532 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     17.4091 (1.71)     17.4091 (1.71)     17.4091 (1.71)     0.0000 (1.0)      17.4091 (1.71)     0.0000 (1.0)           0;0  0.0574 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1586 (1.0)      10.1586 (1.0)      10.1586 (1.0)      0.0000 (1.0)      10.1586 (1.0)      0.0000 (1.0)           0;0  0.0984 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.7337 (1.06)     10.7337 (1.06)     10.7337 (1.06)     0.0000 (1.0)      10.7337 (1.06)     0.0000 (1.0)           0;0  0.0932 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7647 (1.55)     6.7647 (1.55)     6.7647 (1.55)     0.0000 (1.0)      6.7647 (1.55)     0.0000 (1.0)           0;0  0.1478 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7396 (1.55)     6.7396 (1.55)     6.7396 (1.55)     0.0000 (1.0)      6.7396 (1.55)     0.0000 (1.0)           0;0  0.1484 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6398 (1.52)     6.6398 (1.52)     6.6398 (1.52)     0.0000 (1.0)      6.6398 (1.52)     0.0000 (1.0)           0;0  0.1506 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3572 (1.0)      4.3572 (1.0)      4.3572 (1.0)      0.0000 (1.0)      4.3572 (1.0)      0.0000 (1.0)           0;0  0.2295 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4321 (1.02)     4.4321 (1.02)     4.4321 (1.02)     0.0000 (1.0)      4.4321 (1.02)     0.0000 (1.0)           0;0  0.2256 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.8542 (1.85)     10.8542 (1.85)     10.8542 (1.85)     0.0000 (1.0)      10.8542 (1.85)     0.0000 (1.0)           0;0  0.0921 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.5664 (1.46)      8.5664 (1.46)      8.5664 (1.46)     0.0000 (1.0)       8.5664 (1.46)     0.0000 (1.0)           0;0  0.1167 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3654 (1.42)      8.3654 (1.42)      8.3654 (1.42)     0.0000 (1.0)       8.3654 (1.42)     0.0000 (1.0)           0;0  0.1195 (0.70)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9127 (1.01)      5.9127 (1.01)      5.9127 (1.01)     0.0000 (1.0)       5.9127 (1.01)     0.0000 (1.0)           0;0  0.1691 (0.99)          1           1
test_checkout_symlink-checkout-update[main]        5.8741 (1.0)       5.8741 (1.0)       5.8741 (1.0)      0.0000 (1.0)       5.8741 (1.0)      0.0000 (1.0)           0;0  0.1702 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2031 (1.75)     4.2031 (1.75)     4.2031 (1.75)     0.0000 (1.0)      4.2031 (1.75)     0.0000 (1.0)           0;0  0.2379 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.7404 (1.98)     4.7404 (1.98)     4.7404 (1.98)     0.0000 (1.0)      4.7404 (1.98)     0.0000 (1.0)           0;0  0.2110 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.6552 (1.94)     4.6552 (1.94)     4.6552 (1.94)     0.0000 (1.0)      4.6552 (1.94)     0.0000 (1.0)           0;0  0.2148 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3965 (1.0)      2.3965 (1.0)      2.3965 (1.0)      0.0000 (1.0)      2.3965 (1.0)      0.0000 (1.0)           0;0  0.4173 (1.0)           1           1
test_data_status-data-changed[main]       2.4396 (1.02)     2.4396 (1.02)     2.4396 (1.02)     0.0000 (1.0)      2.4396 (1.02)     0.0000 (1.0)           0;0  0.4099 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1981 (1.77)     4.1981 (1.77)     4.1981 (1.77)     0.0000 (1.0)      4.1981 (1.77)     0.0000 (1.0)           0;0  0.2382 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7897 (2.02)     4.7897 (2.02)     4.7897 (2.02)     0.0000 (1.0)      4.7897 (2.02)     0.0000 (1.0)           0;0  0.2088 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5849 (1.93)     4.5849 (1.93)     4.5849 (1.93)     0.0000 (1.0)      4.5849 (1.93)     0.0000 (1.0)           0;0  0.2181 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3765 (1.0)      2.3765 (1.0)      2.3765 (1.0)      0.0000 (1.0)      2.3765 (1.0)      0.0000 (1.0)           0;0  0.4208 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5312 (1.07)     2.5312 (1.07)     2.5312 (1.07)     0.0000 (1.0)      2.5312 (1.07)     0.0000 (1.0)           0;0  0.3951 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.7867 (3.76)     18.7867 (3.76)     18.7867 (3.76)     0.0000 (1.0)      18.7867 (3.76)     0.0000 (1.0)           0;0  0.0532 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.6680 (3.93)     19.6680 (3.93)     19.6680 (3.93)     0.0000 (1.0)      19.6680 (3.93)     0.0000 (1.0)           0;0  0.0508 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.8929 (3.78)     18.8929 (3.78)     18.8929 (3.78)     0.0000 (1.0)      18.8929 (3.78)     0.0000 (1.0)           0;0  0.0529 (0.26)          1           1
test_data_status-data-new[3.60.1]      5.0266 (1.00)      5.0266 (1.00)      5.0266 (1.00)     0.0000 (1.0)       5.0266 (1.00)     0.0000 (1.0)           0;0  0.1989 (1.00)          1           1
test_data_status-data-new[main]        5.0020 (1.0)       5.0020 (1.0)       5.0020 (1.0)      0.0000 (1.0)       5.0020 (1.0)      0.0000 (1.0)           0;0  0.1999 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1733 (1.75)     4.1733 (1.75)     4.1733 (1.75)     0.0000 (1.0)      4.1733 (1.75)     0.0000 (1.0)           0;0  0.2396 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.8740 (2.05)     4.8740 (2.05)     4.8740 (2.05)     0.0000 (1.0)      4.8740 (2.05)     0.0000 (1.0)           0;0  0.2052 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.6240 (1.94)     4.6240 (1.94)     4.6240 (1.94)     0.0000 (1.0)      4.6240 (1.94)     0.0000 (1.0)           0;0  0.2163 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.3782 (1.0)      2.3782 (1.0)      2.3782 (1.0)      0.0000 (1.0)      2.3782 (1.0)      0.0000 (1.0)           0;0  0.4205 (1.0)           1           1
test_data_status-data-noop[main]       2.4472 (1.03)     2.4472 (1.03)     2.4472 (1.03)     0.0000 (1.0)      2.4472 (1.03)     0.0000 (1.0)           0;0  0.4086 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1329 (1.30)     7.1329 (1.30)     7.1329 (1.30)     0.0000 (1.0)      7.1329 (1.30)     0.0000 (1.0)           0;0  0.1402 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7817 (1.41)     7.7817 (1.41)     7.7817 (1.41)     0.0000 (1.0)      7.7817 (1.41)     0.0000 (1.0)           0;0  0.1285 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6579 (1.39)     7.6579 (1.39)     7.6579 (1.39)     0.0000 (1.0)      7.6579 (1.39)     0.0000 (1.0)           0;0  0.1306 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5598 (1.01)     5.5598 (1.01)     5.5598 (1.01)     0.0000 (1.0)      5.5598 (1.01)     0.0000 (1.0)           0;0  0.1799 (0.99)          1           1
test_data_status_all_flags-data-changed[main]       5.5052 (1.0)      5.5052 (1.0)      5.5052 (1.0)      0.0000 (1.0)      5.5052 (1.0)      0.0000 (1.0)           0;0  0.1816 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1977 (1.31)     7.1977 (1.31)     7.1977 (1.31)     0.0000 (1.0)      7.1977 (1.31)     0.0000 (1.0)           0;0  0.1389 (0.76)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8833 (1.43)     7.8833 (1.43)     7.8833 (1.43)     0.0000 (1.0)      7.8833 (1.43)     0.0000 (1.0)           0;0  0.1269 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7564 (1.41)     7.7564 (1.41)     7.7564 (1.41)     0.0000 (1.0)      7.7564 (1.41)     0.0000 (1.0)           0;0  0.1289 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5764 (1.01)     5.5764 (1.01)     5.5764 (1.01)     0.0000 (1.0)      5.5764 (1.01)     0.0000 (1.0)           0;0  0.1793 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.5049 (1.0)      5.5049 (1.0)      5.5049 (1.0)      0.0000 (1.0)      5.5049 (1.0)      0.0000 (1.0)           0;0  0.1817 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.6567 (2.70)     21.6567 (2.70)     21.6567 (2.70)     0.0000 (1.0)      21.6567 (2.70)     0.0000 (1.0)           0;0  0.0462 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0148 (2.75)     22.0148 (2.75)     22.0148 (2.75)     0.0000 (1.0)      22.0148 (2.75)     0.0000 (1.0)           0;0  0.0454 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.0987 (2.76)     22.0987 (2.76)     22.0987 (2.76)     0.0000 (1.0)      22.0987 (2.76)     0.0000 (1.0)           0;0  0.0453 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0097 (1.0)       8.0097 (1.0)       8.0097 (1.0)      0.0000 (1.0)       8.0097 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.5742 (1.07)      8.5742 (1.07)      8.5742 (1.07)     0.0000 (1.0)       8.5742 (1.07)     0.0000 (1.0)           0;0  0.1166 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4345 (1.34)     6.4345 (1.34)     6.4345 (1.34)     0.0000 (1.0)      6.4345 (1.34)     0.0000 (1.0)           0;0  0.1554 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0647 (1.47)     7.0647 (1.47)     7.0647 (1.47)     0.0000 (1.0)      7.0647 (1.47)     0.0000 (1.0)           0;0  0.1415 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0358 (1.47)     7.0358 (1.47)     7.0358 (1.47)     0.0000 (1.0)      7.0358 (1.47)     0.0000 (1.0)           0;0  0.1421 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8309 (1.01)     4.8309 (1.01)     4.8309 (1.01)     0.0000 (1.0)      4.8309 (1.01)     0.0000 (1.0)           0;0  0.2070 (0.99)          1           1
test_data_status_all_flags-data-noop[main]       4.7972 (1.0)      4.7972 (1.0)      4.7972 (1.0)      0.0000 (1.0)      4.7972 (1.0)      0.0000 (1.0)           0;0  0.2085 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.3410 (2.62)     18.3410 (2.62)     18.3410 (2.62)     0.0000 (1.0)      18.3410 (2.62)     0.0000 (1.0)           0;0  0.0545 (0.38)          1           1
test_diff-diff[3.10.0]     19.1756 (2.74)     19.1756 (2.74)     19.1756 (2.74)     0.0000 (1.0)      19.1756 (2.74)     0.0000 (1.0)           0;0  0.0521 (0.37)          1           1
test_diff-diff[3.53.2]     19.1698 (2.73)     19.1698 (2.73)     19.1698 (2.73)     0.0000 (1.0)      19.1698 (2.73)     0.0000 (1.0)           0;0  0.0522 (0.37)          1           1
test_diff-diff[3.60.1]      7.0106 (1.0)       7.0106 (1.0)       7.0106 (1.0)      0.0000 (1.0)       7.0106 (1.0)      0.0000 (1.0)           0;0  0.1426 (1.0)           1           1
test_diff-diff[main]        7.0363 (1.00)      7.0363 (1.00)      7.0363 (1.00)     0.0000 (1.0)       7.0363 (1.00)     0.0000 (1.0)           0;0  0.1421 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9881 (1.76)     5.9881 (1.76)     5.9881 (1.76)     0.0000 (1.0)      5.9881 (1.76)     0.0000 (1.0)           0;0  0.1670 (0.57)          1           1
test_diff-diff-changed[3.10.0]     6.7802 (1.99)     6.7802 (1.99)     6.7802 (1.99)     0.0000 (1.0)      6.7802 (1.99)     0.0000 (1.0)           0;0  0.1475 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.7801 (1.70)     5.7801 (1.70)     5.7801 (1.70)     0.0000 (1.0)      5.7801 (1.70)     0.0000 (1.0)           0;0  0.1730 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.4059 (1.0)      3.4059 (1.0)      3.4059 (1.0)      0.0000 (1.0)      3.4059 (1.0)      0.0000 (1.0)           0;0  0.2936 (1.0)           1           1
test_diff-diff-changed[main]       3.5004 (1.03)     3.5004 (1.03)     3.5004 (1.03)     0.0000 (1.0)      3.5004 (1.03)     0.0000 (1.0)           0;0  0.2857 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0757 (1.50)     5.0757 (1.50)     5.0757 (1.50)     0.0000 (1.0)      5.0757 (1.50)     0.0000 (1.0)           0;0  0.1970 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7388 (1.70)     5.7388 (1.70)     5.7388 (1.70)     0.0000 (1.0)      5.7388 (1.70)     0.0000 (1.0)           0;0  0.1743 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4733 (1.62)     5.4733 (1.62)     5.4733 (1.62)     0.0000 (1.0)      5.4733 (1.62)     0.0000 (1.0)           0;0  0.1827 (0.62)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3795 (1.0)      3.3795 (1.0)      3.3795 (1.0)      0.0000 (1.0)      3.3795 (1.0)      0.0000 (1.0)           0;0  0.2959 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.5205 (1.04)     3.5205 (1.04)     3.5205 (1.04)     0.0000 (1.0)      3.5205 (1.04)     0.0000 (1.0)           0;0  0.2841 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1446 (1.22)     4.1446 (1.22)     4.1446 (1.22)     0.0000 (1.0)      4.1446 (1.22)     0.0000 (1.0)           0;0  0.2413 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.7843 (1.41)     4.7843 (1.41)     4.7843 (1.41)     0.0000 (1.0)      4.7843 (1.41)     0.0000 (1.0)           0;0  0.2090 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.6733 (1.67)     5.6733 (1.67)     5.6733 (1.67)     0.0000 (1.0)      5.6733 (1.67)     0.0000 (1.0)           0;0  0.1763 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3908 (1.0)      3.3908 (1.0)      3.3908 (1.0)      0.0000 (1.0)      3.3908 (1.0)      0.0000 (1.0)           0;0  0.2949 (1.0)           1           1
test_diff-diff-noop[main]       3.4637 (1.02)     3.4637 (1.02)     3.4637 (1.02)     0.0000 (1.0)      3.4637 (1.02)     0.0000 (1.0)           0;0  0.2887 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0061 (1.0)      1.0061 (1.0)      1.0061 (1.0)      0.0000 (1.0)      1.0061 (1.0)      0.0000 (1.0)           0;0  0.9939 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.3277 (5.30)     5.3277 (5.30)     5.3277 (5.30)     0.0000 (1.0)      5.3277 (5.30)     0.0000 (1.0)           0;0  0.1877 (0.19)          1           1
test_exp_show-exp[3.53.2]     3.7412 (3.72)     3.7412 (3.72)     3.7412 (3.72)     0.0000 (1.0)      3.7412 (3.72)     0.0000 (1.0)           0;0  0.2673 (0.27)          1           1
test_exp_show-exp[3.60.1]     3.9115 (3.89)     3.9115 (3.89)     3.9115 (3.89)     0.0000 (1.0)      3.9115 (3.89)     0.0000 (1.0)           0;0  0.2557 (0.26)          1           1
test_exp_show-exp[main]       5.0744 (5.04)     5.0744 (5.04)     5.0744 (5.04)     0.0000 (1.0)      5.0744 (5.04)     0.0000 (1.0)           0;0  0.1971 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.0937 (2.84)     66.0937 (2.84)     66.0937 (2.84)     0.0000 (1.0)      66.0937 (2.84)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_fetch-fetch[3.10.0]     72.6691 (3.12)     72.6691 (3.12)     72.6691 (3.12)     0.0000 (1.0)      72.6691 (3.12)     0.0000 (1.0)           0;0  0.0138 (0.32)          1           1
test_fetch-fetch[3.53.2]     34.6387 (1.49)     34.6387 (1.49)     34.6387 (1.49)     0.0000 (1.0)      34.6387 (1.49)     0.0000 (1.0)           0;0  0.0289 (0.67)          1           1
test_fetch-fetch[3.60.1]     23.2789 (1.0)      23.2789 (1.0)      23.2789 (1.0)      0.0000 (1.0)      23.2789 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
test_fetch-fetch[main]       23.7636 (1.02)     23.7636 (1.02)     23.7636 (1.02)     0.0000 (1.0)      23.7636 (1.02)     0.0000 (1.0)           0;0  0.0421 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7820 (1.0)      2.7820 (1.0)      2.7820 (1.0)      0.0000 (1.0)      2.7820 (1.0)      0.0000 (1.0)           0;0  0.3595 (1.0)           1           1
test_gc-gc[3.10.0]     2.8772 (1.03)     2.8772 (1.03)     2.8772 (1.03)     0.0000 (1.0)      2.8772 (1.03)     0.0000 (1.0)           0;0  0.3476 (0.97)          1           1
test_gc-gc[3.53.2]     2.8269 (1.02)     2.8269 (1.02)     2.8269 (1.02)     0.0000 (1.0)      2.8269 (1.02)     0.0000 (1.0)           0;0  0.3537 (0.98)          1           1
test_gc-gc[3.60.1]     2.8780 (1.03)     2.8780 (1.03)     2.8780 (1.03)     0.0000 (1.0)      2.8780 (1.03)     0.0000 (1.0)           0;0  0.3475 (0.97)          1           1
test_gc-gc[main]       2.8340 (1.02)     2.8340 (1.02)     2.8340 (1.02)     0.0000 (1.0)      2.8340 (1.02)     0.0000 (1.0)           0;0  0.3529 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     138.1422 (2.72)     138.1422 (2.72)     138.1422 (2.72)     0.0000 (1.0)      138.1422 (2.72)     0.0000 (1.0)           0;0  0.0072 (0.37)          1           1
test_get-get[3.10.0]     167.5757 (3.30)     167.5757 (3.30)     167.5757 (3.30)     0.0000 (1.0)      167.5757 (3.30)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     155.7540 (3.07)     155.7540 (3.07)     155.7540 (3.07)     0.0000 (1.0)      155.7540 (3.07)     0.0000 (1.0)           0;0  0.0064 (0.33)          1           1
test_get-get[3.60.1]      51.2059 (1.01)      51.2059 (1.01)      51.2059 (1.01)     0.0000 (1.0)       51.2059 (1.01)     0.0000 (1.0)           0;0  0.0195 (0.99)          1           1
test_get-get[main]        50.7911 (1.0)       50.7911 (1.0)       50.7911 (1.0)      0.0000 (1.0)       50.7911 (1.0)      0.0000 (1.0)           0;0  0.0197 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.6755 (2.69)     44.6755 (2.69)     44.6755 (2.69)     0.0000 (1.0)      44.6755 (2.69)     0.0000 (1.0)           0;0  0.0224 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.7221 (2.88)     47.7221 (2.88)     47.7221 (2.88)     0.0000 (1.0)      47.7221 (2.88)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.5791 (1.0)      16.5791 (1.0)      16.5791 (1.0)      0.0000 (1.0)      16.5791 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.7658 (1.01)     16.7658 (1.01)     16.7658 (1.01)     0.0000 (1.0)      16.7658 (1.01)     0.0000 (1.0)           0;0  0.0596 (0.99)          1           1
test_get_url-get-url[main]       16.8126 (1.01)     16.8126 (1.01)     16.8126 (1.01)     0.0000 (1.0)      16.8126 (1.01)     0.0000 (1.0)           0;0  0.0595 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     129.3250 (1.02)     137.3051 (1.00)     132.8839 (1.01)     1.9767 (1.0)      132.6419 (1.01)     3.2836 (1.20)         39;0  7.5254 (0.99)        100           1
test_help---help[3.10.0]     126.6627 (1.0)      136.8664 (1.0)      131.0678 (1.0)      2.1827 (1.10)     130.7419 (1.0)      3.0966 (1.13)         28;0  7.6296 (1.0)         100           1
test_help---help[3.53.2]     127.6980 (1.01)     137.8458 (1.01)     131.8462 (1.01)     2.1194 (1.07)     131.7934 (1.01)     2.8959 (1.06)         30;1  7.5846 (0.99)        100           1
test_help---help[3.60.1]     129.1735 (1.02)     142.2614 (1.04)     133.5536 (1.02)     2.2763 (1.15)     133.2294 (1.02)     2.8489 (1.04)         27;1  7.4876 (0.98)        100           1
test_help---help[main]       129.9973 (1.03)     172.6513 (1.26)     134.5403 (1.03)     5.2783 (2.67)     133.6062 (1.02)     2.7374 (1.0)           4;6  7.4327 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     220.7194 (2.94)     220.7194 (2.94)     220.7194 (2.94)     0.0000 (1.0)      220.7194 (2.94)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     251.4005 (3.35)     251.4005 (3.35)     251.4005 (3.35)     0.0000 (1.0)      251.4005 (3.35)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      75.1569 (1.0)       75.1569 (1.0)       75.1569 (1.0)      0.0000 (1.0)       75.1569 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        75.4107 (1.00)      75.4107 (1.00)      75.4107 (1.00)     0.0000 (1.0)       75.4107 (1.00)     0.0000 (1.0)           0;0  0.0133 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     155.0367 (3.33)     155.0367 (3.33)     155.0367 (3.33)     0.0000 (1.0)      155.0367 (3.33)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     158.5424 (3.40)     158.5424 (3.40)     158.5424 (3.40)     0.0000 (1.0)      158.5424 (3.40)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.8242 (2.53)     117.8242 (2.53)     117.8242 (2.53)     0.0000 (1.0)      117.8242 (2.53)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.5866 (1.0)       46.5866 (1.0)       46.5866 (1.0)      0.0000 (1.0)       46.5866 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_import_url-import-url[main]        47.1867 (1.01)      47.1867 (1.01)      47.1867 (1.01)     0.0000 (1.0)       47.1867 (1.01)     0.0000 (1.0)           0;0  0.0212 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     386.1068 (1.01)     414.2157 (1.02)     401.3337 (1.03)      7.8799 (1.92)     403.7250 (1.03)     13.9547 (3.21)         38;0  2.4917 (0.97)        100           1
test_init-init[3.10.0]     397.2253 (1.04)     439.1898 (1.08)     413.4653 (1.06)      6.8883 (1.68)     413.5870 (1.06)      7.4404 (1.71)         30;2  2.4186 (0.95)        100           1
test_init-init[3.53.2]     384.2756 (1.00)     425.3635 (1.05)     393.9516 (1.01)      8.5423 (2.08)     390.8972 (1.00)     10.5889 (2.44)         30;3  2.5384 (0.99)        100           1
test_init-init[3.60.1]     383.6856 (1.0)      405.3731 (1.0)      390.7902 (1.0)       4.1108 (1.0)      390.0832 (1.0)       4.3447 (1.0)          25;4  2.5589 (1.0)         100           1
test_init-init[main]       415.4285 (1.08)     606.1289 (1.50)     425.7534 (1.09)     20.1101 (4.89)     421.6770 (1.08)      7.2624 (1.67)          3;5  2.3488 (0.92)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     613.5118 (1.07)     613.5118 (1.07)     613.5118 (1.07)     0.0000 (1.0)      613.5118 (1.07)     0.0000 (1.0)           0;0  1.6300 (0.94)          1           1
test_list-list[3.10.0]     713.8051 (1.24)     713.8051 (1.24)     713.8051 (1.24)     0.0000 (1.0)      713.8051 (1.24)     0.0000 (1.0)           0;0  1.4009 (0.80)          1           1
test_list-list[3.53.2]     614.7968 (1.07)     614.7968 (1.07)     614.7968 (1.07)     0.0000 (1.0)      614.7968 (1.07)     0.0000 (1.0)           0;0  1.6266 (0.93)          1           1
test_list-list[3.60.1]     574.0517 (1.0)      574.0517 (1.0)      574.0517 (1.0)      0.0000 (1.0)      574.0517 (1.0)      0.0000 (1.0)           0;0  1.7420 (1.0)           1           1
test_list-list[main]       592.1335 (1.03)     592.1335 (1.03)     592.1335 (1.03)     0.0000 (1.0)      592.1335 (1.03)     0.0000 (1.0)           0;0  1.6888 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     446.6331 (1.03)     446.6331 (1.03)     446.6331 (1.03)     0.0000 (1.0)      446.6331 (1.03)     0.0000 (1.0)           0;0  2.2390 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     450.7104 (1.04)     450.7104 (1.04)     450.7104 (1.04)     0.0000 (1.0)      450.7104 (1.04)     0.0000 (1.0)           0;0  2.2187 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     437.1194 (1.01)     437.1194 (1.01)     437.1194 (1.01)     0.0000 (1.0)      437.1194 (1.01)     0.0000 (1.0)           0;0  2.2877 (0.99)          1           1
test_list-list-dvc-only[3.60.1]     453.8200 (1.05)     453.8200 (1.05)     453.8200 (1.05)     0.0000 (1.0)      453.8200 (1.05)     0.0000 (1.0)           0;0  2.2035 (0.95)          1           1
test_list-list-dvc-only[main]       433.0984 (1.0)      433.0984 (1.0)      433.0984 (1.0)      0.0000 (1.0)      433.0984 (1.0)      0.0000 (1.0)           0;0  2.3089 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8081 (1.0)      2.8081 (1.0)      2.8081 (1.0)      0.0000 (1.0)      2.8081 (1.0)      0.0000 (1.0)           0;0  0.3561 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8493 (1.01)     2.8493 (1.01)     2.8493 (1.01)     0.0000 (1.0)      2.8493 (1.01)     0.0000 (1.0)           0;0  0.3510 (0.99)          1           1
test_list-list-recursive[3.53.2]     3.0377 (1.08)     3.0377 (1.08)     3.0377 (1.08)     0.0000 (1.0)      3.0377 (1.08)     0.0000 (1.0)           0;0  0.3292 (0.92)          1           1
test_list-list-recursive[3.60.1]     3.1038 (1.11)     3.1038 (1.11)     3.1038 (1.11)     0.0000 (1.0)      3.1038 (1.11)     0.0000 (1.0)           0;0  0.3222 (0.90)          1           1
test_list-list-recursive[main]       3.1009 (1.10)     3.1009 (1.10)     3.1009 (1.10)     0.0000 (1.0)      3.1009 (1.10)     0.0000 (1.0)           0;0  0.3225 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     448.4604 (1.06)     448.4604 (1.06)     448.4604 (1.06)     0.0000 (1.0)      448.4604 (1.06)     0.0000 (1.0)           0;0  2.2299 (0.95)          1           1
test_list-list-shallow[3.10.0]     438.7935 (1.04)     438.7935 (1.04)     438.7935 (1.04)     0.0000 (1.0)      438.7935 (1.04)     0.0000 (1.0)           0;0  2.2790 (0.97)          1           1
test_list-list-shallow[3.53.2]     456.4149 (1.08)     456.4149 (1.08)     456.4149 (1.08)     0.0000 (1.0)      456.4149 (1.08)     0.0000 (1.0)           0;0  2.1910 (0.93)          1           1
test_list-list-shallow[3.60.1]     434.3923 (1.02)     434.3923 (1.02)     434.3923 (1.02)     0.0000 (1.0)      434.3923 (1.02)     0.0000 (1.0)           0;0  2.3021 (0.98)          1           1
test_list-list-shallow[main]       423.9466 (1.0)      423.9466 (1.0)      423.9466 (1.0)      0.0000 (1.0)      423.9466 (1.0)      0.0000 (1.0)           0;0  2.3588 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     73.7789 (3.79)     73.7789 (3.79)     73.7789 (3.79)     0.0000 (1.0)      73.7789 (3.79)     0.0000 (1.0)           0;0  0.0136 (0.26)          1           1
test_partial_add-add[3.10.0]     75.2367 (3.86)     75.2367 (3.86)     75.2367 (3.86)     0.0000 (1.0)      75.2367 (3.86)     0.0000 (1.0)           0;0  0.0133 (0.26)          1           1
test_partial_add-add[3.53.2]     65.4147 (3.36)     65.4147 (3.36)     65.4147 (3.36)     0.0000 (1.0)      65.4147 (3.36)     0.0000 (1.0)           0;0  0.0153 (0.30)          1           1
test_partial_add-add[3.60.1]     19.4860 (1.0)      19.4860 (1.0)      19.4860 (1.0)      0.0000 (1.0)      19.4860 (1.0)      0.0000 (1.0)           0;0  0.0513 (1.0)           1           1
test_partial_add-add[main]       20.2824 (1.04)     20.2824 (1.04)     20.2824 (1.04)     0.0000 (1.0)      20.2824 (1.04)     0.0000 (1.0)           0;0  0.0493 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     62.1931 (8.19)     62.1931 (8.19)     62.1931 (8.19)     0.0000 (1.0)      62.1931 (8.19)     0.0000 (1.0)           0;0  0.0161 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     62.6825 (8.25)     62.6825 (8.25)     62.6825 (8.25)     0.0000 (1.0)      62.6825 (8.25)     0.0000 (1.0)           0;0  0.0160 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     56.5067 (7.44)     56.5067 (7.44)     56.5067 (7.44)     0.0000 (1.0)      56.5067 (7.44)     0.0000 (1.0)           0;0  0.0177 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.7238 (1.02)      7.7238 (1.02)      7.7238 (1.02)     0.0000 (1.0)       7.7238 (1.02)     0.0000 (1.0)           0;0  0.1295 (0.98)          1           1
test_partial_add-add-partial[main]        7.5983 (1.0)       7.5983 (1.0)       7.5983 (1.0)      0.0000 (1.0)       7.5983 (1.0)      0.0000 (1.0)           0;0  0.1316 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5200 (1.0)      4.5200 (1.0)      4.5200 (1.0)      0.0000 (1.0)      4.5200 (1.0)      0.0000 (1.0)           0;0  0.2212 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8376 (1.29)     5.8376 (1.29)     5.8376 (1.29)     0.0000 (1.0)      5.8376 (1.29)     0.0000 (1.0)           0;0  0.1713 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.5974 (1.46)     6.5974 (1.46)     6.5974 (1.46)     0.0000 (1.0)      6.5974 (1.46)     0.0000 (1.0)           0;0  0.1516 (0.69)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7739 (1.50)     6.7739 (1.50)     6.7739 (1.50)     0.0000 (1.0)      6.7739 (1.50)     0.0000 (1.0)           0;0  0.1476 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.6795 (1.48)     6.6795 (1.48)     6.6795 (1.48)     0.0000 (1.0)      6.6795 (1.48)     0.0000 (1.0)           0;0  0.1497 (0.68)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4216 (1.0)      2.4216 (1.0)      2.4216 (1.0)      0.0000 (1.0)      2.4216 (1.0)      0.0000 (1.0)           0;0  0.4130 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6786 (1.52)     3.6786 (1.52)     3.6786 (1.52)     0.0000 (1.0)      3.6786 (1.52)     0.0000 (1.0)           0;0  0.2718 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.7242 (1.54)     3.7242 (1.54)     3.7242 (1.54)     0.0000 (1.0)      3.7242 (1.54)     0.0000 (1.0)           0;0  0.2685 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.7593 (1.55)     3.7593 (1.55)     3.7593 (1.55)     0.0000 (1.0)      3.7593 (1.55)     0.0000 (1.0)           0;0  0.2660 (0.64)          1           1
test_partial_add-gc-noop[main]       3.7405 (1.54)     3.7405 (1.54)     3.7405 (1.54)     0.0000 (1.0)      3.7405 (1.54)     0.0000 (1.0)           0;0  0.2673 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.0244 (2.32)     44.0244 (2.32)     44.0244 (2.32)     0.0000 (1.0)      44.0244 (2.32)     0.0000 (1.0)           0;0  0.0227 (0.43)          1           1
test_partial_add-push[3.10.0]     39.5249 (2.09)     39.5249 (2.09)     39.5249 (2.09)     0.0000 (1.0)      39.5249 (2.09)     0.0000 (1.0)           0;0  0.0253 (0.48)          1           1
test_partial_add-push[3.53.2]     19.6610 (1.04)     19.6610 (1.04)     19.6610 (1.04)     0.0000 (1.0)      19.6610 (1.04)     0.0000 (1.0)           0;0  0.0509 (0.96)          1           1
test_partial_add-push[3.60.1]     18.9558 (1.0)      18.9558 (1.0)      18.9558 (1.0)      0.0000 (1.0)      18.9558 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
test_partial_add-push[main]       19.3001 (1.02)     19.3001 (1.02)     19.3001 (1.02)     0.0000 (1.0)      19.3001 (1.02)     0.0000 (1.0)           0;0  0.0518 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.0691 (1.09)     11.0691 (1.09)     11.0691 (1.09)     0.0000 (1.0)      11.0691 (1.09)     0.0000 (1.0)           0;0  0.0903 (0.91)          1           1
test_partial_add-push-partial[3.10.0]     10.4656 (1.03)     10.4656 (1.03)     10.4656 (1.03)     0.0000 (1.0)      10.4656 (1.03)     0.0000 (1.0)           0;0  0.0956 (0.97)          1           1
test_partial_add-push-partial[3.53.2]     10.3025 (1.02)     10.3025 (1.02)     10.3025 (1.02)     0.0000 (1.0)      10.3025 (1.02)     0.0000 (1.0)           0;0  0.0971 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     10.1203 (1.0)      10.1203 (1.0)      10.1203 (1.0)      0.0000 (1.0)      10.1203 (1.0)      0.0000 (1.0)           0;0  0.0988 (1.0)           1           1
test_partial_add-push-partial[main]       10.1677 (1.00)     10.1677 (1.00)     10.1677 (1.00)     0.0000 (1.0)      10.1677 (1.00)     0.0000 (1.0)           0;0  0.0984 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     84.2976 (3.64)     84.2976 (3.64)     84.2976 (3.64)     0.0000 (1.0)      84.2976 (3.64)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.1457 (3.63)     84.1457 (3.63)     84.1457 (3.63)     0.0000 (1.0)      84.1457 (3.63)     0.0000 (1.0)           0;0  0.0119 (0.28)          1           1
test_partial_remove-add[3.53.2]     75.7059 (3.27)     75.7059 (3.27)     75.7059 (3.27)     0.0000 (1.0)      75.7059 (3.27)     0.0000 (1.0)           0;0  0.0132 (0.31)          1           1
test_partial_remove-add[3.60.1]     23.1503 (1.0)      23.1503 (1.0)      23.1503 (1.0)      0.0000 (1.0)      23.1503 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
test_partial_remove-add[main]       23.8807 (1.03)     23.8807 (1.03)     23.8807 (1.03)     0.0000 (1.0)      23.8807 (1.03)     0.0000 (1.0)           0;0  0.0419 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.9001 (8.19)     8.9001 (8.19)     8.9001 (8.19)     0.0000 (1.0)      8.9001 (8.19)     0.0000 (1.0)           0;0  0.1124 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.5958 (7.91)     8.5958 (7.91)     8.5958 (7.91)     0.0000 (1.0)      8.5958 (7.91)     0.0000 (1.0)           0;0  0.1163 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.5008 (6.90)     7.5008 (6.90)     7.5008 (6.90)     0.0000 (1.0)      7.5008 (6.90)     0.0000 (1.0)           0;0  0.1333 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.3164 (1.21)     1.3164 (1.21)     1.3164 (1.21)     0.0000 (1.0)      1.3164 (1.21)     0.0000 (1.0)           0;0  0.7596 (0.83)          1           1
test_partial_remove-add-update[main]       1.0873 (1.0)      1.0873 (1.0)      1.0873 (1.0)      0.0000 (1.0)      1.0873 (1.0)      0.0000 (1.0)           0;0  0.9197 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3517 (1.0)      3.3517 (1.0)      3.3517 (1.0)      0.0000 (1.0)      3.3517 (1.0)      0.0000 (1.0)           0;0  0.2984 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5706 (1.07)     3.5706 (1.07)     3.5706 (1.07)     0.0000 (1.0)      3.5706 (1.07)     0.0000 (1.0)           0;0  0.2801 (0.94)          1           1
test_partial_remove-gc[3.53.2]     3.5581 (1.06)     3.5581 (1.06)     3.5581 (1.06)     0.0000 (1.0)      3.5581 (1.06)     0.0000 (1.0)           0;0  0.2810 (0.94)          1           1
test_partial_remove-gc[3.60.1]     3.8849 (1.16)     3.8849 (1.16)     3.8849 (1.16)     0.0000 (1.0)      3.8849 (1.16)     0.0000 (1.0)           0;0  0.2574 (0.86)          1           1
test_partial_remove-gc[main]       3.7968 (1.13)     3.7968 (1.13)     3.7968 (1.13)     0.0000 (1.0)      3.7968 (1.13)     0.0000 (1.0)           0;0  0.2634 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7467 (1.06)     4.7467 (1.06)     4.7467 (1.06)     0.0000 (1.0)      4.7467 (1.06)     0.0000 (1.0)           0;0  0.2107 (0.94)          1           1
test_partial_remove-gc-cloud[3.10.0]     4.7092 (1.05)     4.7092 (1.05)     4.7092 (1.05)     0.0000 (1.0)      4.7092 (1.05)     0.0000 (1.0)           0;0  0.2124 (0.95)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8959 (1.09)     4.8959 (1.09)     4.8959 (1.09)     0.0000 (1.0)      4.8959 (1.09)     0.0000 (1.0)           0;0  0.2043 (0.91)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8408 (1.08)     4.8408 (1.08)     4.8408 (1.08)     0.0000 (1.0)      4.8408 (1.08)     0.0000 (1.0)           0;0  0.2066 (0.92)          1           1
test_partial_remove-gc-cloud[main]       4.4729 (1.0)      4.4729 (1.0)      4.4729 (1.0)      0.0000 (1.0)      4.4729 (1.0)      0.0000 (1.0)           0;0  0.2236 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     54.1383 (2.42)     54.1383 (2.42)     54.1383 (2.42)     0.0000 (1.0)      54.1383 (2.42)     0.0000 (1.0)           0;0  0.0185 (0.41)          1           1
test_partial_remove-push[3.10.0]     47.2177 (2.11)     47.2177 (2.11)     47.2177 (2.11)     0.0000 (1.0)      47.2177 (2.11)     0.0000 (1.0)           0;0  0.0212 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.5646 (1.05)     23.5646 (1.05)     23.5646 (1.05)     0.0000 (1.0)      23.5646 (1.05)     0.0000 (1.0)           0;0  0.0424 (0.95)          1           1
test_partial_remove-push[3.60.1]     22.4255 (1.00)     22.4255 (1.00)     22.4255 (1.00)     0.0000 (1.0)      22.4255 (1.00)     0.0000 (1.0)           0;0  0.0446 (1.00)          1           1
test_partial_remove-push[main]       22.4090 (1.0)      22.4090 (1.0)      22.4090 (1.0)      0.0000 (1.0)      22.4090 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7926 (1.0)      1.7926 (1.0)      1.7926 (1.0)      0.0000 (1.0)      1.7926 (1.0)      0.0000 (1.0)           0;0  0.5579 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8956 (1.06)     1.8956 (1.06)     1.8956 (1.06)     0.0000 (1.0)      1.8956 (1.06)     0.0000 (1.0)           0;0  0.5275 (0.95)          1           1
test_partial_remove-push-update[3.53.2]     2.5000 (1.39)     2.5000 (1.39)     2.5000 (1.39)     0.0000 (1.0)      2.5000 (1.39)     0.0000 (1.0)           0;0  0.4000 (0.72)          1           1
test_partial_remove-push-update[3.60.1]     2.5310 (1.41)     2.5310 (1.41)     2.5310 (1.41)     0.0000 (1.0)      2.5310 (1.41)     0.0000 (1.0)           0;0  0.3951 (0.71)          1           1
test_partial_remove-push-update[main]       2.4347 (1.36)     2.4347 (1.36)     2.4347 (1.36)     0.0000 (1.0)      2.4347 (1.36)     0.0000 (1.0)           0;0  0.4107 (0.74)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     506.2358 (1.0)      515.0725 (1.0)      511.3620 (1.0)       3.3629 (1.0)      510.9792 (1.0)       4.1726 (1.0)           2;0  1.9556 (1.0)           5           3
test_plots-plots-diff[3.10.0]     908.1665 (1.79)     922.5716 (1.79)     915.2466 (1.79)      6.1603 (1.83)     917.8247 (1.80)     10.0863 (2.42)          2;0  1.0926 (0.56)          5           3
test_plots-plots-diff[3.53.2]     838.4718 (1.66)     853.6734 (1.66)     842.9454 (1.65)      6.1496 (1.83)     840.8969 (1.65)      5.6754 (1.36)          1;1  1.1863 (0.61)          5           3
test_plots-plots-diff[3.60.1]     833.3168 (1.65)     855.5057 (1.66)     842.0652 (1.65)      8.9373 (2.66)     837.5477 (1.64)     12.4124 (2.97)          1;0  1.1876 (0.61)          5           3
test_plots-plots-diff[main]       830.0931 (1.64)     858.9834 (1.67)     842.4432 (1.65)     11.0274 (3.28)     838.5695 (1.64)     14.3575 (3.44)          2;0  1.1870 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       524.2604 (1.0)        533.4221 (1.0)        528.3976 (1.0)       3.8674 (1.0)        526.6558 (1.0)       6.2684 (1.0)           2;0  1.8925 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,155.2803 (2.20)     1,177.8392 (2.21)     1,164.9368 (2.20)     10.8741 (2.81)     1,159.1988 (2.20)     19.7604 (3.15)          1;0  0.8584 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       914.1811 (1.74)       927.5656 (1.74)       920.0962 (1.74)      5.3482 (1.38)       919.2371 (1.75)      8.3941 (1.34)          2;0  1.0868 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       922.0299 (1.76)       934.7323 (1.75)       927.1025 (1.75)      5.2362 (1.35)       927.1682 (1.76)      8.1824 (1.31)          1;0  1.0786 (0.57)          5           3
test_plots-plots-diff-json[main]         914.5969 (1.74)       930.7568 (1.74)       921.5045 (1.74)      6.1897 (1.60)       920.1592 (1.75)      8.4920 (1.35)          2;0  1.0852 (0.57)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     425.5278 (1.0)      433.9608 (1.0)      429.7878 (1.0)       3.3384 (1.18)     430.0653 (1.0)       5.2768 (1.09)          2;0  2.3267 (1.0)           5           3
test_plots-plots-show[3.10.0]     745.2885 (1.75)     769.4732 (1.77)     755.6950 (1.76)     10.4118 (3.69)     754.8946 (1.76)     18.2113 (3.77)          1;0  1.3233 (0.57)          5           3
test_plots-plots-show[3.53.2]     717.1570 (1.69)     731.1747 (1.68)     725.5838 (1.69)      5.4163 (1.92)     726.5173 (1.69)      7.2388 (1.50)          2;0  1.3782 (0.59)          5           3
test_plots-plots-show[3.60.1]     717.6183 (1.69)     738.0004 (1.70)     727.7590 (1.69)      7.5398 (2.67)     727.9155 (1.69)      9.7931 (2.03)          2;0  1.3741 (0.59)          5           3
test_plots-plots-show[main]       724.5072 (1.70)     730.7385 (1.68)     728.3648 (1.69)      2.8239 (1.0)      729.7299 (1.70)      4.8290 (1.0)           1;0  1.3729 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     438.8660 (1.0)      465.2218 (1.0)      451.3729 (1.0)      11.7532 (2.43)     454.4160 (1.0)      21.0336 (2.91)          3;0  2.2155 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     881.9285 (2.01)     900.0562 (1.93)     888.3913 (1.97)      7.5049 (1.55)     884.5165 (1.95)     10.4911 (1.45)          1;0  1.1256 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     767.0565 (1.75)     788.3879 (1.69)     774.4969 (1.72)      9.0569 (1.87)     771.2718 (1.70)     13.8305 (1.91)          1;0  1.2912 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     767.1031 (1.75)     782.3676 (1.68)     774.1629 (1.72)      5.6790 (1.18)     774.6188 (1.70)      7.2298 (1.0)           2;0  1.2917 (0.58)          5           3
test_plots-plots-show-json[main]       779.8142 (1.78)     790.3596 (1.70)     785.1459 (1.74)      4.8311 (1.0)      785.6790 (1.73)      9.1210 (1.26)          2;0  1.2736 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.3784 (2.37)     53.3784 (2.37)     53.3784 (2.37)     0.0000 (1.0)      53.3784 (2.37)     0.0000 (1.0)           0;0  0.0187 (0.42)          1           1
test_push-push[3.10.0]     47.8007 (2.12)     47.8007 (2.12)     47.8007 (2.12)     0.0000 (1.0)      47.8007 (2.12)     0.0000 (1.0)           0;0  0.0209 (0.47)          1           1
test_push-push[3.53.2]     23.6347 (1.05)     23.6347 (1.05)     23.6347 (1.05)     0.0000 (1.0)      23.6347 (1.05)     0.0000 (1.0)           0;0  0.0423 (0.95)          1           1
test_push-push[3.60.1]     22.6652 (1.01)     22.6652 (1.01)     22.6652 (1.01)     0.0000 (1.0)      22.6652 (1.01)     0.0000 (1.0)           0;0  0.0441 (0.99)          1           1
test_push-push[main]       22.5252 (1.0)      22.5252 (1.0)      22.5252 (1.0)      0.0000 (1.0)      22.5252 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     63.1300 (2.72)     63.1300 (2.72)     63.1300 (2.72)     0.0000 (1.0)      63.1300 (2.72)     0.0000 (1.0)           0;0  0.0158 (0.37)          1           1
test_sharing-fetch[3.10.0]     69.4099 (2.99)     69.4099 (2.99)     69.4099 (2.99)     0.0000 (1.0)      69.4099 (2.99)     0.0000 (1.0)           0;0  0.0144 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.5536 (1.45)     33.5536 (1.45)     33.5536 (1.45)     0.0000 (1.0)      33.5536 (1.45)     0.0000 (1.0)           0;0  0.0298 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.4061 (1.01)     23.4061 (1.01)     23.4061 (1.01)     0.0000 (1.0)      23.4061 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
test_sharing-fetch[main]       23.1881 (1.0)      23.1881 (1.0)      23.1881 (1.0)      0.0000 (1.0)      23.1881 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2365 (1.0)      1.2365 (1.0)      1.2365 (1.0)      0.0000 (1.0)      1.2365 (1.0)      0.0000 (1.0)           0;0  0.8087 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5630 (2.88)     3.5630 (2.88)     3.5630 (2.88)     0.0000 (1.0)      3.5630 (2.88)     0.0000 (1.0)           0;0  0.2807 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.6984 (4.61)     5.6984 (4.61)     5.6984 (4.61)     0.0000 (1.0)      5.6984 (4.61)     0.0000 (1.0)           0;0  0.1755 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8439 (4.73)     5.8439 (4.73)     5.8439 (4.73)     0.0000 (1.0)      5.8439 (4.73)     0.0000 (1.0)           0;0  0.1711 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8245 (4.71)     5.8245 (4.71)     5.8245 (4.71)     0.0000 (1.0)      5.8245 (4.71)     0.0000 (1.0)           0;0  0.1717 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.9954 (2.35)     51.9954 (2.35)     51.9954 (2.35)     0.0000 (1.0)      51.9954 (2.35)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_sharing-push[3.10.0]     46.0983 (2.08)     46.0983 (2.08)     46.0983 (2.08)     0.0000 (1.0)      46.0983 (2.08)     0.0000 (1.0)           0;0  0.0217 (0.48)          1           1
test_sharing-push[3.53.2]     22.5966 (1.02)     22.5966 (1.02)     22.5966 (1.02)     0.0000 (1.0)      22.5966 (1.02)     0.0000 (1.0)           0;0  0.0443 (0.98)          1           1
test_sharing-push[3.60.1]     22.1223 (1.0)      22.1223 (1.0)      22.1223 (1.0)      0.0000 (1.0)      22.1223 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_sharing-push[main]       22.2819 (1.01)     22.2819 (1.01)     22.2819 (1.01)     0.0000 (1.0)      22.2819 (1.01)     0.0000 (1.0)           0;0  0.0449 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0768 (1.02)     2.0768 (1.02)     2.0768 (1.02)     0.0000 (1.0)      2.0768 (1.02)     0.0000 (1.0)           0;0  0.4815 (0.98)          1           1
test_sharing-push-noop[3.10.0]     2.0400 (1.0)      2.0400 (1.0)      2.0400 (1.0)      0.0000 (1.0)      2.0400 (1.0)      0.0000 (1.0)           0;0  0.4902 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0015 (2.94)     6.0015 (2.94)     6.0015 (2.94)     0.0000 (1.0)      6.0015 (2.94)     0.0000 (1.0)           0;0  0.1666 (0.34)          1           1
test_sharing-push-noop[3.60.1]     5.9014 (2.89)     5.9014 (2.89)     5.9014 (2.89)     0.0000 (1.0)      5.9014 (2.89)     0.0000 (1.0)           0;0  0.1695 (0.35)          1           1
test_sharing-push-noop[main]       5.8133 (2.85)     5.8133 (2.85)     5.8133 (2.85)     0.0000 (1.0)      5.8133 (2.85)     0.0000 (1.0)           0;0  0.1720 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     157.3395 (1.07)     157.3395 (1.07)     157.3395 (1.07)     0.0000 (1.0)      157.3395 (1.07)     0.0000 (1.0)           0;0  0.0064 (0.93)          1           1
test_sharing_azure-fetch[main]       146.7211 (1.0)      146.7211 (1.0)      146.7211 (1.0)      0.0000 (1.0)      146.7211 (1.0)      0.0000 (1.0)           0;0  0.0068 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3374 (1.0)      6.3374 (1.0)      6.3374 (1.0)      0.0000 (1.0)      6.3374 (1.0)      0.0000 (1.0)           0;0  0.1578 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4626 (1.02)     6.4626 (1.02)     6.4626 (1.02)     0.0000 (1.0)      6.4626 (1.02)     0.0000 (1.0)           0;0  0.1547 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     153.3152 (1.0)      153.3152 (1.0)      153.3152 (1.0)      0.0000 (1.0)      153.3152 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
test_sharing_azure-push[main]       153.9450 (1.00)     153.9450 (1.00)     153.9450 (1.00)     0.0000 (1.0)      153.9450 (1.00)     0.0000 (1.0)           0;0  0.0065 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.9721 (1.02)     6.9721 (1.02)     6.9721 (1.02)     0.0000 (1.0)      6.9721 (1.02)     0.0000 (1.0)           0;0  0.1434 (0.98)          1           1
test_sharing_azure-push-noop[main]       6.8187 (1.0)      6.8187 (1.0)      6.8187 (1.0)      0.0000 (1.0)      6.8187 (1.0)      0.0000 (1.0)           0;0  0.1467 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     265.3303 (1.09)     265.3303 (1.09)     265.3303 (1.09)     0.0000 (1.0)      265.3303 (1.09)     0.0000 (1.0)           0;0  0.0038 (0.92)          1           1
test_sharing_gs-fetch[main]       243.4291 (1.0)      243.4291 (1.0)      243.4291 (1.0)      0.0000 (1.0)      243.4291 (1.0)      0.0000 (1.0)           0;0  0.0041 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     14.1233 (1.0)      14.1233 (1.0)      14.1233 (1.0)      0.0000 (1.0)      14.1233 (1.0)      0.0000 (1.0)           0;0  0.0708 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       14.6082 (1.03)     14.6082 (1.03)     14.6082 (1.03)     0.0000 (1.0)      14.6082 (1.03)     0.0000 (1.0)           0;0  0.0685 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     592.4683 (1.0)      592.4683 (1.0)      592.4683 (1.0)      0.0000 (1.0)      592.4683 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
test_sharing_gs-push[main]       606.7978 (1.02)     606.7978 (1.02)     606.7978 (1.02)     0.0000 (1.0)      606.7978 (1.02)     0.0000 (1.0)           0;0  0.0016 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.4450 (1.0)      6.4450 (1.0)      6.4450 (1.0)      0.0000 (1.0)      6.4450 (1.0)      0.0000 (1.0)           0;0  0.1552 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.4818 (1.01)     6.4818 (1.01)     6.4818 (1.01)     0.0000 (1.0)      6.4818 (1.01)     0.0000 (1.0)           0;0  0.1543 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     380.2329 (1.0)      380.2329 (1.0)      380.2329 (1.0)      0.0000 (1.0)      380.2329 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
test_sharing_s3-fetch[main]       382.2557 (1.01)     382.2557 (1.01)     382.2557 (1.01)     0.0000 (1.0)      382.2557 (1.01)     0.0000 (1.0)           0;0  0.0026 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.3352 (1.0)      6.3352 (1.0)      6.3352 (1.0)      0.0000 (1.0)      6.3352 (1.0)      0.0000 (1.0)           0;0  0.1578 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3808 (1.01)     6.3808 (1.01)     6.3808 (1.01)     0.0000 (1.0)      6.3808 (1.01)     0.0000 (1.0)           0;0  0.1567 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     497.8732 (1.0)      497.8732 (1.0)      497.8732 (1.0)      0.0000 (1.0)      497.8732 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
test_sharing_s3-push[main]       499.9488 (1.00)     499.9488 (1.00)     499.9488 (1.00)     0.0000 (1.0)      499.9488 (1.00)     0.0000 (1.0)           0;0  0.0020 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5550 (1.0)      6.5550 (1.0)      6.5550 (1.0)      0.0000 (1.0)      6.5550 (1.0)      0.0000 (1.0)           0;0  0.1526 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.6062 (1.01)     6.6062 (1.01)     6.6062 (1.01)     0.0000 (1.0)      6.6062 (1.01)     0.0000 (1.0)           0;0  0.1514 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.4216 (3.82)     19.4216 (3.82)     19.4216 (3.82)     0.0000 (1.0)      19.4216 (3.82)     0.0000 (1.0)           0;0  0.0515 (0.26)          1           1
test_status-status[3.10.0]     19.6779 (3.87)     19.6779 (3.87)     19.6779 (3.87)     0.0000 (1.0)      19.6779 (3.87)     0.0000 (1.0)           0;0  0.0508 (0.26)          1           1
test_status-status[3.53.2]     18.1116 (3.56)     18.1116 (3.56)     18.1116 (3.56)     0.0000 (1.0)      18.1116 (3.56)     0.0000 (1.0)           0;0  0.0552 (0.28)          1           1
test_status-status[3.60.1]      5.0889 (1.0)       5.0889 (1.0)       5.0889 (1.0)      0.0000 (1.0)       5.0889 (1.0)      0.0000 (1.0)           0;0  0.1965 (1.0)           1           1
test_status-status[main]        5.2459 (1.03)      5.2459 (1.03)      5.2459 (1.03)     0.0000 (1.0)       5.2459 (1.03)     0.0000 (1.0)           0;0  0.1906 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7460 (1.76)     4.7460 (1.76)     4.7460 (1.76)     0.0000 (1.0)      4.7460 (1.76)     0.0000 (1.0)           0;0  0.2107 (0.57)          1           1
test_status-status-changed[3.10.0]     4.9192 (1.83)     4.9192 (1.83)     4.9192 (1.83)     0.0000 (1.0)      4.9192 (1.83)     0.0000 (1.0)           0;0  0.2033 (0.55)          1           1
test_status-status-changed[3.53.2]     4.8297 (1.79)     4.8297 (1.79)     4.8297 (1.79)     0.0000 (1.0)      4.8297 (1.79)     0.0000 (1.0)           0;0  0.2071 (0.56)          1           1
test_status-status-changed[3.60.1]     2.6940 (1.0)      2.6940 (1.0)      2.6940 (1.0)      0.0000 (1.0)      2.6940 (1.0)      0.0000 (1.0)           0;0  0.3712 (1.0)           1           1
test_status-status-changed[main]       2.7220 (1.01)     2.7220 (1.01)     2.7220 (1.01)     0.0000 (1.0)      2.7220 (1.01)     0.0000 (1.0)           0;0  0.3674 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7091 (1.83)     4.7091 (1.83)     4.7091 (1.83)     0.0000 (1.0)      4.7091 (1.83)     0.0000 (1.0)           0;0  0.2124 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.9985 (1.94)     4.9985 (1.94)     4.9985 (1.94)     0.0000 (1.0)      4.9985 (1.94)     0.0000 (1.0)           0;0  0.2001 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     4.7567 (1.85)     4.7567 (1.85)     4.7567 (1.85)     0.0000 (1.0)      4.7567 (1.85)     0.0000 (1.0)           0;0  0.2102 (0.54)          1           1
test_status-status-changed-noop[3.60.1]     2.5739 (1.0)      2.5739 (1.0)      2.5739 (1.0)      0.0000 (1.0)      2.5739 (1.0)      0.0000 (1.0)           0;0  0.3885 (1.0)           1           1
test_status-status-changed-noop[main]       2.5842 (1.00)     2.5842 (1.00)     2.5842 (1.00)     0.0000 (1.0)      2.5842 (1.00)     0.0000 (1.0)           0;0  0.3870 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7223 (1.83)     4.7223 (1.83)     4.7223 (1.83)     0.0000 (1.0)      4.7223 (1.83)     0.0000 (1.0)           0;0  0.2118 (0.55)          1           1
test_status-status-noop[3.10.0]     4.9910 (1.93)     4.9910 (1.93)     4.9910 (1.93)     0.0000 (1.0)      4.9910 (1.93)     0.0000 (1.0)           0;0  0.2004 (0.52)          1           1
test_status-status-noop[3.53.2]     4.8434 (1.88)     4.8434 (1.88)     4.8434 (1.88)     0.0000 (1.0)      4.8434 (1.88)     0.0000 (1.0)           0;0  0.2065 (0.53)          1           1
test_status-status-noop[3.60.1]     2.5825 (1.0)      2.5825 (1.0)      2.5825 (1.0)      0.0000 (1.0)      2.5825 (1.0)      0.0000 (1.0)           0;0  0.3872 (1.0)           1           1
test_status-status-noop[main]       2.5900 (1.00)     2.5900 (1.00)     2.5900 (1.00)     0.0000 (1.0)      2.5900 (1.00)     0.0000 (1.0)           0;0  0.3861 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     155.2026 (3.34)     155.2026 (3.34)     155.2026 (3.34)     0.0000 (1.0)      155.2026 (3.34)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     157.7327 (3.39)     157.7327 (3.39)     157.7327 (3.39)     0.0000 (1.0)      157.7327 (3.39)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.53.2]     118.0053 (2.54)     118.0053 (2.54)     118.0053 (2.54)     0.0000 (1.0)      118.0053 (2.54)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_update-import-url[3.60.1]      46.4991 (1.0)       46.4991 (1.0)       46.4991 (1.0)      0.0000 (1.0)       46.4991 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_update-import-url[main]        47.2695 (1.02)      47.2695 (1.02)      47.2695 (1.02)     0.0000 (1.0)       47.2695 (1.02)     0.0000 (1.0)           0;0  0.0212 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     139.3590 (3.87)     139.3590 (3.87)     139.3590 (3.87)     0.0000 (1.0)      139.3590 (3.87)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     143.4599 (3.99)     143.4599 (3.99)     143.4599 (3.99)     0.0000 (1.0)      143.4599 (3.99)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     108.9965 (3.03)     108.9965 (3.03)     108.9965 (3.03)     0.0000 (1.0)      108.9965 (3.03)     0.0000 (1.0)           0;0  0.0092 (0.33)          1           1
test_update-update[3.60.1]      36.0017 (1.00)      36.0017 (1.00)      36.0017 (1.00)     0.0000 (1.0)       36.0017 (1.00)     0.0000 (1.0)           0;0  0.0278 (1.00)          1           1
test_update-update[main]        35.9670 (1.0)       35.9670 (1.0)       35.9670 (1.0)      0.0000 (1.0)       35.9670 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.8730 (2.04)     15.8730 (2.04)     15.8730 (2.04)     0.0000 (1.0)      15.8730 (2.04)     0.0000 (1.0)           0;0  0.0630 (0.49)          1           1
test_update-update-noop[3.10.0]     16.9797 (2.19)     16.9797 (2.19)     16.9797 (2.19)     0.0000 (1.0)      16.9797 (2.19)     0.0000 (1.0)           0;0  0.0589 (0.46)          1           1
test_update-update-noop[3.53.2]     16.1371 (2.08)     16.1371 (2.08)     16.1371 (2.08)     0.0000 (1.0)      16.1371 (2.08)     0.0000 (1.0)           0;0  0.0620 (0.48)          1           1
test_update-update-noop[3.60.1]      7.9611 (1.02)      7.9611 (1.02)      7.9611 (1.02)     0.0000 (1.0)       7.9611 (1.02)     0.0000 (1.0)           0;0  0.1256 (0.98)          1           1
test_update-update-noop[main]        7.7689 (1.0)       7.7689 (1.0)       7.7689 (1.0)      0.0000 (1.0)       7.7689 (1.0)      0.0000 (1.0)           0;0  0.1287 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean