Mon Nov 10 01:26:53 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     86.4891 (3.89)     86.4891 (3.89)     86.4891 (3.89)     0.0000 (1.0)      86.4891 (3.89)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.10.0]     87.1052 (3.91)     87.1052 (3.91)     87.1052 (3.91)     0.0000 (1.0)      87.1052 (3.91)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_add_copy-add[3.53.2]     76.9588 (3.46)     76.9588 (3.46)     76.9588 (3.46)     0.0000 (1.0)      76.9588 (3.46)     0.0000 (1.0)           0;0  0.0130 (0.29)          1           1
test_add_copy-add[3.60.1]     22.2607 (1.0)      22.2607 (1.0)      22.2607 (1.0)      0.0000 (1.0)      22.2607 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
test_add_copy-add[main]       23.4301 (1.05)     23.4301 (1.05)     23.4301 (1.05)     0.0000 (1.0)      23.4301 (1.05)     0.0000 (1.0)           0;0  0.0427 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.7902 (6.89)     28.7902 (6.89)     28.7902 (6.89)     0.0000 (1.0)      28.7902 (6.89)     0.0000 (1.0)           0;0  0.0347 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.3770 (7.03)     29.3770 (7.03)     29.3770 (7.03)     0.0000 (1.0)      29.3770 (7.03)     0.0000 (1.0)           0;0  0.0340 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     28.0923 (6.73)     28.0923 (6.73)     28.0923 (6.73)     0.0000 (1.0)      28.0923 (6.73)     0.0000 (1.0)           0;0  0.0356 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.1773 (1.0)       4.1773 (1.0)       4.1773 (1.0)      0.0000 (1.0)       4.1773 (1.0)      0.0000 (1.0)           0;0  0.2394 (1.0)           1           1
test_add_copy-add-noop[main]        4.4775 (1.07)      4.4775 (1.07)      4.4775 (1.07)     0.0000 (1.0)       4.4775 (1.07)     0.0000 (1.0)           0;0  0.2233 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.5245 (4.16)     67.5245 (4.16)     67.5245 (4.16)     0.0000 (1.0)      67.5245 (4.16)     0.0000 (1.0)           0;0  0.0148 (0.24)          1           1
test_add_hardlink-add[3.10.0]     69.3437 (4.28)     69.3437 (4.28)     69.3437 (4.28)     0.0000 (1.0)      69.3437 (4.28)     0.0000 (1.0)           0;0  0.0144 (0.23)          1           1
test_add_hardlink-add[3.53.2]     63.5615 (3.92)     63.5615 (3.92)     63.5615 (3.92)     0.0000 (1.0)      63.5615 (3.92)     0.0000 (1.0)           0;0  0.0157 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.2166 (1.0)      16.2166 (1.0)      16.2166 (1.0)      0.0000 (1.0)      16.2166 (1.0)      0.0000 (1.0)           0;0  0.0617 (1.0)           1           1
test_add_hardlink-add[main]       17.8152 (1.10)     17.8152 (1.10)     17.8152 (1.10)     0.0000 (1.0)      17.8152 (1.10)     0.0000 (1.0)           0;0  0.0561 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.1075 (7.82)     34.1075 (7.82)     34.1075 (7.82)     0.0000 (1.0)      34.1075 (7.82)     0.0000 (1.0)           0;0  0.0293 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     34.9354 (8.01)     34.9354 (8.01)     34.9354 (8.01)     0.0000 (1.0)      34.9354 (8.01)     0.0000 (1.0)           0;0  0.0286 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     33.1552 (7.60)     33.1552 (7.60)     33.1552 (7.60)     0.0000 (1.0)      33.1552 (7.60)     0.0000 (1.0)           0;0  0.0302 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3602 (1.0)       4.3602 (1.0)       4.3602 (1.0)      0.0000 (1.0)       4.3602 (1.0)      0.0000 (1.0)           0;0  0.2293 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.6040 (1.06)      4.6040 (1.06)      4.6040 (1.06)     0.0000 (1.0)       4.6040 (1.06)     0.0000 (1.0)           0;0  0.2172 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     67.6214 (1.94)     67.6214 (1.94)     67.6214 (1.94)     0.0000 (1.0)      67.6214 (1.94)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.10.0]     67.9549 (1.94)     67.9549 (1.94)     67.9549 (1.94)     0.0000 (1.0)      67.9549 (1.94)     0.0000 (1.0)           0;0  0.0147 (0.51)          1           1
test_add_symlink-add[3.53.2]     62.7406 (1.80)     62.7406 (1.80)     62.7406 (1.80)     0.0000 (1.0)      62.7406 (1.80)     0.0000 (1.0)           0;0  0.0159 (0.56)          1           1
test_add_symlink-add[3.60.1]     34.9431 (1.0)      34.9431 (1.0)      34.9431 (1.0)      0.0000 (1.0)      34.9431 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_add_symlink-add[main]       35.5682 (1.02)     35.5682 (1.02)     35.5682 (1.02)     0.0000 (1.0)      35.5682 (1.02)     0.0000 (1.0)           0;0  0.0281 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.1133 (8.31)     46.1133 (8.31)     46.1133 (8.31)     0.0000 (1.0)      46.1133 (8.31)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     46.9836 (8.47)     46.9836 (8.47)     46.9836 (8.47)     0.0000 (1.0)      46.9836 (8.47)     0.0000 (1.0)           0;0  0.0213 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.1126 (8.31)     46.1126 (8.31)     46.1126 (8.31)     0.0000 (1.0)      46.1126 (8.31)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5491 (1.0)       5.5491 (1.0)       5.5491 (1.0)      0.0000 (1.0)       5.5491 (1.0)      0.0000 (1.0)           0;0  0.1802 (1.0)           1           1
test_add_symlink-add-noop[main]        5.6751 (1.02)      5.6751 (1.02)      5.6751 (1.02)     0.0000 (1.0)       5.6751 (1.02)     0.0000 (1.0)           0;0  0.1762 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     28.5139 (2.28)     28.5139 (2.28)     28.5139 (2.28)     0.0000 (1.0)      28.5139 (2.28)     0.0000 (1.0)           0;0  0.0351 (0.44)          1           1
test_checkout_copy-checkout[3.10.0]     43.5068 (3.48)     43.5068 (3.48)     43.5068 (3.48)     0.0000 (1.0)      43.5068 (3.48)     0.0000 (1.0)           0;0  0.0230 (0.29)          1           1
test_checkout_copy-checkout[3.53.2]     17.6743 (1.42)     17.6743 (1.42)     17.6743 (1.42)     0.0000 (1.0)      17.6743 (1.42)     0.0000 (1.0)           0;0  0.0566 (0.71)          1           1
test_checkout_copy-checkout[3.60.1]     12.4899 (1.0)      12.4899 (1.0)      12.4899 (1.0)      0.0000 (1.0)      12.4899 (1.0)      0.0000 (1.0)           0;0  0.0801 (1.0)           1           1
test_checkout_copy-checkout[main]       13.7063 (1.10)     13.7063 (1.10)     13.7063 (1.10)     0.0000 (1.0)      13.7063 (1.10)     0.0000 (1.0)           0;0  0.0730 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     4.1555 (1.41)     4.1555 (1.41)     4.1555 (1.41)     0.0000 (1.0)      4.1555 (1.41)     0.0000 (1.0)           0;0  0.2406 (0.71)          1           1
test_checkout_copy-checkout-noop[3.10.0]     4.3707 (1.49)     4.3707 (1.49)     4.3707 (1.49)     0.0000 (1.0)      4.3707 (1.49)     0.0000 (1.0)           0;0  0.2288 (0.67)          1           1
test_checkout_copy-checkout-noop[3.53.2]     4.1921 (1.43)     4.1921 (1.43)     4.1921 (1.43)     0.0000 (1.0)      4.1921 (1.43)     0.0000 (1.0)           0;0  0.2385 (0.70)          1           1
test_checkout_copy-checkout-noop[3.60.1]     2.9408 (1.0)      2.9408 (1.0)      2.9408 (1.0)      0.0000 (1.0)      2.9408 (1.0)      0.0000 (1.0)           0;0  0.3400 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.2035 (1.09)     3.2035 (1.09)     3.2035 (1.09)     0.0000 (1.0)      3.2035 (1.09)     0.0000 (1.0)           0;0  0.3122 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     6.0425 (1.78)     6.0425 (1.78)     6.0425 (1.78)     0.0000 (1.0)      6.0425 (1.78)     0.0000 (1.0)           0;0  0.1655 (0.56)          1           1
test_checkout_copy-checkout-update[3.10.0]     5.1941 (1.53)     5.1941 (1.53)     5.1941 (1.53)     0.0000 (1.0)      5.1941 (1.53)     0.0000 (1.0)           0;0  0.1925 (0.65)          1           1
test_checkout_copy-checkout-update[3.53.2]     4.8278 (1.42)     4.8278 (1.42)     4.8278 (1.42)     0.0000 (1.0)      4.8278 (1.42)     0.0000 (1.0)           0;0  0.2071 (0.70)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.3986 (1.0)      3.3986 (1.0)      3.3986 (1.0)      0.0000 (1.0)      3.3986 (1.0)      0.0000 (1.0)           0;0  0.2942 (1.0)           1           1
test_checkout_copy-checkout-update[main]       3.9138 (1.15)     3.9138 (1.15)     3.9138 (1.15)     0.0000 (1.0)      3.9138 (1.15)     0.0000 (1.0)           0;0  0.2555 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.8849 (2.91)     21.8849 (2.91)     21.8849 (2.91)     0.0000 (1.0)      21.8849 (2.91)     0.0000 (1.0)           0;0  0.0457 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.2782 (2.17)     16.2782 (2.17)     16.2782 (2.17)     0.0000 (1.0)      16.2782 (2.17)     0.0000 (1.0)           0;0  0.0614 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.8448 (1.98)     14.8448 (1.98)     14.8448 (1.98)     0.0000 (1.0)      14.8448 (1.98)     0.0000 (1.0)           0;0  0.0674 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5087 (1.0)       7.5087 (1.0)       7.5087 (1.0)      0.0000 (1.0)       7.5087 (1.0)      0.0000 (1.0)           0;0  0.1332 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.6590 (1.15)      8.6590 (1.15)      8.6590 (1.15)     0.0000 (1.0)       8.6590 (1.15)     0.0000 (1.0)           0;0  0.1155 (0.87)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5565 (1.69)     5.5565 (1.69)     5.5565 (1.69)     0.0000 (1.0)      5.5565 (1.69)     0.0000 (1.0)           0;0  0.1800 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8601 (1.79)     5.8601 (1.79)     5.8601 (1.79)     0.0000 (1.0)      5.8601 (1.79)     0.0000 (1.0)           0;0  0.1706 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6565 (1.72)     5.6565 (1.72)     5.6565 (1.72)     0.0000 (1.0)      5.6565 (1.72)     0.0000 (1.0)           0;0  0.1768 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2792 (1.0)      3.2792 (1.0)      3.2792 (1.0)      0.0000 (1.0)      3.2792 (1.0)      0.0000 (1.0)           0;0  0.3050 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5570 (1.08)     3.5570 (1.08)     3.5570 (1.08)     0.0000 (1.0)      3.5570 (1.08)     0.0000 (1.0)           0;0  0.2811 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.0635 (2.03)     8.0635 (2.03)     8.0635 (2.03)     0.0000 (1.0)      8.0635 (2.03)     0.0000 (1.0)           0;0  0.1240 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6072 (1.67)     6.6072 (1.67)     6.6072 (1.67)     0.0000 (1.0)      6.6072 (1.67)     0.0000 (1.0)           0;0  0.1514 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6080 (1.67)     6.6080 (1.67)     6.6080 (1.67)     0.0000 (1.0)      6.6080 (1.67)     0.0000 (1.0)           0;0  0.1513 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9640 (1.0)      3.9640 (1.0)      3.9640 (1.0)      0.0000 (1.0)      3.9640 (1.0)      0.0000 (1.0)           0;0  0.2523 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4067 (1.11)     4.4067 (1.11)     4.4067 (1.11)     0.0000 (1.0)      4.4067 (1.11)     0.0000 (1.0)           0;0  0.2269 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9188 (2.39)     24.9188 (2.39)     24.9188 (2.39)     0.0000 (1.0)      24.9188 (2.39)     0.0000 (1.0)           0;0  0.0401 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     19.2347 (1.85)     19.2347 (1.85)     19.2347 (1.85)     0.0000 (1.0)      19.2347 (1.85)     0.0000 (1.0)           0;0  0.0520 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     18.1675 (1.74)     18.1675 (1.74)     18.1675 (1.74)     0.0000 (1.0)      18.1675 (1.74)     0.0000 (1.0)           0;0  0.0550 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.4118 (1.0)      10.4118 (1.0)      10.4118 (1.0)      0.0000 (1.0)      10.4118 (1.0)      0.0000 (1.0)           0;0  0.0960 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.7272 (1.13)     11.7272 (1.13)     11.7272 (1.13)     0.0000 (1.0)      11.7272 (1.13)     0.0000 (1.0)           0;0  0.0853 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8900 (1.59)     6.8900 (1.59)     6.8900 (1.59)     0.0000 (1.0)      6.8900 (1.59)     0.0000 (1.0)           0;0  0.1451 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.0622 (1.63)     7.0622 (1.63)     7.0622 (1.63)     0.0000 (1.0)      7.0622 (1.63)     0.0000 (1.0)           0;0  0.1416 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.8766 (1.59)     6.8766 (1.59)     6.8766 (1.59)     0.0000 (1.0)      6.8766 (1.59)     0.0000 (1.0)           0;0  0.1454 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3215 (1.0)      4.3215 (1.0)      4.3215 (1.0)      0.0000 (1.0)      4.3215 (1.0)      0.0000 (1.0)           0;0  0.2314 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5509 (1.05)     4.5509 (1.05)     4.5509 (1.05)     0.0000 (1.0)      4.5509 (1.05)     0.0000 (1.0)           0;0  0.2197 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.0596 (1.73)     10.0596 (1.73)     10.0596 (1.73)     0.0000 (1.0)      10.0596 (1.73)     0.0000 (1.0)           0;0  0.0994 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7729 (1.51)      8.7729 (1.51)      8.7729 (1.51)     0.0000 (1.0)       8.7729 (1.51)     0.0000 (1.0)           0;0  0.1140 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.6356 (1.49)      8.6356 (1.49)      8.6356 (1.49)     0.0000 (1.0)       8.6356 (1.49)     0.0000 (1.0)           0;0  0.1158 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.8131 (1.0)       5.8131 (1.0)       5.8131 (1.0)      0.0000 (1.0)       5.8131 (1.0)      0.0000 (1.0)           0;0  0.1720 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.3170 (1.09)      6.3170 (1.09)      6.3170 (1.09)     0.0000 (1.0)       6.3170 (1.09)     0.0000 (1.0)           0;0  0.1583 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0404 (1.72)     4.0404 (1.72)     4.0404 (1.72)     0.0000 (1.0)      4.0404 (1.72)     0.0000 (1.0)           0;0  0.2475 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7872 (2.03)     4.7872 (2.03)     4.7872 (2.03)     0.0000 (1.0)      4.7872 (2.03)     0.0000 (1.0)           0;0  0.2089 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.7191 (2.00)     4.7191 (2.00)     4.7191 (2.00)     0.0000 (1.0)      4.7191 (2.00)     0.0000 (1.0)           0;0  0.2119 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3559 (1.0)      2.3559 (1.0)      2.3559 (1.0)      0.0000 (1.0)      2.3559 (1.0)      0.0000 (1.0)           0;0  0.4245 (1.0)           1           1
test_data_status-data-changed[main]       2.5966 (1.10)     2.5966 (1.10)     2.5966 (1.10)     0.0000 (1.0)      2.5966 (1.10)     0.0000 (1.0)           0;0  0.3851 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1131 (1.72)     4.1131 (1.72)     4.1131 (1.72)     0.0000 (1.0)      4.1131 (1.72)     0.0000 (1.0)           0;0  0.2431 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7588 (1.99)     4.7588 (1.99)     4.7588 (1.99)     0.0000 (1.0)      4.7588 (1.99)     0.0000 (1.0)           0;0  0.2101 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6784 (1.95)     4.6784 (1.95)     4.6784 (1.95)     0.0000 (1.0)      4.6784 (1.95)     0.0000 (1.0)           0;0  0.2137 (0.51)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3934 (1.0)      2.3934 (1.0)      2.3934 (1.0)      0.0000 (1.0)      2.3934 (1.0)      0.0000 (1.0)           0;0  0.4178 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6180 (1.09)     2.6180 (1.09)     2.6180 (1.09)     0.0000 (1.0)      2.6180 (1.09)     0.0000 (1.0)           0;0  0.3820 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2651 (3.82)     18.2651 (3.82)     18.2651 (3.82)     0.0000 (1.0)      18.2651 (3.82)     0.0000 (1.0)           0;0  0.0547 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.1494 (4.01)     19.1494 (4.01)     19.1494 (4.01)     0.0000 (1.0)      19.1494 (4.01)     0.0000 (1.0)           0;0  0.0522 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.7098 (3.92)     18.7098 (3.92)     18.7098 (3.92)     0.0000 (1.0)      18.7098 (3.92)     0.0000 (1.0)           0;0  0.0534 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.7764 (1.0)       4.7764 (1.0)       4.7764 (1.0)      0.0000 (1.0)       4.7764 (1.0)      0.0000 (1.0)           0;0  0.2094 (1.0)           1           1
test_data_status-data-new[main]        5.1186 (1.07)      5.1186 (1.07)      5.1186 (1.07)     0.0000 (1.0)       5.1186 (1.07)     0.0000 (1.0)           0;0  0.1954 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9605 (1.71)     3.9605 (1.71)     3.9605 (1.71)     0.0000 (1.0)      3.9605 (1.71)     0.0000 (1.0)           0;0  0.2525 (0.59)          1           1
test_data_status-data-noop[3.10.0]     4.8437 (2.09)     4.8437 (2.09)     4.8437 (2.09)     0.0000 (1.0)      4.8437 (2.09)     0.0000 (1.0)           0;0  0.2065 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6675 (2.01)     4.6675 (2.01)     4.6675 (2.01)     0.0000 (1.0)      4.6675 (2.01)     0.0000 (1.0)           0;0  0.2142 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.3171 (1.0)      2.3171 (1.0)      2.3171 (1.0)      0.0000 (1.0)      2.3171 (1.0)      0.0000 (1.0)           0;0  0.4316 (1.0)           1           1
test_data_status-data-noop[main]       2.6274 (1.13)     2.6274 (1.13)     2.6274 (1.13)     0.0000 (1.0)      2.6274 (1.13)     0.0000 (1.0)           0;0  0.3806 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.9177 (1.28)     6.9177 (1.28)     6.9177 (1.28)     0.0000 (1.0)      6.9177 (1.28)     0.0000 (1.0)           0;0  0.1446 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7469 (1.43)     7.7469 (1.43)     7.7469 (1.43)     0.0000 (1.0)      7.7469 (1.43)     0.0000 (1.0)           0;0  0.1291 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6965 (1.42)     7.6965 (1.42)     7.6965 (1.42)     0.0000 (1.0)      7.6965 (1.42)     0.0000 (1.0)           0;0  0.1299 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4054 (1.0)      5.4054 (1.0)      5.4054 (1.0)      0.0000 (1.0)      5.4054 (1.0)      0.0000 (1.0)           0;0  0.1850 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5855 (1.03)     5.5855 (1.03)     5.5855 (1.03)     0.0000 (1.0)      5.5855 (1.03)     0.0000 (1.0)           0;0  0.1790 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.9754 (1.26)     6.9754 (1.26)     6.9754 (1.26)     0.0000 (1.0)      6.9754 (1.26)     0.0000 (1.0)           0;0  0.1434 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6644 (1.39)     7.6644 (1.39)     7.6644 (1.39)     0.0000 (1.0)      7.6644 (1.39)     0.0000 (1.0)           0;0  0.1305 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7175 (1.40)     7.7175 (1.40)     7.7175 (1.40)     0.0000 (1.0)      7.7175 (1.40)     0.0000 (1.0)           0;0  0.1296 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5207 (1.0)      5.5207 (1.0)      5.5207 (1.0)      0.0000 (1.0)      5.5207 (1.0)      0.0000 (1.0)           0;0  0.1811 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.6912 (1.03)     5.6912 (1.03)     5.6912 (1.03)     0.0000 (1.0)      5.6912 (1.03)     0.0000 (1.0)           0;0  0.1757 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.7116 (2.75)     21.7116 (2.75)     21.7116 (2.75)     0.0000 (1.0)      21.7116 (2.75)     0.0000 (1.0)           0;0  0.0461 (0.36)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.5083 (2.85)     22.5083 (2.85)     22.5083 (2.85)     0.0000 (1.0)      22.5083 (2.85)     0.0000 (1.0)           0;0  0.0444 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.0949 (2.80)     22.0949 (2.80)     22.0949 (2.80)     0.0000 (1.0)      22.0949 (2.80)     0.0000 (1.0)           0;0  0.0453 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.8990 (1.0)       7.8990 (1.0)       7.8990 (1.0)      0.0000 (1.0)       7.8990 (1.0)      0.0000 (1.0)           0;0  0.1266 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3477 (1.06)      8.3477 (1.06)      8.3477 (1.06)     0.0000 (1.0)       8.3477 (1.06)     0.0000 (1.0)           0;0  0.1198 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4272 (1.36)     6.4272 (1.36)     6.4272 (1.36)     0.0000 (1.0)      6.4272 (1.36)     0.0000 (1.0)           0;0  0.1556 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2764 (1.54)     7.2764 (1.54)     7.2764 (1.54)     0.0000 (1.0)      7.2764 (1.54)     0.0000 (1.0)           0;0  0.1374 (0.65)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1530 (1.52)     7.1530 (1.52)     7.1530 (1.52)     0.0000 (1.0)      7.1530 (1.52)     0.0000 (1.0)           0;0  0.1398 (0.66)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7126 (1.0)      4.7126 (1.0)      4.7126 (1.0)      0.0000 (1.0)      4.7126 (1.0)      0.0000 (1.0)           0;0  0.2122 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0865 (1.08)     5.0865 (1.08)     5.0865 (1.08)     0.0000 (1.0)      5.0865 (1.08)     0.0000 (1.0)           0;0  0.1966 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.5153 (2.69)     18.5153 (2.69)     18.5153 (2.69)     0.0000 (1.0)      18.5153 (2.69)     0.0000 (1.0)           0;0  0.0540 (0.37)          1           1
test_diff-diff[3.10.0]     19.7154 (2.87)     19.7154 (2.87)     19.7154 (2.87)     0.0000 (1.0)      19.7154 (2.87)     0.0000 (1.0)           0;0  0.0507 (0.35)          1           1
test_diff-diff[3.53.2]     19.2121 (2.79)     19.2121 (2.79)     19.2121 (2.79)     0.0000 (1.0)      19.2121 (2.79)     0.0000 (1.0)           0;0  0.0521 (0.36)          1           1
test_diff-diff[3.60.1]      6.8746 (1.0)       6.8746 (1.0)       6.8746 (1.0)      0.0000 (1.0)       6.8746 (1.0)      0.0000 (1.0)           0;0  0.1455 (1.0)           1           1
test_diff-diff[main]        8.0299 (1.17)      8.0299 (1.17)      8.0299 (1.17)     0.0000 (1.0)       8.0299 (1.17)     0.0000 (1.0)           0;0  0.1245 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1112 (1.79)     6.1112 (1.79)     6.1112 (1.79)     0.0000 (1.0)      6.1112 (1.79)     0.0000 (1.0)           0;0  0.1636 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.8177 (2.00)     6.8177 (2.00)     6.8177 (2.00)     0.0000 (1.0)      6.8177 (2.00)     0.0000 (1.0)           0;0  0.1467 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.6956 (1.67)     5.6956 (1.67)     5.6956 (1.67)     0.0000 (1.0)      5.6956 (1.67)     0.0000 (1.0)           0;0  0.1756 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.4128 (1.0)      3.4128 (1.0)      3.4128 (1.0)      0.0000 (1.0)      3.4128 (1.0)      0.0000 (1.0)           0;0  0.2930 (1.0)           1           1
test_diff-diff-changed[main]       4.3441 (1.27)     4.3441 (1.27)     4.3441 (1.27)     0.0000 (1.0)      4.3441 (1.27)     0.0000 (1.0)           0;0  0.2302 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2498 (1.51)     5.2498 (1.51)     5.2498 (1.51)     0.0000 (1.0)      5.2498 (1.51)     0.0000 (1.0)           0;0  0.1905 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9410 (1.71)     5.9410 (1.71)     5.9410 (1.71)     0.0000 (1.0)      5.9410 (1.71)     0.0000 (1.0)           0;0  0.1683 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6376 (1.63)     5.6376 (1.63)     5.6376 (1.63)     0.0000 (1.0)      5.6376 (1.63)     0.0000 (1.0)           0;0  0.1774 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4666 (1.0)      3.4666 (1.0)      3.4666 (1.0)      0.0000 (1.0)      3.4666 (1.0)      0.0000 (1.0)           0;0  0.2885 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.3273 (1.25)     4.3273 (1.25)     4.3273 (1.25)     0.0000 (1.0)      4.3273 (1.25)     0.0000 (1.0)           0;0  0.2311 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3210 (1.26)     4.3210 (1.26)     4.3210 (1.26)     0.0000 (1.0)      4.3210 (1.26)     0.0000 (1.0)           0;0  0.2314 (0.79)          1           1
test_diff-diff-noop[3.10.0]     5.0222 (1.47)     5.0222 (1.47)     5.0222 (1.47)     0.0000 (1.0)      5.0222 (1.47)     0.0000 (1.0)           0;0  0.1991 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.7745 (1.69)     5.7745 (1.69)     5.7745 (1.69)     0.0000 (1.0)      5.7745 (1.69)     0.0000 (1.0)           0;0  0.1732 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.4162 (1.0)      3.4162 (1.0)      3.4162 (1.0)      0.0000 (1.0)      3.4162 (1.0)      0.0000 (1.0)           0;0  0.2927 (1.0)           1           1
test_diff-diff-noop[main]       4.2581 (1.25)     4.2581 (1.25)     4.2581 (1.25)     0.0000 (1.0)      4.2581 (1.25)     0.0000 (1.0)           0;0  0.2348 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2562 (1.0)       1.2562 (1.0)       1.2562 (1.0)      0.0000 (1.0)       1.2562 (1.0)      0.0000 (1.0)           0;0  0.7960 (1.0)           1           1
test_exp_show-exp[3.10.0]     11.9766 (9.53)     11.9766 (9.53)     11.9766 (9.53)     0.0000 (1.0)      11.9766 (9.53)     0.0000 (1.0)           0;0  0.0835 (0.10)          1           1
test_exp_show-exp[3.53.2]      7.0213 (5.59)      7.0213 (5.59)      7.0213 (5.59)     0.0000 (1.0)       7.0213 (5.59)     0.0000 (1.0)           0;0  0.1424 (0.18)          1           1
test_exp_show-exp[3.60.1]      7.3261 (5.83)      7.3261 (5.83)      7.3261 (5.83)     0.0000 (1.0)       7.3261 (5.83)     0.0000 (1.0)           0;0  0.1365 (0.17)          1           1
test_exp_show-exp[main]       10.7556 (8.56)     10.7556 (8.56)     10.7556 (8.56)     0.0000 (1.0)      10.7556 (8.56)     0.0000 (1.0)           0;0  0.0930 (0.12)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     62.5790 (2.74)     62.5790 (2.74)     62.5790 (2.74)     0.0000 (1.0)      62.5790 (2.74)     0.0000 (1.0)           0;0  0.0160 (0.37)          1           1
test_fetch-fetch[3.10.0]     67.0827 (2.93)     67.0827 (2.93)     67.0827 (2.93)     0.0000 (1.0)      67.0827 (2.93)     0.0000 (1.0)           0;0  0.0149 (0.34)          1           1
test_fetch-fetch[3.53.2]     32.4115 (1.42)     32.4115 (1.42)     32.4115 (1.42)     0.0000 (1.0)      32.4115 (1.42)     0.0000 (1.0)           0;0  0.0309 (0.71)          1           1
test_fetch-fetch[3.60.1]     22.8576 (1.0)      22.8576 (1.0)      22.8576 (1.0)      0.0000 (1.0)      22.8576 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
test_fetch-fetch[main]       22.8744 (1.00)     22.8744 (1.00)     22.8744 (1.00)     0.0000 (1.0)      22.8744 (1.00)     0.0000 (1.0)           0;0  0.0437 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8922 (1.0)      2.8922 (1.0)      2.8922 (1.0)      0.0000 (1.0)      2.8922 (1.0)      0.0000 (1.0)           0;0  0.3458 (1.0)           1           1
test_gc-gc[3.10.0]     3.1009 (1.07)     3.1009 (1.07)     3.1009 (1.07)     0.0000 (1.0)      3.1009 (1.07)     0.0000 (1.0)           0;0  0.3225 (0.93)          1           1
test_gc-gc[3.53.2]     2.9642 (1.02)     2.9642 (1.02)     2.9642 (1.02)     0.0000 (1.0)      2.9642 (1.02)     0.0000 (1.0)           0;0  0.3374 (0.98)          1           1
test_gc-gc[3.60.1]     2.9833 (1.03)     2.9833 (1.03)     2.9833 (1.03)     0.0000 (1.0)      2.9833 (1.03)     0.0000 (1.0)           0;0  0.3352 (0.97)          1           1
test_gc-gc[main]       3.0353 (1.05)     3.0353 (1.05)     3.0353 (1.05)     0.0000 (1.0)      3.0353 (1.05)     0.0000 (1.0)           0;0  0.3295 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     129.9064 (2.73)     129.9064 (2.73)     129.9064 (2.73)     0.0000 (1.0)      129.9064 (2.73)     0.0000 (1.0)           0;0  0.0077 (0.37)          1           1
test_get-get[3.10.0]     156.4241 (3.29)     156.4241 (3.29)     156.4241 (3.29)     0.0000 (1.0)      156.4241 (3.29)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_get-get[3.53.2]     139.8592 (2.94)     139.8592 (2.94)     139.8592 (2.94)     0.0000 (1.0)      139.8592 (2.94)     0.0000 (1.0)           0;0  0.0072 (0.34)          1           1
test_get-get[3.60.1]      47.5492 (1.0)       47.5492 (1.0)       47.5492 (1.0)      0.0000 (1.0)       47.5492 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
test_get-get[main]        47.8221 (1.01)      47.8221 (1.01)      47.8221 (1.01)     0.0000 (1.0)       47.8221 (1.01)     0.0000 (1.0)           0;0  0.0209 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     41.9102 (2.53)     41.9102 (2.53)     41.9102 (2.53)     0.0000 (1.0)      41.9102 (2.53)     0.0000 (1.0)           0;0  0.0239 (0.40)          1           1
test_get_url-get-url[3.10.0]     44.9059 (2.71)     44.9059 (2.71)     44.9059 (2.71)     0.0000 (1.0)      44.9059 (2.71)     0.0000 (1.0)           0;0  0.0223 (0.37)          1           1
test_get_url-get-url[3.53.2]     16.6608 (1.01)     16.6608 (1.01)     16.6608 (1.01)     0.0000 (1.0)      16.6608 (1.01)     0.0000 (1.0)           0;0  0.0600 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.5960 (1.00)     16.5960 (1.00)     16.5960 (1.00)     0.0000 (1.0)      16.5960 (1.00)     0.0000 (1.0)           0;0  0.0603 (1.00)          1           1
test_get_url-get-url[main]       16.5626 (1.0)      16.5626 (1.0)      16.5626 (1.0)      0.0000 (1.0)      16.5626 (1.0)      0.0000 (1.0)           0;0  0.0604 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     149.8813 (1.06)     176.6592 (1.20)     152.2909 (1.06)     2.7213 (1.99)     151.8404 (1.06)     1.3317 (1.0)           4;6  6.5664 (0.94)        100           1
test_help---help[3.10.0]     145.4858 (1.03)     160.8398 (1.09)     148.2649 (1.03)     1.9718 (1.44)     147.7753 (1.03)     1.9284 (1.45)         19;3  6.7447 (0.97)        100           1
test_help---help[3.53.2]     149.5532 (1.06)     157.9427 (1.07)     152.3508 (1.06)     1.9652 (1.44)     151.7655 (1.06)     2.6944 (2.02)         31;1  6.5638 (0.94)        100           1
test_help---help[3.60.1]     149.4070 (1.06)     168.4885 (1.14)     152.5161 (1.06)     3.2995 (2.41)     151.8166 (1.06)     2.4024 (1.80)          9;7  6.5567 (0.94)        100           1
test_help---help[main]       141.3881 (1.0)      147.6073 (1.0)      143.6985 (1.0)      1.3694 (1.0)      143.4236 (1.0)      1.8681 (1.40)         36;1  6.9590 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     217.3458 (2.89)     217.3458 (2.89)     217.3458 (2.89)     0.0000 (1.0)      217.3458 (2.89)     0.0000 (1.0)           0;0  0.0046 (0.35)          1           1
test_import-import[3.10.0]     245.9369 (3.27)     245.9369 (3.27)     245.9369 (3.27)     0.0000 (1.0)      245.9369 (3.27)     0.0000 (1.0)           0;0  0.0041 (0.31)          1           1
test_import-import[3.60.1]      75.3104 (1.0)       75.3104 (1.0)       75.3104 (1.0)      0.0000 (1.0)       75.3104 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        76.0152 (1.01)      76.0152 (1.01)      76.0152 (1.01)     0.0000 (1.0)       76.0152 (1.01)     0.0000 (1.0)           0;0  0.0132 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     109.6163 (3.79)     109.6163 (3.79)     109.6163 (3.79)     0.0000 (1.0)      109.6163 (3.79)     0.0000 (1.0)           0;0  0.0091 (0.26)          1           1
test_import_url-import-url[3.10.0]     112.8603 (3.90)     112.8603 (3.90)     112.8603 (3.90)     0.0000 (1.0)      112.8603 (3.90)     0.0000 (1.0)           0;0  0.0089 (0.26)          1           1
test_import_url-import-url[3.53.2]      77.0017 (2.66)      77.0017 (2.66)      77.0017 (2.66)     0.0000 (1.0)       77.0017 (2.66)     0.0000 (1.0)           0;0  0.0130 (0.38)          1           1
test_import_url-import-url[3.60.1]      28.9449 (1.0)       28.9449 (1.0)       28.9449 (1.0)      0.0000 (1.0)       28.9449 (1.0)      0.0000 (1.0)           0;0  0.0345 (1.0)           1           1
test_import_url-import-url[main]        30.5629 (1.06)      30.5629 (1.06)      30.5629 (1.06)     0.0000 (1.0)       30.5629 (1.06)     0.0000 (1.0)           0;0  0.0327 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     437.6994 (1.04)     518.5105 (1.13)     472.2673 (1.09)     17.4123 (1.96)     469.6337 (1.09)     24.1762 (2.08)         29;0  2.1174 (0.92)        100           1
test_init-init[3.10.0]     439.4379 (1.05)     521.5850 (1.13)     463.9917 (1.07)     18.8059 (2.12)     457.2744 (1.06)     20.1000 (1.73)         24;7  2.1552 (0.93)        100           1
test_init-init[3.53.2]     419.8318 (1.0)      460.5854 (1.0)      433.0256 (1.0)       8.8785 (1.0)      431.6296 (1.0)      11.6318 (1.0)          31;3  2.3093 (1.0)         100           1
test_init-init[3.60.1]     423.6893 (1.01)     476.2757 (1.03)     443.3409 (1.02)     13.4197 (1.51)     440.6546 (1.02)     21.7200 (1.87)         40;0  2.2556 (0.98)        100           1
test_init-init[main]       458.5825 (1.09)     576.3543 (1.25)     493.6956 (1.14)     15.4769 (1.74)     493.3094 (1.14)     17.1058 (1.47)         30;2  2.0255 (0.88)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     568.0263 (1.04)     568.0263 (1.04)     568.0263 (1.04)     0.0000 (1.0)      568.0263 (1.04)     0.0000 (1.0)           0;0  1.7605 (0.96)          1           1
test_list-list[3.10.0]     669.6610 (1.22)     669.6610 (1.22)     669.6610 (1.22)     0.0000 (1.0)      669.6610 (1.22)     0.0000 (1.0)           0;0  1.4933 (0.82)          1           1
test_list-list[3.53.2]     566.1012 (1.03)     566.1012 (1.03)     566.1012 (1.03)     0.0000 (1.0)      566.1012 (1.03)     0.0000 (1.0)           0;0  1.7665 (0.97)          1           1
test_list-list[3.60.1]     608.8728 (1.11)     608.8728 (1.11)     608.8728 (1.11)     0.0000 (1.0)      608.8728 (1.11)     0.0000 (1.0)           0;0  1.6424 (0.90)          1           1
test_list-list[main]       547.4787 (1.0)      547.4787 (1.0)      547.4787 (1.0)      0.0000 (1.0)      547.4787 (1.0)      0.0000 (1.0)           0;0  1.8266 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     388.5747 (1.06)     388.5747 (1.06)     388.5747 (1.06)     0.0000 (1.0)      388.5747 (1.06)     0.0000 (1.0)           0;0  2.5735 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     391.9338 (1.06)     391.9338 (1.06)     391.9338 (1.06)     0.0000 (1.0)      391.9338 (1.06)     0.0000 (1.0)           0;0  2.5515 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     376.2949 (1.02)     376.2949 (1.02)     376.2949 (1.02)     0.0000 (1.0)      376.2949 (1.02)     0.0000 (1.0)           0;0  2.6575 (0.98)          1           1
test_list-list-dvc-only[3.60.1]     384.1604 (1.04)     384.1604 (1.04)     384.1604 (1.04)     0.0000 (1.0)      384.1604 (1.04)     0.0000 (1.0)           0;0  2.6031 (0.96)          1           1
test_list-list-dvc-only[main]       368.1966 (1.0)      368.1966 (1.0)      368.1966 (1.0)      0.0000 (1.0)      368.1966 (1.0)      0.0000 (1.0)           0;0  2.7159 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.2469 (1.0)      2.2469 (1.0)      2.2469 (1.0)      0.0000 (1.0)      2.2469 (1.0)      0.0000 (1.0)           0;0  0.4451 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.3074 (1.03)     2.3074 (1.03)     2.3074 (1.03)     0.0000 (1.0)      2.3074 (1.03)     0.0000 (1.0)           0;0  0.4334 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.3786 (1.06)     2.3786 (1.06)     2.3786 (1.06)     0.0000 (1.0)      2.3786 (1.06)     0.0000 (1.0)           0;0  0.4204 (0.94)          1           1
test_list-list-recursive[3.60.1]     2.3955 (1.07)     2.3955 (1.07)     2.3955 (1.07)     0.0000 (1.0)      2.3955 (1.07)     0.0000 (1.0)           0;0  0.4174 (0.94)          1           1
test_list-list-recursive[main]       2.4074 (1.07)     2.4074 (1.07)     2.4074 (1.07)     0.0000 (1.0)      2.4074 (1.07)     0.0000 (1.0)           0;0  0.4154 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     431.3245 (1.15)     431.3245 (1.15)     431.3245 (1.15)     0.0000 (1.0)      431.3245 (1.15)     0.0000 (1.0)           0;0  2.3184 (0.87)          1           1
test_list-list-shallow[3.10.0]     392.4506 (1.04)     392.4506 (1.04)     392.4506 (1.04)     0.0000 (1.0)      392.4506 (1.04)     0.0000 (1.0)           0;0  2.5481 (0.96)          1           1
test_list-list-shallow[3.53.2]     384.2806 (1.02)     384.2806 (1.02)     384.2806 (1.02)     0.0000 (1.0)      384.2806 (1.02)     0.0000 (1.0)           0;0  2.6023 (0.98)          1           1
test_list-list-shallow[3.60.1]     375.5676 (1.0)      375.5676 (1.0)      375.5676 (1.0)      0.0000 (1.0)      375.5676 (1.0)      0.0000 (1.0)           0;0  2.6626 (1.0)           1           1
test_list-list-shallow[main]       376.9599 (1.00)     376.9599 (1.00)     376.9599 (1.00)     0.0000 (1.0)      376.9599 (1.00)     0.0000 (1.0)           0;0  2.6528 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.1294 (3.71)     71.1294 (3.71)     71.1294 (3.71)     0.0000 (1.0)      71.1294 (3.71)     0.0000 (1.0)           0;0  0.0141 (0.27)          1           1
test_partial_add-add[3.10.0]     70.9292 (3.70)     70.9292 (3.70)     70.9292 (3.70)     0.0000 (1.0)      70.9292 (3.70)     0.0000 (1.0)           0;0  0.0141 (0.27)          1           1
test_partial_add-add[3.53.2]     63.4817 (3.31)     63.4817 (3.31)     63.4817 (3.31)     0.0000 (1.0)      63.4817 (3.31)     0.0000 (1.0)           0;0  0.0158 (0.30)          1           1
test_partial_add-add[3.60.1]     19.1855 (1.0)      19.1855 (1.0)      19.1855 (1.0)      0.0000 (1.0)      19.1855 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
test_partial_add-add[main]       20.0740 (1.05)     20.0740 (1.05)     20.0740 (1.05)     0.0000 (1.0)      20.0740 (1.05)     0.0000 (1.0)           0;0  0.0498 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.5900 (8.21)     59.5900 (8.21)     59.5900 (8.21)     0.0000 (1.0)      59.5900 (8.21)     0.0000 (1.0)           0;0  0.0168 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     60.6588 (8.36)     60.6588 (8.36)     60.6588 (8.36)     0.0000 (1.0)      60.6588 (8.36)     0.0000 (1.0)           0;0  0.0165 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     53.8505 (7.42)     53.8505 (7.42)     53.8505 (7.42)     0.0000 (1.0)      53.8505 (7.42)     0.0000 (1.0)           0;0  0.0186 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.2556 (1.0)       7.2556 (1.0)       7.2556 (1.0)      0.0000 (1.0)       7.2556 (1.0)      0.0000 (1.0)           0;0  0.1378 (1.0)           1           1
test_partial_add-add-partial[main]        7.6156 (1.05)      7.6156 (1.05)      7.6156 (1.05)     0.0000 (1.0)       7.6156 (1.05)     0.0000 (1.0)           0;0  0.1313 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6385 (1.0)      4.6385 (1.0)      4.6385 (1.0)      0.0000 (1.0)      4.6385 (1.0)      0.0000 (1.0)           0;0  0.2156 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1944 (1.34)     6.1944 (1.34)     6.1944 (1.34)     0.0000 (1.0)      6.1944 (1.34)     0.0000 (1.0)           0;0  0.1614 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.0144 (1.51)     7.0144 (1.51)     7.0144 (1.51)     0.0000 (1.0)      7.0144 (1.51)     0.0000 (1.0)           0;0  0.1426 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.0527 (1.52)     7.0527 (1.52)     7.0527 (1.52)     0.0000 (1.0)      7.0527 (1.52)     0.0000 (1.0)           0;0  0.1418 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       7.0996 (1.53)     7.0996 (1.53)     7.0996 (1.53)     0.0000 (1.0)      7.0996 (1.53)     0.0000 (1.0)           0;0  0.1409 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6032 (1.0)      2.6032 (1.0)      2.6032 (1.0)      0.0000 (1.0)      2.6032 (1.0)      0.0000 (1.0)           0;0  0.3841 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9531 (1.52)     3.9531 (1.52)     3.9531 (1.52)     0.0000 (1.0)      3.9531 (1.52)     0.0000 (1.0)           0;0  0.2530 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.9488 (1.52)     3.9488 (1.52)     3.9488 (1.52)     0.0000 (1.0)      3.9488 (1.52)     0.0000 (1.0)           0;0  0.2532 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.9691 (1.52)     3.9691 (1.52)     3.9691 (1.52)     0.0000 (1.0)      3.9691 (1.52)     0.0000 (1.0)           0;0  0.2519 (0.66)          1           1
test_partial_add-gc-noop[main]       4.0486 (1.56)     4.0486 (1.56)     4.0486 (1.56)     0.0000 (1.0)      4.0486 (1.56)     0.0000 (1.0)           0;0  0.2470 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     41.0016 (2.22)     41.0016 (2.22)     41.0016 (2.22)     0.0000 (1.0)      41.0016 (2.22)     0.0000 (1.0)           0;0  0.0244 (0.45)          1           1
test_partial_add-push[3.10.0]     35.9488 (1.94)     35.9488 (1.94)     35.9488 (1.94)     0.0000 (1.0)      35.9488 (1.94)     0.0000 (1.0)           0;0  0.0278 (0.51)          1           1
test_partial_add-push[3.53.2]     19.4415 (1.05)     19.4415 (1.05)     19.4415 (1.05)     0.0000 (1.0)      19.4415 (1.05)     0.0000 (1.0)           0;0  0.0514 (0.95)          1           1
test_partial_add-push[3.60.1]     18.8874 (1.02)     18.8874 (1.02)     18.8874 (1.02)     0.0000 (1.0)      18.8874 (1.02)     0.0000 (1.0)           0;0  0.0529 (0.98)          1           1
test_partial_add-push[main]       18.4845 (1.0)      18.4845 (1.0)      18.4845 (1.0)      0.0000 (1.0)      18.4845 (1.0)      0.0000 (1.0)           0;0  0.0541 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.7377 (1.07)     10.7377 (1.07)     10.7377 (1.07)     0.0000 (1.0)      10.7377 (1.07)     0.0000 (1.0)           0;0  0.0931 (0.93)          1           1
test_partial_add-push-partial[3.10.0]     10.0183 (1.0)      10.0183 (1.0)      10.0183 (1.0)      0.0000 (1.0)      10.0183 (1.0)      0.0000 (1.0)           0;0  0.0998 (1.0)           1           1
test_partial_add-push-partial[3.53.2]     10.3548 (1.03)     10.3548 (1.03)     10.3548 (1.03)     0.0000 (1.0)      10.3548 (1.03)     0.0000 (1.0)           0;0  0.0966 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.0624 (1.00)     10.0624 (1.00)     10.0624 (1.00)     0.0000 (1.0)      10.0624 (1.00)     0.0000 (1.0)           0;0  0.0994 (1.00)          1           1
test_partial_add-push-partial[main]       10.2337 (1.02)     10.2337 (1.02)     10.2337 (1.02)     0.0000 (1.0)      10.2337 (1.02)     0.0000 (1.0)           0;0  0.0977 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.0446 (3.64)     85.0446 (3.64)     85.0446 (3.64)     0.0000 (1.0)      85.0446 (3.64)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_partial_remove-add[3.10.0]     86.9070 (3.72)     86.9070 (3.72)     86.9070 (3.72)     0.0000 (1.0)      86.9070 (3.72)     0.0000 (1.0)           0;0  0.0115 (0.27)          1           1
test_partial_remove-add[3.53.2]     79.2642 (3.39)     79.2642 (3.39)     79.2642 (3.39)     0.0000 (1.0)      79.2642 (3.39)     0.0000 (1.0)           0;0  0.0126 (0.29)          1           1
test_partial_remove-add[3.60.1]     23.3673 (1.0)      23.3673 (1.0)      23.3673 (1.0)      0.0000 (1.0)      23.3673 (1.0)      0.0000 (1.0)           0;0  0.0428 (1.0)           1           1
test_partial_remove-add[main]       24.1805 (1.03)     24.1805 (1.03)     24.1805 (1.03)     0.0000 (1.0)      24.1805 (1.03)     0.0000 (1.0)           0;0  0.0414 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.3603 (6.93)     8.3603 (6.93)     8.3603 (6.93)     0.0000 (1.0)      8.3603 (6.93)     0.0000 (1.0)           0;0  0.1196 (0.14)          1           1
test_partial_remove-add-update[3.10.0]     8.5860 (7.11)     8.5860 (7.11)     8.5860 (7.11)     0.0000 (1.0)      8.5860 (7.11)     0.0000 (1.0)           0;0  0.1165 (0.14)          1           1
test_partial_remove-add-update[3.53.2]     7.5426 (6.25)     7.5426 (6.25)     7.5426 (6.25)     0.0000 (1.0)      7.5426 (6.25)     0.0000 (1.0)           0;0  0.1326 (0.16)          1           1
test_partial_remove-add-update[3.60.1]     1.2072 (1.0)      1.2072 (1.0)      1.2072 (1.0)      0.0000 (1.0)      1.2072 (1.0)      0.0000 (1.0)           0;0  0.8284 (1.0)           1           1
test_partial_remove-add-update[main]       1.2406 (1.03)     1.2406 (1.03)     1.2406 (1.03)     0.0000 (1.0)      1.2406 (1.03)     0.0000 (1.0)           0;0  0.8060 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.4375 (1.0)      3.4375 (1.0)      3.4375 (1.0)      0.0000 (1.0)      3.4375 (1.0)      0.0000 (1.0)           0;0  0.2909 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.8139 (1.11)     3.8139 (1.11)     3.8139 (1.11)     0.0000 (1.0)      3.8139 (1.11)     0.0000 (1.0)           0;0  0.2622 (0.90)          1           1
test_partial_remove-gc[3.53.2]     3.7524 (1.09)     3.7524 (1.09)     3.7524 (1.09)     0.0000 (1.0)      3.7524 (1.09)     0.0000 (1.0)           0;0  0.2665 (0.92)          1           1
test_partial_remove-gc[3.60.1]     4.0458 (1.18)     4.0458 (1.18)     4.0458 (1.18)     0.0000 (1.0)      4.0458 (1.18)     0.0000 (1.0)           0;0  0.2472 (0.85)          1           1
test_partial_remove-gc[main]       4.0462 (1.18)     4.0462 (1.18)     4.0462 (1.18)     0.0000 (1.0)      4.0462 (1.18)     0.0000 (1.0)           0;0  0.2471 (0.85)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.9722 (1.02)     4.9722 (1.02)     4.9722 (1.02)     0.0000 (1.0)      4.9722 (1.02)     0.0000 (1.0)           0;0  0.2011 (0.98)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.2479 (1.08)     5.2479 (1.08)     5.2479 (1.08)     0.0000 (1.0)      5.2479 (1.08)     0.0000 (1.0)           0;0  0.1906 (0.93)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.2086 (1.07)     5.2086 (1.07)     5.2086 (1.07)     0.0000 (1.0)      5.2086 (1.07)     0.0000 (1.0)           0;0  0.1920 (0.93)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8608 (1.0)      4.8608 (1.0)      4.8608 (1.0)      0.0000 (1.0)      4.8608 (1.0)      0.0000 (1.0)           0;0  0.2057 (1.0)           1           1
test_partial_remove-gc-cloud[main]       5.0080 (1.03)     5.0080 (1.03)     5.0080 (1.03)     0.0000 (1.0)      5.0080 (1.03)     0.0000 (1.0)           0;0  0.1997 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     47.6945 (2.08)     47.6945 (2.08)     47.6945 (2.08)     0.0000 (1.0)      47.6945 (2.08)     0.0000 (1.0)           0;0  0.0210 (0.48)          1           1
test_partial_remove-push[3.10.0]     43.4087 (1.89)     43.4087 (1.89)     43.4087 (1.89)     0.0000 (1.0)      43.4087 (1.89)     0.0000 (1.0)           0;0  0.0230 (0.53)          1           1
test_partial_remove-push[3.53.2]     23.0309 (1.00)     23.0309 (1.00)     23.0309 (1.00)     0.0000 (1.0)      23.0309 (1.00)     0.0000 (1.0)           0;0  0.0434 (1.00)          1           1
test_partial_remove-push[3.60.1]     22.9610 (1.0)      22.9610 (1.0)      22.9610 (1.0)      0.0000 (1.0)      22.9610 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
test_partial_remove-push[main]       23.0086 (1.00)     23.0086 (1.00)     23.0086 (1.00)     0.0000 (1.0)      23.0086 (1.00)     0.0000 (1.0)           0;0  0.0435 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.9153 (1.01)     1.9153 (1.01)     1.9153 (1.01)     0.0000 (1.0)      1.9153 (1.01)     0.0000 (1.0)           0;0  0.5221 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     1.8967 (1.0)      1.8967 (1.0)      1.8967 (1.0)      0.0000 (1.0)      1.8967 (1.0)      0.0000 (1.0)           0;0  0.5272 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.6014 (1.37)     2.6014 (1.37)     2.6014 (1.37)     0.0000 (1.0)      2.6014 (1.37)     0.0000 (1.0)           0;0  0.3844 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.6674 (1.41)     2.6674 (1.41)     2.6674 (1.41)     0.0000 (1.0)      2.6674 (1.41)     0.0000 (1.0)           0;0  0.3749 (0.71)          1           1
test_partial_remove-push-update[main]       2.6533 (1.40)     2.6533 (1.40)     2.6533 (1.40)     0.0000 (1.0)      2.6533 (1.40)     0.0000 (1.0)           0;0  0.3769 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     579.4272 (1.0)        593.5597 (1.0)        586.0087 (1.0)       6.0352 (1.0)        588.0209 (1.0)       9.9732 (1.0)           2;0  1.7065 (1.0)           5           3
test_plots-plots-diff[3.10.0]     996.4134 (1.72)     1,033.5881 (1.74)     1,010.8547 (1.72)     17.2913 (2.87)     1,002.8236 (1.71)     30.6671 (3.07)          1;0  0.9893 (0.58)          5           3
test_plots-plots-diff[3.53.2]     941.3932 (1.62)       961.9546 (1.62)       950.5195 (1.62)      9.1930 (1.52)       948.7444 (1.61)     16.7930 (1.68)          1;0  1.0521 (0.62)          5           3
test_plots-plots-diff[3.60.1]     938.2998 (1.62)       974.2745 (1.64)       954.0158 (1.63)     14.2271 (2.36)       947.9894 (1.61)     20.3592 (2.04)          2;0  1.0482 (0.61)          5           3
test_plots-plots-diff[main]       937.5319 (1.62)       961.0069 (1.62)       948.6828 (1.62)      9.6153 (1.59)       951.8961 (1.62)     14.9710 (1.50)          2;0  1.0541 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       600.6480 (1.0)        612.3537 (1.0)        603.8763 (1.0)       4.7891 (1.0)        601.9641 (1.0)       3.4353 (1.0)           1;1  1.6560 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,240.0012 (2.06)     1,256.2082 (2.05)     1,247.2172 (2.07)      7.9222 (1.65)     1,242.6510 (2.06)     14.3018 (4.16)          2;0  0.8018 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]     1,020.4067 (1.70)     1,043.7470 (1.70)     1,029.8345 (1.71)     11.0928 (2.32)     1,024.2390 (1.70)     19.9792 (5.82)          1;0  0.9710 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]     1,013.8972 (1.69)     1,032.7748 (1.69)     1,024.3568 (1.70)      7.2450 (1.51)     1,025.7117 (1.70)     10.2941 (3.00)          2;0  0.9762 (0.59)          5           3
test_plots-plots-diff-json[main]       1,015.3428 (1.69)     1,027.7328 (1.68)     1,021.7580 (1.69)      5.4915 (1.15)     1,024.3683 (1.70)      9.3371 (2.72)          2;0  0.9787 (0.59)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     468.5844 (1.0)      482.0198 (1.0)      475.2454 (1.0)       5.9336 (1.15)     476.1613 (1.0)      10.7988 (1.31)          2;0  2.1042 (1.0)           5           3
test_plots-plots-show[3.10.0]     813.8111 (1.74)     826.3661 (1.71)     819.0930 (1.72)      5.1603 (1.0)      817.5954 (1.72)      8.2644 (1.0)           2;0  1.2209 (0.58)          5           3
test_plots-plots-show[3.53.2]     779.7951 (1.66)     798.1623 (1.66)     789.7669 (1.66)      7.1354 (1.38)     790.1032 (1.66)     10.6713 (1.29)          2;0  1.2662 (0.60)          5           3
test_plots-plots-show[3.60.1]     777.7117 (1.66)     798.2215 (1.66)     788.9934 (1.66)      7.6864 (1.49)     789.1043 (1.66)     10.1011 (1.22)          2;0  1.2674 (0.60)          5           3
test_plots-plots-show[main]       781.0335 (1.67)     825.9791 (1.71)     796.4851 (1.68)     18.1033 (3.51)     796.1921 (1.67)     22.2415 (2.69)          1;0  1.2555 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     485.7919 (1.0)      496.4886 (1.0)      491.9820 (1.0)      4.0716 (1.21)     493.2889 (1.0)       5.2514 (1.26)          2;0  2.0326 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     940.9081 (1.94)     964.3625 (1.94)     952.7587 (1.94)     9.2737 (2.75)     951.0822 (1.93)     14.3661 (3.44)          2;0  1.0496 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     846.5834 (1.74)     865.2493 (1.74)     851.5778 (1.73)     7.7279 (2.29)     849.0261 (1.72)      6.0720 (1.46)          1;1  1.1743 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     842.2978 (1.73)     850.2888 (1.71)     847.9314 (1.72)     3.3699 (1.0)      849.5037 (1.72)      4.1731 (1.0)           1;0  1.1793 (0.58)          5           3
test_plots-plots-show-json[main]       822.9917 (1.69)     838.3182 (1.69)     831.0305 (1.69)     6.6458 (1.97)     833.8091 (1.69)     11.2682 (2.70)          2;0  1.2033 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     47.8791 (2.21)     47.8791 (2.21)     47.8791 (2.21)     0.0000 (1.0)      47.8791 (2.21)     0.0000 (1.0)           0;0  0.0209 (0.45)          1           1
test_push-push[3.10.0]     42.2166 (1.95)     42.2166 (1.95)     42.2166 (1.95)     0.0000 (1.0)      42.2166 (1.95)     0.0000 (1.0)           0;0  0.0237 (0.51)          1           1
test_push-push[3.53.2]     22.9309 (1.06)     22.9309 (1.06)     22.9309 (1.06)     0.0000 (1.0)      22.9309 (1.06)     0.0000 (1.0)           0;0  0.0436 (0.94)          1           1
test_push-push[3.60.1]     21.6213 (1.0)      21.6213 (1.0)      21.6213 (1.0)      0.0000 (1.0)      21.6213 (1.0)      0.0000 (1.0)           0;0  0.0463 (1.0)           1           1
test_push-push[main]       21.7996 (1.01)     21.7996 (1.01)     21.7996 (1.01)     0.0000 (1.0)      21.7996 (1.01)     0.0000 (1.0)           0;0  0.0459 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     60.2399 (2.69)     60.2399 (2.69)     60.2399 (2.69)     0.0000 (1.0)      60.2399 (2.69)     0.0000 (1.0)           0;0  0.0166 (0.37)          1           1
test_sharing-fetch[3.10.0]     65.5247 (2.93)     65.5247 (2.93)     65.5247 (2.93)     0.0000 (1.0)      65.5247 (2.93)     0.0000 (1.0)           0;0  0.0153 (0.34)          1           1
test_sharing-fetch[3.53.2]     33.2662 (1.49)     33.2662 (1.49)     33.2662 (1.49)     0.0000 (1.0)      33.2662 (1.49)     0.0000 (1.0)           0;0  0.0301 (0.67)          1           1
test_sharing-fetch[3.60.1]     22.8258 (1.02)     22.8258 (1.02)     22.8258 (1.02)     0.0000 (1.0)      22.8258 (1.02)     0.0000 (1.0)           0;0  0.0438 (0.98)          1           1
test_sharing-fetch[main]       22.3941 (1.0)      22.3941 (1.0)      22.3941 (1.0)      0.0000 (1.0)      22.3941 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2605 (1.0)      1.2605 (1.0)      1.2605 (1.0)      0.0000 (1.0)      1.2605 (1.0)      0.0000 (1.0)           0;0  0.7933 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6284 (2.88)     3.6284 (2.88)     3.6284 (2.88)     0.0000 (1.0)      3.6284 (2.88)     0.0000 (1.0)           0;0  0.2756 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.9634 (4.73)     5.9634 (4.73)     5.9634 (4.73)     0.0000 (1.0)      5.9634 (4.73)     0.0000 (1.0)           0;0  0.1677 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.9651 (4.73)     5.9651 (4.73)     5.9651 (4.73)     0.0000 (1.0)      5.9651 (4.73)     0.0000 (1.0)           0;0  0.1676 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9587 (4.73)     5.9587 (4.73)     5.9587 (4.73)     0.0000 (1.0)      5.9587 (4.73)     0.0000 (1.0)           0;0  0.1678 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     47.8450 (2.16)     47.8450 (2.16)     47.8450 (2.16)     0.0000 (1.0)      47.8450 (2.16)     0.0000 (1.0)           0;0  0.0209 (0.46)          1           1
test_sharing-push[3.10.0]     42.6114 (1.92)     42.6114 (1.92)     42.6114 (1.92)     0.0000 (1.0)      42.6114 (1.92)     0.0000 (1.0)           0;0  0.0235 (0.52)          1           1
test_sharing-push[3.53.2]     22.3680 (1.01)     22.3680 (1.01)     22.3680 (1.01)     0.0000 (1.0)      22.3680 (1.01)     0.0000 (1.0)           0;0  0.0447 (0.99)          1           1
test_sharing-push[3.60.1]     22.1758 (1.0)      22.1758 (1.0)      22.1758 (1.0)      0.0000 (1.0)      22.1758 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
test_sharing-push[main]       22.2793 (1.00)     22.2793 (1.00)     22.2793 (1.00)     0.0000 (1.0)      22.2793 (1.00)     0.0000 (1.0)           0;0  0.0449 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0399 (1.0)      2.0399 (1.0)      2.0399 (1.0)      0.0000 (1.0)      2.0399 (1.0)      0.0000 (1.0)           0;0  0.4902 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1173 (1.04)     2.1173 (1.04)     2.1173 (1.04)     0.0000 (1.0)      2.1173 (1.04)     0.0000 (1.0)           0;0  0.4723 (0.96)          1           1
test_sharing-push-noop[3.53.2]     6.1047 (2.99)     6.1047 (2.99)     6.1047 (2.99)     0.0000 (1.0)      6.1047 (2.99)     0.0000 (1.0)           0;0  0.1638 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.0228 (2.95)     6.0228 (2.95)     6.0228 (2.95)     0.0000 (1.0)      6.0228 (2.95)     0.0000 (1.0)           0;0  0.1660 (0.34)          1           1
test_sharing-push-noop[main]       6.0819 (2.98)     6.0819 (2.98)     6.0819 (2.98)     0.0000 (1.0)      6.0819 (2.98)     0.0000 (1.0)           0;0  0.1644 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     222.8376 (1.04)     222.8376 (1.04)     222.8376 (1.04)     0.0000 (1.0)      222.8376 (1.04)     0.0000 (1.0)           0;0  0.0045 (0.96)          1           1
test_sharing_azure-fetch[main]       214.3429 (1.0)      214.3429 (1.0)      214.3429 (1.0)      0.0000 (1.0)      214.3429 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.2418 (1.0)      6.2418 (1.0)      6.2418 (1.0)      0.0000 (1.0)      6.2418 (1.0)      0.0000 (1.0)           0;0  0.1602 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4066 (1.03)     6.4066 (1.03)     6.4066 (1.03)     0.0000 (1.0)      6.4066 (1.03)     0.0000 (1.0)           0;0  0.1561 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     219.6488 (1.0)      219.6488 (1.0)      219.6488 (1.0)      0.0000 (1.0)      219.6488 (1.0)      0.0000 (1.0)           0;0  0.0046 (1.0)           1           1
test_sharing_azure-push[main]       221.4245 (1.01)     221.4245 (1.01)     221.4245 (1.01)     0.0000 (1.0)      221.4245 (1.01)     0.0000 (1.0)           0;0  0.0045 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.9352 (1.0)      6.9352 (1.0)      6.9352 (1.0)      0.0000 (1.0)      6.9352 (1.0)      0.0000 (1.0)           0;0  0.1442 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.9987 (1.01)     6.9987 (1.01)     6.9987 (1.01)     0.0000 (1.0)      6.9987 (1.01)     0.0000 (1.0)           0;0  0.1429 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     212.6268 (1.02)     212.6268 (1.02)     212.6268 (1.02)     0.0000 (1.0)      212.6268 (1.02)     0.0000 (1.0)           0;0  0.0047 (0.98)          1           1
test_sharing_gs-fetch[main]       208.4777 (1.0)      208.4777 (1.0)      208.4777 (1.0)      0.0000 (1.0)      208.4777 (1.0)      0.0000 (1.0)           0;0  0.0048 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     6.3643 (1.0)      6.3643 (1.0)      6.3643 (1.0)      0.0000 (1.0)      6.3643 (1.0)      0.0000 (1.0)           0;0  0.1571 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       6.4562 (1.01)     6.4562 (1.01)     6.4562 (1.01)     0.0000 (1.0)      6.4562 (1.01)     0.0000 (1.0)           0;0  0.1549 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     551.4600 (1.0)      551.4600 (1.0)      551.4600 (1.0)      0.0000 (1.0)      551.4600 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
test_sharing_gs-push[main]       607.2012 (1.10)     607.2012 (1.10)     607.2012 (1.10)     0.0000 (1.0)      607.2012 (1.10)     0.0000 (1.0)           0;0  0.0016 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.6970 (1.03)     6.6970 (1.03)     6.6970 (1.03)     0.0000 (1.0)      6.6970 (1.03)     0.0000 (1.0)           0;0  0.1493 (0.97)          1           1
test_sharing_gs-push-noop[main]       6.5059 (1.0)      6.5059 (1.0)      6.5059 (1.0)      0.0000 (1.0)      6.5059 (1.0)      0.0000 (1.0)           0;0  0.1537 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     745.6560 (1.02)     745.6560 (1.02)     745.6560 (1.02)     0.0000 (1.0)      745.6560 (1.02)     0.0000 (1.0)           0;0  0.0013 (0.98)          1           1
test_sharing_s3-fetch[main]       733.1987 (1.0)      733.1987 (1.0)      733.1987 (1.0)      0.0000 (1.0)      733.1987 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.7400 (1.0)      6.7400 (1.0)      6.7400 (1.0)      0.0000 (1.0)      6.7400 (1.0)      0.0000 (1.0)           0;0  0.1484 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7764 (1.01)     6.7764 (1.01)     6.7764 (1.01)     0.0000 (1.0)      6.7764 (1.01)     0.0000 (1.0)           0;0  0.1476 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,152.9046 (1.00)     1,152.9046 (1.00)     1,152.9046 (1.00)     0.0000 (1.0)      1,152.9046 (1.00)     0.0000 (1.0)           0;0  0.0009 (1.00)          1           1
test_sharing_s3-push[main]       1,151.6226 (1.0)      1,151.6226 (1.0)      1,151.6226 (1.0)      0.0000 (1.0)      1,151.6226 (1.0)      0.0000 (1.0)           0;0  0.0009 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.4400 (1.0)      7.4400 (1.0)      7.4400 (1.0)      0.0000 (1.0)      7.4400 (1.0)      0.0000 (1.0)           0;0  0.1344 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.4771 (1.00)     7.4771 (1.00)     7.4771 (1.00)     0.0000 (1.0)      7.4771 (1.00)     0.0000 (1.0)           0;0  0.1337 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.2510 (3.63)     19.2510 (3.63)     19.2510 (3.63)     0.0000 (1.0)      19.2510 (3.63)     0.0000 (1.0)           0;0  0.0519 (0.28)          1           1
test_status-status[3.10.0]     20.0564 (3.78)     20.0564 (3.78)     20.0564 (3.78)     0.0000 (1.0)      20.0564 (3.78)     0.0000 (1.0)           0;0  0.0499 (0.26)          1           1
test_status-status[3.53.2]     18.1850 (3.42)     18.1850 (3.42)     18.1850 (3.42)     0.0000 (1.0)      18.1850 (3.42)     0.0000 (1.0)           0;0  0.0550 (0.29)          1           1
test_status-status[3.60.1]      5.3103 (1.0)       5.3103 (1.0)       5.3103 (1.0)      0.0000 (1.0)       5.3103 (1.0)      0.0000 (1.0)           0;0  0.1883 (1.0)           1           1
test_status-status[main]        5.6692 (1.07)      5.6692 (1.07)      5.6692 (1.07)     0.0000 (1.0)       5.6692 (1.07)     0.0000 (1.0)           0;0  0.1764 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9221 (1.68)     4.9221 (1.68)     4.9221 (1.68)     0.0000 (1.0)      4.9221 (1.68)     0.0000 (1.0)           0;0  0.2032 (0.59)          1           1
test_status-status-changed[3.10.0]     5.3983 (1.85)     5.3983 (1.85)     5.3983 (1.85)     0.0000 (1.0)      5.3983 (1.85)     0.0000 (1.0)           0;0  0.1852 (0.54)          1           1
test_status-status-changed[3.53.2]     5.1013 (1.74)     5.1013 (1.74)     5.1013 (1.74)     0.0000 (1.0)      5.1013 (1.74)     0.0000 (1.0)           0;0  0.1960 (0.57)          1           1
test_status-status-changed[3.60.1]     2.9250 (1.0)      2.9250 (1.0)      2.9250 (1.0)      0.0000 (1.0)      2.9250 (1.0)      0.0000 (1.0)           0;0  0.3419 (1.0)           1           1
test_status-status-changed[main]       3.1823 (1.09)     3.1823 (1.09)     3.1823 (1.09)     0.0000 (1.0)      3.1823 (1.09)     0.0000 (1.0)           0;0  0.3142 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9274 (1.75)     4.9274 (1.75)     4.9274 (1.75)     0.0000 (1.0)      4.9274 (1.75)     0.0000 (1.0)           0;0  0.2029 (0.57)          1           1
test_status-status-changed-noop[3.10.0]     5.0112 (1.78)     5.0112 (1.78)     5.0112 (1.78)     0.0000 (1.0)      5.0112 (1.78)     0.0000 (1.0)           0;0  0.1996 (0.56)          1           1
test_status-status-changed-noop[3.53.2]     5.1164 (1.81)     5.1164 (1.81)     5.1164 (1.81)     0.0000 (1.0)      5.1164 (1.81)     0.0000 (1.0)           0;0  0.1954 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.8195 (1.0)      2.8195 (1.0)      2.8195 (1.0)      0.0000 (1.0)      2.8195 (1.0)      0.0000 (1.0)           0;0  0.3547 (1.0)           1           1
test_status-status-changed-noop[main]       2.9470 (1.05)     2.9470 (1.05)     2.9470 (1.05)     0.0000 (1.0)      2.9470 (1.05)     0.0000 (1.0)           0;0  0.3393 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9833 (1.80)     4.9833 (1.80)     4.9833 (1.80)     0.0000 (1.0)      4.9833 (1.80)     0.0000 (1.0)           0;0  0.2007 (0.56)          1           1
test_status-status-noop[3.10.0]     5.2305 (1.89)     5.2305 (1.89)     5.2305 (1.89)     0.0000 (1.0)      5.2305 (1.89)     0.0000 (1.0)           0;0  0.1912 (0.53)          1           1
test_status-status-noop[3.53.2]     5.1534 (1.86)     5.1534 (1.86)     5.1534 (1.86)     0.0000 (1.0)      5.1534 (1.86)     0.0000 (1.0)           0;0  0.1940 (0.54)          1           1
test_status-status-noop[3.60.1]     2.7666 (1.0)      2.7666 (1.0)      2.7666 (1.0)      0.0000 (1.0)      2.7666 (1.0)      0.0000 (1.0)           0;0  0.3615 (1.0)           1           1
test_status-status-noop[main]       3.1133 (1.13)     3.1133 (1.13)     3.1133 (1.13)     0.0000 (1.0)      3.1133 (1.13)     0.0000 (1.0)           0;0  0.3212 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     151.9221 (3.28)     151.9221 (3.28)     151.9221 (3.28)     0.0000 (1.0)      151.9221 (3.28)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_update-import-url[3.10.0]     155.6006 (3.36)     155.6006 (3.36)     155.6006 (3.36)     0.0000 (1.0)      155.6006 (3.36)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.53.2]     116.1882 (2.51)     116.1882 (2.51)     116.1882 (2.51)     0.0000 (1.0)      116.1882 (2.51)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.2540 (1.0)       46.2540 (1.0)       46.2540 (1.0)      0.0000 (1.0)       46.2540 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        47.3938 (1.02)      47.3938 (1.02)      47.3938 (1.02)     0.0000 (1.0)       47.3938 (1.02)     0.0000 (1.0)           0;0  0.0211 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     136.4944 (3.87)     136.4944 (3.87)     136.4944 (3.87)     0.0000 (1.0)      136.4944 (3.87)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     142.0555 (4.03)     142.0555 (4.03)     142.0555 (4.03)     0.0000 (1.0)      142.0555 (4.03)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     108.8171 (3.09)     108.8171 (3.09)     108.8171 (3.09)     0.0000 (1.0)      108.8171 (3.09)     0.0000 (1.0)           0;0  0.0092 (0.32)          1           1
test_update-update[3.60.1]      35.2590 (1.0)       35.2590 (1.0)       35.2590 (1.0)      0.0000 (1.0)       35.2590 (1.0)      0.0000 (1.0)           0;0  0.0284 (1.0)           1           1
test_update-update[main]        36.3197 (1.03)      36.3197 (1.03)      36.3197 (1.03)     0.0000 (1.0)       36.3197 (1.03)     0.0000 (1.0)           0;0  0.0275 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.7856 (2.18)     16.7856 (2.18)     16.7856 (2.18)     0.0000 (1.0)      16.7856 (2.18)     0.0000 (1.0)           0;0  0.0596 (0.46)          1           1
test_update-update-noop[3.10.0]     17.5713 (2.28)     17.5713 (2.28)     17.5713 (2.28)     0.0000 (1.0)      17.5713 (2.28)     0.0000 (1.0)           0;0  0.0569 (0.44)          1           1
test_update-update-noop[3.53.2]     16.8529 (2.19)     16.8529 (2.19)     16.8529 (2.19)     0.0000 (1.0)      16.8529 (2.19)     0.0000 (1.0)           0;0  0.0593 (0.46)          1           1
test_update-update-noop[3.60.1]      7.7109 (1.0)       7.7109 (1.0)       7.7109 (1.0)      0.0000 (1.0)       7.7109 (1.0)      0.0000 (1.0)           0;0  0.1297 (1.0)           1           1
test_update-update-noop[main]        8.3504 (1.08)      8.3504 (1.08)      8.3504 (1.08)     0.0000 (1.0)       8.3504 (1.08)     0.0000 (1.0)           0;0  0.1198 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean