Wed Oct 29 01:07:25 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     82.9663 (3.76)     82.9663 (3.76)     82.9663 (3.76)     0.0000 (1.0)      82.9663 (3.76)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_add_copy-add[3.10.0]     83.5019 (3.79)     83.5019 (3.79)     83.5019 (3.79)     0.0000 (1.0)      83.5019 (3.79)     0.0000 (1.0)           0;0  0.0120 (0.26)          1           1
test_add_copy-add[3.53.2]     75.1684 (3.41)     75.1684 (3.41)     75.1684 (3.41)     0.0000 (1.0)      75.1684 (3.41)     0.0000 (1.0)           0;0  0.0133 (0.29)          1           1
test_add_copy-add[3.60.1]     22.0466 (1.0)      22.0466 (1.0)      22.0466 (1.0)      0.0000 (1.0)      22.0466 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
test_add_copy-add[main]       23.4115 (1.06)     23.4115 (1.06)     23.4115 (1.06)     0.0000 (1.0)      23.4115 (1.06)     0.0000 (1.0)           0;0  0.0427 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.8821 (6.63)     27.8821 (6.63)     27.8821 (6.63)     0.0000 (1.0)      27.8821 (6.63)     0.0000 (1.0)           0;0  0.0359 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.5499 (6.78)     28.5499 (6.78)     28.5499 (6.78)     0.0000 (1.0)      28.5499 (6.78)     0.0000 (1.0)           0;0  0.0350 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.6462 (6.33)     26.6462 (6.33)     26.6462 (6.33)     0.0000 (1.0)      26.6462 (6.33)     0.0000 (1.0)           0;0  0.0375 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.2081 (1.0)       4.2081 (1.0)       4.2081 (1.0)      0.0000 (1.0)       4.2081 (1.0)      0.0000 (1.0)           0;0  0.2376 (1.0)           1           1
test_add_copy-add-noop[main]        4.2971 (1.02)      4.2971 (1.02)      4.2971 (1.02)     0.0000 (1.0)       4.2971 (1.02)     0.0000 (1.0)           0;0  0.2327 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     65.1737 (3.99)     65.1737 (3.99)     65.1737 (3.99)     0.0000 (1.0)      65.1737 (3.99)     0.0000 (1.0)           0;0  0.0153 (0.25)          1           1
test_add_hardlink-add[3.10.0]     65.9407 (4.03)     65.9407 (4.03)     65.9407 (4.03)     0.0000 (1.0)      65.9407 (4.03)     0.0000 (1.0)           0;0  0.0152 (0.25)          1           1
test_add_hardlink-add[3.53.2]     60.2240 (3.68)     60.2240 (3.68)     60.2240 (3.68)     0.0000 (1.0)      60.2240 (3.68)     0.0000 (1.0)           0;0  0.0166 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.3470 (1.0)      16.3470 (1.0)      16.3470 (1.0)      0.0000 (1.0)      16.3470 (1.0)      0.0000 (1.0)           0;0  0.0612 (1.0)           1           1
test_add_hardlink-add[main]       17.7919 (1.09)     17.7919 (1.09)     17.7919 (1.09)     0.0000 (1.0)      17.7919 (1.09)     0.0000 (1.0)           0;0  0.0562 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.9047 (7.37)     32.9047 (7.37)     32.9047 (7.37)     0.0000 (1.0)      32.9047 (7.37)     0.0000 (1.0)           0;0  0.0304 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     34.1473 (7.65)     34.1473 (7.65)     34.1473 (7.65)     0.0000 (1.0)      34.1473 (7.65)     0.0000 (1.0)           0;0  0.0293 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.7510 (7.11)     31.7510 (7.11)     31.7510 (7.11)     0.0000 (1.0)      31.7510 (7.11)     0.0000 (1.0)           0;0  0.0315 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.4648 (1.0)       4.4648 (1.0)       4.4648 (1.0)      0.0000 (1.0)       4.4648 (1.0)      0.0000 (1.0)           0;0  0.2240 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.6343 (1.04)      4.6343 (1.04)      4.6343 (1.04)     0.0000 (1.0)       4.6343 (1.04)     0.0000 (1.0)           0;0  0.2158 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     70.2493 (1.99)     70.2493 (1.99)     70.2493 (1.99)     0.0000 (1.0)      70.2493 (1.99)     0.0000 (1.0)           0;0  0.0142 (0.50)          1           1
test_add_symlink-add[3.10.0]     71.1948 (2.02)     71.1948 (2.02)     71.1948 (2.02)     0.0000 (1.0)      71.1948 (2.02)     0.0000 (1.0)           0;0  0.0140 (0.50)          1           1
test_add_symlink-add[3.53.2]     65.9186 (1.87)     65.9186 (1.87)     65.9186 (1.87)     0.0000 (1.0)      65.9186 (1.87)     0.0000 (1.0)           0;0  0.0152 (0.54)          1           1
test_add_symlink-add[3.60.1]     35.3205 (1.0)      35.3205 (1.0)      35.3205 (1.0)      0.0000 (1.0)      35.3205 (1.0)      0.0000 (1.0)           0;0  0.0283 (1.0)           1           1
test_add_symlink-add[main]       36.0958 (1.02)     36.0958 (1.02)     36.0958 (1.02)     0.0000 (1.0)      36.0958 (1.02)     0.0000 (1.0)           0;0  0.0277 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.6923 (8.65)     46.6923 (8.65)     46.6923 (8.65)     0.0000 (1.0)      46.6923 (8.65)     0.0000 (1.0)           0;0  0.0214 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.3014 (8.76)     47.3014 (8.76)     47.3014 (8.76)     0.0000 (1.0)      47.3014 (8.76)     0.0000 (1.0)           0;0  0.0211 (0.11)          1           1
test_add_symlink-add-noop[3.53.2]     46.2358 (8.56)     46.2358 (8.56)     46.2358 (8.56)     0.0000 (1.0)      46.2358 (8.56)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.3988 (1.0)       5.3988 (1.0)       5.3988 (1.0)      0.0000 (1.0)       5.3988 (1.0)      0.0000 (1.0)           0;0  0.1852 (1.0)           1           1
test_add_symlink-add-noop[main]        5.7124 (1.06)      5.7124 (1.06)      5.7124 (1.06)     0.0000 (1.0)       5.7124 (1.06)     0.0000 (1.0)           0;0  0.1751 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.6382 (1.86)     39.6382 (1.86)     39.6382 (1.86)     0.0000 (1.0)      39.6382 (1.86)     0.0000 (1.0)           0;0  0.0252 (0.54)          1           1
test_checkout_copy-checkout[3.10.0]     57.0001 (2.67)     57.0001 (2.67)     57.0001 (2.67)     0.0000 (1.0)      57.0001 (2.67)     0.0000 (1.0)           0;0  0.0175 (0.37)          1           1
test_checkout_copy-checkout[3.53.2]     28.4128 (1.33)     28.4128 (1.33)     28.4128 (1.33)     0.0000 (1.0)      28.4128 (1.33)     0.0000 (1.0)           0;0  0.0352 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     21.3195 (1.0)      21.3195 (1.0)      21.3195 (1.0)      0.0000 (1.0)      21.3195 (1.0)      0.0000 (1.0)           0;0  0.0469 (1.0)           1           1
test_checkout_copy-checkout[main]       22.3536 (1.05)     22.3536 (1.05)     22.3536 (1.05)     0.0000 (1.0)      22.3536 (1.05)     0.0000 (1.0)           0;0  0.0447 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6942 (1.69)     5.6942 (1.69)     5.6942 (1.69)     0.0000 (1.0)      5.6942 (1.69)     0.0000 (1.0)           0;0  0.1756 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9287 (1.76)     5.9287 (1.76)     5.9287 (1.76)     0.0000 (1.0)      5.9287 (1.76)     0.0000 (1.0)           0;0  0.1687 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6648 (1.68)     5.6648 (1.68)     5.6648 (1.68)     0.0000 (1.0)      5.6648 (1.68)     0.0000 (1.0)           0;0  0.1765 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3770 (1.0)      3.3770 (1.0)      3.3770 (1.0)      0.0000 (1.0)      3.3770 (1.0)      0.0000 (1.0)           0;0  0.2961 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4529 (1.02)     3.4529 (1.02)     3.4529 (1.02)     0.0000 (1.0)      3.4529 (1.02)     0.0000 (1.0)           0;0  0.2896 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9981 (1.94)     7.9981 (1.94)     7.9981 (1.94)     0.0000 (1.0)      7.9981 (1.94)     0.0000 (1.0)           0;0  0.1250 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6468 (1.61)     6.6468 (1.61)     6.6468 (1.61)     0.0000 (1.0)      6.6468 (1.61)     0.0000 (1.0)           0;0  0.1504 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5180 (1.58)     6.5180 (1.58)     6.5180 (1.58)     0.0000 (1.0)      6.5180 (1.58)     0.0000 (1.0)           0;0  0.1534 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.1240 (1.0)      4.1240 (1.0)      4.1240 (1.0)      0.0000 (1.0)      4.1240 (1.0)      0.0000 (1.0)           0;0  0.2425 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4144 (1.07)     4.4144 (1.07)     4.4144 (1.07)     0.0000 (1.0)      4.4144 (1.07)     0.0000 (1.0)           0;0  0.2265 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.6636 (2.84)     21.6636 (2.84)     21.6636 (2.84)     0.0000 (1.0)      21.6636 (2.84)     0.0000 (1.0)           0;0  0.0462 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.8817 (2.21)     16.8817 (2.21)     16.8817 (2.21)     0.0000 (1.0)      16.8817 (2.21)     0.0000 (1.0)           0;0  0.0592 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.9520 (1.96)     14.9520 (1.96)     14.9520 (1.96)     0.0000 (1.0)      14.9520 (1.96)     0.0000 (1.0)           0;0  0.0669 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6403 (1.0)       7.6403 (1.0)       7.6403 (1.0)      0.0000 (1.0)       7.6403 (1.0)      0.0000 (1.0)           0;0  0.1309 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.3422 (1.09)      8.3422 (1.09)      8.3422 (1.09)     0.0000 (1.0)       8.3422 (1.09)     0.0000 (1.0)           0;0  0.1199 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5449 (1.69)     5.5449 (1.69)     5.5449 (1.69)     0.0000 (1.0)      5.5449 (1.69)     0.0000 (1.0)           0;0  0.1803 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7330 (1.74)     5.7330 (1.74)     5.7330 (1.74)     0.0000 (1.0)      5.7330 (1.74)     0.0000 (1.0)           0;0  0.1744 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5882 (1.70)     5.5882 (1.70)     5.5882 (1.70)     0.0000 (1.0)      5.5882 (1.70)     0.0000 (1.0)           0;0  0.1789 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2884 (1.0)      3.2884 (1.0)      3.2884 (1.0)      0.0000 (1.0)      3.2884 (1.0)      0.0000 (1.0)           0;0  0.3041 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4276 (1.04)     3.4276 (1.04)     3.4276 (1.04)     0.0000 (1.0)      3.4276 (1.04)     0.0000 (1.0)           0;0  0.2918 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.1359 (2.09)     8.1359 (2.09)     8.1359 (2.09)     0.0000 (1.0)      8.1359 (2.09)     0.0000 (1.0)           0;0  0.1229 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4760 (1.67)     6.4760 (1.67)     6.4760 (1.67)     0.0000 (1.0)      6.4760 (1.67)     0.0000 (1.0)           0;0  0.1544 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4412 (1.66)     6.4412 (1.66)     6.4412 (1.66)     0.0000 (1.0)      6.4412 (1.66)     0.0000 (1.0)           0;0  0.1553 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8875 (1.0)      3.8875 (1.0)      3.8875 (1.0)      0.0000 (1.0)      3.8875 (1.0)      0.0000 (1.0)           0;0  0.2572 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4557 (1.15)     4.4557 (1.15)     4.4557 (1.15)     0.0000 (1.0)      4.4557 (1.15)     0.0000 (1.0)           0;0  0.2244 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.8993 (2.42)     24.8993 (2.42)     24.8993 (2.42)     0.0000 (1.0)      24.8993 (2.42)     0.0000 (1.0)           0;0  0.0402 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     19.3542 (1.88)     19.3542 (1.88)     19.3542 (1.88)     0.0000 (1.0)      19.3542 (1.88)     0.0000 (1.0)           0;0  0.0517 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.6791 (1.71)     17.6791 (1.71)     17.6791 (1.71)     0.0000 (1.0)      17.6791 (1.71)     0.0000 (1.0)           0;0  0.0566 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.3093 (1.0)      10.3093 (1.0)      10.3093 (1.0)      0.0000 (1.0)      10.3093 (1.0)      0.0000 (1.0)           0;0  0.0970 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.5137 (1.12)     11.5137 (1.12)     11.5137 (1.12)     0.0000 (1.0)      11.5137 (1.12)     0.0000 (1.0)           0;0  0.0869 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6589 (1.60)     6.6589 (1.60)     6.6589 (1.60)     0.0000 (1.0)      6.6589 (1.60)     0.0000 (1.0)           0;0  0.1502 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7979 (1.63)     6.7979 (1.63)     6.7979 (1.63)     0.0000 (1.0)      6.7979 (1.63)     0.0000 (1.0)           0;0  0.1471 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6591 (1.60)     6.6591 (1.60)     6.6591 (1.60)     0.0000 (1.0)      6.6591 (1.60)     0.0000 (1.0)           0;0  0.1502 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1652 (1.0)      4.1652 (1.0)      4.1652 (1.0)      0.0000 (1.0)      4.1652 (1.0)      0.0000 (1.0)           0;0  0.2401 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3619 (1.05)     4.3619 (1.05)     4.3619 (1.05)     0.0000 (1.0)      4.3619 (1.05)     0.0000 (1.0)           0;0  0.2293 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.9649 (1.77)     9.9649 (1.77)     9.9649 (1.77)     0.0000 (1.0)      9.9649 (1.77)     0.0000 (1.0)           0;0  0.1004 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.6371 (1.53)     8.6371 (1.53)     8.6371 (1.53)     0.0000 (1.0)      8.6371 (1.53)     0.0000 (1.0)           0;0  0.1158 (0.65)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.4286 (1.50)     8.4286 (1.50)     8.4286 (1.50)     0.0000 (1.0)      8.4286 (1.50)     0.0000 (1.0)           0;0  0.1186 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.6368 (1.0)      5.6368 (1.0)      5.6368 (1.0)      0.0000 (1.0)      5.6368 (1.0)      0.0000 (1.0)           0;0  0.1774 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.1095 (1.08)     6.1095 (1.08)     6.1095 (1.08)     0.0000 (1.0)      6.1095 (1.08)     0.0000 (1.0)           0;0  0.1637 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1113 (1.72)     4.1113 (1.72)     4.1113 (1.72)     0.0000 (1.0)      4.1113 (1.72)     0.0000 (1.0)           0;0  0.2432 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7100 (1.97)     4.7100 (1.97)     4.7100 (1.97)     0.0000 (1.0)      4.7100 (1.97)     0.0000 (1.0)           0;0  0.2123 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.7509 (1.98)     4.7509 (1.98)     4.7509 (1.98)     0.0000 (1.0)      4.7509 (1.98)     0.0000 (1.0)           0;0  0.2105 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3937 (1.0)      2.3937 (1.0)      2.3937 (1.0)      0.0000 (1.0)      2.3937 (1.0)      0.0000 (1.0)           0;0  0.4178 (1.0)           1           1
test_data_status-data-changed[main]       2.6109 (1.09)     2.6109 (1.09)     2.6109 (1.09)     0.0000 (1.0)      2.6109 (1.09)     0.0000 (1.0)           0;0  0.3830 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2385 (1.77)     4.2385 (1.77)     4.2385 (1.77)     0.0000 (1.0)      4.2385 (1.77)     0.0000 (1.0)           0;0  0.2359 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8528 (2.02)     4.8528 (2.02)     4.8528 (2.02)     0.0000 (1.0)      4.8528 (2.02)     0.0000 (1.0)           0;0  0.2061 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6761 (1.95)     4.6761 (1.95)     4.6761 (1.95)     0.0000 (1.0)      4.6761 (1.95)     0.0000 (1.0)           0;0  0.2139 (0.51)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3997 (1.0)      2.3997 (1.0)      2.3997 (1.0)      0.0000 (1.0)      2.3997 (1.0)      0.0000 (1.0)           0;0  0.4167 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6788 (1.12)     2.6788 (1.12)     2.6788 (1.12)     0.0000 (1.0)      2.6788 (1.12)     0.0000 (1.0)           0;0  0.3733 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.0209 (3.71)     18.0209 (3.71)     18.0209 (3.71)     0.0000 (1.0)      18.0209 (3.71)     0.0000 (1.0)           0;0  0.0555 (0.27)          1           1
test_data_status-data-new[3.10.0]     18.4887 (3.81)     18.4887 (3.81)     18.4887 (3.81)     0.0000 (1.0)      18.4887 (3.81)     0.0000 (1.0)           0;0  0.0541 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.6386 (3.84)     18.6386 (3.84)     18.6386 (3.84)     0.0000 (1.0)      18.6386 (3.84)     0.0000 (1.0)           0;0  0.0537 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8533 (1.0)       4.8533 (1.0)       4.8533 (1.0)      0.0000 (1.0)       4.8533 (1.0)      0.0000 (1.0)           0;0  0.2060 (1.0)           1           1
test_data_status-data-new[main]        5.2404 (1.08)      5.2404 (1.08)      5.2404 (1.08)     0.0000 (1.0)       5.2404 (1.08)     0.0000 (1.0)           0;0  0.1908 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0856 (1.67)     4.0856 (1.67)     4.0856 (1.67)     0.0000 (1.0)      4.0856 (1.67)     0.0000 (1.0)           0;0  0.2448 (0.60)          1           1
test_data_status-data-noop[3.10.0]     4.8745 (1.99)     4.8745 (1.99)     4.8745 (1.99)     0.0000 (1.0)      4.8745 (1.99)     0.0000 (1.0)           0;0  0.2052 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.7942 (1.96)     4.7942 (1.96)     4.7942 (1.96)     0.0000 (1.0)      4.7942 (1.96)     0.0000 (1.0)           0;0  0.2086 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.4482 (1.0)      2.4482 (1.0)      2.4482 (1.0)      0.0000 (1.0)      2.4482 (1.0)      0.0000 (1.0)           0;0  0.4085 (1.0)           1           1
test_data_status-data-noop[main]       2.6846 (1.10)     2.6846 (1.10)     2.6846 (1.10)     0.0000 (1.0)      2.6846 (1.10)     0.0000 (1.0)           0;0  0.3725 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.0500 (1.26)     7.0500 (1.26)     7.0500 (1.26)     0.0000 (1.0)      7.0500 (1.26)     0.0000 (1.0)           0;0  0.1418 (0.79)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8668 (1.41)     7.8668 (1.41)     7.8668 (1.41)     0.0000 (1.0)      7.8668 (1.41)     0.0000 (1.0)           0;0  0.1271 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8856 (1.41)     7.8856 (1.41)     7.8856 (1.41)     0.0000 (1.0)      7.8856 (1.41)     0.0000 (1.0)           0;0  0.1268 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5809 (1.0)      5.5809 (1.0)      5.5809 (1.0)      0.0000 (1.0)      5.5809 (1.0)      0.0000 (1.0)           0;0  0.1792 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.6591 (1.01)     5.6591 (1.01)     5.6591 (1.01)     0.0000 (1.0)      5.6591 (1.01)     0.0000 (1.0)           0;0  0.1767 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1601 (1.28)     7.1601 (1.28)     7.1601 (1.28)     0.0000 (1.0)      7.1601 (1.28)     0.0000 (1.0)           0;0  0.1397 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8303 (1.40)     7.8303 (1.40)     7.8303 (1.40)     0.0000 (1.0)      7.8303 (1.40)     0.0000 (1.0)           0;0  0.1277 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.9507 (1.42)     7.9507 (1.42)     7.9507 (1.42)     0.0000 (1.0)      7.9507 (1.42)     0.0000 (1.0)           0;0  0.1258 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6010 (1.0)      5.6010 (1.0)      5.6010 (1.0)      0.0000 (1.0)      5.6010 (1.0)      0.0000 (1.0)           0;0  0.1785 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.7614 (1.03)     5.7614 (1.03)     5.7614 (1.03)     0.0000 (1.0)      5.7614 (1.03)     0.0000 (1.0)           0;0  0.1736 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.6760 (2.69)     21.6760 (2.69)     21.6760 (2.69)     0.0000 (1.0)      21.6760 (2.69)     0.0000 (1.0)           0;0  0.0461 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.7279 (2.82)     22.7279 (2.82)     22.7279 (2.82)     0.0000 (1.0)      22.7279 (2.82)     0.0000 (1.0)           0;0  0.0440 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.2705 (2.76)     22.2705 (2.76)     22.2705 (2.76)     0.0000 (1.0)      22.2705 (2.76)     0.0000 (1.0)           0;0  0.0449 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0690 (1.0)       8.0690 (1.0)       8.0690 (1.0)      0.0000 (1.0)       8.0690 (1.0)      0.0000 (1.0)           0;0  0.1239 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.5465 (1.06)      8.5465 (1.06)      8.5465 (1.06)     0.0000 (1.0)       8.5465 (1.06)     0.0000 (1.0)           0;0  0.1170 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.7251 (1.37)     6.7251 (1.37)     6.7251 (1.37)     0.0000 (1.0)      6.7251 (1.37)     0.0000 (1.0)           0;0  0.1487 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2991 (1.49)     7.2991 (1.49)     7.2991 (1.49)     0.0000 (1.0)      7.2991 (1.49)     0.0000 (1.0)           0;0  0.1370 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.3190 (1.50)     7.3190 (1.50)     7.3190 (1.50)     0.0000 (1.0)      7.3190 (1.50)     0.0000 (1.0)           0;0  0.1366 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8929 (1.0)      4.8929 (1.0)      4.8929 (1.0)      0.0000 (1.0)      4.8929 (1.0)      0.0000 (1.0)           0;0  0.2044 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0954 (1.04)     5.0954 (1.04)     5.0954 (1.04)     0.0000 (1.0)      5.0954 (1.04)     0.0000 (1.0)           0;0  0.1963 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.1685 (2.66)     18.1685 (2.66)     18.1685 (2.66)     0.0000 (1.0)      18.1685 (2.66)     0.0000 (1.0)           0;0  0.0550 (0.38)          1           1
test_diff-diff[3.10.0]     19.1717 (2.80)     19.1717 (2.80)     19.1717 (2.80)     0.0000 (1.0)      19.1717 (2.80)     0.0000 (1.0)           0;0  0.0522 (0.36)          1           1
test_diff-diff[3.53.2]     18.8951 (2.76)     18.8951 (2.76)     18.8951 (2.76)     0.0000 (1.0)      18.8951 (2.76)     0.0000 (1.0)           0;0  0.0529 (0.36)          1           1
test_diff-diff[3.60.1]      6.8393 (1.0)       6.8393 (1.0)       6.8393 (1.0)      0.0000 (1.0)       6.8393 (1.0)      0.0000 (1.0)           0;0  0.1462 (1.0)           1           1
test_diff-diff[main]        7.9391 (1.16)      7.9391 (1.16)      7.9391 (1.16)     0.0000 (1.0)       7.9391 (1.16)     0.0000 (1.0)           0;0  0.1260 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0454 (1.77)     6.0454 (1.77)     6.0454 (1.77)     0.0000 (1.0)      6.0454 (1.77)     0.0000 (1.0)           0;0  0.1654 (0.57)          1           1
test_diff-diff-changed[3.10.0]     6.6290 (1.94)     6.6290 (1.94)     6.6290 (1.94)     0.0000 (1.0)      6.6290 (1.94)     0.0000 (1.0)           0;0  0.1509 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.7683 (1.69)     5.7683 (1.69)     5.7683 (1.69)     0.0000 (1.0)      5.7683 (1.69)     0.0000 (1.0)           0;0  0.1734 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.4216 (1.0)      3.4216 (1.0)      3.4216 (1.0)      0.0000 (1.0)      3.4216 (1.0)      0.0000 (1.0)           0;0  0.2923 (1.0)           1           1
test_diff-diff-changed[main]       4.2192 (1.23)     4.2192 (1.23)     4.2192 (1.23)     0.0000 (1.0)      4.2192 (1.23)     0.0000 (1.0)           0;0  0.2370 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3812 (1.57)     5.3812 (1.57)     5.3812 (1.57)     0.0000 (1.0)      5.3812 (1.57)     0.0000 (1.0)           0;0  0.1858 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8667 (1.72)     5.8667 (1.72)     5.8667 (1.72)     0.0000 (1.0)      5.8667 (1.72)     0.0000 (1.0)           0;0  0.1705 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.7707 (1.69)     5.7707 (1.69)     5.7707 (1.69)     0.0000 (1.0)      5.7707 (1.69)     0.0000 (1.0)           0;0  0.1733 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4178 (1.0)      3.4178 (1.0)      3.4178 (1.0)      0.0000 (1.0)      3.4178 (1.0)      0.0000 (1.0)           0;0  0.2926 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.3974 (1.29)     4.3974 (1.29)     4.3974 (1.29)     0.0000 (1.0)      4.3974 (1.29)     0.0000 (1.0)           0;0  0.2274 (0.78)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2077 (1.23)     4.2077 (1.23)     4.2077 (1.23)     0.0000 (1.0)      4.2077 (1.23)     0.0000 (1.0)           0;0  0.2377 (0.81)          1           1
test_diff-diff-noop[3.10.0]     5.0488 (1.47)     5.0488 (1.47)     5.0488 (1.47)     0.0000 (1.0)      5.0488 (1.47)     0.0000 (1.0)           0;0  0.1981 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.6281 (1.64)     5.6281 (1.64)     5.6281 (1.64)     0.0000 (1.0)      5.6281 (1.64)     0.0000 (1.0)           0;0  0.1777 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.4251 (1.0)      3.4251 (1.0)      3.4251 (1.0)      0.0000 (1.0)      3.4251 (1.0)      0.0000 (1.0)           0;0  0.2920 (1.0)           1           1
test_diff-diff-noop[main]       4.2570 (1.24)     4.2570 (1.24)     4.2570 (1.24)     0.0000 (1.0)      4.2570 (1.24)     0.0000 (1.0)           0;0  0.2349 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.4091 (1.0)      1.4091 (1.0)      1.4091 (1.0)      0.0000 (1.0)      1.4091 (1.0)      0.0000 (1.0)           0;0  0.7097 (1.0)           1           1
test_exp_show-exp[3.10.0]     6.1357 (4.35)     6.1357 (4.35)     6.1357 (4.35)     0.0000 (1.0)      6.1357 (4.35)     0.0000 (1.0)           0;0  0.1630 (0.23)          1           1
test_exp_show-exp[3.53.2]     5.1737 (3.67)     5.1737 (3.67)     5.1737 (3.67)     0.0000 (1.0)      5.1737 (3.67)     0.0000 (1.0)           0;0  0.1933 (0.27)          1           1
test_exp_show-exp[3.60.1]     4.6816 (3.32)     4.6816 (3.32)     4.6816 (3.32)     0.0000 (1.0)      4.6816 (3.32)     0.0000 (1.0)           0;0  0.2136 (0.30)          1           1
test_exp_show-exp[main]       7.2735 (5.16)     7.2735 (5.16)     7.2735 (5.16)     0.0000 (1.0)      7.2735 (5.16)     0.0000 (1.0)           0;0  0.1375 (0.19)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     61.8443 (2.59)     61.8443 (2.59)     61.8443 (2.59)     0.0000 (1.0)      61.8443 (2.59)     0.0000 (1.0)           0;0  0.0162 (0.39)          1           1
test_fetch-fetch[3.10.0]     67.7561 (2.84)     67.7561 (2.84)     67.7561 (2.84)     0.0000 (1.0)      67.7561 (2.84)     0.0000 (1.0)           0;0  0.0148 (0.35)          1           1
test_fetch-fetch[3.53.2]     34.9596 (1.46)     34.9596 (1.46)     34.9596 (1.46)     0.0000 (1.0)      34.9596 (1.46)     0.0000 (1.0)           0;0  0.0286 (0.68)          1           1
test_fetch-fetch[3.60.1]     23.9737 (1.00)     23.9737 (1.00)     23.9737 (1.00)     0.0000 (1.0)      23.9737 (1.00)     0.0000 (1.0)           0;0  0.0417 (1.00)          1           1
test_fetch-fetch[main]       23.8734 (1.0)      23.8734 (1.0)      23.8734 (1.0)      0.0000 (1.0)      23.8734 (1.0)      0.0000 (1.0)           0;0  0.0419 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9066 (1.0)      2.9066 (1.0)      2.9066 (1.0)      0.0000 (1.0)      2.9066 (1.0)      0.0000 (1.0)           0;0  0.3440 (1.0)           1           1
test_gc-gc[3.10.0]     3.0578 (1.05)     3.0578 (1.05)     3.0578 (1.05)     0.0000 (1.0)      3.0578 (1.05)     0.0000 (1.0)           0;0  0.3270 (0.95)          1           1
test_gc-gc[3.53.2]     3.0073 (1.03)     3.0073 (1.03)     3.0073 (1.03)     0.0000 (1.0)      3.0073 (1.03)     0.0000 (1.0)           0;0  0.3325 (0.97)          1           1
test_gc-gc[3.60.1]     2.9278 (1.01)     2.9278 (1.01)     2.9278 (1.01)     0.0000 (1.0)      2.9278 (1.01)     0.0000 (1.0)           0;0  0.3416 (0.99)          1           1
test_gc-gc[main]       2.9380 (1.01)     2.9380 (1.01)     2.9380 (1.01)     0.0000 (1.0)      2.9380 (1.01)     0.0000 (1.0)           0;0  0.3404 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     130.4264 (2.70)     130.4264 (2.70)     130.4264 (2.70)     0.0000 (1.0)      130.4264 (2.70)     0.0000 (1.0)           0;0  0.0077 (0.37)          1           1
test_get-get[3.10.0]     159.1286 (3.29)     159.1286 (3.29)     159.1286 (3.29)     0.0000 (1.0)      159.1286 (3.29)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_get-get[3.53.2]     141.9808 (2.94)     141.9808 (2.94)     141.9808 (2.94)     0.0000 (1.0)      141.9808 (2.94)     0.0000 (1.0)           0;0  0.0070 (0.34)          1           1
test_get-get[3.60.1]      48.2954 (1.0)       48.2954 (1.0)       48.2954 (1.0)      0.0000 (1.0)       48.2954 (1.0)      0.0000 (1.0)           0;0  0.0207 (1.0)           1           1
test_get-get[main]        48.4106 (1.00)      48.4106 (1.00)      48.4106 (1.00)     0.0000 (1.0)       48.4106 (1.00)     0.0000 (1.0)           0;0  0.0207 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     40.6152 (2.47)     40.6152 (2.47)     40.6152 (2.47)     0.0000 (1.0)      40.6152 (2.47)     0.0000 (1.0)           0;0  0.0246 (0.41)          1           1
test_get_url-get-url[3.10.0]     43.1379 (2.62)     43.1379 (2.62)     43.1379 (2.62)     0.0000 (1.0)      43.1379 (2.62)     0.0000 (1.0)           0;0  0.0232 (0.38)          1           1
test_get_url-get-url[3.53.2]     16.4549 (1.0)      16.4549 (1.0)      16.4549 (1.0)      0.0000 (1.0)      16.4549 (1.0)      0.0000 (1.0)           0;0  0.0608 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.5126 (1.00)     16.5126 (1.00)     16.5126 (1.00)     0.0000 (1.0)      16.5126 (1.00)     0.0000 (1.0)           0;0  0.0606 (1.00)          1           1
test_get_url-get-url[main]       16.4870 (1.00)     16.4870 (1.00)     16.4870 (1.00)     0.0000 (1.0)      16.4870 (1.00)     0.0000 (1.0)           0;0  0.0607 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     132.8991 (1.07)     137.1760 (1.02)     134.5270 (1.07)     0.7847 (1.0)      134.5318 (1.07)     1.1123 (1.45)         29;1  7.4335 (0.94)        100           1
test_help---help[3.10.0]     128.9240 (1.04)     134.5835 (1.0)      130.6258 (1.04)     0.8568 (1.09)     130.5846 (1.04)     1.0171 (1.33)         29;2  7.6555 (0.97)        100           1
test_help---help[3.53.2]     131.7108 (1.06)     143.1140 (1.06)     133.7088 (1.06)     1.4852 (1.89)     133.4589 (1.06)     1.5006 (1.96)         20;2  7.4789 (0.94)        100           1
test_help---help[3.60.1]     132.0155 (1.06)     140.9808 (1.05)     134.2780 (1.06)     1.4405 (1.84)     134.1207 (1.06)     1.5728 (2.05)         26;3  7.4472 (0.94)        100           1
test_help---help[main]       124.3373 (1.0)      136.8640 (1.02)     126.1780 (1.0)      1.2949 (1.65)     126.0343 (1.0)      0.7661 (1.0)           8;5  7.9253 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     217.9339 (2.95)     217.9339 (2.95)     217.9339 (2.95)     0.0000 (1.0)      217.9339 (2.95)     0.0000 (1.0)           0;0  0.0046 (0.34)          1           1
test_import-import[3.10.0]     245.3101 (3.32)     245.3101 (3.32)     245.3101 (3.32)     0.0000 (1.0)      245.3101 (3.32)     0.0000 (1.0)           0;0  0.0041 (0.30)          1           1
test_import-import[3.60.1]      73.8364 (1.0)       73.8364 (1.0)       73.8364 (1.0)      0.0000 (1.0)       73.8364 (1.0)      0.0000 (1.0)           0;0  0.0135 (1.0)           1           1
test_import-import[main]        74.7379 (1.01)      74.7379 (1.01)      74.7379 (1.01)     0.0000 (1.0)       74.7379 (1.01)     0.0000 (1.0)           0;0  0.0134 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     148.9398 (3.26)     148.9398 (3.26)     148.9398 (3.26)     0.0000 (1.0)      148.9398 (3.26)     0.0000 (1.0)           0;0  0.0067 (0.31)          1           1
test_import_url-import-url[3.10.0]     153.1673 (3.36)     153.1673 (3.36)     153.1673 (3.36)     0.0000 (1.0)      153.1673 (3.36)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.53.2]     115.4142 (2.53)     115.4142 (2.53)     115.4142 (2.53)     0.0000 (1.0)      115.4142 (2.53)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_import_url-import-url[3.60.1]      45.6511 (1.0)       45.6511 (1.0)       45.6511 (1.0)      0.0000 (1.0)       45.6511 (1.0)      0.0000 (1.0)           0;0  0.0219 (1.0)           1           1
test_import_url-import-url[main]        46.4300 (1.02)      46.4300 (1.02)      46.4300 (1.02)     0.0000 (1.0)       46.4300 (1.02)     0.0000 (1.0)           0;0  0.0215 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     427.1419 (1.03)     693.0373 (1.40)     454.6434 (1.0)      31.9053 (1.82)     443.8703 (1.0)      33.7125 (1.50)          8;2  2.1995 (1.0)         100           1
test_init-init[3.10.0]     433.1261 (1.05)     523.8246 (1.06)     471.9963 (1.04)     24.0002 (1.37)     475.3701 (1.07)     38.6035 (1.72)         39;0  2.1187 (0.96)        100           1
test_init-init[3.53.2]     414.1717 (1.0)      496.3761 (1.0)      454.9311 (1.00)     18.6789 (1.06)     456.4020 (1.03)     22.4736 (1.0)          32;0  2.1981 (1.00)        100           1
test_init-init[3.60.1]     427.5636 (1.03)     500.2798 (1.01)     456.9961 (1.01)     17.5767 (1.0)      457.2331 (1.03)     25.6404 (1.14)         34;0  2.1882 (0.99)        100           1
test_init-init[main]       443.3191 (1.07)     519.6109 (1.05)     467.5022 (1.03)     21.3249 (1.21)     456.9724 (1.03)     38.3699 (1.71)         34;0  2.1390 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     649.2018 (1.12)     649.2018 (1.12)     649.2018 (1.12)     0.0000 (1.0)      649.2018 (1.12)     0.0000 (1.0)           0;0  1.5404 (0.89)          1           1
test_list-list[3.10.0]     747.2276 (1.29)     747.2276 (1.29)     747.2276 (1.29)     0.0000 (1.0)      747.2276 (1.29)     0.0000 (1.0)           0;0  1.3383 (0.78)          1           1
test_list-list[3.53.2]     631.2366 (1.09)     631.2366 (1.09)     631.2366 (1.09)     0.0000 (1.0)      631.2366 (1.09)     0.0000 (1.0)           0;0  1.5842 (0.92)          1           1
test_list-list[3.60.1]     579.5559 (1.0)      579.5559 (1.0)      579.5559 (1.0)      0.0000 (1.0)      579.5559 (1.0)      0.0000 (1.0)           0;0  1.7255 (1.0)           1           1
test_list-list[main]       599.2229 (1.03)     599.2229 (1.03)     599.2229 (1.03)     0.0000 (1.0)      599.2229 (1.03)     0.0000 (1.0)           0;0  1.6688 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     454.3225 (1.08)     454.3225 (1.08)     454.3225 (1.08)     0.0000 (1.0)      454.3225 (1.08)     0.0000 (1.0)           0;0  2.2011 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     444.4911 (1.05)     444.4911 (1.05)     444.4911 (1.05)     0.0000 (1.0)      444.4911 (1.05)     0.0000 (1.0)           0;0  2.2498 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     421.8621 (1.0)      421.8621 (1.0)      421.8621 (1.0)      0.0000 (1.0)      421.8621 (1.0)      0.0000 (1.0)           0;0  2.3704 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     430.5915 (1.02)     430.5915 (1.02)     430.5915 (1.02)     0.0000 (1.0)      430.5915 (1.02)     0.0000 (1.0)           0;0  2.3224 (0.98)          1           1
test_list-list-dvc-only[main]       425.0875 (1.01)     425.0875 (1.01)     425.0875 (1.01)     0.0000 (1.0)      425.0875 (1.01)     0.0000 (1.0)           0;0  2.3525 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4317 (1.0)      2.4317 (1.0)      2.4317 (1.0)      0.0000 (1.0)      2.4317 (1.0)      0.0000 (1.0)           0;0  0.4112 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5497 (1.05)     2.5497 (1.05)     2.5497 (1.05)     0.0000 (1.0)      2.5497 (1.05)     0.0000 (1.0)           0;0  0.3922 (0.95)          1           1
test_list-list-recursive[3.53.2]     2.5942 (1.07)     2.5942 (1.07)     2.5942 (1.07)     0.0000 (1.0)      2.5942 (1.07)     0.0000 (1.0)           0;0  0.3855 (0.94)          1           1
test_list-list-recursive[3.60.1]     2.7892 (1.15)     2.7892 (1.15)     2.7892 (1.15)     0.0000 (1.0)      2.7892 (1.15)     0.0000 (1.0)           0;0  0.3585 (0.87)          1           1
test_list-list-recursive[main]       2.6813 (1.10)     2.6813 (1.10)     2.6813 (1.10)     0.0000 (1.0)      2.6813 (1.10)     0.0000 (1.0)           0;0  0.3729 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     458.3501 (1.09)     458.3501 (1.09)     458.3501 (1.09)     0.0000 (1.0)      458.3501 (1.09)     0.0000 (1.0)           0;0  2.1817 (0.92)          1           1
test_list-list-shallow[3.10.0]     449.4926 (1.07)     449.4926 (1.07)     449.4926 (1.07)     0.0000 (1.0)      449.4926 (1.07)     0.0000 (1.0)           0;0  2.2247 (0.94)          1           1
test_list-list-shallow[3.53.2]     421.3370 (1.0)      421.3370 (1.0)      421.3370 (1.0)      0.0000 (1.0)      421.3370 (1.0)      0.0000 (1.0)           0;0  2.3734 (1.0)           1           1
test_list-list-shallow[3.60.1]     422.0031 (1.00)     422.0031 (1.00)     422.0031 (1.00)     0.0000 (1.0)      422.0031 (1.00)     0.0000 (1.0)           0;0  2.3697 (1.00)          1           1
test_list-list-shallow[main]       423.0226 (1.00)     423.0226 (1.00)     423.0226 (1.00)     0.0000 (1.0)      423.0226 (1.00)     0.0000 (1.0)           0;0  2.3639 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.5273 (3.74)     71.5273 (3.74)     71.5273 (3.74)     0.0000 (1.0)      71.5273 (3.74)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.10.0]     71.5126 (3.73)     71.5126 (3.73)     71.5126 (3.73)     0.0000 (1.0)      71.5126 (3.73)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.53.2]     64.7591 (3.38)     64.7591 (3.38)     64.7591 (3.38)     0.0000 (1.0)      64.7591 (3.38)     0.0000 (1.0)           0;0  0.0154 (0.30)          1           1
test_partial_add-add[3.60.1]     19.1476 (1.0)      19.1476 (1.0)      19.1476 (1.0)      0.0000 (1.0)      19.1476 (1.0)      0.0000 (1.0)           0;0  0.0522 (1.0)           1           1
test_partial_add-add[main]       20.0672 (1.05)     20.0672 (1.05)     20.0672 (1.05)     0.0000 (1.0)      20.0672 (1.05)     0.0000 (1.0)           0;0  0.0498 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.2554 (8.11)     59.2554 (8.11)     59.2554 (8.11)     0.0000 (1.0)      59.2554 (8.11)     0.0000 (1.0)           0;0  0.0169 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     60.1697 (8.23)     60.1697 (8.23)     60.1697 (8.23)     0.0000 (1.0)      60.1697 (8.23)     0.0000 (1.0)           0;0  0.0166 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     54.3138 (7.43)     54.3138 (7.43)     54.3138 (7.43)     0.0000 (1.0)      54.3138 (7.43)     0.0000 (1.0)           0;0  0.0184 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.3086 (1.0)       7.3086 (1.0)       7.3086 (1.0)      0.0000 (1.0)       7.3086 (1.0)      0.0000 (1.0)           0;0  0.1368 (1.0)           1           1
test_partial_add-add-partial[main]        7.6235 (1.04)      7.6235 (1.04)      7.6235 (1.04)     0.0000 (1.0)       7.6235 (1.04)     0.0000 (1.0)           0;0  0.1312 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5722 (1.0)      4.5722 (1.0)      4.5722 (1.0)      0.0000 (1.0)      4.5722 (1.0)      0.0000 (1.0)           0;0  0.2187 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1179 (1.34)     6.1179 (1.34)     6.1179 (1.34)     0.0000 (1.0)      6.1179 (1.34)     0.0000 (1.0)           0;0  0.1635 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9893 (1.53)     6.9893 (1.53)     6.9893 (1.53)     0.0000 (1.0)      6.9893 (1.53)     0.0000 (1.0)           0;0  0.1431 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.1132 (1.56)     7.1132 (1.56)     7.1132 (1.56)     0.0000 (1.0)      7.1132 (1.56)     0.0000 (1.0)           0;0  0.1406 (0.64)          1           1
test_partial_add-gc-cloud-noop[main]       7.1912 (1.57)     7.1912 (1.57)     7.1912 (1.57)     0.0000 (1.0)      7.1912 (1.57)     0.0000 (1.0)           0;0  0.1391 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5819 (1.0)      2.5819 (1.0)      2.5819 (1.0)      0.0000 (1.0)      2.5819 (1.0)      0.0000 (1.0)           0;0  0.3873 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9182 (1.52)     3.9182 (1.52)     3.9182 (1.52)     0.0000 (1.0)      3.9182 (1.52)     0.0000 (1.0)           0;0  0.2552 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     4.0246 (1.56)     4.0246 (1.56)     4.0246 (1.56)     0.0000 (1.0)      4.0246 (1.56)     0.0000 (1.0)           0;0  0.2485 (0.64)          1           1
test_partial_add-gc-noop[3.60.1]     3.9327 (1.52)     3.9327 (1.52)     3.9327 (1.52)     0.0000 (1.0)      3.9327 (1.52)     0.0000 (1.0)           0;0  0.2543 (0.66)          1           1
test_partial_add-gc-noop[main]       4.0419 (1.57)     4.0419 (1.57)     4.0419 (1.57)     0.0000 (1.0)      4.0419 (1.57)     0.0000 (1.0)           0;0  0.2474 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     40.9695 (2.18)     40.9695 (2.18)     40.9695 (2.18)     0.0000 (1.0)      40.9695 (2.18)     0.0000 (1.0)           0;0  0.0244 (0.46)          1           1
test_partial_add-push[3.10.0]     36.2129 (1.93)     36.2129 (1.93)     36.2129 (1.93)     0.0000 (1.0)      36.2129 (1.93)     0.0000 (1.0)           0;0  0.0276 (0.52)          1           1
test_partial_add-push[3.53.2]     19.2142 (1.02)     19.2142 (1.02)     19.2142 (1.02)     0.0000 (1.0)      19.2142 (1.02)     0.0000 (1.0)           0;0  0.0520 (0.98)          1           1
test_partial_add-push[3.60.1]     18.7847 (1.0)      18.7847 (1.0)      18.7847 (1.0)      0.0000 (1.0)      18.7847 (1.0)      0.0000 (1.0)           0;0  0.0532 (1.0)           1           1
test_partial_add-push[main]       18.8620 (1.00)     18.8620 (1.00)     18.8620 (1.00)     0.0000 (1.0)      18.8620 (1.00)     0.0000 (1.0)           0;0  0.0530 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.7059 (1.07)     10.7059 (1.07)     10.7059 (1.07)     0.0000 (1.0)      10.7059 (1.07)     0.0000 (1.0)           0;0  0.0934 (0.93)          1           1
test_partial_add-push-partial[3.10.0]     10.0663 (1.01)     10.0663 (1.01)     10.0663 (1.01)     0.0000 (1.0)      10.0663 (1.01)     0.0000 (1.0)           0;0  0.0993 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.4197 (1.04)     10.4197 (1.04)     10.4197 (1.04)     0.0000 (1.0)      10.4197 (1.04)     0.0000 (1.0)           0;0  0.0960 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     10.0067 (1.0)      10.0067 (1.0)      10.0067 (1.0)      0.0000 (1.0)      10.0067 (1.0)      0.0000 (1.0)           0;0  0.0999 (1.0)           1           1
test_partial_add-push-partial[main]       10.0457 (1.00)     10.0457 (1.00)     10.0457 (1.00)     0.0000 (1.0)      10.0457 (1.00)     0.0000 (1.0)           0;0  0.0995 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     84.1265 (3.76)     84.1265 (3.76)     84.1265 (3.76)     0.0000 (1.0)      84.1265 (3.76)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.0657 (3.75)     84.0657 (3.75)     84.0657 (3.75)     0.0000 (1.0)      84.0657 (3.75)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.8029 (3.38)     75.8029 (3.38)     75.8029 (3.38)     0.0000 (1.0)      75.8029 (3.38)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.3946 (1.0)      22.3946 (1.0)      22.3946 (1.0)      0.0000 (1.0)      22.3946 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
test_partial_remove-add[main]       23.5474 (1.05)     23.5474 (1.05)     23.5474 (1.05)     0.0000 (1.0)      23.5474 (1.05)     0.0000 (1.0)           0;0  0.0425 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.3051 (7.91)     8.3051 (7.91)     8.3051 (7.91)     0.0000 (1.0)      8.3051 (7.91)     0.0000 (1.0)           0;0  0.1204 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.3229 (7.93)     8.3229 (7.93)     8.3229 (7.93)     0.0000 (1.0)      8.3229 (7.93)     0.0000 (1.0)           0;0  0.1202 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.3886 (7.04)     7.3886 (7.04)     7.3886 (7.04)     0.0000 (1.0)      7.3886 (7.04)     0.0000 (1.0)           0;0  0.1353 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0499 (1.0)      1.0499 (1.0)      1.0499 (1.0)      0.0000 (1.0)      1.0499 (1.0)      0.0000 (1.0)           0;0  0.9525 (1.0)           1           1
test_partial_remove-add-update[main]       1.4281 (1.36)     1.4281 (1.36)     1.4281 (1.36)     0.0000 (1.0)      1.4281 (1.36)     0.0000 (1.0)           0;0  0.7002 (0.74)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.4126 (1.0)      3.4126 (1.0)      3.4126 (1.0)      0.0000 (1.0)      3.4126 (1.0)      0.0000 (1.0)           0;0  0.2930 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7034 (1.09)     3.7034 (1.09)     3.7034 (1.09)     0.0000 (1.0)      3.7034 (1.09)     0.0000 (1.0)           0;0  0.2700 (0.92)          1           1
test_partial_remove-gc[3.53.2]     3.9229 (1.15)     3.9229 (1.15)     3.9229 (1.15)     0.0000 (1.0)      3.9229 (1.15)     0.0000 (1.0)           0;0  0.2549 (0.87)          1           1
test_partial_remove-gc[3.60.1]     3.8748 (1.14)     3.8748 (1.14)     3.8748 (1.14)     0.0000 (1.0)      3.8748 (1.14)     0.0000 (1.0)           0;0  0.2581 (0.88)          1           1
test_partial_remove-gc[main]       3.7829 (1.11)     3.7829 (1.11)     3.7829 (1.11)     0.0000 (1.0)      3.7829 (1.11)     0.0000 (1.0)           0;0  0.2643 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7146 (1.0)      4.7146 (1.0)      4.7146 (1.0)      0.0000 (1.0)      4.7146 (1.0)      0.0000 (1.0)           0;0  0.2121 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.4914 (1.16)     5.4914 (1.16)     5.4914 (1.16)     0.0000 (1.0)      5.4914 (1.16)     0.0000 (1.0)           0;0  0.1821 (0.86)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0453 (1.07)     5.0453 (1.07)     5.0453 (1.07)     0.0000 (1.0)      5.0453 (1.07)     0.0000 (1.0)           0;0  0.1982 (0.93)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.9091 (1.04)     4.9091 (1.04)     4.9091 (1.04)     0.0000 (1.0)      4.9091 (1.04)     0.0000 (1.0)           0;0  0.2037 (0.96)          1           1
test_partial_remove-gc-cloud[main]       5.1148 (1.08)     5.1148 (1.08)     5.1148 (1.08)     0.0000 (1.0)      5.1148 (1.08)     0.0000 (1.0)           0;0  0.1955 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     47.3632 (2.16)     47.3632 (2.16)     47.3632 (2.16)     0.0000 (1.0)      47.3632 (2.16)     0.0000 (1.0)           0;0  0.0211 (0.46)          1           1
test_partial_remove-push[3.10.0]     42.1704 (1.92)     42.1704 (1.92)     42.1704 (1.92)     0.0000 (1.0)      42.1704 (1.92)     0.0000 (1.0)           0;0  0.0237 (0.52)          1           1
test_partial_remove-push[3.53.2]     22.6154 (1.03)     22.6154 (1.03)     22.6154 (1.03)     0.0000 (1.0)      22.6154 (1.03)     0.0000 (1.0)           0;0  0.0442 (0.97)          1           1
test_partial_remove-push[3.60.1]     21.9570 (1.0)      21.9570 (1.0)      21.9570 (1.0)      0.0000 (1.0)      21.9570 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
test_partial_remove-push[main]       21.9890 (1.00)     21.9890 (1.00)     21.9890 (1.00)     0.0000 (1.0)      21.9890 (1.00)     0.0000 (1.0)           0;0  0.0455 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8281 (1.0)      1.8281 (1.0)      1.8281 (1.0)      0.0000 (1.0)      1.8281 (1.0)      0.0000 (1.0)           0;0  0.5470 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8295 (1.00)     1.8295 (1.00)     1.8295 (1.00)     0.0000 (1.0)      1.8295 (1.00)     0.0000 (1.0)           0;0  0.5466 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.4976 (1.37)     2.4976 (1.37)     2.4976 (1.37)     0.0000 (1.0)      2.4976 (1.37)     0.0000 (1.0)           0;0  0.4004 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.6177 (1.43)     2.6177 (1.43)     2.6177 (1.43)     0.0000 (1.0)      2.6177 (1.43)     0.0000 (1.0)           0;0  0.3820 (0.70)          1           1
test_partial_remove-push-update[main]       2.4869 (1.36)     2.4869 (1.36)     2.4869 (1.36)     0.0000 (1.0)      2.4869 (1.36)     0.0000 (1.0)           0;0  0.4021 (0.74)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     571.3986 (1.0)      588.7403 (1.0)      577.3861 (1.0)       6.7135 (1.0)      575.4291 (1.0)       6.9063 (1.0)           1;0  1.7319 (1.0)           5           3
test_plots-plots-diff[3.10.0]     977.7350 (1.71)     997.4551 (1.69)     987.4772 (1.71)      7.0988 (1.06)     986.5175 (1.71)      7.5110 (1.09)          2;0  1.0127 (0.58)          5           3
test_plots-plots-diff[3.53.2]     932.2044 (1.63)     978.2869 (1.66)     953.1584 (1.65)     19.9085 (2.97)     956.6680 (1.66)     34.5896 (5.01)          2;0  1.0491 (0.61)          5           3
test_plots-plots-diff[3.60.1]     922.2797 (1.61)     943.5332 (1.60)     931.8955 (1.61)      8.4484 (1.26)     933.8105 (1.62)     12.5214 (1.81)          2;0  1.0731 (0.62)          5           3
test_plots-plots-diff[main]       915.8597 (1.60)     944.9552 (1.61)     929.9173 (1.61)     11.4940 (1.71)     931.6435 (1.62)     17.7766 (2.57)          2;0  1.0754 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       579.7267 (1.0)        594.3257 (1.0)        588.6042 (1.0)       5.7018 (1.0)        591.2125 (1.0)       7.2533 (1.0)           2;0  1.6989 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,211.1108 (2.09)     1,259.9698 (2.12)     1,233.8778 (2.10)     20.6224 (3.62)     1,230.8094 (2.08)     35.7546 (4.93)          2;0  0.8105 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]       994.7204 (1.72)     1,019.2991 (1.72)     1,005.0349 (1.71)     10.5636 (1.85)       999.9585 (1.69)     17.2740 (2.38)          1;0  0.9950 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       998.5822 (1.72)     1,017.1614 (1.71)     1,007.2279 (1.71)      7.3350 (1.29)     1,006.5991 (1.70)     11.4505 (1.58)          2;0  0.9928 (0.58)          5           3
test_plots-plots-diff-json[main]         990.5322 (1.71)     1,025.8281 (1.73)     1,003.3342 (1.70)     14.1724 (2.49)     1,000.2305 (1.69)     19.5479 (2.70)          1;0  0.9967 (0.59)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     476.4102 (1.0)      497.5319 (1.0)      488.2428 (1.0)       9.1103 (2.33)     492.3213 (1.0)      15.2237 (2.78)          2;0  2.0482 (1.0)           5           3
test_plots-plots-show[3.10.0]     791.7968 (1.66)     812.6110 (1.63)     803.0274 (1.64)     10.0977 (2.58)     807.6267 (1.64)     18.8021 (3.43)          2;0  1.2453 (0.61)          5           3
test_plots-plots-show[3.53.2]     785.3177 (1.65)     795.1183 (1.60)     790.0998 (1.62)      3.9101 (1.0)      789.7661 (1.60)      6.2724 (1.14)          2;0  1.2657 (0.62)          5           3
test_plots-plots-show[3.60.1]     772.4351 (1.62)     798.6667 (1.61)     785.6665 (1.61)     11.4697 (2.93)     789.6864 (1.60)     19.9240 (3.64)          2;0  1.2728 (0.62)          5           3
test_plots-plots-show[main]       757.9263 (1.59)     772.4528 (1.55)     762.9187 (1.56)      5.6122 (1.44)     761.8167 (1.55)      5.4789 (1.0)           1;0  1.3108 (0.64)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     478.1561 (1.0)      493.4954 (1.0)      487.8928 (1.0)      5.9012 (1.61)     489.1330 (1.0)       6.7162 (1.17)          1;0  2.0496 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     918.1189 (1.92)     932.3751 (1.89)     924.2870 (1.89)     6.3632 (1.74)     921.9462 (1.88)     11.2805 (1.97)          1;0  1.0819 (0.53)          5           3
test_plots-plots-show-json[3.53.2]     837.6785 (1.75)     845.7975 (1.71)     841.5762 (1.72)     3.6559 (1.0)      841.1097 (1.72)      6.7996 (1.19)          2;0  1.1882 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     833.1362 (1.74)     847.4294 (1.72)     838.7523 (1.72)     6.0153 (1.65)     837.8278 (1.71)      9.8270 (1.71)          1;0  1.1922 (0.58)          5           3
test_plots-plots-show-json[main]       808.7461 (1.69)     823.0910 (1.67)     814.7243 (1.67)     5.2962 (1.45)     814.4804 (1.67)      5.7334 (1.0)           2;0  1.2274 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     47.7825 (2.20)     47.7825 (2.20)     47.7825 (2.20)     0.0000 (1.0)      47.7825 (2.20)     0.0000 (1.0)           0;0  0.0209 (0.45)          1           1
test_push-push[3.10.0]     42.1209 (1.94)     42.1209 (1.94)     42.1209 (1.94)     0.0000 (1.0)      42.1209 (1.94)     0.0000 (1.0)           0;0  0.0237 (0.52)          1           1
test_push-push[3.53.2]     22.9281 (1.06)     22.9281 (1.06)     22.9281 (1.06)     0.0000 (1.0)      22.9281 (1.06)     0.0000 (1.0)           0;0  0.0436 (0.95)          1           1
test_push-push[3.60.1]     21.6995 (1.0)      21.6995 (1.0)      21.6995 (1.0)      0.0000 (1.0)      21.6995 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
test_push-push[main]       22.1271 (1.02)     22.1271 (1.02)     22.1271 (1.02)     0.0000 (1.0)      22.1271 (1.02)     0.0000 (1.0)           0;0  0.0452 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     60.9822 (2.71)     60.9822 (2.71)     60.9822 (2.71)     0.0000 (1.0)      60.9822 (2.71)     0.0000 (1.0)           0;0  0.0164 (0.37)          1           1
test_sharing-fetch[3.10.0]     64.7528 (2.88)     64.7528 (2.88)     64.7528 (2.88)     0.0000 (1.0)      64.7528 (2.88)     0.0000 (1.0)           0;0  0.0154 (0.35)          1           1
test_sharing-fetch[3.53.2]     32.7511 (1.46)     32.7511 (1.46)     32.7511 (1.46)     0.0000 (1.0)      32.7511 (1.46)     0.0000 (1.0)           0;0  0.0305 (0.69)          1           1
test_sharing-fetch[3.60.1]     22.4920 (1.0)      22.4920 (1.0)      22.4920 (1.0)      0.0000 (1.0)      22.4920 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_sharing-fetch[main]       22.9671 (1.02)     22.9671 (1.02)     22.9671 (1.02)     0.0000 (1.0)      22.9671 (1.02)     0.0000 (1.0)           0;0  0.0435 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2759 (1.0)      1.2759 (1.0)      1.2759 (1.0)      0.0000 (1.0)      1.2759 (1.0)      0.0000 (1.0)           0;0  0.7837 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5551 (2.79)     3.5551 (2.79)     3.5551 (2.79)     0.0000 (1.0)      3.5551 (2.79)     0.0000 (1.0)           0;0  0.2813 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     5.9209 (4.64)     5.9209 (4.64)     5.9209 (4.64)     0.0000 (1.0)      5.9209 (4.64)     0.0000 (1.0)           0;0  0.1689 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9982 (4.70)     5.9982 (4.70)     5.9982 (4.70)     0.0000 (1.0)      5.9982 (4.70)     0.0000 (1.0)           0;0  0.1667 (0.21)          1           1
test_sharing-fetch-noop[main]       6.0808 (4.77)     6.0808 (4.77)     6.0808 (4.77)     0.0000 (1.0)      6.0808 (4.77)     0.0000 (1.0)           0;0  0.1645 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     49.1940 (2.16)     49.1940 (2.16)     49.1940 (2.16)     0.0000 (1.0)      49.1940 (2.16)     0.0000 (1.0)           0;0  0.0203 (0.46)          1           1
test_sharing-push[3.10.0]     43.2517 (1.90)     43.2517 (1.90)     43.2517 (1.90)     0.0000 (1.0)      43.2517 (1.90)     0.0000 (1.0)           0;0  0.0231 (0.53)          1           1
test_sharing-push[3.53.2]     23.5390 (1.03)     23.5390 (1.03)     23.5390 (1.03)     0.0000 (1.0)      23.5390 (1.03)     0.0000 (1.0)           0;0  0.0425 (0.97)          1           1
test_sharing-push[3.60.1]     22.7521 (1.0)      22.7521 (1.0)      22.7521 (1.0)      0.0000 (1.0)      22.7521 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_sharing-push[main]       22.9201 (1.01)     22.9201 (1.01)     22.9201 (1.01)     0.0000 (1.0)      22.9201 (1.01)     0.0000 (1.0)           0;0  0.0436 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2184 (1.07)     2.2184 (1.07)     2.2184 (1.07)     0.0000 (1.0)      2.2184 (1.07)     0.0000 (1.0)           0;0  0.4508 (0.94)          1           1
test_sharing-push-noop[3.10.0]     2.0820 (1.0)      2.0820 (1.0)      2.0820 (1.0)      0.0000 (1.0)      2.0820 (1.0)      0.0000 (1.0)           0;0  0.4803 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9556 (2.86)     5.9556 (2.86)     5.9556 (2.86)     0.0000 (1.0)      5.9556 (2.86)     0.0000 (1.0)           0;0  0.1679 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.0557 (2.91)     6.0557 (2.91)     6.0557 (2.91)     0.0000 (1.0)      6.0557 (2.91)     0.0000 (1.0)           0;0  0.1651 (0.34)          1           1
test_sharing-push-noop[main]       6.1098 (2.93)     6.1098 (2.93)     6.1098 (2.93)     0.0000 (1.0)      6.1098 (2.93)     0.0000 (1.0)           0;0  0.1637 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     260.3518 (1.04)     260.3518 (1.04)     260.3518 (1.04)     0.0000 (1.0)      260.3518 (1.04)     0.0000 (1.0)           0;0  0.0038 (0.96)          1           1
test_sharing_azure-fetch[main]       250.5609 (1.0)      250.5609 (1.0)      250.5609 (1.0)      0.0000 (1.0)      250.5609 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4070 (1.0)      6.4070 (1.0)      6.4070 (1.0)      0.0000 (1.0)      6.4070 (1.0)      0.0000 (1.0)           0;0  0.1561 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5111 (1.02)     6.5111 (1.02)     6.5111 (1.02)     0.0000 (1.0)      6.5111 (1.02)     0.0000 (1.0)           0;0  0.1536 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     270.3130 (1.02)     270.3130 (1.02)     270.3130 (1.02)     0.0000 (1.0)      270.3130 (1.02)     0.0000 (1.0)           0;0  0.0037 (0.98)          1           1
test_sharing_azure-push[main]       265.5747 (1.0)      265.5747 (1.0)      265.5747 (1.0)      0.0000 (1.0)      265.5747 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.2041 (1.0)      7.2041 (1.0)      7.2041 (1.0)      0.0000 (1.0)      7.2041 (1.0)      0.0000 (1.0)           0;0  0.1388 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.4101 (1.03)     7.4101 (1.03)     7.4101 (1.03)     0.0000 (1.0)      7.4101 (1.03)     0.0000 (1.0)           0;0  0.1350 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     398.1223 (1.0)      398.1223 (1.0)      398.1223 (1.0)      0.0000 (1.0)      398.1223 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
test_sharing_gs-fetch[main]       406.2483 (1.02)     406.2483 (1.02)     406.2483 (1.02)     0.0000 (1.0)      406.2483 (1.02)     0.0000 (1.0)           0;0  0.0025 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     22.1368 (1.02)     22.1368 (1.02)     22.1368 (1.02)     0.0000 (1.0)      22.1368 (1.02)     0.0000 (1.0)           0;0  0.0452 (0.98)          1           1
test_sharing_gs-fetch-noop[main]       21.6941 (1.0)      21.6941 (1.0)      21.6941 (1.0)      0.0000 (1.0)      21.6941 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     923.7302 (1.05)     923.7302 (1.05)     923.7302 (1.05)     0.0000 (1.0)      923.7302 (1.05)     0.0000 (1.0)           0;0  0.0011 (0.95)          1           1
test_sharing_gs-push[main]       880.8629 (1.0)      880.8629 (1.0)      880.8629 (1.0)      0.0000 (1.0)      880.8629 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.1481 (1.0)      7.1481 (1.0)      7.1481 (1.0)      0.0000 (1.0)      7.1481 (1.0)      0.0000 (1.0)           0;0  0.1399 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.2260 (1.01)     7.2260 (1.01)     7.2260 (1.01)     0.0000 (1.0)      7.2260 (1.01)     0.0000 (1.0)           0;0  0.1384 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     275.7421 (1.03)     275.7421 (1.03)     275.7421 (1.03)     0.0000 (1.0)      275.7421 (1.03)     0.0000 (1.0)           0;0  0.0036 (0.97)          1           1
test_sharing_s3-fetch[main]       267.1968 (1.0)      267.1968 (1.0)      267.1968 (1.0)      0.0000 (1.0)      267.1968 (1.0)      0.0000 (1.0)           0;0  0.0037 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.4270 (1.01)     6.4270 (1.01)     6.4270 (1.01)     0.0000 (1.0)      6.4270 (1.01)     0.0000 (1.0)           0;0  0.1556 (0.99)          1           1
test_sharing_s3-fetch-noop[main]       6.3750 (1.0)      6.3750 (1.0)      6.3750 (1.0)      0.0000 (1.0)      6.3750 (1.0)      0.0000 (1.0)           0;0  0.1569 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     298.5763 (1.0)      298.5763 (1.0)      298.5763 (1.0)      0.0000 (1.0)      298.5763 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
test_sharing_s3-push[main]       302.2145 (1.01)     302.2145 (1.01)     302.2145 (1.01)     0.0000 (1.0)      302.2145 (1.01)     0.0000 (1.0)           0;0  0.0033 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5630 (1.01)     6.5630 (1.01)     6.5630 (1.01)     0.0000 (1.0)      6.5630 (1.01)     0.0000 (1.0)           0;0  0.1524 (0.99)          1           1
test_sharing_s3-push-noop[main]       6.4978 (1.0)      6.4978 (1.0)      6.4978 (1.0)      0.0000 (1.0)      6.4978 (1.0)      0.0000 (1.0)           0;0  0.1539 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     18.9178 (3.77)     18.9178 (3.77)     18.9178 (3.77)     0.0000 (1.0)      18.9178 (3.77)     0.0000 (1.0)           0;0  0.0529 (0.27)          1           1
test_status-status[3.10.0]     19.5288 (3.89)     19.5288 (3.89)     19.5288 (3.89)     0.0000 (1.0)      19.5288 (3.89)     0.0000 (1.0)           0;0  0.0512 (0.26)          1           1
test_status-status[3.53.2]     17.8271 (3.55)     17.8271 (3.55)     17.8271 (3.55)     0.0000 (1.0)      17.8271 (3.55)     0.0000 (1.0)           0;0  0.0561 (0.28)          1           1
test_status-status[3.60.1]      5.0241 (1.0)       5.0241 (1.0)       5.0241 (1.0)      0.0000 (1.0)       5.0241 (1.0)      0.0000 (1.0)           0;0  0.1990 (1.0)           1           1
test_status-status[main]        5.3491 (1.06)      5.3491 (1.06)      5.3491 (1.06)     0.0000 (1.0)       5.3491 (1.06)     0.0000 (1.0)           0;0  0.1869 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8577 (1.83)     4.8577 (1.83)     4.8577 (1.83)     0.0000 (1.0)      4.8577 (1.83)     0.0000 (1.0)           0;0  0.2059 (0.55)          1           1
test_status-status-changed[3.10.0]     5.1659 (1.94)     5.1659 (1.94)     5.1659 (1.94)     0.0000 (1.0)      5.1659 (1.94)     0.0000 (1.0)           0;0  0.1936 (0.51)          1           1
test_status-status-changed[3.53.2]     4.9366 (1.86)     4.9366 (1.86)     4.9366 (1.86)     0.0000 (1.0)      4.9366 (1.86)     0.0000 (1.0)           0;0  0.2026 (0.54)          1           1
test_status-status-changed[3.60.1]     2.6579 (1.0)      2.6579 (1.0)      2.6579 (1.0)      0.0000 (1.0)      2.6579 (1.0)      0.0000 (1.0)           0;0  0.3762 (1.0)           1           1
test_status-status-changed[main]       2.8558 (1.07)     2.8558 (1.07)     2.8558 (1.07)     0.0000 (1.0)      2.8558 (1.07)     0.0000 (1.0)           0;0  0.3502 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9522 (1.96)     4.9522 (1.96)     4.9522 (1.96)     0.0000 (1.0)      4.9522 (1.96)     0.0000 (1.0)           0;0  0.2019 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.0652 (2.01)     5.0652 (2.01)     5.0652 (2.01)     0.0000 (1.0)      5.0652 (2.01)     0.0000 (1.0)           0;0  0.1974 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     4.9957 (1.98)     4.9957 (1.98)     4.9957 (1.98)     0.0000 (1.0)      4.9957 (1.98)     0.0000 (1.0)           0;0  0.2002 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.5248 (1.0)      2.5248 (1.0)      2.5248 (1.0)      0.0000 (1.0)      2.5248 (1.0)      0.0000 (1.0)           0;0  0.3961 (1.0)           1           1
test_status-status-changed-noop[main]       2.7557 (1.09)     2.7557 (1.09)     2.7557 (1.09)     0.0000 (1.0)      2.7557 (1.09)     0.0000 (1.0)           0;0  0.3629 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8601 (1.93)     4.8601 (1.93)     4.8601 (1.93)     0.0000 (1.0)      4.8601 (1.93)     0.0000 (1.0)           0;0  0.2058 (0.52)          1           1
test_status-status-noop[3.10.0]     5.0389 (2.00)     5.0389 (2.00)     5.0389 (2.00)     0.0000 (1.0)      5.0389 (2.00)     0.0000 (1.0)           0;0  0.1985 (0.50)          1           1
test_status-status-noop[3.53.2]     4.8814 (1.94)     4.8814 (1.94)     4.8814 (1.94)     0.0000 (1.0)      4.8814 (1.94)     0.0000 (1.0)           0;0  0.2049 (0.51)          1           1
test_status-status-noop[3.60.1]     2.5135 (1.0)      2.5135 (1.0)      2.5135 (1.0)      0.0000 (1.0)      2.5135 (1.0)      0.0000 (1.0)           0;0  0.3978 (1.0)           1           1
test_status-status-noop[main]       2.7368 (1.09)     2.7368 (1.09)     2.7368 (1.09)     0.0000 (1.0)      2.7368 (1.09)     0.0000 (1.0)           0;0  0.3654 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     147.6390 (3.27)     147.6390 (3.27)     147.6390 (3.27)     0.0000 (1.0)      147.6390 (3.27)     0.0000 (1.0)           0;0  0.0068 (0.31)          1           1
test_update-import-url[3.10.0]     149.2960 (3.30)     149.2960 (3.30)     149.2960 (3.30)     0.0000 (1.0)      149.2960 (3.30)     0.0000 (1.0)           0;0  0.0067 (0.30)          1           1
test_update-import-url[3.53.2]     111.9708 (2.48)     111.9708 (2.48)     111.9708 (2.48)     0.0000 (1.0)      111.9708 (2.48)     0.0000 (1.0)           0;0  0.0089 (0.40)          1           1
test_update-import-url[3.60.1]      45.2120 (1.0)       45.2120 (1.0)       45.2120 (1.0)      0.0000 (1.0)       45.2120 (1.0)      0.0000 (1.0)           0;0  0.0221 (1.0)           1           1
test_update-import-url[main]        46.5464 (1.03)      46.5464 (1.03)      46.5464 (1.03)     0.0000 (1.0)       46.5464 (1.03)     0.0000 (1.0)           0;0  0.0215 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     132.9473 (3.81)     132.9473 (3.81)     132.9473 (3.81)     0.0000 (1.0)      132.9473 (3.81)     0.0000 (1.0)           0;0  0.0075 (0.26)          1           1
test_update-update[3.10.0]     136.9023 (3.93)     136.9023 (3.93)     136.9023 (3.93)     0.0000 (1.0)      136.9023 (3.93)     0.0000 (1.0)           0;0  0.0073 (0.25)          1           1
test_update-update[3.53.2]     105.7206 (3.03)     105.7206 (3.03)     105.7206 (3.03)     0.0000 (1.0)      105.7206 (3.03)     0.0000 (1.0)           0;0  0.0095 (0.33)          1           1
test_update-update[3.60.1]      34.8573 (1.0)       34.8573 (1.0)       34.8573 (1.0)      0.0000 (1.0)       34.8573 (1.0)      0.0000 (1.0)           0;0  0.0287 (1.0)           1           1
test_update-update[main]        35.7213 (1.02)      35.7213 (1.02)      35.7213 (1.02)     0.0000 (1.0)       35.7213 (1.02)     0.0000 (1.0)           0;0  0.0280 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1580 (2.13)     16.1580 (2.13)     16.1580 (2.13)     0.0000 (1.0)      16.1580 (2.13)     0.0000 (1.0)           0;0  0.0619 (0.47)          1           1
test_update-update-noop[3.10.0]     17.3583 (2.28)     17.3583 (2.28)     17.3583 (2.28)     0.0000 (1.0)      17.3583 (2.28)     0.0000 (1.0)           0;0  0.0576 (0.44)          1           1
test_update-update-noop[3.53.2]     16.8575 (2.22)     16.8575 (2.22)     16.8575 (2.22)     0.0000 (1.0)      16.8575 (2.22)     0.0000 (1.0)           0;0  0.0593 (0.45)          1           1
test_update-update-noop[3.60.1]      7.6009 (1.0)       7.6009 (1.0)       7.6009 (1.0)      0.0000 (1.0)       7.6009 (1.0)      0.0000 (1.0)           0;0  0.1316 (1.0)           1           1
test_update-update-noop[main]        8.1774 (1.08)      8.1774 (1.08)      8.1774 (1.08)     0.0000 (1.0)       8.1774 (1.08)     0.0000 (1.0)           0;0  0.1223 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean