Wed Sep 10 01:27:56 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.6812 (3.78)     85.6812 (3.78)     85.6812 (3.78)     0.0000 (1.0)      85.6812 (3.78)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_add_copy-add[3.10.0]     86.8867 (3.83)     86.8867 (3.83)     86.8867 (3.83)     0.0000 (1.0)      86.8867 (3.83)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_add_copy-add[3.53.2]     77.9461 (3.44)     77.9461 (3.44)     77.9461 (3.44)     0.0000 (1.0)      77.9461 (3.44)     0.0000 (1.0)           0;0  0.0128 (0.29)          1           1
test_add_copy-add[3.60.1]     22.6632 (1.0)      22.6632 (1.0)      22.6632 (1.0)      0.0000 (1.0)      22.6632 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
test_add_copy-add[main]       23.8793 (1.05)     23.8793 (1.05)     23.8793 (1.05)     0.0000 (1.0)      23.8793 (1.05)     0.0000 (1.0)           0;0  0.0419 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.5056 (6.53)     29.5056 (6.53)     29.5056 (6.53)     0.0000 (1.0)      29.5056 (6.53)     0.0000 (1.0)           0;0  0.0339 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.9563 (6.63)     29.9563 (6.63)     29.9563 (6.63)     0.0000 (1.0)      29.9563 (6.63)     0.0000 (1.0)           0;0  0.0334 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.6355 (6.33)     28.6355 (6.33)     28.6355 (6.33)     0.0000 (1.0)      28.6355 (6.33)     0.0000 (1.0)           0;0  0.0349 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.5210 (1.0)       4.5210 (1.0)       4.5210 (1.0)      0.0000 (1.0)       4.5210 (1.0)      0.0000 (1.0)           0;0  0.2212 (1.0)           1           1
test_add_copy-add-noop[main]        5.0065 (1.11)      5.0065 (1.11)      5.0065 (1.11)     0.0000 (1.0)       5.0065 (1.11)     0.0000 (1.0)           0;0  0.1997 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     63.5624 (4.00)     63.5624 (4.00)     63.5624 (4.00)     0.0000 (1.0)      63.5624 (4.00)     0.0000 (1.0)           0;0  0.0157 (0.25)          1           1
test_add_hardlink-add[3.10.0]     64.7433 (4.08)     64.7433 (4.08)     64.7433 (4.08)     0.0000 (1.0)      64.7433 (4.08)     0.0000 (1.0)           0;0  0.0154 (0.25)          1           1
test_add_hardlink-add[3.53.2]     58.9111 (3.71)     58.9111 (3.71)     58.9111 (3.71)     0.0000 (1.0)      58.9111 (3.71)     0.0000 (1.0)           0;0  0.0170 (0.27)          1           1
test_add_hardlink-add[3.60.1]     15.8737 (1.0)      15.8737 (1.0)      15.8737 (1.0)      0.0000 (1.0)      15.8737 (1.0)      0.0000 (1.0)           0;0  0.0630 (1.0)           1           1
test_add_hardlink-add[main]       16.8946 (1.06)     16.8946 (1.06)     16.8946 (1.06)     0.0000 (1.0)      16.8946 (1.06)     0.0000 (1.0)           0;0  0.0592 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.9459 (7.51)     33.9459 (7.51)     33.9459 (7.51)     0.0000 (1.0)      33.9459 (7.51)     0.0000 (1.0)           0;0  0.0295 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.9549 (7.51)     33.9549 (7.51)     33.9549 (7.51)     0.0000 (1.0)      33.9549 (7.51)     0.0000 (1.0)           0;0  0.0295 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.6364 (7.00)     31.6364 (7.00)     31.6364 (7.00)     0.0000 (1.0)      31.6364 (7.00)     0.0000 (1.0)           0;0  0.0316 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5219 (1.0)       4.5219 (1.0)       4.5219 (1.0)      0.0000 (1.0)       4.5219 (1.0)      0.0000 (1.0)           0;0  0.2211 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8598 (1.07)      4.8598 (1.07)      4.8598 (1.07)     0.0000 (1.0)       4.8598 (1.07)     0.0000 (1.0)           0;0  0.2058 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.3461 (2.00)     69.3461 (2.00)     69.3461 (2.00)     0.0000 (1.0)      69.3461 (2.00)     0.0000 (1.0)           0;0  0.0144 (0.50)          1           1
test_add_symlink-add[3.10.0]     69.6939 (2.01)     69.6939 (2.01)     69.6939 (2.01)     0.0000 (1.0)      69.6939 (2.01)     0.0000 (1.0)           0;0  0.0143 (0.50)          1           1
test_add_symlink-add[3.53.2]     63.3933 (1.83)     63.3933 (1.83)     63.3933 (1.83)     0.0000 (1.0)      63.3933 (1.83)     0.0000 (1.0)           0;0  0.0158 (0.55)          1           1
test_add_symlink-add[3.60.1]     34.6356 (1.0)      34.6356 (1.0)      34.6356 (1.0)      0.0000 (1.0)      34.6356 (1.0)      0.0000 (1.0)           0;0  0.0289 (1.0)           1           1
test_add_symlink-add[main]       36.5923 (1.06)     36.5923 (1.06)     36.5923 (1.06)     0.0000 (1.0)      36.5923 (1.06)     0.0000 (1.0)           0;0  0.0273 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.5537 (7.94)     47.5537 (7.94)     47.5537 (7.94)     0.0000 (1.0)      47.5537 (7.94)     0.0000 (1.0)           0;0  0.0210 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     47.8153 (7.99)     47.8153 (7.99)     47.8153 (7.99)     0.0000 (1.0)      47.8153 (7.99)     0.0000 (1.0)           0;0  0.0209 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     47.1972 (7.88)     47.1972 (7.88)     47.1972 (7.88)     0.0000 (1.0)      47.1972 (7.88)     0.0000 (1.0)           0;0  0.0212 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.9860 (1.0)       5.9860 (1.0)       5.9860 (1.0)      0.0000 (1.0)       5.9860 (1.0)      0.0000 (1.0)           0;0  0.1671 (1.0)           1           1
test_add_symlink-add-noop[main]        6.2051 (1.04)      6.2051 (1.04)      6.2051 (1.04)     0.0000 (1.0)       6.2051 (1.04)     0.0000 (1.0)           0;0  0.1612 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.8014 (1.92)     39.8014 (1.92)     39.8014 (1.92)     0.0000 (1.0)      39.8014 (1.92)     0.0000 (1.0)           0;0  0.0251 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     61.0086 (2.94)     61.0086 (2.94)     61.0086 (2.94)     0.0000 (1.0)      61.0086 (2.94)     0.0000 (1.0)           0;0  0.0164 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     27.7426 (1.34)     27.7426 (1.34)     27.7426 (1.34)     0.0000 (1.0)      27.7426 (1.34)     0.0000 (1.0)           0;0  0.0360 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.7766 (1.0)      20.7766 (1.0)      20.7766 (1.0)      0.0000 (1.0)      20.7766 (1.0)      0.0000 (1.0)           0;0  0.0481 (1.0)           1           1
test_checkout_copy-checkout[main]       21.9176 (1.05)     21.9176 (1.05)     21.9176 (1.05)     0.0000 (1.0)      21.9176 (1.05)     0.0000 (1.0)           0;0  0.0456 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3867 (1.60)     5.3867 (1.60)     5.3867 (1.60)     0.0000 (1.0)      5.3867 (1.60)     0.0000 (1.0)           0;0  0.1856 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6025 (1.67)     5.6025 (1.67)     5.6025 (1.67)     0.0000 (1.0)      5.6025 (1.67)     0.0000 (1.0)           0;0  0.1785 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5483 (1.65)     5.5483 (1.65)     5.5483 (1.65)     0.0000 (1.0)      5.5483 (1.65)     0.0000 (1.0)           0;0  0.1802 (0.61)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3593 (1.0)      3.3593 (1.0)      3.3593 (1.0)      0.0000 (1.0)      3.3593 (1.0)      0.0000 (1.0)           0;0  0.2977 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6488 (1.09)     3.6488 (1.09)     3.6488 (1.09)     0.0000 (1.0)      3.6488 (1.09)     0.0000 (1.0)           0;0  0.2741 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6916 (2.14)     8.6916 (2.14)     8.6916 (2.14)     0.0000 (1.0)      8.6916 (2.14)     0.0000 (1.0)           0;0  0.1151 (0.47)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3897 (1.57)     6.3897 (1.57)     6.3897 (1.57)     0.0000 (1.0)      6.3897 (1.57)     0.0000 (1.0)           0;0  0.1565 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1782 (1.52)     6.1782 (1.52)     6.1782 (1.52)     0.0000 (1.0)      6.1782 (1.52)     0.0000 (1.0)           0;0  0.1619 (0.66)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0676 (1.0)      4.0676 (1.0)      4.0676 (1.0)      0.0000 (1.0)      4.0676 (1.0)      0.0000 (1.0)           0;0  0.2458 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.6243 (1.14)     4.6243 (1.14)     4.6243 (1.14)     0.0000 (1.0)      4.6243 (1.14)     0.0000 (1.0)           0;0  0.2163 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.2896 (3.06)     22.2896 (3.06)     22.2896 (3.06)     0.0000 (1.0)      22.2896 (3.06)     0.0000 (1.0)           0;0  0.0449 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7327 (2.16)     15.7327 (2.16)     15.7327 (2.16)     0.0000 (1.0)      15.7327 (2.16)     0.0000 (1.0)           0;0  0.0636 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.8481 (2.04)     14.8481 (2.04)     14.8481 (2.04)     0.0000 (1.0)      14.8481 (2.04)     0.0000 (1.0)           0;0  0.0673 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2913 (1.0)       7.2913 (1.0)       7.2913 (1.0)      0.0000 (1.0)       7.2913 (1.0)      0.0000 (1.0)           0;0  0.1371 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1575 (1.12)      8.1575 (1.12)      8.1575 (1.12)     0.0000 (1.0)       8.1575 (1.12)     0.0000 (1.0)           0;0  0.1226 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4540 (1.62)     5.4540 (1.62)     5.4540 (1.62)     0.0000 (1.0)      5.4540 (1.62)     0.0000 (1.0)           0;0  0.1834 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6666 (1.68)     5.6666 (1.68)     5.6666 (1.68)     0.0000 (1.0)      5.6666 (1.68)     0.0000 (1.0)           0;0  0.1765 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4807 (1.62)     5.4807 (1.62)     5.4807 (1.62)     0.0000 (1.0)      5.4807 (1.62)     0.0000 (1.0)           0;0  0.1825 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3733 (1.0)      3.3733 (1.0)      3.3733 (1.0)      0.0000 (1.0)      3.3733 (1.0)      0.0000 (1.0)           0;0  0.2964 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6150 (1.07)     3.6150 (1.07)     3.6150 (1.07)     0.0000 (1.0)      3.6150 (1.07)     0.0000 (1.0)           0;0  0.2766 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7595 (2.22)     8.7595 (2.22)     8.7595 (2.22)     0.0000 (1.0)      8.7595 (2.22)     0.0000 (1.0)           0;0  0.1142 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4563 (1.64)     6.4563 (1.64)     6.4563 (1.64)     0.0000 (1.0)      6.4563 (1.64)     0.0000 (1.0)           0;0  0.1549 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2322 (1.58)     6.2322 (1.58)     6.2322 (1.58)     0.0000 (1.0)      6.2322 (1.58)     0.0000 (1.0)           0;0  0.1605 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9389 (1.0)      3.9389 (1.0)      3.9389 (1.0)      0.0000 (1.0)      3.9389 (1.0)      0.0000 (1.0)           0;0  0.2539 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.5014 (1.14)     4.5014 (1.14)     4.5014 (1.14)     0.0000 (1.0)      4.5014 (1.14)     0.0000 (1.0)           0;0  0.2222 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.6072 (2.59)     25.6072 (2.59)     25.6072 (2.59)     0.0000 (1.0)      25.6072 (2.59)     0.0000 (1.0)           0;0  0.0391 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     18.9563 (1.92)     18.9563 (1.92)     18.9563 (1.92)     0.0000 (1.0)      18.9563 (1.92)     0.0000 (1.0)           0;0  0.0528 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.6639 (1.78)     17.6639 (1.78)     17.6639 (1.78)     0.0000 (1.0)      17.6639 (1.78)     0.0000 (1.0)           0;0  0.0566 (0.56)          1           1
test_checkout_symlink-checkout[3.60.1]      9.8979 (1.0)       9.8979 (1.0)       9.8979 (1.0)      0.0000 (1.0)       9.8979 (1.0)      0.0000 (1.0)           0;0  0.1010 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.7442 (1.09)     10.7442 (1.09)     10.7442 (1.09)     0.0000 (1.0)      10.7442 (1.09)     0.0000 (1.0)           0;0  0.0931 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8204 (1.58)     6.8204 (1.58)     6.8204 (1.58)     0.0000 (1.0)      6.8204 (1.58)     0.0000 (1.0)           0;0  0.1466 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9338 (1.61)     6.9338 (1.61)     6.9338 (1.61)     0.0000 (1.0)      6.9338 (1.61)     0.0000 (1.0)           0;0  0.1442 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6688 (1.55)     6.6688 (1.55)     6.6688 (1.55)     0.0000 (1.0)      6.6688 (1.55)     0.0000 (1.0)           0;0  0.1500 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3110 (1.0)      4.3110 (1.0)      4.3110 (1.0)      0.0000 (1.0)      4.3110 (1.0)      0.0000 (1.0)           0;0  0.2320 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5859 (1.06)     4.5859 (1.06)     4.5859 (1.06)     0.0000 (1.0)      4.5859 (1.06)     0.0000 (1.0)           0;0  0.2181 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.9140 (1.89)     10.9140 (1.89)     10.9140 (1.89)     0.0000 (1.0)      10.9140 (1.89)     0.0000 (1.0)           0;0  0.0916 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.5965 (1.49)      8.5965 (1.49)      8.5965 (1.49)     0.0000 (1.0)       8.5965 (1.49)     0.0000 (1.0)           0;0  0.1163 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.2904 (1.43)      8.2904 (1.43)      8.2904 (1.43)     0.0000 (1.0)       8.2904 (1.43)     0.0000 (1.0)           0;0  0.1206 (0.70)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7805 (1.0)       5.7805 (1.0)       5.7805 (1.0)      0.0000 (1.0)       5.7805 (1.0)      0.0000 (1.0)           0;0  0.1730 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.3188 (1.09)      6.3188 (1.09)      6.3188 (1.09)     0.0000 (1.0)       6.3188 (1.09)     0.0000 (1.0)           0;0  0.1583 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9185 (1.71)     3.9185 (1.71)     3.9185 (1.71)     0.0000 (1.0)      3.9185 (1.71)     0.0000 (1.0)           0;0  0.2552 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.6062 (2.01)     4.6062 (2.01)     4.6062 (2.01)     0.0000 (1.0)      4.6062 (2.01)     0.0000 (1.0)           0;0  0.2171 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.5213 (1.98)     4.5213 (1.98)     4.5213 (1.98)     0.0000 (1.0)      4.5213 (1.98)     0.0000 (1.0)           0;0  0.2212 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.2874 (1.0)      2.2874 (1.0)      2.2874 (1.0)      0.0000 (1.0)      2.2874 (1.0)      0.0000 (1.0)           0;0  0.4372 (1.0)           1           1
test_data_status-data-changed[main]       2.5191 (1.10)     2.5191 (1.10)     2.5191 (1.10)     0.0000 (1.0)      2.5191 (1.10)     0.0000 (1.0)           0;0  0.3970 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2724 (1.86)     4.2724 (1.86)     4.2724 (1.86)     0.0000 (1.0)      4.2724 (1.86)     0.0000 (1.0)           0;0  0.2341 (0.54)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7457 (2.07)     4.7457 (2.07)     4.7457 (2.07)     0.0000 (1.0)      4.7457 (2.07)     0.0000 (1.0)           0;0  0.2107 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8172 (2.10)     4.8172 (2.10)     4.8172 (2.10)     0.0000 (1.0)      4.8172 (2.10)     0.0000 (1.0)           0;0  0.2076 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2917 (1.0)      2.2917 (1.0)      2.2917 (1.0)      0.0000 (1.0)      2.2917 (1.0)      0.0000 (1.0)           0;0  0.4364 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5570 (1.12)     2.5570 (1.12)     2.5570 (1.12)     0.0000 (1.0)      2.5570 (1.12)     0.0000 (1.0)           0;0  0.3911 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.4193 (3.82)     18.4193 (3.82)     18.4193 (3.82)     0.0000 (1.0)      18.4193 (3.82)     0.0000 (1.0)           0;0  0.0543 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.2463 (3.99)     19.2463 (3.99)     19.2463 (3.99)     0.0000 (1.0)      19.2463 (3.99)     0.0000 (1.0)           0;0  0.0520 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.5433 (3.84)     18.5433 (3.84)     18.5433 (3.84)     0.0000 (1.0)      18.5433 (3.84)     0.0000 (1.0)           0;0  0.0539 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8241 (1.0)       4.8241 (1.0)       4.8241 (1.0)      0.0000 (1.0)       4.8241 (1.0)      0.0000 (1.0)           0;0  0.2073 (1.0)           1           1
test_data_status-data-new[main]        5.0519 (1.05)      5.0519 (1.05)      5.0519 (1.05)     0.0000 (1.0)       5.0519 (1.05)     0.0000 (1.0)           0;0  0.1979 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1481 (1.82)     4.1481 (1.82)     4.1481 (1.82)     0.0000 (1.0)      4.1481 (1.82)     0.0000 (1.0)           0;0  0.2411 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.7440 (2.08)     4.7440 (2.08)     4.7440 (2.08)     0.0000 (1.0)      4.7440 (2.08)     0.0000 (1.0)           0;0  0.2108 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6127 (2.02)     4.6127 (2.02)     4.6127 (2.02)     0.0000 (1.0)      4.6127 (2.02)     0.0000 (1.0)           0;0  0.2168 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.2793 (1.0)      2.2793 (1.0)      2.2793 (1.0)      0.0000 (1.0)      2.2793 (1.0)      0.0000 (1.0)           0;0  0.4387 (1.0)           1           1
test_data_status-data-noop[main]       2.5599 (1.12)     2.5599 (1.12)     2.5599 (1.12)     0.0000 (1.0)      2.5599 (1.12)     0.0000 (1.0)           0;0  0.3906 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.3177 (1.32)     7.3177 (1.32)     7.3177 (1.32)     0.0000 (1.0)      7.3177 (1.32)     0.0000 (1.0)           0;0  0.1367 (0.76)          1           1
test_data_status_all_flags-data-changed[3.10.0]     8.1721 (1.48)     8.1721 (1.48)     8.1721 (1.48)     0.0000 (1.0)      8.1721 (1.48)     0.0000 (1.0)           0;0  0.1224 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7464 (1.40)     7.7464 (1.40)     7.7464 (1.40)     0.0000 (1.0)      7.7464 (1.40)     0.0000 (1.0)           0;0  0.1291 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5398 (1.0)      5.5398 (1.0)      5.5398 (1.0)      0.0000 (1.0)      5.5398 (1.0)      0.0000 (1.0)           0;0  0.1805 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9517 (1.07)     5.9517 (1.07)     5.9517 (1.07)     0.0000 (1.0)      5.9517 (1.07)     0.0000 (1.0)           0;0  0.1680 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.5272 (1.32)     7.5272 (1.32)     7.5272 (1.32)     0.0000 (1.0)      7.5272 (1.32)     0.0000 (1.0)           0;0  0.1329 (0.76)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9920 (1.40)     7.9920 (1.40)     7.9920 (1.40)     0.0000 (1.0)      7.9920 (1.40)     0.0000 (1.0)           0;0  0.1251 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7813 (1.36)     7.7813 (1.36)     7.7813 (1.36)     0.0000 (1.0)      7.7813 (1.36)     0.0000 (1.0)           0;0  0.1285 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7027 (1.0)      5.7027 (1.0)      5.7027 (1.0)      0.0000 (1.0)      5.7027 (1.0)      0.0000 (1.0)           0;0  0.1754 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.9482 (1.04)     5.9482 (1.04)     5.9482 (1.04)     0.0000 (1.0)      5.9482 (1.04)     0.0000 (1.0)           0;0  0.1681 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     22.0236 (2.78)     22.0236 (2.78)     22.0236 (2.78)     0.0000 (1.0)      22.0236 (2.78)     0.0000 (1.0)           0;0  0.0454 (0.36)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.6090 (2.86)     22.6090 (2.86)     22.6090 (2.86)     0.0000 (1.0)      22.6090 (2.86)     0.0000 (1.0)           0;0  0.0442 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.0496 (2.79)     22.0496 (2.79)     22.0496 (2.79)     0.0000 (1.0)      22.0496 (2.79)     0.0000 (1.0)           0;0  0.0454 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9100 (1.0)       7.9100 (1.0)       7.9100 (1.0)      0.0000 (1.0)       7.9100 (1.0)      0.0000 (1.0)           0;0  0.1264 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4816 (1.07)      8.4816 (1.07)      8.4816 (1.07)     0.0000 (1.0)       8.4816 (1.07)     0.0000 (1.0)           0;0  0.1179 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.7099 (1.40)     6.7099 (1.40)     6.7099 (1.40)     0.0000 (1.0)      6.7099 (1.40)     0.0000 (1.0)           0;0  0.1490 (0.71)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.3266 (1.53)     7.3266 (1.53)     7.3266 (1.53)     0.0000 (1.0)      7.3266 (1.53)     0.0000 (1.0)           0;0  0.1365 (0.65)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.2661 (1.52)     7.2661 (1.52)     7.2661 (1.52)     0.0000 (1.0)      7.2661 (1.52)     0.0000 (1.0)           0;0  0.1376 (0.66)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7838 (1.0)      4.7838 (1.0)      4.7838 (1.0)      0.0000 (1.0)      4.7838 (1.0)      0.0000 (1.0)           0;0  0.2090 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2719 (1.10)     5.2719 (1.10)     5.2719 (1.10)     0.0000 (1.0)      5.2719 (1.10)     0.0000 (1.0)           0;0  0.1897 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.1460 (2.58)     18.1460 (2.58)     18.1460 (2.58)     0.0000 (1.0)      18.1460 (2.58)     0.0000 (1.0)           0;0  0.0551 (0.39)          1           1
test_diff-diff[3.10.0]     19.3594 (2.75)     19.3594 (2.75)     19.3594 (2.75)     0.0000 (1.0)      19.3594 (2.75)     0.0000 (1.0)           0;0  0.0517 (0.36)          1           1
test_diff-diff[3.53.2]     19.5439 (2.77)     19.5439 (2.77)     19.5439 (2.77)     0.0000 (1.0)      19.5439 (2.77)     0.0000 (1.0)           0;0  0.0512 (0.36)          1           1
test_diff-diff[3.60.1]      7.0470 (1.0)       7.0470 (1.0)       7.0470 (1.0)      0.0000 (1.0)       7.0470 (1.0)      0.0000 (1.0)           0;0  0.1419 (1.0)           1           1
test_diff-diff[main]        8.0585 (1.14)      8.0585 (1.14)      8.0585 (1.14)     0.0000 (1.0)       8.0585 (1.14)     0.0000 (1.0)           0;0  0.1241 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2766 (1.80)     6.2766 (1.80)     6.2766 (1.80)     0.0000 (1.0)      6.2766 (1.80)     0.0000 (1.0)           0;0  0.1593 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.8065 (1.95)     6.8065 (1.95)     6.8065 (1.95)     0.0000 (1.0)      6.8065 (1.95)     0.0000 (1.0)           0;0  0.1469 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.7848 (1.65)     5.7848 (1.65)     5.7848 (1.65)     0.0000 (1.0)      5.7848 (1.65)     0.0000 (1.0)           0;0  0.1729 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.4958 (1.0)      3.4958 (1.0)      3.4958 (1.0)      0.0000 (1.0)      3.4958 (1.0)      0.0000 (1.0)           0;0  0.2861 (1.0)           1           1
test_diff-diff-changed[main]       4.2437 (1.21)     4.2437 (1.21)     4.2437 (1.21)     0.0000 (1.0)      4.2437 (1.21)     0.0000 (1.0)           0;0  0.2356 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.4382 (1.54)     5.4382 (1.54)     5.4382 (1.54)     0.0000 (1.0)      5.4382 (1.54)     0.0000 (1.0)           0;0  0.1839 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0886 (1.72)     6.0886 (1.72)     6.0886 (1.72)     0.0000 (1.0)      6.0886 (1.72)     0.0000 (1.0)           0;0  0.1642 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.7161 (1.61)     5.7161 (1.61)     5.7161 (1.61)     0.0000 (1.0)      5.7161 (1.61)     0.0000 (1.0)           0;0  0.1749 (0.62)          1           1
test_diff-diff-changed-noop[3.60.1]     3.5402 (1.0)      3.5402 (1.0)      3.5402 (1.0)      0.0000 (1.0)      3.5402 (1.0)      0.0000 (1.0)           0;0  0.2825 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.4127 (1.25)     4.4127 (1.25)     4.4127 (1.25)     0.0000 (1.0)      4.4127 (1.25)     0.0000 (1.0)           0;0  0.2266 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2728 (1.24)     4.2728 (1.24)     4.2728 (1.24)     0.0000 (1.0)      4.2728 (1.24)     0.0000 (1.0)           0;0  0.2340 (0.81)          1           1
test_diff-diff-noop[3.10.0]     4.8605 (1.41)     4.8605 (1.41)     4.8605 (1.41)     0.0000 (1.0)      4.8605 (1.41)     0.0000 (1.0)           0;0  0.2057 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.6957 (1.65)     5.6957 (1.65)     5.6957 (1.65)     0.0000 (1.0)      5.6957 (1.65)     0.0000 (1.0)           0;0  0.1756 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.4523 (1.0)      3.4523 (1.0)      3.4523 (1.0)      0.0000 (1.0)      3.4523 (1.0)      0.0000 (1.0)           0;0  0.2897 (1.0)           1           1
test_diff-diff-noop[main]       4.2722 (1.24)     4.2722 (1.24)     4.2722 (1.24)     0.0000 (1.0)      4.2722 (1.24)     0.0000 (1.0)           0;0  0.2341 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0019 (1.0)      1.0019 (1.0)      1.0019 (1.0)      0.0000 (1.0)      1.0019 (1.0)      0.0000 (1.0)           0;0  0.9981 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.1382 (4.13)     4.1382 (4.13)     4.1382 (4.13)     0.0000 (1.0)      4.1382 (4.13)     0.0000 (1.0)           0;0  0.2417 (0.24)          1           1
test_exp_show-exp[3.53.2]     2.3839 (2.38)     2.3839 (2.38)     2.3839 (2.38)     0.0000 (1.0)      2.3839 (2.38)     0.0000 (1.0)           0;0  0.4195 (0.42)          1           1
test_exp_show-exp[3.60.1]     2.2471 (2.24)     2.2471 (2.24)     2.2471 (2.24)     0.0000 (1.0)      2.2471 (2.24)     0.0000 (1.0)           0;0  0.4450 (0.45)          1           1
test_exp_show-exp[main]       6.0504 (6.04)     6.0504 (6.04)     6.0504 (6.04)     0.0000 (1.0)      6.0504 (6.04)     0.0000 (1.0)           0;0  0.1653 (0.17)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     64.7935 (2.81)     64.7935 (2.81)     64.7935 (2.81)     0.0000 (1.0)      64.7935 (2.81)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.2861 (3.05)     70.2861 (3.05)     70.2861 (3.05)     0.0000 (1.0)      70.2861 (3.05)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.7173 (1.46)     33.7173 (1.46)     33.7173 (1.46)     0.0000 (1.0)      33.7173 (1.46)     0.0000 (1.0)           0;0  0.0297 (0.68)          1           1
test_fetch-fetch[3.60.1]     23.0448 (1.0)      23.0448 (1.0)      23.0448 (1.0)      0.0000 (1.0)      23.0448 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
test_fetch-fetch[main]       23.1703 (1.01)     23.1703 (1.01)     23.1703 (1.01)     0.0000 (1.0)      23.1703 (1.01)     0.0000 (1.0)           0;0  0.0432 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8178 (1.01)     2.8178 (1.01)     2.8178 (1.01)     0.0000 (1.0)      2.8178 (1.01)     0.0000 (1.0)           0;0  0.3549 (0.99)          1           1
test_gc-gc[3.10.0]     2.8994 (1.04)     2.8994 (1.04)     2.8994 (1.04)     0.0000 (1.0)      2.8994 (1.04)     0.0000 (1.0)           0;0  0.3449 (0.96)          1           1
test_gc-gc[3.53.2]     2.8397 (1.02)     2.8397 (1.02)     2.8397 (1.02)     0.0000 (1.0)      2.8397 (1.02)     0.0000 (1.0)           0;0  0.3522 (0.98)          1           1
test_gc-gc[3.60.1]     2.7860 (1.0)      2.7860 (1.0)      2.7860 (1.0)      0.0000 (1.0)      2.7860 (1.0)      0.0000 (1.0)           0;0  0.3589 (1.0)           1           1
test_gc-gc[main]       2.9770 (1.07)     2.9770 (1.07)     2.9770 (1.07)     0.0000 (1.0)      2.9770 (1.07)     0.0000 (1.0)           0;0  0.3359 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     135.5251 (2.68)     135.5251 (2.68)     135.5251 (2.68)     0.0000 (1.0)      135.5251 (2.68)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     164.1370 (3.25)     164.1370 (3.25)     164.1370 (3.25)     0.0000 (1.0)      164.1370 (3.25)     0.0000 (1.0)           0;0  0.0061 (0.31)          1           1
test_get-get[3.53.2]     143.5900 (2.84)     143.5900 (2.84)     143.5900 (2.84)     0.0000 (1.0)      143.5900 (2.84)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      50.7249 (1.00)      50.7249 (1.00)      50.7249 (1.00)     0.0000 (1.0)       50.7249 (1.00)     0.0000 (1.0)           0;0  0.0197 (1.00)          1           1
test_get-get[main]        50.4903 (1.0)       50.4903 (1.0)       50.4903 (1.0)      0.0000 (1.0)       50.4903 (1.0)      0.0000 (1.0)           0;0  0.0198 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.6437 (2.71)     44.6437 (2.71)     44.6437 (2.71)     0.0000 (1.0)      44.6437 (2.71)     0.0000 (1.0)           0;0  0.0224 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.3759 (2.87)     47.3759 (2.87)     47.3759 (2.87)     0.0000 (1.0)      47.3759 (2.87)     0.0000 (1.0)           0;0  0.0211 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.6863 (1.01)     16.6863 (1.01)     16.6863 (1.01)     0.0000 (1.0)      16.6863 (1.01)     0.0000 (1.0)           0;0  0.0599 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.5032 (1.0)      16.5032 (1.0)      16.5032 (1.0)      0.0000 (1.0)      16.5032 (1.0)      0.0000 (1.0)           0;0  0.0606 (1.0)           1           1
test_get_url-get-url[main]       16.7189 (1.01)     16.7189 (1.01)     16.7189 (1.01)     0.0000 (1.0)      16.7189 (1.01)     0.0000 (1.0)           0;0  0.0598 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     122.0703 (1.01)     130.1878 (1.05)     123.4149 (1.01)     1.0769 (1.95)     123.2509 (1.01)     0.8354 (1.24)         12;4  8.1028 (0.99)        100           1
test_help---help[3.10.0]     120.7666 (1.0)      123.6687 (1.0)      121.8900 (1.0)      0.5519 (1.0)      121.8960 (1.0)      0.6730 (1.00)         31;2  8.2041 (1.0)         100           1
test_help---help[3.53.2]     122.2987 (1.01)     128.1692 (1.04)     123.5841 (1.01)     0.8221 (1.49)     123.4487 (1.01)     0.6898 (1.03)         15;4  8.0917 (0.99)        100           1
test_help---help[3.60.1]     123.3885 (1.02)     135.5829 (1.10)     124.4926 (1.02)     1.2351 (2.24)     124.3278 (1.02)     0.6725 (1.0)           2;2  8.0326 (0.98)        100           1
test_help---help[main]       123.1847 (1.02)     157.5941 (1.27)     126.5868 (1.04)     6.4695 (11.72)    124.5053 (1.02)     0.9548 (1.42)        10;13  7.8997 (0.96)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     221.0491 (2.97)     221.0491 (2.97)     221.0491 (2.97)     0.0000 (1.0)      221.0491 (2.97)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     252.1244 (3.38)     252.1244 (3.38)     252.1244 (3.38)     0.0000 (1.0)      252.1244 (3.38)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      74.4988 (1.0)       74.4988 (1.0)       74.4988 (1.0)      0.0000 (1.0)       74.4988 (1.0)      0.0000 (1.0)           0;0  0.0134 (1.0)           1           1
test_import-import[main]        75.9388 (1.02)      75.9388 (1.02)      75.9388 (1.02)     0.0000 (1.0)       75.9388 (1.02)     0.0000 (1.0)           0;0  0.0132 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     157.5633 (3.35)     157.5633 (3.35)     157.5633 (3.35)     0.0000 (1.0)      157.5633 (3.35)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     159.3993 (3.39)     159.3993 (3.39)     159.3993 (3.39)     0.0000 (1.0)      159.3993 (3.39)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     118.8814 (2.53)     118.8814 (2.53)     118.8814 (2.53)     0.0000 (1.0)      118.8814 (2.53)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.9976 (1.0)       46.9976 (1.0)       46.9976 (1.0)      0.0000 (1.0)       46.9976 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_import_url-import-url[main]        48.2505 (1.03)      48.2505 (1.03)      48.2505 (1.03)     0.0000 (1.0)       48.2505 (1.03)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     400.9322 (1.05)     457.0481 (1.08)     418.0893 (1.05)      9.7293 (1.59)     416.9988 (1.04)     10.4889 (1.77)         26;5  2.3918 (0.96)        100           1
test_init-init[3.10.0]     404.1243 (1.05)     444.8889 (1.05)     417.4063 (1.04)      7.8964 (1.29)     416.0466 (1.04)      9.4189 (1.59)         33;3  2.3957 (0.96)        100           1
test_init-init[3.53.2]     383.3937 (1.0)      422.3428 (1.0)      399.7412 (1.0)       6.1189 (1.0)      400.3585 (1.0)       5.9319 (1.0)          24;7  2.5016 (1.0)         100           1
test_init-init[3.60.1]     387.3977 (1.01)     439.4679 (1.04)     410.7073 (1.03)     13.0569 (2.13)     409.1660 (1.02)     20.5843 (3.47)         33;0  2.4348 (0.97)        100           1
test_init-init[main]       436.2325 (1.14)     494.1270 (1.17)     461.9507 (1.16)     13.5760 (2.22)     460.9822 (1.15)     22.1666 (3.74)         43;0  2.1647 (0.87)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     568.5233 (1.08)     568.5233 (1.08)     568.5233 (1.08)     0.0000 (1.0)      568.5233 (1.08)     0.0000 (1.0)           0;0  1.7589 (0.92)          1           1
test_list-list[3.10.0]     665.9709 (1.27)     665.9709 (1.27)     665.9709 (1.27)     0.0000 (1.0)      665.9709 (1.27)     0.0000 (1.0)           0;0  1.5016 (0.79)          1           1
test_list-list[3.53.2]     576.2485 (1.10)     576.2485 (1.10)     576.2485 (1.10)     0.0000 (1.0)      576.2485 (1.10)     0.0000 (1.0)           0;0  1.7354 (0.91)          1           1
test_list-list[3.60.1]     525.8668 (1.0)      525.8668 (1.0)      525.8668 (1.0)      0.0000 (1.0)      525.8668 (1.0)      0.0000 (1.0)           0;0  1.9016 (1.0)           1           1
test_list-list[main]       553.7540 (1.05)     553.7540 (1.05)     553.7540 (1.05)     0.0000 (1.0)      553.7540 (1.05)     0.0000 (1.0)           0;0  1.8059 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     421.0063 (1.06)     421.0063 (1.06)     421.0063 (1.06)     0.0000 (1.0)      421.0063 (1.06)     0.0000 (1.0)           0;0  2.3753 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     433.7748 (1.09)     433.7748 (1.09)     433.7748 (1.09)     0.0000 (1.0)      433.7748 (1.09)     0.0000 (1.0)           0;0  2.3053 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     405.2259 (1.02)     405.2259 (1.02)     405.2259 (1.02)     0.0000 (1.0)      405.2259 (1.02)     0.0000 (1.0)           0;0  2.4678 (0.98)          1           1
test_list-list-dvc-only[3.60.1]     398.9361 (1.0)      398.9361 (1.0)      398.9361 (1.0)      0.0000 (1.0)      398.9361 (1.0)      0.0000 (1.0)           0;0  2.5067 (1.0)           1           1
test_list-list-dvc-only[main]       428.5942 (1.07)     428.5942 (1.07)     428.5942 (1.07)     0.0000 (1.0)      428.5942 (1.07)     0.0000 (1.0)           0;0  2.3332 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6139 (1.0)      2.6139 (1.0)      2.6139 (1.0)      0.0000 (1.0)      2.6139 (1.0)      0.0000 (1.0)           0;0  0.3826 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7383 (1.05)     2.7383 (1.05)     2.7383 (1.05)     0.0000 (1.0)      2.7383 (1.05)     0.0000 (1.0)           0;0  0.3652 (0.95)          1           1
test_list-list-recursive[3.53.2]     2.8221 (1.08)     2.8221 (1.08)     2.8221 (1.08)     0.0000 (1.0)      2.8221 (1.08)     0.0000 (1.0)           0;0  0.3543 (0.93)          1           1
test_list-list-recursive[3.60.1]     2.7982 (1.07)     2.7982 (1.07)     2.7982 (1.07)     0.0000 (1.0)      2.7982 (1.07)     0.0000 (1.0)           0;0  0.3574 (0.93)          1           1
test_list-list-recursive[main]       2.7392 (1.05)     2.7392 (1.05)     2.7392 (1.05)     0.0000 (1.0)      2.7392 (1.05)     0.0000 (1.0)           0;0  0.3651 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     411.0203 (1.04)     411.0203 (1.04)     411.0203 (1.04)     0.0000 (1.0)      411.0203 (1.04)     0.0000 (1.0)           0;0  2.4330 (0.96)          1           1
test_list-list-shallow[3.10.0]     428.6253 (1.08)     428.6253 (1.08)     428.6253 (1.08)     0.0000 (1.0)      428.6253 (1.08)     0.0000 (1.0)           0;0  2.3330 (0.93)          1           1
test_list-list-shallow[3.53.2]     406.3970 (1.02)     406.3970 (1.02)     406.3970 (1.02)     0.0000 (1.0)      406.3970 (1.02)     0.0000 (1.0)           0;0  2.4606 (0.98)          1           1
test_list-list-shallow[3.60.1]     396.5045 (1.0)      396.5045 (1.0)      396.5045 (1.0)      0.0000 (1.0)      396.5045 (1.0)      0.0000 (1.0)           0;0  2.5220 (1.0)           1           1
test_list-list-shallow[main]       415.6469 (1.05)     415.6469 (1.05)     415.6469 (1.05)     0.0000 (1.0)      415.6469 (1.05)     0.0000 (1.0)           0;0  2.4059 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     69.5961 (3.64)     69.5961 (3.64)     69.5961 (3.64)     0.0000 (1.0)      69.5961 (3.64)     0.0000 (1.0)           0;0  0.0144 (0.27)          1           1
test_partial_add-add[3.10.0]     70.1964 (3.67)     70.1964 (3.67)     70.1964 (3.67)     0.0000 (1.0)      70.1964 (3.67)     0.0000 (1.0)           0;0  0.0142 (0.27)          1           1
test_partial_add-add[3.53.2]     62.3088 (3.26)     62.3088 (3.26)     62.3088 (3.26)     0.0000 (1.0)      62.3088 (3.26)     0.0000 (1.0)           0;0  0.0160 (0.31)          1           1
test_partial_add-add[3.60.1]     19.1386 (1.0)      19.1386 (1.0)      19.1386 (1.0)      0.0000 (1.0)      19.1386 (1.0)      0.0000 (1.0)           0;0  0.0523 (1.0)           1           1
test_partial_add-add[main]       20.3530 (1.06)     20.3530 (1.06)     20.3530 (1.06)     0.0000 (1.0)      20.3530 (1.06)     0.0000 (1.0)           0;0  0.0491 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.0615 (7.81)     59.0615 (7.81)     59.0615 (7.81)     0.0000 (1.0)      59.0615 (7.81)     0.0000 (1.0)           0;0  0.0169 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     59.9067 (7.92)     59.9067 (7.92)     59.9067 (7.92)     0.0000 (1.0)      59.9067 (7.92)     0.0000 (1.0)           0;0  0.0167 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     53.6124 (7.09)     53.6124 (7.09)     53.6124 (7.09)     0.0000 (1.0)      53.6124 (7.09)     0.0000 (1.0)           0;0  0.0187 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.5651 (1.0)       7.5651 (1.0)       7.5651 (1.0)      0.0000 (1.0)       7.5651 (1.0)      0.0000 (1.0)           0;0  0.1322 (1.0)           1           1
test_partial_add-add-partial[main]        7.7408 (1.02)      7.7408 (1.02)      7.7408 (1.02)     0.0000 (1.0)       7.7408 (1.02)     0.0000 (1.0)           0;0  0.1292 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.2362 (1.0)      4.2362 (1.0)      4.2362 (1.0)      0.0000 (1.0)      4.2362 (1.0)      0.0000 (1.0)           0;0  0.2361 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.6974 (1.34)     5.6974 (1.34)     5.6974 (1.34)     0.0000 (1.0)      5.6974 (1.34)     0.0000 (1.0)           0;0  0.1755 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.5413 (1.54)     6.5413 (1.54)     6.5413 (1.54)     0.0000 (1.0)      6.5413 (1.54)     0.0000 (1.0)           0;0  0.1529 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.4628 (1.53)     6.4628 (1.53)     6.4628 (1.53)     0.0000 (1.0)      6.4628 (1.53)     0.0000 (1.0)           0;0  0.1547 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.4410 (1.52)     6.4410 (1.52)     6.4410 (1.52)     0.0000 (1.0)      6.4410 (1.52)     0.0000 (1.0)           0;0  0.1553 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3832 (1.0)      2.3832 (1.0)      2.3832 (1.0)      0.0000 (1.0)      2.3832 (1.0)      0.0000 (1.0)           0;0  0.4196 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6120 (1.52)     3.6120 (1.52)     3.6120 (1.52)     0.0000 (1.0)      3.6120 (1.52)     0.0000 (1.0)           0;0  0.2769 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.5925 (1.51)     3.5925 (1.51)     3.5925 (1.51)     0.0000 (1.0)      3.5925 (1.51)     0.0000 (1.0)           0;0  0.2784 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.6174 (1.52)     3.6174 (1.52)     3.6174 (1.52)     0.0000 (1.0)      3.6174 (1.52)     0.0000 (1.0)           0;0  0.2764 (0.66)          1           1
test_partial_add-gc-noop[main]       3.6197 (1.52)     3.6197 (1.52)     3.6197 (1.52)     0.0000 (1.0)      3.6197 (1.52)     0.0000 (1.0)           0;0  0.2763 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.9839 (2.44)     44.9839 (2.44)     44.9839 (2.44)     0.0000 (1.0)      44.9839 (2.44)     0.0000 (1.0)           0;0  0.0222 (0.41)          1           1
test_partial_add-push[3.10.0]     40.0968 (2.17)     40.0968 (2.17)     40.0968 (2.17)     0.0000 (1.0)      40.0968 (2.17)     0.0000 (1.0)           0;0  0.0249 (0.46)          1           1
test_partial_add-push[3.53.2]     19.1268 (1.04)     19.1268 (1.04)     19.1268 (1.04)     0.0000 (1.0)      19.1268 (1.04)     0.0000 (1.0)           0;0  0.0523 (0.96)          1           1
test_partial_add-push[3.60.1]     18.4384 (1.0)      18.4384 (1.0)      18.4384 (1.0)      0.0000 (1.0)      18.4384 (1.0)      0.0000 (1.0)           0;0  0.0542 (1.0)           1           1
test_partial_add-push[main]       18.6216 (1.01)     18.6216 (1.01)     18.6216 (1.01)     0.0000 (1.0)      18.6216 (1.01)     0.0000 (1.0)           0;0  0.0537 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.3564 (1.14)     11.3564 (1.14)     11.3564 (1.14)     0.0000 (1.0)      11.3564 (1.14)     0.0000 (1.0)           0;0  0.0881 (0.88)          1           1
test_partial_add-push-partial[3.10.0]     10.5448 (1.06)     10.5448 (1.06)     10.5448 (1.06)     0.0000 (1.0)      10.5448 (1.06)     0.0000 (1.0)           0;0  0.0948 (0.94)          1           1
test_partial_add-push-partial[3.53.2]     10.2790 (1.03)     10.2790 (1.03)     10.2790 (1.03)     0.0000 (1.0)      10.2790 (1.03)     0.0000 (1.0)           0;0  0.0973 (0.97)          1           1
test_partial_add-push-partial[3.60.1]      9.9867 (1.00)      9.9867 (1.00)      9.9867 (1.00)     0.0000 (1.0)       9.9867 (1.00)     0.0000 (1.0)           0;0  0.1001 (1.00)          1           1
test_partial_add-push-partial[main]        9.9417 (1.0)       9.9417 (1.0)       9.9417 (1.0)      0.0000 (1.0)       9.9417 (1.0)      0.0000 (1.0)           0;0  0.1006 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.7412 (3.75)     85.7412 (3.75)     85.7412 (3.75)     0.0000 (1.0)      85.7412 (3.75)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     86.7323 (3.79)     86.7323 (3.79)     86.7323 (3.79)     0.0000 (1.0)      86.7323 (3.79)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_partial_remove-add[3.53.2]     78.1350 (3.42)     78.1350 (3.42)     78.1350 (3.42)     0.0000 (1.0)      78.1350 (3.42)     0.0000 (1.0)           0;0  0.0128 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.8546 (1.0)      22.8546 (1.0)      22.8546 (1.0)      0.0000 (1.0)      22.8546 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
test_partial_remove-add[main]       23.7427 (1.04)     23.7427 (1.04)     23.7427 (1.04)     0.0000 (1.0)      23.7427 (1.04)     0.0000 (1.0)           0;0  0.0421 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.6283 (8.01)     8.6283 (8.01)     8.6283 (8.01)     0.0000 (1.0)      8.6283 (8.01)     0.0000 (1.0)           0;0  0.1159 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.8245 (8.19)     8.8245 (8.19)     8.8245 (8.19)     0.0000 (1.0)      8.8245 (8.19)     0.0000 (1.0)           0;0  0.1133 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     8.0239 (7.44)     8.0239 (7.44)     8.0239 (7.44)     0.0000 (1.0)      8.0239 (7.44)     0.0000 (1.0)           0;0  0.1246 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.1603 (1.08)     1.1603 (1.08)     1.1603 (1.08)     0.0000 (1.0)      1.1603 (1.08)     0.0000 (1.0)           0;0  0.8618 (0.93)          1           1
test_partial_remove-add-update[main]       1.0779 (1.0)      1.0779 (1.0)      1.0779 (1.0)      0.0000 (1.0)      1.0779 (1.0)      0.0000 (1.0)           0;0  0.9278 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1620 (1.0)      3.1620 (1.0)      3.1620 (1.0)      0.0000 (1.0)      3.1620 (1.0)      0.0000 (1.0)           0;0  0.3163 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5914 (1.14)     3.5914 (1.14)     3.5914 (1.14)     0.0000 (1.0)      3.5914 (1.14)     0.0000 (1.0)           0;0  0.2784 (0.88)          1           1
test_partial_remove-gc[3.53.2]     3.5654 (1.13)     3.5654 (1.13)     3.5654 (1.13)     0.0000 (1.0)      3.5654 (1.13)     0.0000 (1.0)           0;0  0.2805 (0.89)          1           1
test_partial_remove-gc[3.60.1]     3.6702 (1.16)     3.6702 (1.16)     3.6702 (1.16)     0.0000 (1.0)      3.6702 (1.16)     0.0000 (1.0)           0;0  0.2725 (0.86)          1           1
test_partial_remove-gc[main]       3.5518 (1.12)     3.5518 (1.12)     3.5518 (1.12)     0.0000 (1.0)      3.5518 (1.12)     0.0000 (1.0)           0;0  0.2815 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7062 (1.00)     4.7062 (1.00)     4.7062 (1.00)     0.0000 (1.0)      4.7062 (1.00)     0.0000 (1.0)           0;0  0.2125 (1.00)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1008 (1.09)     5.1008 (1.09)     5.1008 (1.09)     0.0000 (1.0)      5.1008 (1.09)     0.0000 (1.0)           0;0  0.1960 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.9527 (1.06)     4.9527 (1.06)     4.9527 (1.06)     0.0000 (1.0)      4.9527 (1.06)     0.0000 (1.0)           0;0  0.2019 (0.95)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.9776 (1.06)     4.9776 (1.06)     4.9776 (1.06)     0.0000 (1.0)      4.9776 (1.06)     0.0000 (1.0)           0;0  0.2009 (0.94)          1           1
test_partial_remove-gc-cloud[main]       4.6867 (1.0)      4.6867 (1.0)      4.6867 (1.0)      0.0000 (1.0)      4.6867 (1.0)      0.0000 (1.0)           0;0  0.2134 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.2015 (2.40)     52.2015 (2.40)     52.2015 (2.40)     0.0000 (1.0)      52.2015 (2.40)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_partial_remove-push[3.10.0]     46.1196 (2.12)     46.1196 (2.12)     46.1196 (2.12)     0.0000 (1.0)      46.1196 (2.12)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_partial_remove-push[3.53.2]     22.9078 (1.05)     22.9078 (1.05)     22.9078 (1.05)     0.0000 (1.0)      22.9078 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.95)          1           1
test_partial_remove-push[3.60.1]     22.2902 (1.02)     22.2902 (1.02)     22.2902 (1.02)     0.0000 (1.0)      22.2902 (1.02)     0.0000 (1.0)           0;0  0.0449 (0.98)          1           1
test_partial_remove-push[main]       21.7812 (1.0)      21.7812 (1.0)      21.7812 (1.0)      0.0000 (1.0)      21.7812 (1.0)      0.0000 (1.0)           0;0  0.0459 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7992 (1.0)      1.7992 (1.0)      1.7992 (1.0)      0.0000 (1.0)      1.7992 (1.0)      0.0000 (1.0)           0;0  0.5558 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8266 (1.02)     1.8266 (1.02)     1.8266 (1.02)     0.0000 (1.0)      1.8266 (1.02)     0.0000 (1.0)           0;0  0.5475 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.5258 (1.40)     2.5258 (1.40)     2.5258 (1.40)     0.0000 (1.0)      2.5258 (1.40)     0.0000 (1.0)           0;0  0.3959 (0.71)          1           1
test_partial_remove-push-update[3.60.1]     2.4566 (1.37)     2.4566 (1.37)     2.4566 (1.37)     0.0000 (1.0)      2.4566 (1.37)     0.0000 (1.0)           0;0  0.4071 (0.73)          1           1
test_partial_remove-push-update[main]       2.5154 (1.40)     2.5154 (1.40)     2.5154 (1.40)     0.0000 (1.0)      2.5154 (1.40)     0.0000 (1.0)           0;0  0.3975 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     496.8113 (1.0)      511.0382 (1.0)      503.4422 (1.0)       5.7843 (1.0)      501.7613 (1.0)       9.2764 (1.0)           2;0  1.9863 (1.0)           5           3
test_plots-plots-diff[3.10.0]     906.7451 (1.83)     935.3823 (1.83)     924.0097 (1.84)     11.9201 (2.06)     928.7430 (1.85)     18.6752 (2.01)          1;0  1.0822 (0.54)          5           3
test_plots-plots-diff[3.53.2]     821.8594 (1.65)     846.2618 (1.66)     834.2640 (1.66)      9.1202 (1.58)     833.4977 (1.66)     12.2505 (1.32)          2;0  1.1987 (0.60)          5           3
test_plots-plots-diff[3.60.1]     838.5953 (1.69)     868.1340 (1.70)     847.8155 (1.68)     12.1100 (2.09)     845.7593 (1.69)     14.3918 (1.55)          1;0  1.1795 (0.59)          5           3
test_plots-plots-diff[main]       844.4060 (1.70)     884.6125 (1.73)     863.3519 (1.71)     16.9729 (2.93)     864.6257 (1.72)     29.4157 (3.17)          2;0  1.1583 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       513.6058 (1.0)        543.1556 (1.0)        530.1024 (1.0)      11.6620 (2.20)       533.7347 (1.0)      17.3528 (2.32)          2;0  1.8864 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,147.7239 (2.23)     1,193.8341 (2.20)     1,162.0701 (2.19)     18.7878 (3.54)     1,160.1226 (2.17)     20.6335 (2.76)          1;0  0.8605 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       894.8704 (1.74)       908.8751 (1.67)       902.1512 (1.70)      5.3062 (1.0)        902.7716 (1.69)      7.4721 (1.0)           2;0  1.1085 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       900.0443 (1.75)       924.4217 (1.70)       909.4029 (1.72)      9.4754 (1.79)       906.1483 (1.70)     12.1407 (1.62)          1;0  1.0996 (0.58)          5           3
test_plots-plots-diff-json[main]         917.4323 (1.79)       983.2066 (1.81)       948.7658 (1.79)     25.3812 (4.78)       946.3835 (1.77)     37.7344 (5.05)          2;0  1.0540 (0.56)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     419.0845 (1.0)      431.5276 (1.0)      425.0259 (1.0)      4.8418 (1.0)      425.2206 (1.0)       7.3368 (1.25)          2;0  2.3528 (1.0)           5           3
test_plots-plots-show[3.10.0]     743.9464 (1.78)     759.0368 (1.76)     748.7267 (1.76)     6.1091 (1.26)     745.7592 (1.75)      6.7812 (1.16)          1;0  1.3356 (0.57)          5           3
test_plots-plots-show[3.53.2]     704.1362 (1.68)     724.6684 (1.68)     714.3071 (1.68)     9.4554 (1.95)     716.5378 (1.69)     17.6339 (3.01)          3;0  1.4000 (0.60)          5           3
test_plots-plots-show[3.60.1]     723.8897 (1.73)     736.8790 (1.71)     732.0761 (1.72)     5.0070 (1.03)     733.6642 (1.73)      5.8585 (1.0)           1;0  1.3660 (0.58)          5           3
test_plots-plots-show[main]       715.5199 (1.71)     728.5902 (1.69)     723.2158 (1.70)     5.0935 (1.05)     724.9135 (1.70)      7.0309 (1.20)          2;0  1.3827 (0.59)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     431.3714 (1.0)      438.3619 (1.0)      434.7209 (1.0)       3.2089 (1.0)      434.5487 (1.0)       6.0787 (1.0)           2;0  2.3003 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     875.7527 (2.03)     892.8997 (2.04)     882.3145 (2.03)      8.1255 (2.53)     876.9008 (2.02)     13.6973 (2.25)          1;0  1.1334 (0.49)          5           3
test_plots-plots-show-json[3.53.2]     762.5549 (1.77)     813.0726 (1.85)     783.1946 (1.80)     23.7503 (7.40)     767.9222 (1.77)     40.4132 (6.65)          1;0  1.2768 (0.56)          5           3
test_plots-plots-show-json[3.60.1]     763.1213 (1.77)     789.6202 (1.80)     773.0921 (1.78)     10.1862 (3.17)     769.0708 (1.77)     11.7178 (1.93)          1;0  1.2935 (0.56)          5           3
test_plots-plots-show-json[main]       752.9704 (1.75)     784.1311 (1.79)     763.2207 (1.76)     12.2796 (3.83)     759.9013 (1.75)     12.8639 (2.12)          1;0  1.3102 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.7885 (2.46)     53.7885 (2.46)     53.7885 (2.46)     0.0000 (1.0)      53.7885 (2.46)     0.0000 (1.0)           0;0  0.0186 (0.41)          1           1
test_push-push[3.10.0]     47.7076 (2.18)     47.7076 (2.18)     47.7076 (2.18)     0.0000 (1.0)      47.7076 (2.18)     0.0000 (1.0)           0;0  0.0210 (0.46)          1           1
test_push-push[3.53.2]     22.8563 (1.04)     22.8563 (1.04)     22.8563 (1.04)     0.0000 (1.0)      22.8563 (1.04)     0.0000 (1.0)           0;0  0.0438 (0.96)          1           1
test_push-push[3.60.1]     21.8811 (1.0)      21.8811 (1.0)      21.8811 (1.0)      0.0000 (1.0)      21.8811 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
test_push-push[main]       22.0026 (1.01)     22.0026 (1.01)     22.0026 (1.01)     0.0000 (1.0)      22.0026 (1.01)     0.0000 (1.0)           0;0  0.0454 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.5186 (2.75)     64.5186 (2.75)     64.5186 (2.75)     0.0000 (1.0)      64.5186 (2.75)     0.0000 (1.0)           0;0  0.0155 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.4036 (3.00)     70.4036 (3.00)     70.4036 (3.00)     0.0000 (1.0)      70.4036 (3.00)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_sharing-fetch[3.53.2]     34.2822 (1.46)     34.2822 (1.46)     34.2822 (1.46)     0.0000 (1.0)      34.2822 (1.46)     0.0000 (1.0)           0;0  0.0292 (0.68)          1           1
test_sharing-fetch[3.60.1]     23.4647 (1.00)     23.4647 (1.00)     23.4647 (1.00)     0.0000 (1.0)      23.4647 (1.00)     0.0000 (1.0)           0;0  0.0426 (1.00)          1           1
test_sharing-fetch[main]       23.4337 (1.0)      23.4337 (1.0)      23.4337 (1.0)      0.0000 (1.0)      23.4337 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2561 (1.0)      1.2561 (1.0)      1.2561 (1.0)      0.0000 (1.0)      1.2561 (1.0)      0.0000 (1.0)           0;0  0.7961 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5462 (2.82)     3.5462 (2.82)     3.5462 (2.82)     0.0000 (1.0)      3.5462 (2.82)     0.0000 (1.0)           0;0  0.2820 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.8575 (4.66)     5.8575 (4.66)     5.8575 (4.66)     0.0000 (1.0)      5.8575 (4.66)     0.0000 (1.0)           0;0  0.1707 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.8987 (4.70)     5.8987 (4.70)     5.8987 (4.70)     0.0000 (1.0)      5.8987 (4.70)     0.0000 (1.0)           0;0  0.1695 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9935 (4.77)     5.9935 (4.77)     5.9935 (4.77)     0.0000 (1.0)      5.9935 (4.77)     0.0000 (1.0)           0;0  0.1668 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.3461 (2.33)     52.3461 (2.33)     52.3461 (2.33)     0.0000 (1.0)      52.3461 (2.33)     0.0000 (1.0)           0;0  0.0191 (0.43)          1           1
test_sharing-push[3.10.0]     46.5590 (2.07)     46.5590 (2.07)     46.5590 (2.07)     0.0000 (1.0)      46.5590 (2.07)     0.0000 (1.0)           0;0  0.0215 (0.48)          1           1
test_sharing-push[3.53.2]     23.4484 (1.04)     23.4484 (1.04)     23.4484 (1.04)     0.0000 (1.0)      23.4484 (1.04)     0.0000 (1.0)           0;0  0.0426 (0.96)          1           1
test_sharing-push[3.60.1]     22.5068 (1.00)     22.5068 (1.00)     22.5068 (1.00)     0.0000 (1.0)      22.5068 (1.00)     0.0000 (1.0)           0;0  0.0444 (1.00)          1           1
test_sharing-push[main]       22.4585 (1.0)      22.4585 (1.0)      22.4585 (1.0)      0.0000 (1.0)      22.4585 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1605 (1.01)     2.1605 (1.01)     2.1605 (1.01)     0.0000 (1.0)      2.1605 (1.01)     0.0000 (1.0)           0;0  0.4628 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.1401 (1.0)      2.1401 (1.0)      2.1401 (1.0)      0.0000 (1.0)      2.1401 (1.0)      0.0000 (1.0)           0;0  0.4673 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0569 (2.83)     6.0569 (2.83)     6.0569 (2.83)     0.0000 (1.0)      6.0569 (2.83)     0.0000 (1.0)           0;0  0.1651 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.0834 (2.84)     6.0834 (2.84)     6.0834 (2.84)     0.0000 (1.0)      6.0834 (2.84)     0.0000 (1.0)           0;0  0.1644 (0.35)          1           1
test_sharing-push-noop[main]       6.0796 (2.84)     6.0796 (2.84)     6.0796 (2.84)     0.0000 (1.0)      6.0796 (2.84)     0.0000 (1.0)           0;0  0.1645 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     212.3878 (1.05)     212.3878 (1.05)     212.3878 (1.05)     0.0000 (1.0)      212.3878 (1.05)     0.0000 (1.0)           0;0  0.0047 (0.96)          1           1
test_sharing_azure-fetch[main]       203.1350 (1.0)      203.1350 (1.0)      203.1350 (1.0)      0.0000 (1.0)      203.1350 (1.0)      0.0000 (1.0)           0;0  0.0049 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3690 (1.0)      6.3690 (1.0)      6.3690 (1.0)      0.0000 (1.0)      6.3690 (1.0)      0.0000 (1.0)           0;0  0.1570 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4619 (1.01)     6.4619 (1.01)     6.4619 (1.01)     0.0000 (1.0)      6.4619 (1.01)     0.0000 (1.0)           0;0  0.1548 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     212.5062 (1.0)      212.5062 (1.0)      212.5062 (1.0)      0.0000 (1.0)      212.5062 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
test_sharing_azure-push[main]       213.8505 (1.01)     213.8505 (1.01)     213.8505 (1.01)     0.0000 (1.0)      213.8505 (1.01)     0.0000 (1.0)           0;0  0.0047 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.0449 (1.0)      7.0449 (1.0)      7.0449 (1.0)      0.0000 (1.0)      7.0449 (1.0)      0.0000 (1.0)           0;0  0.1419 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.3166 (1.04)     7.3166 (1.04)     7.3166 (1.04)     0.0000 (1.0)      7.3166 (1.04)     0.0000 (1.0)           0;0  0.1367 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     247.6379 (1.04)     247.6379 (1.04)     247.6379 (1.04)     0.0000 (1.0)      247.6379 (1.04)     0.0000 (1.0)           0;0  0.0040 (0.96)          1           1
test_sharing_gs-fetch[main]       237.1791 (1.0)      237.1791 (1.0)      237.1791 (1.0)      0.0000 (1.0)      237.1791 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     14.5374 (1.0)      14.5374 (1.0)      14.5374 (1.0)      0.0000 (1.0)      14.5374 (1.0)      0.0000 (1.0)           0;0  0.0688 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       14.9454 (1.03)     14.9454 (1.03)     14.9454 (1.03)     0.0000 (1.0)      14.9454 (1.03)     0.0000 (1.0)           0;0  0.0669 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     568.8796 (1.0)      568.8796 (1.0)      568.8796 (1.0)      0.0000 (1.0)      568.8796 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
test_sharing_gs-push[main]       569.9411 (1.00)     569.9411 (1.00)     569.9411 (1.00)     0.0000 (1.0)      569.9411 (1.00)     0.0000 (1.0)           0;0  0.0018 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.6009 (1.01)     6.6009 (1.01)     6.6009 (1.01)     0.0000 (1.0)      6.6009 (1.01)     0.0000 (1.0)           0;0  0.1515 (0.99)          1           1
test_sharing_gs-push-noop[main]       6.5496 (1.0)      6.5496 (1.0)      6.5496 (1.0)      0.0000 (1.0)      6.5496 (1.0)      0.0000 (1.0)           0;0  0.1527 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     790.1769 (1.01)     790.1769 (1.01)     790.1769 (1.01)     0.0000 (1.0)      790.1769 (1.01)     0.0000 (1.0)           0;0  0.0013 (0.99)          1           1
test_sharing_s3-fetch[main]       782.6746 (1.0)      782.6746 (1.0)      782.6746 (1.0)      0.0000 (1.0)      782.6746 (1.0)      0.0000 (1.0)           0;0  0.0013 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.4277 (1.0)      6.4277 (1.0)      6.4277 (1.0)      0.0000 (1.0)      6.4277 (1.0)      0.0000 (1.0)           0;0  0.1556 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7494 (1.05)     6.7494 (1.05)     6.7494 (1.05)     0.0000 (1.0)      6.7494 (1.05)     0.0000 (1.0)           0;0  0.1482 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,217.7940 (1.0)      1,217.7940 (1.0)      1,217.7940 (1.0)      0.0000 (1.0)      1,217.7940 (1.0)      0.0000 (1.0)           0;0  0.0008 (1.0)           1           1
test_sharing_s3-push[main]       1,230.5477 (1.01)     1,230.5477 (1.01)     1,230.5477 (1.01)     0.0000 (1.0)      1,230.5477 (1.01)     0.0000 (1.0)           0;0  0.0008 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.1450 (1.0)      7.1450 (1.0)      7.1450 (1.0)      0.0000 (1.0)      7.1450 (1.0)      0.0000 (1.0)           0;0  0.1400 (1.0)           1           1
test_sharing_s3-push-noop[main]       8.0984 (1.13)     8.0984 (1.13)     8.0984 (1.13)     0.0000 (1.0)      8.0984 (1.13)     0.0000 (1.0)           0;0  0.1235 (0.88)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.0505 (3.73)     19.0505 (3.73)     19.0505 (3.73)     0.0000 (1.0)      19.0505 (3.73)     0.0000 (1.0)           0;0  0.0525 (0.27)          1           1
test_status-status[3.10.0]     19.2014 (3.76)     19.2014 (3.76)     19.2014 (3.76)     0.0000 (1.0)      19.2014 (3.76)     0.0000 (1.0)           0;0  0.0521 (0.27)          1           1
test_status-status[3.53.2]     17.6560 (3.46)     17.6560 (3.46)     17.6560 (3.46)     0.0000 (1.0)      17.6560 (3.46)     0.0000 (1.0)           0;0  0.0566 (0.29)          1           1
test_status-status[3.60.1]      5.1027 (1.0)       5.1027 (1.0)       5.1027 (1.0)      0.0000 (1.0)       5.1027 (1.0)      0.0000 (1.0)           0;0  0.1960 (1.0)           1           1
test_status-status[main]        5.4909 (1.08)      5.4909 (1.08)      5.4909 (1.08)     0.0000 (1.0)       5.4909 (1.08)     0.0000 (1.0)           0;0  0.1821 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7041 (1.81)     4.7041 (1.81)     4.7041 (1.81)     0.0000 (1.0)      4.7041 (1.81)     0.0000 (1.0)           0;0  0.2126 (0.55)          1           1
test_status-status-changed[3.10.0]     5.0409 (1.94)     5.0409 (1.94)     5.0409 (1.94)     0.0000 (1.0)      5.0409 (1.94)     0.0000 (1.0)           0;0  0.1984 (0.52)          1           1
test_status-status-changed[3.53.2]     4.7693 (1.83)     4.7693 (1.83)     4.7693 (1.83)     0.0000 (1.0)      4.7693 (1.83)     0.0000 (1.0)           0;0  0.2097 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6021 (1.0)      2.6021 (1.0)      2.6021 (1.0)      0.0000 (1.0)      2.6021 (1.0)      0.0000 (1.0)           0;0  0.3843 (1.0)           1           1
test_status-status-changed[main]       2.8876 (1.11)     2.8876 (1.11)     2.8876 (1.11)     0.0000 (1.0)      2.8876 (1.11)     0.0000 (1.0)           0;0  0.3463 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7307 (1.88)     4.7307 (1.88)     4.7307 (1.88)     0.0000 (1.0)      4.7307 (1.88)     0.0000 (1.0)           0;0  0.2114 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     4.8683 (1.93)     4.8683 (1.93)     4.8683 (1.93)     0.0000 (1.0)      4.8683 (1.93)     0.0000 (1.0)           0;0  0.2054 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.7202 (1.87)     4.7202 (1.87)     4.7202 (1.87)     0.0000 (1.0)      4.7202 (1.87)     0.0000 (1.0)           0;0  0.2119 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.5195 (1.0)      2.5195 (1.0)      2.5195 (1.0)      0.0000 (1.0)      2.5195 (1.0)      0.0000 (1.0)           0;0  0.3969 (1.0)           1           1
test_status-status-changed-noop[main]       2.7593 (1.10)     2.7593 (1.10)     2.7593 (1.10)     0.0000 (1.0)      2.7593 (1.10)     0.0000 (1.0)           0;0  0.3624 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.6173 (1.85)     4.6173 (1.85)     4.6173 (1.85)     0.0000 (1.0)      4.6173 (1.85)     0.0000 (1.0)           0;0  0.2166 (0.54)          1           1
test_status-status-noop[3.10.0]     4.8689 (1.95)     4.8689 (1.95)     4.8689 (1.95)     0.0000 (1.0)      4.8689 (1.95)     0.0000 (1.0)           0;0  0.2054 (0.51)          1           1
test_status-status-noop[3.53.2]     4.7588 (1.90)     4.7588 (1.90)     4.7588 (1.90)     0.0000 (1.0)      4.7588 (1.90)     0.0000 (1.0)           0;0  0.2101 (0.53)          1           1
test_status-status-noop[3.60.1]     2.5002 (1.0)      2.5002 (1.0)      2.5002 (1.0)      0.0000 (1.0)      2.5002 (1.0)      0.0000 (1.0)           0;0  0.4000 (1.0)           1           1
test_status-status-noop[main]       2.7537 (1.10)     2.7537 (1.10)     2.7537 (1.10)     0.0000 (1.0)      2.7537 (1.10)     0.0000 (1.0)           0;0  0.3631 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     157.5837 (3.42)     157.5837 (3.42)     157.5837 (3.42)     0.0000 (1.0)      157.5837 (3.42)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.10.0]     159.1068 (3.45)     159.1068 (3.45)     159.1068 (3.45)     0.0000 (1.0)      159.1068 (3.45)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.53.2]     116.4184 (2.52)     116.4184 (2.52)     116.4184 (2.52)     0.0000 (1.0)      116.4184 (2.52)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.1311 (1.0)       46.1311 (1.0)       46.1311 (1.0)      0.0000 (1.0)       46.1311 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_update-import-url[main]        47.3481 (1.03)      47.3481 (1.03)      47.3481 (1.03)     0.0000 (1.0)       47.3481 (1.03)     0.0000 (1.0)           0;0  0.0211 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     139.8345 (3.94)     139.8345 (3.94)     139.8345 (3.94)     0.0000 (1.0)      139.8345 (3.94)     0.0000 (1.0)           0;0  0.0072 (0.25)          1           1
test_update-update[3.10.0]     145.2496 (4.09)     145.2496 (4.09)     145.2496 (4.09)     0.0000 (1.0)      145.2496 (4.09)     0.0000 (1.0)           0;0  0.0069 (0.24)          1           1
test_update-update[3.53.2]     108.3874 (3.05)     108.3874 (3.05)     108.3874 (3.05)     0.0000 (1.0)      108.3874 (3.05)     0.0000 (1.0)           0;0  0.0092 (0.33)          1           1
test_update-update[3.60.1]      35.4810 (1.0)       35.4810 (1.0)       35.4810 (1.0)      0.0000 (1.0)       35.4810 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.7641 (1.04)      36.7641 (1.04)      36.7641 (1.04)     0.0000 (1.0)       36.7641 (1.04)     0.0000 (1.0)           0;0  0.0272 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.8973 (2.09)     15.8973 (2.09)     15.8973 (2.09)     0.0000 (1.0)      15.8973 (2.09)     0.0000 (1.0)           0;0  0.0629 (0.48)          1           1
test_update-update-noop[3.10.0]     17.0806 (2.24)     17.0806 (2.24)     17.0806 (2.24)     0.0000 (1.0)      17.0806 (2.24)     0.0000 (1.0)           0;0  0.0585 (0.45)          1           1
test_update-update-noop[3.53.2]     15.9956 (2.10)     15.9956 (2.10)     15.9956 (2.10)     0.0000 (1.0)      15.9956 (2.10)     0.0000 (1.0)           0;0  0.0625 (0.48)          1           1
test_update-update-noop[3.60.1]      7.6136 (1.0)       7.6136 (1.0)       7.6136 (1.0)      0.0000 (1.0)       7.6136 (1.0)      0.0000 (1.0)           0;0  0.1313 (1.0)           1           1
test_update-update-noop[main]        8.4576 (1.11)      8.4576 (1.11)      8.4576 (1.11)     0.0000 (1.0)       8.4576 (1.11)     0.0000 (1.0)           0;0  0.1182 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean