Tue Nov 11 00:47:38 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.1404 (3.76)     84.1404 (3.76)     84.1404 (3.76)     0.0000 (1.0)      84.1404 (3.76)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_add_copy-add[3.10.0]     85.3289 (3.81)     85.3289 (3.81)     85.3289 (3.81)     0.0000 (1.0)      85.3289 (3.81)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_add_copy-add[3.53.2]     76.3521 (3.41)     76.3521 (3.41)     76.3521 (3.41)     0.0000 (1.0)      76.3521 (3.41)     0.0000 (1.0)           0;0  0.0131 (0.29)          1           1
test_add_copy-add[3.60.1]     22.3769 (1.0)      22.3769 (1.0)      22.3769 (1.0)      0.0000 (1.0)      22.3769 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
test_add_copy-add[main]       23.5911 (1.05)     23.5911 (1.05)     23.5911 (1.05)     0.0000 (1.0)      23.5911 (1.05)     0.0000 (1.0)           0;0  0.0424 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.5317 (6.77)     28.5317 (6.77)     28.5317 (6.77)     0.0000 (1.0)      28.5317 (6.77)     0.0000 (1.0)           0;0  0.0350 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.8040 (6.83)     28.8040 (6.83)     28.8040 (6.83)     0.0000 (1.0)      28.8040 (6.83)     0.0000 (1.0)           0;0  0.0347 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     27.3983 (6.50)     27.3983 (6.50)     27.3983 (6.50)     0.0000 (1.0)      27.3983 (6.50)     0.0000 (1.0)           0;0  0.0365 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.2142 (1.0)       4.2142 (1.0)       4.2142 (1.0)      0.0000 (1.0)       4.2142 (1.0)      0.0000 (1.0)           0;0  0.2373 (1.0)           1           1
test_add_copy-add-noop[main]        4.5735 (1.09)      4.5735 (1.09)      4.5735 (1.09)     0.0000 (1.0)       4.5735 (1.09)     0.0000 (1.0)           0;0  0.2187 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.4243 (4.15)     64.4243 (4.15)     64.4243 (4.15)     0.0000 (1.0)      64.4243 (4.15)     0.0000 (1.0)           0;0  0.0155 (0.24)          1           1
test_add_hardlink-add[3.10.0]     64.9416 (4.18)     64.9416 (4.18)     64.9416 (4.18)     0.0000 (1.0)      64.9416 (4.18)     0.0000 (1.0)           0;0  0.0154 (0.24)          1           1
test_add_hardlink-add[3.53.2]     60.0389 (3.87)     60.0389 (3.87)     60.0389 (3.87)     0.0000 (1.0)      60.0389 (3.87)     0.0000 (1.0)           0;0  0.0167 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.5331 (1.0)      15.5331 (1.0)      15.5331 (1.0)      0.0000 (1.0)      15.5331 (1.0)      0.0000 (1.0)           0;0  0.0644 (1.0)           1           1
test_add_hardlink-add[main]       16.5558 (1.07)     16.5558 (1.07)     16.5558 (1.07)     0.0000 (1.0)      16.5558 (1.07)     0.0000 (1.0)           0;0  0.0604 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.6671 (7.96)     32.6671 (7.96)     32.6671 (7.96)     0.0000 (1.0)      32.6671 (7.96)     0.0000 (1.0)           0;0  0.0306 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.1961 (8.09)     33.1961 (8.09)     33.1961 (8.09)     0.0000 (1.0)      33.1961 (8.09)     0.0000 (1.0)           0;0  0.0301 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     31.2500 (7.61)     31.2500 (7.61)     31.2500 (7.61)     0.0000 (1.0)      31.2500 (7.61)     0.0000 (1.0)           0;0  0.0320 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.1053 (1.0)       4.1053 (1.0)       4.1053 (1.0)      0.0000 (1.0)       4.1053 (1.0)      0.0000 (1.0)           0;0  0.2436 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.3027 (1.05)      4.3027 (1.05)      4.3027 (1.05)     0.0000 (1.0)       4.3027 (1.05)     0.0000 (1.0)           0;0  0.2324 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     70.3700 (2.00)     70.3700 (2.00)     70.3700 (2.00)     0.0000 (1.0)      70.3700 (2.00)     0.0000 (1.0)           0;0  0.0142 (0.50)          1           1
test_add_symlink-add[3.10.0]     70.9688 (2.02)     70.9688 (2.02)     70.9688 (2.02)     0.0000 (1.0)      70.9688 (2.02)     0.0000 (1.0)           0;0  0.0141 (0.50)          1           1
test_add_symlink-add[3.53.2]     65.1184 (1.85)     65.1184 (1.85)     65.1184 (1.85)     0.0000 (1.0)      65.1184 (1.85)     0.0000 (1.0)           0;0  0.0154 (0.54)          1           1
test_add_symlink-add[3.60.1]     35.2200 (1.0)      35.2200 (1.0)      35.2200 (1.0)      0.0000 (1.0)      35.2200 (1.0)      0.0000 (1.0)           0;0  0.0284 (1.0)           1           1
test_add_symlink-add[main]       36.7516 (1.04)     36.7516 (1.04)     36.7516 (1.04)     0.0000 (1.0)      36.7516 (1.04)     0.0000 (1.0)           0;0  0.0272 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.8404 (8.35)     46.8404 (8.35)     46.8404 (8.35)     0.0000 (1.0)      46.8404 (8.35)     0.0000 (1.0)           0;0  0.0213 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.5160 (8.47)     47.5160 (8.47)     47.5160 (8.47)     0.0000 (1.0)      47.5160 (8.47)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.4587 (8.28)     46.4587 (8.28)     46.4587 (8.28)     0.0000 (1.0)      46.4587 (8.28)     0.0000 (1.0)           0;0  0.0215 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.6118 (1.0)       5.6118 (1.0)       5.6118 (1.0)      0.0000 (1.0)       5.6118 (1.0)      0.0000 (1.0)           0;0  0.1782 (1.0)           1           1
test_add_symlink-add-noop[main]        5.7009 (1.02)      5.7009 (1.02)      5.7009 (1.02)     0.0000 (1.0)       5.7009 (1.02)     0.0000 (1.0)           0;0  0.1754 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.3222 (1.95)     41.3222 (1.95)     41.3222 (1.95)     0.0000 (1.0)      41.3222 (1.95)     0.0000 (1.0)           0;0  0.0242 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     56.6942 (2.67)     56.6942 (2.67)     56.6942 (2.67)     0.0000 (1.0)      56.6942 (2.67)     0.0000 (1.0)           0;0  0.0176 (0.37)          1           1
test_checkout_copy-checkout[3.53.2]     28.6127 (1.35)     28.6127 (1.35)     28.6127 (1.35)     0.0000 (1.0)      28.6127 (1.35)     0.0000 (1.0)           0;0  0.0349 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     21.2269 (1.0)      21.2269 (1.0)      21.2269 (1.0)      0.0000 (1.0)      21.2269 (1.0)      0.0000 (1.0)           0;0  0.0471 (1.0)           1           1
test_checkout_copy-checkout[main]       22.2408 (1.05)     22.2408 (1.05)     22.2408 (1.05)     0.0000 (1.0)      22.2408 (1.05)     0.0000 (1.0)           0;0  0.0450 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6691 (1.67)     5.6691 (1.67)     5.6691 (1.67)     0.0000 (1.0)      5.6691 (1.67)     0.0000 (1.0)           0;0  0.1764 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9840 (1.76)     5.9840 (1.76)     5.9840 (1.76)     0.0000 (1.0)      5.9840 (1.76)     0.0000 (1.0)           0;0  0.1671 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6148 (1.65)     5.6148 (1.65)     5.6148 (1.65)     0.0000 (1.0)      5.6148 (1.65)     0.0000 (1.0)           0;0  0.1781 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3931 (1.0)      3.3931 (1.0)      3.3931 (1.0)      0.0000 (1.0)      3.3931 (1.0)      0.0000 (1.0)           0;0  0.2947 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4867 (1.03)     3.4867 (1.03)     3.4867 (1.03)     0.0000 (1.0)      3.4867 (1.03)     0.0000 (1.0)           0;0  0.2868 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9919 (1.96)     7.9919 (1.96)     7.9919 (1.96)     0.0000 (1.0)      7.9919 (1.96)     0.0000 (1.0)           0;0  0.1251 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8846 (1.69)     6.8846 (1.69)     6.8846 (1.69)     0.0000 (1.0)      6.8846 (1.69)     0.0000 (1.0)           0;0  0.1453 (0.59)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5245 (1.60)     6.5245 (1.60)     6.5245 (1.60)     0.0000 (1.0)      6.5245 (1.60)     0.0000 (1.0)           0;0  0.1533 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0800 (1.0)      4.0800 (1.0)      4.0800 (1.0)      0.0000 (1.0)      4.0800 (1.0)      0.0000 (1.0)           0;0  0.2451 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3379 (1.06)     4.3379 (1.06)     4.3379 (1.06)     0.0000 (1.0)      4.3379 (1.06)     0.0000 (1.0)           0;0  0.2305 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.0631 (2.82)     21.0631 (2.82)     21.0631 (2.82)     0.0000 (1.0)      21.0631 (2.82)     0.0000 (1.0)           0;0  0.0475 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.1342 (2.16)     16.1342 (2.16)     16.1342 (2.16)     0.0000 (1.0)      16.1342 (2.16)     0.0000 (1.0)           0;0  0.0620 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.4763 (1.94)     14.4763 (1.94)     14.4763 (1.94)     0.0000 (1.0)      14.4763 (1.94)     0.0000 (1.0)           0;0  0.0691 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4705 (1.0)       7.4705 (1.0)       7.4705 (1.0)      0.0000 (1.0)       7.4705 (1.0)      0.0000 (1.0)           0;0  0.1339 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.5545 (1.15)      8.5545 (1.15)      8.5545 (1.15)     0.0000 (1.0)       8.5545 (1.15)     0.0000 (1.0)           0;0  0.1169 (0.87)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3660 (1.67)     5.3660 (1.67)     5.3660 (1.67)     0.0000 (1.0)      5.3660 (1.67)     0.0000 (1.0)           0;0  0.1864 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5909 (1.74)     5.5909 (1.74)     5.5909 (1.74)     0.0000 (1.0)      5.5909 (1.74)     0.0000 (1.0)           0;0  0.1789 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4766 (1.70)     5.4766 (1.70)     5.4766 (1.70)     0.0000 (1.0)      5.4766 (1.70)     0.0000 (1.0)           0;0  0.1826 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2188 (1.0)      3.2188 (1.0)      3.2188 (1.0)      0.0000 (1.0)      3.2188 (1.0)      0.0000 (1.0)           0;0  0.3107 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4670 (1.08)     3.4670 (1.08)     3.4670 (1.08)     0.0000 (1.0)      3.4670 (1.08)     0.0000 (1.0)           0;0  0.2884 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6289 (1.98)     7.6289 (1.98)     7.6289 (1.98)     0.0000 (1.0)      7.6289 (1.98)     0.0000 (1.0)           0;0  0.1311 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4236 (1.67)     6.4236 (1.67)     6.4236 (1.67)     0.0000 (1.0)      6.4236 (1.67)     0.0000 (1.0)           0;0  0.1557 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1315 (1.59)     6.1315 (1.59)     6.1315 (1.59)     0.0000 (1.0)      6.1315 (1.59)     0.0000 (1.0)           0;0  0.1631 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8491 (1.0)      3.8491 (1.0)      3.8491 (1.0)      0.0000 (1.0)      3.8491 (1.0)      0.0000 (1.0)           0;0  0.2598 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3436 (1.13)     4.3436 (1.13)     4.3436 (1.13)     0.0000 (1.0)      4.3436 (1.13)     0.0000 (1.0)           0;0  0.2302 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     23.3263 (2.33)     23.3263 (2.33)     23.3263 (2.33)     0.0000 (1.0)      23.3263 (2.33)     0.0000 (1.0)           0;0  0.0429 (0.43)          1           1
test_checkout_symlink-checkout[3.10.0]     18.6842 (1.87)     18.6842 (1.87)     18.6842 (1.87)     0.0000 (1.0)      18.6842 (1.87)     0.0000 (1.0)           0;0  0.0535 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     16.8916 (1.69)     16.8916 (1.69)     16.8916 (1.69)     0.0000 (1.0)      16.8916 (1.69)     0.0000 (1.0)           0;0  0.0592 (0.59)          1           1
test_checkout_symlink-checkout[3.60.1]     10.0062 (1.0)      10.0062 (1.0)      10.0062 (1.0)      0.0000 (1.0)      10.0062 (1.0)      0.0000 (1.0)           0;0  0.0999 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.0302 (1.10)     11.0302 (1.10)     11.0302 (1.10)     0.0000 (1.0)      11.0302 (1.10)     0.0000 (1.0)           0;0  0.0907 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6583 (1.62)     6.6583 (1.62)     6.6583 (1.62)     0.0000 (1.0)      6.6583 (1.62)     0.0000 (1.0)           0;0  0.1502 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.6973 (1.63)     6.6973 (1.63)     6.6973 (1.63)     0.0000 (1.0)      6.6973 (1.63)     0.0000 (1.0)           0;0  0.1493 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6202 (1.61)     6.6202 (1.61)     6.6202 (1.61)     0.0000 (1.0)      6.6202 (1.61)     0.0000 (1.0)           0;0  0.1511 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1028 (1.0)      4.1028 (1.0)      4.1028 (1.0)      0.0000 (1.0)      4.1028 (1.0)      0.0000 (1.0)           0;0  0.2437 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.2443 (1.03)     4.2443 (1.03)     4.2443 (1.03)     0.0000 (1.0)      4.2443 (1.03)     0.0000 (1.0)           0;0  0.2356 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.6740 (1.75)     9.6740 (1.75)     9.6740 (1.75)     0.0000 (1.0)      9.6740 (1.75)     0.0000 (1.0)           0;0  0.1034 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.4657 (1.53)     8.4657 (1.53)     8.4657 (1.53)     0.0000 (1.0)      8.4657 (1.53)     0.0000 (1.0)           0;0  0.1181 (0.65)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.3509 (1.51)     8.3509 (1.51)     8.3509 (1.51)     0.0000 (1.0)      8.3509 (1.51)     0.0000 (1.0)           0;0  0.1197 (0.66)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.5357 (1.0)      5.5357 (1.0)      5.5357 (1.0)      0.0000 (1.0)      5.5357 (1.0)      0.0000 (1.0)           0;0  0.1806 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       5.9051 (1.07)     5.9051 (1.07)     5.9051 (1.07)     0.0000 (1.0)      5.9051 (1.07)     0.0000 (1.0)           0;0  0.1693 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2483 (1.78)     4.2483 (1.78)     4.2483 (1.78)     0.0000 (1.0)      4.2483 (1.78)     0.0000 (1.0)           0;0  0.2354 (0.56)          1           1
test_data_status-data-changed[3.10.0]     5.1557 (2.16)     5.1557 (2.16)     5.1557 (2.16)     0.0000 (1.0)      5.1557 (2.16)     0.0000 (1.0)           0;0  0.1940 (0.46)          1           1
test_data_status-data-changed[3.53.2]     5.0015 (2.09)     5.0015 (2.09)     5.0015 (2.09)     0.0000 (1.0)      5.0015 (2.09)     0.0000 (1.0)           0;0  0.1999 (0.48)          1           1
test_data_status-data-changed[3.60.1]     2.3897 (1.0)      2.3897 (1.0)      2.3897 (1.0)      0.0000 (1.0)      2.3897 (1.0)      0.0000 (1.0)           0;0  0.4185 (1.0)           1           1
test_data_status-data-changed[main]       2.6540 (1.11)     2.6540 (1.11)     2.6540 (1.11)     0.0000 (1.0)      2.6540 (1.11)     0.0000 (1.0)           0;0  0.3768 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2615 (1.79)     4.2615 (1.79)     4.2615 (1.79)     0.0000 (1.0)      4.2615 (1.79)     0.0000 (1.0)           0;0  0.2347 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     5.1009 (2.14)     5.1009 (2.14)     5.1009 (2.14)     0.0000 (1.0)      5.1009 (2.14)     0.0000 (1.0)           0;0  0.1960 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.9833 (2.09)     4.9833 (2.09)     4.9833 (2.09)     0.0000 (1.0)      4.9833 (2.09)     0.0000 (1.0)           0;0  0.2007 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3854 (1.0)      2.3854 (1.0)      2.3854 (1.0)      0.0000 (1.0)      2.3854 (1.0)      0.0000 (1.0)           0;0  0.4192 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6590 (1.11)     2.6590 (1.11)     2.6590 (1.11)     0.0000 (1.0)      2.6590 (1.11)     0.0000 (1.0)           0;0  0.3761 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.4633 (3.73)     18.4633 (3.73)     18.4633 (3.73)     0.0000 (1.0)      18.4633 (3.73)     0.0000 (1.0)           0;0  0.0542 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.5210 (3.94)     19.5210 (3.94)     19.5210 (3.94)     0.0000 (1.0)      19.5210 (3.94)     0.0000 (1.0)           0;0  0.0512 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.3737 (3.91)     19.3737 (3.91)     19.3737 (3.91)     0.0000 (1.0)      19.3737 (3.91)     0.0000 (1.0)           0;0  0.0516 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9538 (1.0)       4.9538 (1.0)       4.9538 (1.0)      0.0000 (1.0)       4.9538 (1.0)      0.0000 (1.0)           0;0  0.2019 (1.0)           1           1
test_data_status-data-new[main]        5.2014 (1.05)      5.2014 (1.05)      5.2014 (1.05)     0.0000 (1.0)       5.2014 (1.05)     0.0000 (1.0)           0;0  0.1923 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2533 (1.72)     4.2533 (1.72)     4.2533 (1.72)     0.0000 (1.0)      4.2533 (1.72)     0.0000 (1.0)           0;0  0.2351 (0.58)          1           1
test_data_status-data-noop[3.10.0]     5.1002 (2.06)     5.1002 (2.06)     5.1002 (2.06)     0.0000 (1.0)      5.1002 (2.06)     0.0000 (1.0)           0;0  0.1961 (0.48)          1           1
test_data_status-data-noop[3.53.2]     5.0990 (2.06)     5.0990 (2.06)     5.0990 (2.06)     0.0000 (1.0)      5.0990 (2.06)     0.0000 (1.0)           0;0  0.1961 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.4711 (1.0)      2.4711 (1.0)      2.4711 (1.0)      0.0000 (1.0)      2.4711 (1.0)      0.0000 (1.0)           0;0  0.4047 (1.0)           1           1
test_data_status-data-noop[main]       2.7161 (1.10)     2.7161 (1.10)     2.7161 (1.10)     0.0000 (1.0)      2.7161 (1.10)     0.0000 (1.0)           0;0  0.3682 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.0373 (1.31)     7.0373 (1.31)     7.0373 (1.31)     0.0000 (1.0)      7.0373 (1.31)     0.0000 (1.0)           0;0  0.1421 (0.76)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6174 (1.42)     7.6174 (1.42)     7.6174 (1.42)     0.0000 (1.0)      7.6174 (1.42)     0.0000 (1.0)           0;0  0.1313 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7118 (1.44)     7.7118 (1.44)     7.7118 (1.44)     0.0000 (1.0)      7.7118 (1.44)     0.0000 (1.0)           0;0  0.1297 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.3623 (1.0)      5.3623 (1.0)      5.3623 (1.0)      0.0000 (1.0)      5.3623 (1.0)      0.0000 (1.0)           0;0  0.1865 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5660 (1.04)     5.5660 (1.04)     5.5660 (1.04)     0.0000 (1.0)      5.5660 (1.04)     0.0000 (1.0)           0;0  0.1797 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.8881 (1.29)     6.8881 (1.29)     6.8881 (1.29)     0.0000 (1.0)      6.8881 (1.29)     0.0000 (1.0)           0;0  0.1452 (0.77)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6926 (1.44)     7.6926 (1.44)     7.6926 (1.44)     0.0000 (1.0)      7.6926 (1.44)     0.0000 (1.0)           0;0  0.1300 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6605 (1.44)     7.6605 (1.44)     7.6605 (1.44)     0.0000 (1.0)      7.6605 (1.44)     0.0000 (1.0)           0;0  0.1305 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.3327 (1.0)      5.3327 (1.0)      5.3327 (1.0)      0.0000 (1.0)      5.3327 (1.0)      0.0000 (1.0)           0;0  0.1875 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.6421 (1.06)     5.6421 (1.06)     5.6421 (1.06)     0.0000 (1.0)      5.6421 (1.06)     0.0000 (1.0)           0;0  0.1772 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.4736 (2.72)     21.4736 (2.72)     21.4736 (2.72)     0.0000 (1.0)      21.4736 (2.72)     0.0000 (1.0)           0;0  0.0466 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.5454 (2.85)     22.5454 (2.85)     22.5454 (2.85)     0.0000 (1.0)      22.5454 (2.85)     0.0000 (1.0)           0;0  0.0444 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.9236 (2.77)     21.9236 (2.77)     21.9236 (2.77)     0.0000 (1.0)      21.9236 (2.77)     0.0000 (1.0)           0;0  0.0456 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9028 (1.0)       7.9028 (1.0)       7.9028 (1.0)      0.0000 (1.0)       7.9028 (1.0)      0.0000 (1.0)           0;0  0.1265 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2302 (1.04)      8.2302 (1.04)      8.2302 (1.04)     0.0000 (1.0)       8.2302 (1.04)     0.0000 (1.0)           0;0  0.1215 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4219 (1.37)     6.4219 (1.37)     6.4219 (1.37)     0.0000 (1.0)      6.4219 (1.37)     0.0000 (1.0)           0;0  0.1557 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1490 (1.53)     7.1490 (1.53)     7.1490 (1.53)     0.0000 (1.0)      7.1490 (1.53)     0.0000 (1.0)           0;0  0.1399 (0.65)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1132 (1.52)     7.1132 (1.52)     7.1132 (1.52)     0.0000 (1.0)      7.1132 (1.52)     0.0000 (1.0)           0;0  0.1406 (0.66)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.6778 (1.0)      4.6778 (1.0)      4.6778 (1.0)      0.0000 (1.0)      4.6778 (1.0)      0.0000 (1.0)           0;0  0.2138 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.9761 (1.06)     4.9761 (1.06)     4.9761 (1.06)     0.0000 (1.0)      4.9761 (1.06)     0.0000 (1.0)           0;0  0.2010 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0681 (2.70)     18.0681 (2.70)     18.0681 (2.70)     0.0000 (1.0)      18.0681 (2.70)     0.0000 (1.0)           0;0  0.0553 (0.37)          1           1
test_diff-diff[3.10.0]     18.9858 (2.83)     18.9858 (2.83)     18.9858 (2.83)     0.0000 (1.0)      18.9858 (2.83)     0.0000 (1.0)           0;0  0.0527 (0.35)          1           1
test_diff-diff[3.53.2]     18.7909 (2.80)     18.7909 (2.80)     18.7909 (2.80)     0.0000 (1.0)      18.7909 (2.80)     0.0000 (1.0)           0;0  0.0532 (0.36)          1           1
test_diff-diff[3.60.1]      6.7008 (1.0)       6.7008 (1.0)       6.7008 (1.0)      0.0000 (1.0)       6.7008 (1.0)      0.0000 (1.0)           0;0  0.1492 (1.0)           1           1
test_diff-diff[main]        7.8701 (1.17)      7.8701 (1.17)      7.8701 (1.17)     0.0000 (1.0)       7.8701 (1.17)     0.0000 (1.0)           0;0  0.1271 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9891 (1.80)     5.9891 (1.80)     5.9891 (1.80)     0.0000 (1.0)      5.9891 (1.80)     0.0000 (1.0)           0;0  0.1670 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.8853 (2.06)     6.8853 (2.06)     6.8853 (2.06)     0.0000 (1.0)      6.8853 (2.06)     0.0000 (1.0)           0;0  0.1452 (0.48)          1           1
test_diff-diff-changed[3.53.2]     5.6931 (1.71)     5.6931 (1.71)     5.6931 (1.71)     0.0000 (1.0)      5.6931 (1.71)     0.0000 (1.0)           0;0  0.1757 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.3353 (1.0)      3.3353 (1.0)      3.3353 (1.0)      0.0000 (1.0)      3.3353 (1.0)      0.0000 (1.0)           0;0  0.2998 (1.0)           1           1
test_diff-diff-changed[main]       4.0797 (1.22)     4.0797 (1.22)     4.0797 (1.22)     0.0000 (1.0)      4.0797 (1.22)     0.0000 (1.0)           0;0  0.2451 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1782 (1.55)     5.1782 (1.55)     5.1782 (1.55)     0.0000 (1.0)      5.1782 (1.55)     0.0000 (1.0)           0;0  0.1931 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8232 (1.74)     5.8232 (1.74)     5.8232 (1.74)     0.0000 (1.0)      5.8232 (1.74)     0.0000 (1.0)           0;0  0.1717 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6258 (1.68)     5.6258 (1.68)     5.6258 (1.68)     0.0000 (1.0)      5.6258 (1.68)     0.0000 (1.0)           0;0  0.1778 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3442 (1.0)      3.3442 (1.0)      3.3442 (1.0)      0.0000 (1.0)      3.3442 (1.0)      0.0000 (1.0)           0;0  0.2990 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1672 (1.25)     4.1672 (1.25)     4.1672 (1.25)     0.0000 (1.0)      4.1672 (1.25)     0.0000 (1.0)           0;0  0.2400 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2876 (1.29)     4.2876 (1.29)     4.2876 (1.29)     0.0000 (1.0)      4.2876 (1.29)     0.0000 (1.0)           0;0  0.2332 (0.78)          1           1
test_diff-diff-noop[3.10.0]     4.9130 (1.47)     4.9130 (1.47)     4.9130 (1.47)     0.0000 (1.0)      4.9130 (1.47)     0.0000 (1.0)           0;0  0.2035 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.7083 (1.71)     5.7083 (1.71)     5.7083 (1.71)     0.0000 (1.0)      5.7083 (1.71)     0.0000 (1.0)           0;0  0.1752 (0.58)          1           1
test_diff-diff-noop[3.60.1]     3.3331 (1.0)      3.3331 (1.0)      3.3331 (1.0)      0.0000 (1.0)      3.3331 (1.0)      0.0000 (1.0)           0;0  0.3000 (1.0)           1           1
test_diff-diff-noop[main]       4.1016 (1.23)     4.1016 (1.23)     4.1016 (1.23)     0.0000 (1.0)      4.1016 (1.23)     0.0000 (1.0)           0;0  0.2438 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2451 (1.0)       1.2451 (1.0)       1.2451 (1.0)      0.0000 (1.0)       1.2451 (1.0)      0.0000 (1.0)           0;0  0.8032 (1.0)           1           1
test_exp_show-exp[3.10.0]     12.7800 (10.26)    12.7800 (10.26)    12.7800 (10.26)    0.0000 (1.0)      12.7800 (10.26)    0.0000 (1.0)           0;0  0.0782 (0.10)          1           1
test_exp_show-exp[3.53.2]      7.8100 (6.27)      7.8100 (6.27)      7.8100 (6.27)     0.0000 (1.0)       7.8100 (6.27)     0.0000 (1.0)           0;0  0.1280 (0.16)          1           1
test_exp_show-exp[3.60.1]      8.9871 (7.22)      8.9871 (7.22)      8.9871 (7.22)     0.0000 (1.0)       8.9871 (7.22)     0.0000 (1.0)           0;0  0.1113 (0.14)          1           1
test_exp_show-exp[main]       12.3324 (9.90)     12.3324 (9.90)     12.3324 (9.90)     0.0000 (1.0)      12.3324 (9.90)     0.0000 (1.0)           0;0  0.0811 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     50.2243 (3.30)     50.2243 (3.30)     50.2243 (3.30)     0.0000 (1.0)      50.2243 (3.30)     0.0000 (1.0)           0;0  0.0199 (0.30)          1           1
test_fetch-fetch[3.10.0]     53.7808 (3.53)     53.7808 (3.53)     53.7808 (3.53)     0.0000 (1.0)      53.7808 (3.53)     0.0000 (1.0)           0;0  0.0186 (0.28)          1           1
test_fetch-fetch[3.53.2]     22.8815 (1.50)     22.8815 (1.50)     22.8815 (1.50)     0.0000 (1.0)      22.8815 (1.50)     0.0000 (1.0)           0;0  0.0437 (0.67)          1           1
test_fetch-fetch[3.60.1]     15.5142 (1.02)     15.5142 (1.02)     15.5142 (1.02)     0.0000 (1.0)      15.5142 (1.02)     0.0000 (1.0)           0;0  0.0645 (0.98)          1           1
test_fetch-fetch[main]       15.2192 (1.0)      15.2192 (1.0)      15.2192 (1.0)      0.0000 (1.0)      15.2192 (1.0)      0.0000 (1.0)           0;0  0.0657 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9317 (1.00)     2.9317 (1.00)     2.9317 (1.00)     0.0000 (1.0)      2.9317 (1.00)     0.0000 (1.0)           0;0  0.3411 (1.00)          1           1
test_gc-gc[3.10.0]     3.0739 (1.05)     3.0739 (1.05)     3.0739 (1.05)     0.0000 (1.0)      3.0739 (1.05)     0.0000 (1.0)           0;0  0.3253 (0.95)          1           1
test_gc-gc[3.53.2]     2.9490 (1.01)     2.9490 (1.01)     2.9490 (1.01)     0.0000 (1.0)      2.9490 (1.01)     0.0000 (1.0)           0;0  0.3391 (0.99)          1           1
test_gc-gc[3.60.1]     2.9337 (1.00)     2.9337 (1.00)     2.9337 (1.00)     0.0000 (1.0)      2.9337 (1.00)     0.0000 (1.0)           0;0  0.3409 (1.00)          1           1
test_gc-gc[main]       2.9215 (1.0)      2.9215 (1.0)      2.9215 (1.0)      0.0000 (1.0)      2.9215 (1.0)      0.0000 (1.0)           0;0  0.3423 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     138.1157 (2.77)     138.1157 (2.77)     138.1157 (2.77)     0.0000 (1.0)      138.1157 (2.77)     0.0000 (1.0)           0;0  0.0072 (0.36)          1           1
test_get-get[3.10.0]     162.4343 (3.26)     162.4343 (3.26)     162.4343 (3.26)     0.0000 (1.0)      162.4343 (3.26)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     145.7699 (2.92)     145.7699 (2.92)     145.7699 (2.92)     0.0000 (1.0)      145.7699 (2.92)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[3.60.1]      49.8676 (1.0)       49.8676 (1.0)       49.8676 (1.0)      0.0000 (1.0)       49.8676 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
test_get-get[main]        50.2683 (1.01)      50.2683 (1.01)      50.2683 (1.01)     0.0000 (1.0)       50.2683 (1.01)     0.0000 (1.0)           0;0  0.0199 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     41.5373 (2.48)     41.5373 (2.48)     41.5373 (2.48)     0.0000 (1.0)      41.5373 (2.48)     0.0000 (1.0)           0;0  0.0241 (0.40)          1           1
test_get_url-get-url[3.10.0]     44.2281 (2.64)     44.2281 (2.64)     44.2281 (2.64)     0.0000 (1.0)      44.2281 (2.64)     0.0000 (1.0)           0;0  0.0226 (0.38)          1           1
test_get_url-get-url[3.53.2]     16.8583 (1.01)     16.8583 (1.01)     16.8583 (1.01)     0.0000 (1.0)      16.8583 (1.01)     0.0000 (1.0)           0;0  0.0593 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.7766 (1.00)     16.7766 (1.00)     16.7766 (1.00)     0.0000 (1.0)      16.7766 (1.00)     0.0000 (1.0)           0;0  0.0596 (1.00)          1           1
test_get_url-get-url[main]       16.7698 (1.0)      16.7698 (1.0)      16.7698 (1.0)      0.0000 (1.0)      16.7698 (1.0)      0.0000 (1.0)           0;0  0.0596 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     153.4099 (1.07)     165.5048 (1.06)     156.8189 (1.05)     2.3574 (1.43)     156.4468 (1.05)     2.7908 (1.21)         28;3  6.3768 (0.95)        100           1
test_help---help[3.10.0]     147.7377 (1.03)     156.0451 (1.0)      151.4907 (1.01)     1.6432 (1.0)      151.4952 (1.02)     2.3015 (1.0)          31;1  6.6011 (0.99)        100           1
test_help---help[3.53.2]     151.1361 (1.05)     162.2487 (1.04)     155.2483 (1.04)     2.0449 (1.24)     155.0126 (1.04)     2.6243 (1.14)         27;1  6.4413 (0.96)        100           1
test_help---help[3.60.1]     151.8099 (1.06)     196.6974 (1.26)     157.2739 (1.05)     6.9816 (4.25)     155.6268 (1.05)     2.3872 (1.04)          7;8  6.3583 (0.95)        100           1
test_help---help[main]       143.6863 (1.0)      170.4400 (1.09)     149.3775 (1.0)      3.1540 (1.92)     148.7988 (1.0)      2.7093 (1.18)         18;4  6.6945 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     186.8165 (3.18)     186.8165 (3.18)     186.8165 (3.18)     0.0000 (1.0)      186.8165 (3.18)     0.0000 (1.0)           0;0  0.0054 (0.31)          1           1
test_import-import[3.10.0]     207.7856 (3.54)     207.7856 (3.54)     207.7856 (3.54)     0.0000 (1.0)      207.7856 (3.54)     0.0000 (1.0)           0;0  0.0048 (0.28)          1           1
test_import-import[3.60.1]      58.7306 (1.0)       58.7306 (1.0)       58.7306 (1.0)      0.0000 (1.0)       58.7306 (1.0)      0.0000 (1.0)           0;0  0.0170 (1.0)           1           1
test_import-import[main]        60.5988 (1.03)      60.5988 (1.03)      60.5988 (1.03)     0.0000 (1.0)       60.5988 (1.03)     0.0000 (1.0)           0;0  0.0165 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     154.1552 (3.30)     154.1552 (3.30)     154.1552 (3.30)     0.0000 (1.0)      154.1552 (3.30)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     154.5311 (3.30)     154.5311 (3.30)     154.5311 (3.30)     0.0000 (1.0)      154.5311 (3.30)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.53.2]     118.3899 (2.53)     118.3899 (2.53)     118.3899 (2.53)     0.0000 (1.0)      118.3899 (2.53)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.7826 (1.0)       46.7826 (1.0)       46.7826 (1.0)      0.0000 (1.0)       46.7826 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_import_url-import-url[main]        48.3750 (1.03)      48.3750 (1.03)      48.3750 (1.03)     0.0000 (1.0)       48.3750 (1.03)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     435.9399 (1.04)     460.8836 (1.03)     446.3219 (1.03)      5.4953 (1.01)     445.7648 (1.03)     6.7071 (1.01)         29;3  2.2405 (0.97)        100           1
test_init-init[3.10.0]     441.3810 (1.05)     480.1888 (1.07)     451.7793 (1.05)      6.6019 (1.21)     450.4072 (1.04)     6.6183 (1.0)          22;5  2.2135 (0.96)        100           1
test_init-init[3.53.2]     420.7567 (1.00)     448.4611 (1.0)      431.9367 (1.0)       5.4639 (1.0)      431.3177 (1.0)      7.5274 (1.14)         28;2  2.3152 (1.0)         100           1
test_init-init[3.60.1]     420.6835 (1.0)      449.9710 (1.00)     432.6452 (1.00)      5.5247 (1.01)     431.7934 (1.00)     8.4926 (1.28)         28;1  2.3114 (1.00)        100           1
test_init-init[main]       454.9734 (1.08)     523.5869 (1.17)     467.2294 (1.08)     10.4103 (1.91)     465.2473 (1.08)     6.9984 (1.06)          9;8  2.1403 (0.92)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     639.2863 (1.08)     639.2863 (1.08)     639.2863 (1.08)     0.0000 (1.0)      639.2863 (1.08)     0.0000 (1.0)           0;0  1.5642 (0.92)          1           1
test_list-list[3.10.0]     755.3604 (1.28)     755.3604 (1.28)     755.3604 (1.28)     0.0000 (1.0)      755.3604 (1.28)     0.0000 (1.0)           0;0  1.3239 (0.78)          1           1
test_list-list[3.53.2]     630.0339 (1.07)     630.0339 (1.07)     630.0339 (1.07)     0.0000 (1.0)      630.0339 (1.07)     0.0000 (1.0)           0;0  1.5872 (0.94)          1           1
test_list-list[3.60.1]     590.4091 (1.0)      590.4091 (1.0)      590.4091 (1.0)      0.0000 (1.0)      590.4091 (1.0)      0.0000 (1.0)           0;0  1.6937 (1.0)           1           1
test_list-list[main]       601.7372 (1.02)     601.7372 (1.02)     601.7372 (1.02)     0.0000 (1.0)      601.7372 (1.02)     0.0000 (1.0)           0;0  1.6619 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     445.6177 (1.06)     445.6177 (1.06)     445.6177 (1.06)     0.0000 (1.0)      445.6177 (1.06)     0.0000 (1.0)           0;0  2.2441 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     448.7692 (1.07)     448.7692 (1.07)     448.7692 (1.07)     0.0000 (1.0)      448.7692 (1.07)     0.0000 (1.0)           0;0  2.2283 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     419.3986 (1.00)     419.3986 (1.00)     419.3986 (1.00)     0.0000 (1.0)      419.3986 (1.00)     0.0000 (1.0)           0;0  2.3844 (1.00)          1           1
test_list-list-dvc-only[3.60.1]     419.3245 (1.0)      419.3245 (1.0)      419.3245 (1.0)      0.0000 (1.0)      419.3245 (1.0)      0.0000 (1.0)           0;0  2.3848 (1.0)           1           1
test_list-list-dvc-only[main]       423.6643 (1.01)     423.6643 (1.01)     423.6643 (1.01)     0.0000 (1.0)      423.6643 (1.01)     0.0000 (1.0)           0;0  2.3604 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4017 (1.0)      2.4017 (1.0)      2.4017 (1.0)      0.0000 (1.0)      2.4017 (1.0)      0.0000 (1.0)           0;0  0.4164 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.4762 (1.03)     2.4762 (1.03)     2.4762 (1.03)     0.0000 (1.0)      2.4762 (1.03)     0.0000 (1.0)           0;0  0.4038 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.6026 (1.08)     2.6026 (1.08)     2.6026 (1.08)     0.0000 (1.0)      2.6026 (1.08)     0.0000 (1.0)           0;0  0.3842 (0.92)          1           1
test_list-list-recursive[3.60.1]     2.6679 (1.11)     2.6679 (1.11)     2.6679 (1.11)     0.0000 (1.0)      2.6679 (1.11)     0.0000 (1.0)           0;0  0.3748 (0.90)          1           1
test_list-list-recursive[main]       2.6821 (1.12)     2.6821 (1.12)     2.6821 (1.12)     0.0000 (1.0)      2.6821 (1.12)     0.0000 (1.0)           0;0  0.3728 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     452.3569 (1.08)     452.3569 (1.08)     452.3569 (1.08)     0.0000 (1.0)      452.3569 (1.08)     0.0000 (1.0)           0;0  2.2106 (0.92)          1           1
test_list-list-shallow[3.10.0]     443.9654 (1.06)     443.9654 (1.06)     443.9654 (1.06)     0.0000 (1.0)      443.9654 (1.06)     0.0000 (1.0)           0;0  2.2524 (0.94)          1           1
test_list-list-shallow[3.53.2]     424.5828 (1.02)     424.5828 (1.02)     424.5828 (1.02)     0.0000 (1.0)      424.5828 (1.02)     0.0000 (1.0)           0;0  2.3553 (0.98)          1           1
test_list-list-shallow[3.60.1]     427.8037 (1.02)     427.8037 (1.02)     427.8037 (1.02)     0.0000 (1.0)      427.8037 (1.02)     0.0000 (1.0)           0;0  2.3375 (0.98)          1           1
test_list-list-shallow[main]       417.8455 (1.0)      417.8455 (1.0)      417.8455 (1.0)      0.0000 (1.0)      417.8455 (1.0)      0.0000 (1.0)           0;0  2.3932 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.4265 (3.79)     71.4265 (3.79)     71.4265 (3.79)     0.0000 (1.0)      71.4265 (3.79)     0.0000 (1.0)           0;0  0.0140 (0.26)          1           1
test_partial_add-add[3.10.0]     70.9177 (3.77)     70.9177 (3.77)     70.9177 (3.77)     0.0000 (1.0)      70.9177 (3.77)     0.0000 (1.0)           0;0  0.0141 (0.27)          1           1
test_partial_add-add[3.53.2]     64.1048 (3.40)     64.1048 (3.40)     64.1048 (3.40)     0.0000 (1.0)      64.1048 (3.40)     0.0000 (1.0)           0;0  0.0156 (0.29)          1           1
test_partial_add-add[3.60.1]     18.8336 (1.0)      18.8336 (1.0)      18.8336 (1.0)      0.0000 (1.0)      18.8336 (1.0)      0.0000 (1.0)           0;0  0.0531 (1.0)           1           1
test_partial_add-add[main]       19.9155 (1.06)     19.9155 (1.06)     19.9155 (1.06)     0.0000 (1.0)      19.9155 (1.06)     0.0000 (1.0)           0;0  0.0502 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.7519 (8.33)     59.7519 (8.33)     59.7519 (8.33)     0.0000 (1.0)      59.7519 (8.33)     0.0000 (1.0)           0;0  0.0167 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     59.9536 (8.36)     59.9536 (8.36)     59.9536 (8.36)     0.0000 (1.0)      59.9536 (8.36)     0.0000 (1.0)           0;0  0.0167 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     54.6624 (7.62)     54.6624 (7.62)     54.6624 (7.62)     0.0000 (1.0)      54.6624 (7.62)     0.0000 (1.0)           0;0  0.0183 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.1733 (1.0)       7.1733 (1.0)       7.1733 (1.0)      0.0000 (1.0)       7.1733 (1.0)      0.0000 (1.0)           0;0  0.1394 (1.0)           1           1
test_partial_add-add-partial[main]        7.5167 (1.05)      7.5167 (1.05)      7.5167 (1.05)     0.0000 (1.0)       7.5167 (1.05)     0.0000 (1.0)           0;0  0.1330 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6664 (1.0)      4.6664 (1.0)      4.6664 (1.0)      0.0000 (1.0)      4.6664 (1.0)      0.0000 (1.0)           0;0  0.2143 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1678 (1.32)     6.1678 (1.32)     6.1678 (1.32)     0.0000 (1.0)      6.1678 (1.32)     0.0000 (1.0)           0;0  0.1621 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1039 (1.52)     7.1039 (1.52)     7.1039 (1.52)     0.0000 (1.0)      7.1039 (1.52)     0.0000 (1.0)           0;0  0.1408 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.0963 (1.52)     7.0963 (1.52)     7.0963 (1.52)     0.0000 (1.0)      7.0963 (1.52)     0.0000 (1.0)           0;0  0.1409 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       7.0864 (1.52)     7.0864 (1.52)     7.0864 (1.52)     0.0000 (1.0)      7.0864 (1.52)     0.0000 (1.0)           0;0  0.1411 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6247 (1.0)      2.6247 (1.0)      2.6247 (1.0)      0.0000 (1.0)      2.6247 (1.0)      0.0000 (1.0)           0;0  0.3810 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9757 (1.51)     3.9757 (1.51)     3.9757 (1.51)     0.0000 (1.0)      3.9757 (1.51)     0.0000 (1.0)           0;0  0.2515 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.9249 (1.50)     3.9249 (1.50)     3.9249 (1.50)     0.0000 (1.0)      3.9249 (1.50)     0.0000 (1.0)           0;0  0.2548 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.9618 (1.51)     3.9618 (1.51)     3.9618 (1.51)     0.0000 (1.0)      3.9618 (1.51)     0.0000 (1.0)           0;0  0.2524 (0.66)          1           1
test_partial_add-gc-noop[main]       4.0052 (1.53)     4.0052 (1.53)     4.0052 (1.53)     0.0000 (1.0)      4.0052 (1.53)     0.0000 (1.0)           0;0  0.2497 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     40.2802 (2.18)     40.2802 (2.18)     40.2802 (2.18)     0.0000 (1.0)      40.2802 (2.18)     0.0000 (1.0)           0;0  0.0248 (0.46)          1           1
test_partial_add-push[3.10.0]     35.7943 (1.94)     35.7943 (1.94)     35.7943 (1.94)     0.0000 (1.0)      35.7943 (1.94)     0.0000 (1.0)           0;0  0.0279 (0.52)          1           1
test_partial_add-push[3.53.2]     19.6561 (1.06)     19.6561 (1.06)     19.6561 (1.06)     0.0000 (1.0)      19.6561 (1.06)     0.0000 (1.0)           0;0  0.0509 (0.94)          1           1
test_partial_add-push[3.60.1]     18.5540 (1.00)     18.5540 (1.00)     18.5540 (1.00)     0.0000 (1.0)      18.5540 (1.00)     0.0000 (1.0)           0;0  0.0539 (1.00)          1           1
test_partial_add-push[main]       18.4723 (1.0)      18.4723 (1.0)      18.4723 (1.0)      0.0000 (1.0)      18.4723 (1.0)      0.0000 (1.0)           0;0  0.0541 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.9229 (1.11)     10.9229 (1.11)     10.9229 (1.11)     0.0000 (1.0)      10.9229 (1.11)     0.0000 (1.0)           0;0  0.0916 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.0109 (1.01)     10.0109 (1.01)     10.0109 (1.01)     0.0000 (1.0)      10.0109 (1.01)     0.0000 (1.0)           0;0  0.0999 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.1453 (1.03)     10.1453 (1.03)     10.1453 (1.03)     0.0000 (1.0)      10.1453 (1.03)     0.0000 (1.0)           0;0  0.0986 (0.97)          1           1
test_partial_add-push-partial[3.60.1]      9.9649 (1.01)      9.9649 (1.01)      9.9649 (1.01)     0.0000 (1.0)       9.9649 (1.01)     0.0000 (1.0)           0;0  0.1004 (0.99)          1           1
test_partial_add-push-partial[main]        9.8796 (1.0)       9.8796 (1.0)       9.8796 (1.0)      0.0000 (1.0)       9.8796 (1.0)      0.0000 (1.0)           0;0  0.1012 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     81.1857 (3.65)     81.1857 (3.65)     81.1857 (3.65)     0.0000 (1.0)      81.1857 (3.65)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_partial_remove-add[3.10.0]     81.4577 (3.66)     81.4577 (3.66)     81.4577 (3.66)     0.0000 (1.0)      81.4577 (3.66)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_partial_remove-add[3.53.2]     73.1044 (3.29)     73.1044 (3.29)     73.1044 (3.29)     0.0000 (1.0)      73.1044 (3.29)     0.0000 (1.0)           0;0  0.0137 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.2484 (1.0)      22.2484 (1.0)      22.2484 (1.0)      0.0000 (1.0)      22.2484 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
test_partial_remove-add[main]       23.4564 (1.05)     23.4564 (1.05)     23.4564 (1.05)     0.0000 (1.0)      23.4564 (1.05)     0.0000 (1.0)           0;0  0.0426 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.1678 (7.87)     8.1678 (7.87)     8.1678 (7.87)     0.0000 (1.0)      8.1678 (7.87)     0.0000 (1.0)           0;0  0.1224 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.1451 (7.85)     8.1451 (7.85)     8.1451 (7.85)     0.0000 (1.0)      8.1451 (7.85)     0.0000 (1.0)           0;0  0.1228 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.1829 (6.92)     7.1829 (6.92)     7.1829 (6.92)     0.0000 (1.0)      7.1829 (6.92)     0.0000 (1.0)           0;0  0.1392 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0382 (1.0)      1.0382 (1.0)      1.0382 (1.0)      0.0000 (1.0)      1.0382 (1.0)      0.0000 (1.0)           0;0  0.9632 (1.0)           1           1
test_partial_remove-add-update[main]       1.0936 (1.05)     1.0936 (1.05)     1.0936 (1.05)     0.0000 (1.0)      1.0936 (1.05)     0.0000 (1.0)           0;0  0.9144 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3632 (1.0)      3.3632 (1.0)      3.3632 (1.0)      0.0000 (1.0)      3.3632 (1.0)      0.0000 (1.0)           0;0  0.2973 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7158 (1.10)     3.7158 (1.10)     3.7158 (1.10)     0.0000 (1.0)      3.7158 (1.10)     0.0000 (1.0)           0;0  0.2691 (0.91)          1           1
test_partial_remove-gc[3.53.2]     3.6715 (1.09)     3.6715 (1.09)     3.6715 (1.09)     0.0000 (1.0)      3.6715 (1.09)     0.0000 (1.0)           0;0  0.2724 (0.92)          1           1
test_partial_remove-gc[3.60.1]     3.8897 (1.16)     3.8897 (1.16)     3.8897 (1.16)     0.0000 (1.0)      3.8897 (1.16)     0.0000 (1.0)           0;0  0.2571 (0.86)          1           1
test_partial_remove-gc[main]       3.7648 (1.12)     3.7648 (1.12)     3.7648 (1.12)     0.0000 (1.0)      3.7648 (1.12)     0.0000 (1.0)           0;0  0.2656 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.6400 (1.01)     4.6400 (1.01)     4.6400 (1.01)     0.0000 (1.0)      4.6400 (1.01)     0.0000 (1.0)           0;0  0.2155 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1624 (1.12)     5.1624 (1.12)     5.1624 (1.12)     0.0000 (1.0)      5.1624 (1.12)     0.0000 (1.0)           0;0  0.1937 (0.89)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0138 (1.09)     5.0138 (1.09)     5.0138 (1.09)     0.0000 (1.0)      5.0138 (1.09)     0.0000 (1.0)           0;0  0.1995 (0.92)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8241 (1.05)     4.8241 (1.05)     4.8241 (1.05)     0.0000 (1.0)      4.8241 (1.05)     0.0000 (1.0)           0;0  0.2073 (0.95)          1           1
test_partial_remove-gc-cloud[main]       4.5911 (1.0)      4.5911 (1.0)      4.5911 (1.0)      0.0000 (1.0)      4.5911 (1.0)      0.0000 (1.0)           0;0  0.2178 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     49.0231 (2.20)     49.0231 (2.20)     49.0231 (2.20)     0.0000 (1.0)      49.0231 (2.20)     0.0000 (1.0)           0;0  0.0204 (0.45)          1           1
test_partial_remove-push[3.10.0]     43.4129 (1.95)     43.4129 (1.95)     43.4129 (1.95)     0.0000 (1.0)      43.4129 (1.95)     0.0000 (1.0)           0;0  0.0230 (0.51)          1           1
test_partial_remove-push[3.53.2]     23.0451 (1.03)     23.0451 (1.03)     23.0451 (1.03)     0.0000 (1.0)      23.0451 (1.03)     0.0000 (1.0)           0;0  0.0434 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.6443 (1.02)     22.6443 (1.02)     22.6443 (1.02)     0.0000 (1.0)      22.6443 (1.02)     0.0000 (1.0)           0;0  0.0442 (0.98)          1           1
test_partial_remove-push[main]       22.2873 (1.0)      22.2873 (1.0)      22.2873 (1.0)      0.0000 (1.0)      22.2873 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8059 (1.0)      1.8059 (1.0)      1.8059 (1.0)      0.0000 (1.0)      1.8059 (1.0)      0.0000 (1.0)           0;0  0.5537 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8165 (1.01)     1.8165 (1.01)     1.8165 (1.01)     0.0000 (1.0)      1.8165 (1.01)     0.0000 (1.0)           0;0  0.5505 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.4736 (1.37)     2.4736 (1.37)     2.4736 (1.37)     0.0000 (1.0)      2.4736 (1.37)     0.0000 (1.0)           0;0  0.4043 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.5628 (1.42)     2.5628 (1.42)     2.5628 (1.42)     0.0000 (1.0)      2.5628 (1.42)     0.0000 (1.0)           0;0  0.3902 (0.70)          1           1
test_partial_remove-push-update[main]       2.4873 (1.38)     2.4873 (1.38)     2.4873 (1.38)     0.0000 (1.0)      2.4873 (1.38)     0.0000 (1.0)           0;0  0.4020 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]       607.3931 (1.0)        615.2543 (1.0)        611.0582 (1.0)       3.5537 (1.0)        610.2462 (1.0)       6.5613 (1.0)           2;0  1.6365 (1.0)           5           3
test_plots-plots-diff[3.10.0]     1,012.4330 (1.67)     1,035.1045 (1.68)     1,024.8381 (1.68)      8.1141 (2.28)     1,025.4284 (1.68)      7.3525 (1.12)          2;0  0.9758 (0.60)          5           3
test_plots-plots-diff[3.53.2]       962.1781 (1.58)       977.1820 (1.59)       969.9462 (1.59)      5.9086 (1.66)       971.6293 (1.59)      8.8872 (1.35)          2;0  1.0310 (0.63)          5           3
test_plots-plots-diff[3.60.1]       961.8213 (1.58)       975.0676 (1.58)       969.9541 (1.59)      5.5509 (1.56)       972.4308 (1.59)      8.5807 (1.31)          1;0  1.0310 (0.63)          5           3
test_plots-plots-diff[main]         912.8755 (1.50)       951.7485 (1.55)       933.6343 (1.53)     17.8333 (5.02)       940.3449 (1.54)     32.4608 (4.95)          2;0  1.0711 (0.65)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       619.1074 (1.0)        641.8930 (1.0)        626.8742 (1.0)      9.9195 (2.22)       621.0529 (1.0)      14.7456 (2.13)          1;0  1.5952 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,245.4718 (2.01)     1,260.5976 (1.96)     1,256.4895 (2.00)     6.4199 (1.44)     1,259.7607 (2.03)      7.0117 (1.01)          1;0  0.7959 (0.50)          5           3
test_plots-plots-diff-json[3.53.2]     1,027.6735 (1.66)     1,041.5986 (1.62)     1,036.7329 (1.65)     5.6918 (1.28)     1,036.4083 (1.67)      7.3822 (1.07)          1;0  0.9646 (0.60)          5           3
test_plots-plots-diff-json[3.60.1]     1,041.0794 (1.68)     1,052.2789 (1.64)     1,046.9823 (1.67)     4.4628 (1.0)      1,048.1788 (1.69)      6.9300 (1.0)           2;0  0.9551 (0.60)          5           3
test_plots-plots-diff-json[main]       1,034.9004 (1.67)     1,049.9404 (1.64)     1,040.3146 (1.66)     5.9982 (1.34)     1,037.3216 (1.67)      7.4715 (1.08)          1;0  0.9612 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     501.6138 (1.0)      511.5009 (1.0)      505.1592 (1.0)       3.9890 (1.05)     504.5090 (1.0)       5.4972 (1.14)          1;0  1.9796 (1.0)           5           3
test_plots-plots-show[3.10.0]     819.9656 (1.63)     841.8896 (1.65)     828.3741 (1.64)      9.9682 (2.61)     822.7613 (1.63)     16.7291 (3.48)          1;0  1.2072 (0.61)          5           3
test_plots-plots-show[3.53.2]     806.7333 (1.61)     816.4813 (1.60)     812.8446 (1.61)      3.8133 (1.0)      813.0511 (1.61)      4.8034 (1.0)           1;0  1.2302 (0.62)          5           3
test_plots-plots-show[3.60.1]     812.6710 (1.62)     824.4087 (1.61)     819.4506 (1.62)      4.6371 (1.22)     818.8706 (1.62)      6.6463 (1.38)          2;0  1.2203 (0.62)          5           3
test_plots-plots-show[main]       775.2276 (1.55)     816.5907 (1.60)     784.7995 (1.55)     17.8002 (4.67)     777.1929 (1.54)     11.0659 (2.30)          1;1  1.2742 (0.64)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     521.0989 (1.0)      533.3786 (1.0)      525.7902 (1.0)       5.0565 (2.14)     523.3643 (1.0)       7.4024 (1.69)          1;0  1.9019 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     953.8870 (1.83)     972.9471 (1.82)     963.3249 (1.83)      7.6440 (3.24)     961.4813 (1.84)     12.0588 (2.76)          2;0  1.0381 (0.55)          5           3
test_plots-plots-show-json[3.53.2]     871.4366 (1.67)     876.5042 (1.64)     873.7844 (1.66)      2.3607 (1.0)      872.9546 (1.67)      4.3755 (1.0)           1;0  1.1444 (0.60)          5           3
test_plots-plots-show-json[3.60.1]     869.4390 (1.67)     882.2097 (1.65)     877.7453 (1.67)      5.1997 (2.20)     880.0982 (1.68)      6.9546 (1.59)          1;0  1.1393 (0.60)          5           3
test_plots-plots-show-json[main]       823.4165 (1.58)     860.7740 (1.61)     834.7200 (1.59)     15.0824 (6.39)     829.5260 (1.58)     15.2151 (3.48)          1;0  1.1980 (0.63)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     47.2483 (2.21)     47.2483 (2.21)     47.2483 (2.21)     0.0000 (1.0)      47.2483 (2.21)     0.0000 (1.0)           0;0  0.0212 (0.45)          1           1
test_push-push[3.10.0]     42.2664 (1.97)     42.2664 (1.97)     42.2664 (1.97)     0.0000 (1.0)      42.2664 (1.97)     0.0000 (1.0)           0;0  0.0237 (0.51)          1           1
test_push-push[3.53.2]     21.9182 (1.02)     21.9182 (1.02)     21.9182 (1.02)     0.0000 (1.0)      21.9182 (1.02)     0.0000 (1.0)           0;0  0.0456 (0.98)          1           1
test_push-push[3.60.1]     21.4403 (1.00)     21.4403 (1.00)     21.4403 (1.00)     0.0000 (1.0)      21.4403 (1.00)     0.0000 (1.0)           0;0  0.0466 (1.00)          1           1
test_push-push[main]       21.4223 (1.0)      21.4223 (1.0)      21.4223 (1.0)      0.0000 (1.0)      21.4223 (1.0)      0.0000 (1.0)           0;0  0.0467 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     60.3729 (2.67)     60.3729 (2.67)     60.3729 (2.67)     0.0000 (1.0)      60.3729 (2.67)     0.0000 (1.0)           0;0  0.0166 (0.37)          1           1
test_sharing-fetch[3.10.0]     64.5486 (2.86)     64.5486 (2.86)     64.5486 (2.86)     0.0000 (1.0)      64.5486 (2.86)     0.0000 (1.0)           0;0  0.0155 (0.35)          1           1
test_sharing-fetch[3.53.2]     32.3446 (1.43)     32.3446 (1.43)     32.3446 (1.43)     0.0000 (1.0)      32.3446 (1.43)     0.0000 (1.0)           0;0  0.0309 (0.70)          1           1
test_sharing-fetch[3.60.1]     22.6489 (1.00)     22.6489 (1.00)     22.6489 (1.00)     0.0000 (1.0)      22.6489 (1.00)     0.0000 (1.0)           0;0  0.0442 (1.00)          1           1
test_sharing-fetch[main]       22.5862 (1.0)      22.5862 (1.0)      22.5862 (1.0)      0.0000 (1.0)      22.5862 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3096 (1.0)      1.3096 (1.0)      1.3096 (1.0)      0.0000 (1.0)      1.3096 (1.0)      0.0000 (1.0)           0;0  0.7636 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5407 (2.70)     3.5407 (2.70)     3.5407 (2.70)     0.0000 (1.0)      3.5407 (2.70)     0.0000 (1.0)           0;0  0.2824 (0.37)          1           1
test_sharing-fetch-noop[3.53.2]     5.7174 (4.37)     5.7174 (4.37)     5.7174 (4.37)     0.0000 (1.0)      5.7174 (4.37)     0.0000 (1.0)           0;0  0.1749 (0.23)          1           1
test_sharing-fetch-noop[3.60.1]     6.1342 (4.68)     6.1342 (4.68)     6.1342 (4.68)     0.0000 (1.0)      6.1342 (4.68)     0.0000 (1.0)           0;0  0.1630 (0.21)          1           1
test_sharing-fetch-noop[main]       6.0104 (4.59)     6.0104 (4.59)     6.0104 (4.59)     0.0000 (1.0)      6.0104 (4.59)     0.0000 (1.0)           0;0  0.1664 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     47.7718 (2.19)     47.7718 (2.19)     47.7718 (2.19)     0.0000 (1.0)      47.7718 (2.19)     0.0000 (1.0)           0;0  0.0209 (0.46)          1           1
test_sharing-push[3.10.0]     42.3647 (1.94)     42.3647 (1.94)     42.3647 (1.94)     0.0000 (1.0)      42.3647 (1.94)     0.0000 (1.0)           0;0  0.0236 (0.52)          1           1
test_sharing-push[3.53.2]     22.7918 (1.04)     22.7918 (1.04)     22.7918 (1.04)     0.0000 (1.0)      22.7918 (1.04)     0.0000 (1.0)           0;0  0.0439 (0.96)          1           1
test_sharing-push[3.60.1]     21.8444 (1.0)      21.8444 (1.0)      21.8444 (1.0)      0.0000 (1.0)      21.8444 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
test_sharing-push[main]       22.2060 (1.02)     22.2060 (1.02)     22.2060 (1.02)     0.0000 (1.0)      22.2060 (1.02)     0.0000 (1.0)           0;0  0.0450 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0133 (1.0)      2.0133 (1.0)      2.0133 (1.0)      0.0000 (1.0)      2.0133 (1.0)      0.0000 (1.0)           0;0  0.4967 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0691 (1.03)     2.0691 (1.03)     2.0691 (1.03)     0.0000 (1.0)      2.0691 (1.03)     0.0000 (1.0)           0;0  0.4833 (0.97)          1           1
test_sharing-push-noop[3.53.2]     6.0467 (3.00)     6.0467 (3.00)     6.0467 (3.00)     0.0000 (1.0)      6.0467 (3.00)     0.0000 (1.0)           0;0  0.1654 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.0281 (2.99)     6.0281 (2.99)     6.0281 (2.99)     0.0000 (1.0)      6.0281 (2.99)     0.0000 (1.0)           0;0  0.1659 (0.33)          1           1
test_sharing-push-noop[main]       6.0413 (3.00)     6.0413 (3.00)     6.0413 (3.00)     0.0000 (1.0)      6.0413 (3.00)     0.0000 (1.0)           0;0  0.1655 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     352.8060 (1.03)     352.8060 (1.03)     352.8060 (1.03)     0.0000 (1.0)      352.8060 (1.03)     0.0000 (1.0)           0;0  0.0028 (0.97)          1           1
test_sharing_azure-fetch[main]       343.4813 (1.0)      343.4813 (1.0)      343.4813 (1.0)      0.0000 (1.0)      343.4813 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4621 (1.0)      6.4621 (1.0)      6.4621 (1.0)      0.0000 (1.0)      6.4621 (1.0)      0.0000 (1.0)           0;0  0.1547 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7234 (1.04)     6.7234 (1.04)     6.7234 (1.04)     0.0000 (1.0)      6.7234 (1.04)     0.0000 (1.0)           0;0  0.1487 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     348.6520 (1.0)      348.6520 (1.0)      348.6520 (1.0)      0.0000 (1.0)      348.6520 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
test_sharing_azure-push[main]       349.9495 (1.00)     349.9495 (1.00)     349.9495 (1.00)     0.0000 (1.0)      349.9495 (1.00)     0.0000 (1.0)           0;0  0.0029 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.0740 (1.05)     8.0740 (1.05)     8.0740 (1.05)     0.0000 (1.0)      8.0740 (1.05)     0.0000 (1.0)           0;0  0.1239 (0.95)          1           1
test_sharing_azure-push-noop[main]       7.6634 (1.0)      7.6634 (1.0)      7.6634 (1.0)      0.0000 (1.0)      7.6634 (1.0)      0.0000 (1.0)           0;0  0.1305 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     194.2382 (1.03)     194.2382 (1.03)     194.2382 (1.03)     0.0000 (1.0)      194.2382 (1.03)     0.0000 (1.0)           0;0  0.0051 (0.97)          1           1
test_sharing_gs-fetch[main]       188.5842 (1.0)      188.5842 (1.0)      188.5842 (1.0)      0.0000 (1.0)      188.5842 (1.0)      0.0000 (1.0)           0;0  0.0053 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     6.2350 (1.0)      6.2350 (1.0)      6.2350 (1.0)      0.0000 (1.0)      6.2350 (1.0)      0.0000 (1.0)           0;0  0.1604 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       6.4617 (1.04)     6.4617 (1.04)     6.4617 (1.04)     0.0000 (1.0)      6.4617 (1.04)     0.0000 (1.0)           0;0  0.1548 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     545.3911 (1.0)      545.3911 (1.0)      545.3911 (1.0)      0.0000 (1.0)      545.3911 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
test_sharing_gs-push[main]       546.4820 (1.00)     546.4820 (1.00)     546.4820 (1.00)     0.0000 (1.0)      546.4820 (1.00)     0.0000 (1.0)           0;0  0.0018 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.4654 (1.0)      6.4654 (1.0)      6.4654 (1.0)      0.0000 (1.0)      6.4654 (1.0)      0.0000 (1.0)           0;0  0.1547 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.5295 (1.01)     6.5295 (1.01)     6.5295 (1.01)     0.0000 (1.0)      6.5295 (1.01)     0.0000 (1.0)           0;0  0.1532 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     305.2732 (1.0)      305.2732 (1.0)      305.2732 (1.0)      0.0000 (1.0)      305.2732 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
test_sharing_s3-fetch[main]       308.5218 (1.01)     308.5218 (1.01)     308.5218 (1.01)     0.0000 (1.0)      308.5218 (1.01)     0.0000 (1.0)           0;0  0.0032 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6009 (1.01)     6.6009 (1.01)     6.6009 (1.01)     0.0000 (1.0)      6.6009 (1.01)     0.0000 (1.0)           0;0  0.1515 (0.99)          1           1
test_sharing_s3-fetch-noop[main]       6.5315 (1.0)      6.5315 (1.0)      6.5315 (1.0)      0.0000 (1.0)      6.5315 (1.0)      0.0000 (1.0)           0;0  0.1531 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     350.3034 (1.05)     350.3034 (1.05)     350.3034 (1.05)     0.0000 (1.0)      350.3034 (1.05)     0.0000 (1.0)           0;0  0.0029 (0.95)          1           1
test_sharing_s3-push[main]       332.3114 (1.0)      332.3114 (1.0)      332.3114 (1.0)      0.0000 (1.0)      332.3114 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5030 (1.0)      6.5030 (1.0)      6.5030 (1.0)      0.0000 (1.0)      6.5030 (1.0)      0.0000 (1.0)           0;0  0.1538 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.5728 (1.01)     6.5728 (1.01)     6.5728 (1.01)     0.0000 (1.0)      6.5728 (1.01)     0.0000 (1.0)           0;0  0.1521 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.5789 (3.80)     19.5789 (3.80)     19.5789 (3.80)     0.0000 (1.0)      19.5789 (3.80)     0.0000 (1.0)           0;0  0.0511 (0.26)          1           1
test_status-status[3.10.0]     19.8129 (3.84)     19.8129 (3.84)     19.8129 (3.84)     0.0000 (1.0)      19.8129 (3.84)     0.0000 (1.0)           0;0  0.0505 (0.26)          1           1
test_status-status[3.53.2]     17.8696 (3.47)     17.8696 (3.47)     17.8696 (3.47)     0.0000 (1.0)      17.8696 (3.47)     0.0000 (1.0)           0;0  0.0560 (0.29)          1           1
test_status-status[3.60.1]      5.1552 (1.0)       5.1552 (1.0)       5.1552 (1.0)      0.0000 (1.0)       5.1552 (1.0)      0.0000 (1.0)           0;0  0.1940 (1.0)           1           1
test_status-status[main]        5.4583 (1.06)      5.4583 (1.06)      5.4583 (1.06)     0.0000 (1.0)       5.4583 (1.06)     0.0000 (1.0)           0;0  0.1832 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8292 (1.77)     4.8292 (1.77)     4.8292 (1.77)     0.0000 (1.0)      4.8292 (1.77)     0.0000 (1.0)           0;0  0.2071 (0.56)          1           1
test_status-status-changed[3.10.0]     5.0481 (1.85)     5.0481 (1.85)     5.0481 (1.85)     0.0000 (1.0)      5.0481 (1.85)     0.0000 (1.0)           0;0  0.1981 (0.54)          1           1
test_status-status-changed[3.53.2]     5.0557 (1.85)     5.0557 (1.85)     5.0557 (1.85)     0.0000 (1.0)      5.0557 (1.85)     0.0000 (1.0)           0;0  0.1978 (0.54)          1           1
test_status-status-changed[3.60.1]     2.7263 (1.0)      2.7263 (1.0)      2.7263 (1.0)      0.0000 (1.0)      2.7263 (1.0)      0.0000 (1.0)           0;0  0.3668 (1.0)           1           1
test_status-status-changed[main]       2.9546 (1.08)     2.9546 (1.08)     2.9546 (1.08)     0.0000 (1.0)      2.9546 (1.08)     0.0000 (1.0)           0;0  0.3385 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8744 (1.89)     4.8744 (1.89)     4.8744 (1.89)     0.0000 (1.0)      4.8744 (1.89)     0.0000 (1.0)           0;0  0.2052 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     5.1303 (1.99)     5.1303 (1.99)     5.1303 (1.99)     0.0000 (1.0)      5.1303 (1.99)     0.0000 (1.0)           0;0  0.1949 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     4.9392 (1.91)     4.9392 (1.91)     4.9392 (1.91)     0.0000 (1.0)      4.9392 (1.91)     0.0000 (1.0)           0;0  0.2025 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.5814 (1.0)      2.5814 (1.0)      2.5814 (1.0)      0.0000 (1.0)      2.5814 (1.0)      0.0000 (1.0)           0;0  0.3874 (1.0)           1           1
test_status-status-changed-noop[main]       2.7789 (1.08)     2.7789 (1.08)     2.7789 (1.08)     0.0000 (1.0)      2.7789 (1.08)     0.0000 (1.0)           0;0  0.3599 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8912 (1.89)     4.8912 (1.89)     4.8912 (1.89)     0.0000 (1.0)      4.8912 (1.89)     0.0000 (1.0)           0;0  0.2044 (0.53)          1           1
test_status-status-noop[3.10.0]     5.0704 (1.95)     5.0704 (1.95)     5.0704 (1.95)     0.0000 (1.0)      5.0704 (1.95)     0.0000 (1.0)           0;0  0.1972 (0.51)          1           1
test_status-status-noop[3.53.2]     4.9388 (1.90)     4.9388 (1.90)     4.9388 (1.90)     0.0000 (1.0)      4.9388 (1.90)     0.0000 (1.0)           0;0  0.2025 (0.53)          1           1
test_status-status-noop[3.60.1]     2.5941 (1.0)      2.5941 (1.0)      2.5941 (1.0)      0.0000 (1.0)      2.5941 (1.0)      0.0000 (1.0)           0;0  0.3855 (1.0)           1           1
test_status-status-noop[main]       2.7991 (1.08)     2.7991 (1.08)     2.7991 (1.08)     0.0000 (1.0)      2.7991 (1.08)     0.0000 (1.0)           0;0  0.3573 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     149.6118 (3.26)     149.6118 (3.26)     149.6118 (3.26)     0.0000 (1.0)      149.6118 (3.26)     0.0000 (1.0)           0;0  0.0067 (0.31)          1           1
test_update-import-url[3.10.0]     154.9902 (3.38)     154.9902 (3.38)     154.9902 (3.38)     0.0000 (1.0)      154.9902 (3.38)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.53.2]     118.3080 (2.58)     118.3080 (2.58)     118.3080 (2.58)     0.0000 (1.0)      118.3080 (2.58)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_update-import-url[3.60.1]      45.8540 (1.0)       45.8540 (1.0)       45.8540 (1.0)      0.0000 (1.0)       45.8540 (1.0)      0.0000 (1.0)           0;0  0.0218 (1.0)           1           1
test_update-import-url[main]        47.1049 (1.03)      47.1049 (1.03)      47.1049 (1.03)     0.0000 (1.0)       47.1049 (1.03)     0.0000 (1.0)           0;0  0.0212 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     134.1517 (3.80)     134.1517 (3.80)     134.1517 (3.80)     0.0000 (1.0)      134.1517 (3.80)     0.0000 (1.0)           0;0  0.0075 (0.26)          1           1
test_update-update[3.10.0]     139.4885 (3.95)     139.4885 (3.95)     139.4885 (3.95)     0.0000 (1.0)      139.4885 (3.95)     0.0000 (1.0)           0;0  0.0072 (0.25)          1           1
test_update-update[3.53.2]     109.6772 (3.11)     109.6772 (3.11)     109.6772 (3.11)     0.0000 (1.0)      109.6772 (3.11)     0.0000 (1.0)           0;0  0.0091 (0.32)          1           1
test_update-update[3.60.1]      35.2905 (1.0)       35.2905 (1.0)       35.2905 (1.0)      0.0000 (1.0)       35.2905 (1.0)      0.0000 (1.0)           0;0  0.0283 (1.0)           1           1
test_update-update[main]        36.2258 (1.03)      36.2258 (1.03)      36.2258 (1.03)     0.0000 (1.0)       36.2258 (1.03)     0.0000 (1.0)           0;0  0.0276 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.6544 (2.17)     16.6544 (2.17)     16.6544 (2.17)     0.0000 (1.0)      16.6544 (2.17)     0.0000 (1.0)           0;0  0.0600 (0.46)          1           1
test_update-update-noop[3.10.0]     17.4378 (2.27)     17.4378 (2.27)     17.4378 (2.27)     0.0000 (1.0)      17.4378 (2.27)     0.0000 (1.0)           0;0  0.0573 (0.44)          1           1
test_update-update-noop[3.53.2]     16.5834 (2.16)     16.5834 (2.16)     16.5834 (2.16)     0.0000 (1.0)      16.5834 (2.16)     0.0000 (1.0)           0;0  0.0603 (0.46)          1           1
test_update-update-noop[3.60.1]      7.6811 (1.0)       7.6811 (1.0)       7.6811 (1.0)      0.0000 (1.0)       7.6811 (1.0)      0.0000 (1.0)           0;0  0.1302 (1.0)           1           1
test_update-update-noop[main]        8.3289 (1.08)      8.3289 (1.08)      8.3289 (1.08)     0.0000 (1.0)       8.3289 (1.08)     0.0000 (1.0)           0;0  0.1201 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean