Tue Apr  7 01:12:11 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     83.0430 (3.75)     83.0430 (3.75)     83.0430 (3.75)     0.0000 (1.0)      83.0430 (3.75)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_add_copy-add[3.10.0]     84.1921 (3.80)     84.1921 (3.80)     84.1921 (3.80)     0.0000 (1.0)      84.1921 (3.80)     0.0000 (1.0)           0;0  0.0119 (0.26)          1           1
test_add_copy-add[3.53.2]     73.8032 (3.33)     73.8032 (3.33)     73.8032 (3.33)     0.0000 (1.0)      73.8032 (3.33)     0.0000 (1.0)           0;0  0.0135 (0.30)          1           1
test_add_copy-add[3.60.1]     22.1510 (1.0)      22.1510 (1.0)      22.1510 (1.0)      0.0000 (1.0)      22.1510 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
test_add_copy-add[main]       23.3559 (1.05)     23.3559 (1.05)     23.3559 (1.05)     0.0000 (1.0)      23.3559 (1.05)     0.0000 (1.0)           0;0  0.0428 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.1305 (6.93)     27.1305 (6.93)     27.1305 (6.93)     0.0000 (1.0)      27.1305 (6.93)     0.0000 (1.0)           0;0  0.0369 (0.14)          1           1
test_add_copy-add-noop[3.10.0]     27.1575 (6.93)     27.1575 (6.93)     27.1575 (6.93)     0.0000 (1.0)      27.1575 (6.93)     0.0000 (1.0)           0;0  0.0368 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     25.5205 (6.52)     25.5205 (6.52)     25.5205 (6.52)     0.0000 (1.0)      25.5205 (6.52)     0.0000 (1.0)           0;0  0.0392 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      3.9170 (1.0)       3.9170 (1.0)       3.9170 (1.0)      0.0000 (1.0)       3.9170 (1.0)      0.0000 (1.0)           0;0  0.2553 (1.0)           1           1
test_add_copy-add-noop[main]        4.1056 (1.05)      4.1056 (1.05)      4.1056 (1.05)     0.0000 (1.0)       4.1056 (1.05)     0.0000 (1.0)           0;0  0.2436 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     61.9939 (3.84)     61.9939 (3.84)     61.9939 (3.84)     0.0000 (1.0)      61.9939 (3.84)     0.0000 (1.0)           0;0  0.0161 (0.26)          1           1
test_add_hardlink-add[3.10.0]     63.1949 (3.91)     63.1949 (3.91)     63.1949 (3.91)     0.0000 (1.0)      63.1949 (3.91)     0.0000 (1.0)           0;0  0.0158 (0.26)          1           1
test_add_hardlink-add[3.53.2]     60.0702 (3.72)     60.0702 (3.72)     60.0702 (3.72)     0.0000 (1.0)      60.0702 (3.72)     0.0000 (1.0)           0;0  0.0166 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.1625 (1.0)      16.1625 (1.0)      16.1625 (1.0)      0.0000 (1.0)      16.1625 (1.0)      0.0000 (1.0)           0;0  0.0619 (1.0)           1           1
test_add_hardlink-add[main]       17.3344 (1.07)     17.3344 (1.07)     17.3344 (1.07)     0.0000 (1.0)      17.3344 (1.07)     0.0000 (1.0)           0;0  0.0577 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     31.4524 (7.40)     31.4524 (7.40)     31.4524 (7.40)     0.0000 (1.0)      31.4524 (7.40)     0.0000 (1.0)           0;0  0.0318 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     31.4782 (7.41)     31.4782 (7.41)     31.4782 (7.41)     0.0000 (1.0)      31.4782 (7.41)     0.0000 (1.0)           0;0  0.0318 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     30.6267 (7.21)     30.6267 (7.21)     30.6267 (7.21)     0.0000 (1.0)      30.6267 (7.21)     0.0000 (1.0)           0;0  0.0327 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2486 (1.0)       4.2486 (1.0)       4.2486 (1.0)      0.0000 (1.0)       4.2486 (1.0)      0.0000 (1.0)           0;0  0.2354 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4390 (1.04)      4.4390 (1.04)      4.4390 (1.04)     0.0000 (1.0)       4.4390 (1.04)     0.0000 (1.0)           0;0  0.2253 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.0444 (1.92)     69.0444 (1.92)     69.0444 (1.92)     0.0000 (1.0)      69.0444 (1.92)     0.0000 (1.0)           0;0  0.0145 (0.52)          1           1
test_add_symlink-add[3.10.0]     69.2545 (1.93)     69.2545 (1.93)     69.2545 (1.93)     0.0000 (1.0)      69.2545 (1.93)     0.0000 (1.0)           0;0  0.0144 (0.52)          1           1
test_add_symlink-add[3.53.2]     64.6728 (1.80)     64.6728 (1.80)     64.6728 (1.80)     0.0000 (1.0)      64.6728 (1.80)     0.0000 (1.0)           0;0  0.0155 (0.56)          1           1
test_add_symlink-add[3.60.1]     35.9048 (1.0)      35.9048 (1.0)      35.9048 (1.0)      0.0000 (1.0)      35.9048 (1.0)      0.0000 (1.0)           0;0  0.0279 (1.0)           1           1
test_add_symlink-add[main]       38.2309 (1.06)     38.2309 (1.06)     38.2309 (1.06)     0.0000 (1.0)      38.2309 (1.06)     0.0000 (1.0)           0;0  0.0262 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     44.7016 (8.30)     44.7016 (8.30)     44.7016 (8.30)     0.0000 (1.0)      44.7016 (8.30)     0.0000 (1.0)           0;0  0.0224 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.2030 (8.39)     45.2030 (8.39)     45.2030 (8.39)     0.0000 (1.0)      45.2030 (8.39)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.1945 (8.20)     44.1945 (8.20)     44.1945 (8.20)     0.0000 (1.0)      44.1945 (8.20)     0.0000 (1.0)           0;0  0.0226 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.3885 (1.0)       5.3885 (1.0)       5.3885 (1.0)      0.0000 (1.0)       5.3885 (1.0)      0.0000 (1.0)           0;0  0.1856 (1.0)           1           1
test_add_symlink-add-noop[main]        5.6272 (1.04)      5.6272 (1.04)      5.6272 (1.04)     0.0000 (1.0)       5.6272 (1.04)     0.0000 (1.0)           0;0  0.1777 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      41.0302 (1.94)      41.0302 (1.94)      41.0302 (1.94)     0.0000 (1.0)       41.0302 (1.94)     0.0000 (1.0)           0;0  0.0244 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     104.0820 (4.93)     104.0820 (4.93)     104.0820 (4.93)     0.0000 (1.0)      104.0820 (4.93)     0.0000 (1.0)           0;0  0.0096 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      28.5474 (1.35)      28.5474 (1.35)      28.5474 (1.35)     0.0000 (1.0)       28.5474 (1.35)     0.0000 (1.0)           0;0  0.0350 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]      21.1130 (1.0)       21.1130 (1.0)       21.1130 (1.0)      0.0000 (1.0)       21.1130 (1.0)      0.0000 (1.0)           0;0  0.0474 (1.0)           1           1
test_checkout_copy-checkout[main]        21.9358 (1.04)      21.9358 (1.04)      21.9358 (1.04)     0.0000 (1.0)       21.9358 (1.04)     0.0000 (1.0)           0;0  0.0456 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6475 (1.75)     5.6475 (1.75)     5.6475 (1.75)     0.0000 (1.0)      5.6475 (1.75)     0.0000 (1.0)           0;0  0.1771 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8949 (1.82)     5.8949 (1.82)     5.8949 (1.82)     0.0000 (1.0)      5.8949 (1.82)     0.0000 (1.0)           0;0  0.1696 (0.55)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6344 (1.74)     5.6344 (1.74)     5.6344 (1.74)     0.0000 (1.0)      5.6344 (1.74)     0.0000 (1.0)           0;0  0.1775 (0.57)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2347 (1.0)      3.2347 (1.0)      3.2347 (1.0)      0.0000 (1.0)      3.2347 (1.0)      0.0000 (1.0)           0;0  0.3091 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4862 (1.08)     3.4862 (1.08)     3.4862 (1.08)     0.0000 (1.0)      3.4862 (1.08)     0.0000 (1.0)           0;0  0.2868 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.7246 (1.99)     7.7246 (1.99)     7.7246 (1.99)     0.0000 (1.0)      7.7246 (1.99)     0.0000 (1.0)           0;0  0.1295 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6969 (1.72)     6.6969 (1.72)     6.6969 (1.72)     0.0000 (1.0)      6.6969 (1.72)     0.0000 (1.0)           0;0  0.1493 (0.58)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2963 (1.62)     6.2963 (1.62)     6.2963 (1.62)     0.0000 (1.0)      6.2963 (1.62)     0.0000 (1.0)           0;0  0.1588 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8827 (1.0)      3.8827 (1.0)      3.8827 (1.0)      0.0000 (1.0)      3.8827 (1.0)      0.0000 (1.0)           0;0  0.2576 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4557 (1.15)     4.4557 (1.15)     4.4557 (1.15)     0.0000 (1.0)      4.4557 (1.15)     0.0000 (1.0)           0;0  0.2244 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.0333 (2.76)     21.0333 (2.76)     21.0333 (2.76)     0.0000 (1.0)      21.0333 (2.76)     0.0000 (1.0)           0;0  0.0475 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.0401 (2.10)     16.0401 (2.10)     16.0401 (2.10)     0.0000 (1.0)      16.0401 (2.10)     0.0000 (1.0)           0;0  0.0623 (0.48)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.5205 (1.91)     14.5205 (1.91)     14.5205 (1.91)     0.0000 (1.0)      14.5205 (1.91)     0.0000 (1.0)           0;0  0.0689 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6220 (1.0)       7.6220 (1.0)       7.6220 (1.0)      0.0000 (1.0)       7.6220 (1.0)      0.0000 (1.0)           0;0  0.1312 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.3185 (1.09)      8.3185 (1.09)      8.3185 (1.09)     0.0000 (1.0)       8.3185 (1.09)     0.0000 (1.0)           0;0  0.1202 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6434 (1.74)     5.6434 (1.74)     5.6434 (1.74)     0.0000 (1.0)      5.6434 (1.74)     0.0000 (1.0)           0;0  0.1772 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7454 (1.77)     5.7454 (1.77)     5.7454 (1.77)     0.0000 (1.0)      5.7454 (1.77)     0.0000 (1.0)           0;0  0.1741 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5012 (1.69)     5.5012 (1.69)     5.5012 (1.69)     0.0000 (1.0)      5.5012 (1.69)     0.0000 (1.0)           0;0  0.1818 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2477 (1.0)      3.2477 (1.0)      3.2477 (1.0)      0.0000 (1.0)      3.2477 (1.0)      0.0000 (1.0)           0;0  0.3079 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4510 (1.06)     3.4510 (1.06)     3.4510 (1.06)     0.0000 (1.0)      3.4510 (1.06)     0.0000 (1.0)           0;0  0.2898 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6685 (1.97)     7.6685 (1.97)     7.6685 (1.97)     0.0000 (1.0)      7.6685 (1.97)     0.0000 (1.0)           0;0  0.1304 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5638 (1.69)     6.5638 (1.69)     6.5638 (1.69)     0.0000 (1.0)      6.5638 (1.69)     0.0000 (1.0)           0;0  0.1524 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3176 (1.62)     6.3176 (1.62)     6.3176 (1.62)     0.0000 (1.0)      6.3176 (1.62)     0.0000 (1.0)           0;0  0.1583 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8944 (1.0)      3.8944 (1.0)      3.8944 (1.0)      0.0000 (1.0)      3.8944 (1.0)      0.0000 (1.0)           0;0  0.2568 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3349 (1.11)     4.3349 (1.11)     4.3349 (1.11)     0.0000 (1.0)      4.3349 (1.11)     0.0000 (1.0)           0;0  0.2307 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9405 (2.46)     24.9405 (2.46)     24.9405 (2.46)     0.0000 (1.0)      24.9405 (2.46)     0.0000 (1.0)           0;0  0.0401 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     19.2031 (1.89)     19.2031 (1.89)     19.2031 (1.89)     0.0000 (1.0)      19.2031 (1.89)     0.0000 (1.0)           0;0  0.0521 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.7047 (1.75)     17.7047 (1.75)     17.7047 (1.75)     0.0000 (1.0)      17.7047 (1.75)     0.0000 (1.0)           0;0  0.0565 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1438 (1.0)      10.1438 (1.0)      10.1438 (1.0)      0.0000 (1.0)      10.1438 (1.0)      0.0000 (1.0)           0;0  0.0986 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.0192 (1.09)     11.0192 (1.09)     11.0192 (1.09)     0.0000 (1.0)      11.0192 (1.09)     0.0000 (1.0)           0;0  0.0908 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6612 (1.58)     6.6612 (1.58)     6.6612 (1.58)     0.0000 (1.0)      6.6612 (1.58)     0.0000 (1.0)           0;0  0.1501 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8083 (1.61)     6.8083 (1.61)     6.8083 (1.61)     0.0000 (1.0)      6.8083 (1.61)     0.0000 (1.0)           0;0  0.1469 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6687 (1.58)     6.6687 (1.58)     6.6687 (1.58)     0.0000 (1.0)      6.6687 (1.58)     0.0000 (1.0)           0;0  0.1500 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2213 (1.0)      4.2213 (1.0)      4.2213 (1.0)      0.0000 (1.0)      4.2213 (1.0)      0.0000 (1.0)           0;0  0.2369 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4156 (1.05)     4.4156 (1.05)     4.4156 (1.05)     0.0000 (1.0)      4.4156 (1.05)     0.0000 (1.0)           0;0  0.2265 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.7377 (1.70)     9.7377 (1.70)     9.7377 (1.70)     0.0000 (1.0)      9.7377 (1.70)     0.0000 (1.0)           0;0  0.1027 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.6016 (1.50)     8.6016 (1.50)     8.6016 (1.50)     0.0000 (1.0)      8.6016 (1.50)     0.0000 (1.0)           0;0  0.1163 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.3734 (1.46)     8.3734 (1.46)     8.3734 (1.46)     0.0000 (1.0)      8.3734 (1.46)     0.0000 (1.0)           0;0  0.1194 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.7391 (1.0)      5.7391 (1.0)      5.7391 (1.0)      0.0000 (1.0)      5.7391 (1.0)      0.0000 (1.0)           0;0  0.1742 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.2786 (1.09)     6.2786 (1.09)     6.2786 (1.09)     0.0000 (1.0)      6.2786 (1.09)     0.0000 (1.0)           0;0  0.1593 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0403 (1.75)     4.0403 (1.75)     4.0403 (1.75)     0.0000 (1.0)      4.0403 (1.75)     0.0000 (1.0)           0;0  0.2475 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.8424 (2.09)     4.8424 (2.09)     4.8424 (2.09)     0.0000 (1.0)      4.8424 (2.09)     0.0000 (1.0)           0;0  0.2065 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.7550 (2.06)     4.7550 (2.06)     4.7550 (2.06)     0.0000 (1.0)      4.7550 (2.06)     0.0000 (1.0)           0;0  0.2103 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.3119 (1.0)      2.3119 (1.0)      2.3119 (1.0)      0.0000 (1.0)      2.3119 (1.0)      0.0000 (1.0)           0;0  0.4325 (1.0)           1           1
test_data_status-data-changed[main]       2.6010 (1.13)     2.6010 (1.13)     2.6010 (1.13)     0.0000 (1.0)      2.6010 (1.13)     0.0000 (1.0)           0;0  0.3845 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9628 (1.71)     3.9628 (1.71)     3.9628 (1.71)     0.0000 (1.0)      3.9628 (1.71)     0.0000 (1.0)           0;0  0.2523 (0.59)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9496 (2.13)     4.9496 (2.13)     4.9496 (2.13)     0.0000 (1.0)      4.9496 (2.13)     0.0000 (1.0)           0;0  0.2020 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7533 (2.05)     4.7533 (2.05)     4.7533 (2.05)     0.0000 (1.0)      4.7533 (2.05)     0.0000 (1.0)           0;0  0.2104 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3203 (1.0)      2.3203 (1.0)      2.3203 (1.0)      0.0000 (1.0)      2.3203 (1.0)      0.0000 (1.0)           0;0  0.4310 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6031 (1.12)     2.6031 (1.12)     2.6031 (1.12)     0.0000 (1.0)      2.6031 (1.12)     0.0000 (1.0)           0;0  0.3842 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.3458 (3.77)     18.3458 (3.77)     18.3458 (3.77)     0.0000 (1.0)      18.3458 (3.77)     0.0000 (1.0)           0;0  0.0545 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.3294 (3.98)     19.3294 (3.98)     19.3294 (3.98)     0.0000 (1.0)      19.3294 (3.98)     0.0000 (1.0)           0;0  0.0517 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.1838 (3.95)     19.1838 (3.95)     19.1838 (3.95)     0.0000 (1.0)      19.1838 (3.95)     0.0000 (1.0)           0;0  0.0521 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.8618 (1.0)       4.8618 (1.0)       4.8618 (1.0)      0.0000 (1.0)       4.8618 (1.0)      0.0000 (1.0)           0;0  0.2057 (1.0)           1           1
test_data_status-data-new[main]        5.3500 (1.10)      5.3500 (1.10)      5.3500 (1.10)     0.0000 (1.0)       5.3500 (1.10)     0.0000 (1.0)           0;0  0.1869 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0324 (1.75)     4.0324 (1.75)     4.0324 (1.75)     0.0000 (1.0)      4.0324 (1.75)     0.0000 (1.0)           0;0  0.2480 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.8324 (2.10)     4.8324 (2.10)     4.8324 (2.10)     0.0000 (1.0)      4.8324 (2.10)     0.0000 (1.0)           0;0  0.2069 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.8902 (2.12)     4.8902 (2.12)     4.8902 (2.12)     0.0000 (1.0)      4.8902 (2.12)     0.0000 (1.0)           0;0  0.2045 (0.47)          1           1
test_data_status-data-noop[3.60.1]     2.3042 (1.0)      2.3042 (1.0)      2.3042 (1.0)      0.0000 (1.0)      2.3042 (1.0)      0.0000 (1.0)           0;0  0.4340 (1.0)           1           1
test_data_status-data-noop[main]       2.6338 (1.14)     2.6338 (1.14)     2.6338 (1.14)     0.0000 (1.0)      2.6338 (1.14)     0.0000 (1.0)           0;0  0.3797 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.7594 (1.30)     6.7594 (1.30)     6.7594 (1.30)     0.0000 (1.0)      6.7594 (1.30)     0.0000 (1.0)           0;0  0.1479 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.5746 (1.45)     7.5746 (1.45)     7.5746 (1.45)     0.0000 (1.0)      7.5746 (1.45)     0.0000 (1.0)           0;0  0.1320 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5698 (1.45)     7.5698 (1.45)     7.5698 (1.45)     0.0000 (1.0)      7.5698 (1.45)     0.0000 (1.0)           0;0  0.1321 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.2127 (1.0)      5.2127 (1.0)      5.2127 (1.0)      0.0000 (1.0)      5.2127 (1.0)      0.0000 (1.0)           0;0  0.1918 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5722 (1.07)     5.5722 (1.07)     5.5722 (1.07)     0.0000 (1.0)      5.5722 (1.07)     0.0000 (1.0)           0;0  0.1795 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.7477 (1.24)     6.7477 (1.24)     6.7477 (1.24)     0.0000 (1.0)      6.7477 (1.24)     0.0000 (1.0)           0;0  0.1482 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6643 (1.41)     7.6643 (1.41)     7.6643 (1.41)     0.0000 (1.0)      7.6643 (1.41)     0.0000 (1.0)           0;0  0.1305 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6913 (1.42)     7.6913 (1.42)     7.6913 (1.42)     0.0000 (1.0)      7.6913 (1.42)     0.0000 (1.0)           0;0  0.1300 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.4263 (1.0)      5.4263 (1.0)      5.4263 (1.0)      0.0000 (1.0)      5.4263 (1.0)      0.0000 (1.0)           0;0  0.1843 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8694 (1.08)     5.8694 (1.08)     5.8694 (1.08)     0.0000 (1.0)      5.8694 (1.08)     0.0000 (1.0)           0;0  0.1704 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.8993 (2.72)     20.8993 (2.72)     20.8993 (2.72)     0.0000 (1.0)      20.8993 (2.72)     0.0000 (1.0)           0;0  0.0478 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.4547 (2.92)     22.4547 (2.92)     22.4547 (2.92)     0.0000 (1.0)      22.4547 (2.92)     0.0000 (1.0)           0;0  0.0445 (0.34)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.2205 (2.89)     22.2205 (2.89)     22.2205 (2.89)     0.0000 (1.0)      22.2205 (2.89)     0.0000 (1.0)           0;0  0.0450 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.6872 (1.0)       7.6872 (1.0)       7.6872 (1.0)      0.0000 (1.0)       7.6872 (1.0)      0.0000 (1.0)           0;0  0.1301 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3857 (1.09)      8.3857 (1.09)      8.3857 (1.09)     0.0000 (1.0)       8.3857 (1.09)     0.0000 (1.0)           0;0  0.1193 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.2640 (1.32)     6.2640 (1.32)     6.2640 (1.32)     0.0000 (1.0)      6.2640 (1.32)     0.0000 (1.0)           0;0  0.1596 (0.76)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.4062 (1.56)     7.4062 (1.56)     7.4062 (1.56)     0.0000 (1.0)      7.4062 (1.56)     0.0000 (1.0)           0;0  0.1350 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0448 (1.48)     7.0448 (1.48)     7.0448 (1.48)     0.0000 (1.0)      7.0448 (1.48)     0.0000 (1.0)           0;0  0.1419 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7547 (1.0)      4.7547 (1.0)      4.7547 (1.0)      0.0000 (1.0)      4.7547 (1.0)      0.0000 (1.0)           0;0  0.2103 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.9707 (1.05)     4.9707 (1.05)     4.9707 (1.05)     0.0000 (1.0)      4.9707 (1.05)     0.0000 (1.0)           0;0  0.2012 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     13.3434 (2.39)     13.3434 (2.39)     13.3434 (2.39)     0.0000 (1.0)      13.3434 (2.39)     0.0000 (1.0)           0;0  0.0749 (0.42)          1           1
test_diff-diff[3.10.0]     14.1812 (2.54)     14.1812 (2.54)     14.1812 (2.54)     0.0000 (1.0)      14.1812 (2.54)     0.0000 (1.0)           0;0  0.0705 (0.39)          1           1
test_diff-diff[3.53.2]     14.4915 (2.59)     14.4915 (2.59)     14.4915 (2.59)     0.0000 (1.0)      14.4915 (2.59)     0.0000 (1.0)           0;0  0.0690 (0.39)          1           1
test_diff-diff[3.60.1]      5.5862 (1.0)       5.5862 (1.0)       5.5862 (1.0)      0.0000 (1.0)       5.5862 (1.0)      0.0000 (1.0)           0;0  0.1790 (1.0)           1           1
test_diff-diff[main]        6.2207 (1.11)      6.2207 (1.11)      6.2207 (1.11)     0.0000 (1.0)       6.2207 (1.11)     0.0000 (1.0)           0;0  0.1608 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     4.6901 (1.54)     4.6901 (1.54)     4.6901 (1.54)     0.0000 (1.0)      4.6901 (1.54)     0.0000 (1.0)           0;0  0.2132 (0.65)          1           1
test_diff-diff-changed[3.10.0]     5.2008 (1.71)     5.2008 (1.71)     5.2008 (1.71)     0.0000 (1.0)      5.2008 (1.71)     0.0000 (1.0)           0;0  0.1923 (0.59)          1           1
test_diff-diff-changed[3.53.2]     4.2723 (1.40)     4.2723 (1.40)     4.2723 (1.40)     0.0000 (1.0)      4.2723 (1.40)     0.0000 (1.0)           0;0  0.2341 (0.71)          1           1
test_diff-diff-changed[3.60.1]     3.0497 (1.0)      3.0497 (1.0)      3.0497 (1.0)      0.0000 (1.0)      3.0497 (1.0)      0.0000 (1.0)           0;0  0.3279 (1.0)           1           1
test_diff-diff-changed[main]       3.7530 (1.23)     3.7530 (1.23)     3.7530 (1.23)     0.0000 (1.0)      3.7530 (1.23)     0.0000 (1.0)           0;0  0.2665 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.0632 (1.34)     4.0632 (1.34)     4.0632 (1.34)     0.0000 (1.0)      4.0632 (1.34)     0.0000 (1.0)           0;0  0.2461 (0.74)          1           1
test_diff-diff-changed-noop[3.10.0]     4.4255 (1.46)     4.4255 (1.46)     4.4255 (1.46)     0.0000 (1.0)      4.4255 (1.46)     0.0000 (1.0)           0;0  0.2260 (0.68)          1           1
test_diff-diff-changed-noop[3.53.2]     4.3251 (1.43)     4.3251 (1.43)     4.3251 (1.43)     0.0000 (1.0)      4.3251 (1.43)     0.0000 (1.0)           0;0  0.2312 (0.70)          1           1
test_diff-diff-changed-noop[3.60.1]     3.0221 (1.0)      3.0221 (1.0)      3.0221 (1.0)      0.0000 (1.0)      3.0221 (1.0)      0.0000 (1.0)           0;0  0.3309 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.8109 (1.26)     3.8109 (1.26)     3.8109 (1.26)     0.0000 (1.0)      3.8109 (1.26)     0.0000 (1.0)           0;0  0.2624 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.0399 (1.00)     3.0399 (1.00)     3.0399 (1.00)     0.0000 (1.0)      3.0399 (1.00)     0.0000 (1.0)           0;0  0.3290 (1.00)          1           1
test_diff-diff-noop[3.10.0]     3.4931 (1.15)     3.4931 (1.15)     3.4931 (1.15)     0.0000 (1.0)      3.4931 (1.15)     0.0000 (1.0)           0;0  0.2863 (0.87)          1           1
test_diff-diff-noop[3.53.2]     4.2630 (1.41)     4.2630 (1.41)     4.2630 (1.41)     0.0000 (1.0)      4.2630 (1.41)     0.0000 (1.0)           0;0  0.2346 (0.71)          1           1
test_diff-diff-noop[3.60.1]     3.0316 (1.0)      3.0316 (1.0)      3.0316 (1.0)      0.0000 (1.0)      3.0316 (1.0)      0.0000 (1.0)           0;0  0.3299 (1.0)           1           1
test_diff-diff-noop[main]       3.7191 (1.23)     3.7191 (1.23)     3.7191 (1.23)     0.0000 (1.0)      3.7191 (1.23)     0.0000 (1.0)           0;0  0.2689 (0.82)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.2373 (1.0)      1.2373 (1.0)      1.2373 (1.0)      0.0000 (1.0)      1.2373 (1.0)      0.0000 (1.0)           0;0  0.8082 (1.0)           1           1
test_exp_show-exp[3.10.0]     3.8491 (3.11)     3.8491 (3.11)     3.8491 (3.11)     0.0000 (1.0)      3.8491 (3.11)     0.0000 (1.0)           0;0  0.2598 (0.32)          1           1
test_exp_show-exp[3.53.2]     2.5514 (2.06)     2.5514 (2.06)     2.5514 (2.06)     0.0000 (1.0)      2.5514 (2.06)     0.0000 (1.0)           0;0  0.3919 (0.48)          1           1
test_exp_show-exp[3.60.1]     2.8935 (2.34)     2.8935 (2.34)     2.8935 (2.34)     0.0000 (1.0)      2.8935 (2.34)     0.0000 (1.0)           0;0  0.3456 (0.43)          1           1
test_exp_show-exp[main]       6.5047 (5.26)     6.5047 (5.26)     6.5047 (5.26)     0.0000 (1.0)      6.5047 (5.26)     0.0000 (1.0)           0;0  0.1537 (0.19)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     112.6111 (4.79)     112.6111 (4.79)     112.6111 (4.79)     0.0000 (1.0)      112.6111 (4.79)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_fetch-fetch[3.10.0]     117.6060 (5.00)     117.6060 (5.00)     117.6060 (5.00)     0.0000 (1.0)      117.6060 (5.00)     0.0000 (1.0)           0;0  0.0085 (0.20)          1           1
test_fetch-fetch[3.53.2]      33.6936 (1.43)      33.6936 (1.43)      33.6936 (1.43)     0.0000 (1.0)       33.6936 (1.43)     0.0000 (1.0)           0;0  0.0297 (0.70)          1           1
test_fetch-fetch[3.60.1]      23.4985 (1.0)       23.4985 (1.0)       23.4985 (1.0)      0.0000 (1.0)       23.4985 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
test_fetch-fetch[main]        23.6440 (1.01)      23.6440 (1.01)      23.6440 (1.01)     0.0000 (1.0)       23.6440 (1.01)     0.0000 (1.0)           0;0  0.0423 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8443 (1.0)      2.8443 (1.0)      2.8443 (1.0)      0.0000 (1.0)      2.8443 (1.0)      0.0000 (1.0)           0;0  0.3516 (1.0)           1           1
test_gc-gc[3.10.0]     3.1580 (1.11)     3.1580 (1.11)     3.1580 (1.11)     0.0000 (1.0)      3.1580 (1.11)     0.0000 (1.0)           0;0  0.3167 (0.90)          1           1
test_gc-gc[3.53.2]     2.8603 (1.01)     2.8603 (1.01)     2.8603 (1.01)     0.0000 (1.0)      2.8603 (1.01)     0.0000 (1.0)           0;0  0.3496 (0.99)          1           1
test_gc-gc[3.60.1]     2.9180 (1.03)     2.9180 (1.03)     2.9180 (1.03)     0.0000 (1.0)      2.9180 (1.03)     0.0000 (1.0)           0;0  0.3427 (0.97)          1           1
test_gc-gc[main]       2.8673 (1.01)     2.8673 (1.01)     2.8673 (1.01)     0.0000 (1.0)      2.8673 (1.01)     0.0000 (1.0)           0;0  0.3488 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     183.0110 (3.65)     183.0110 (3.65)     183.0110 (3.65)     0.0000 (1.0)      183.0110 (3.65)     0.0000 (1.0)           0;0  0.0055 (0.27)          1           1
test_get-get[3.10.0]     213.0299 (4.25)     213.0299 (4.25)     213.0299 (4.25)     0.0000 (1.0)      213.0299 (4.25)     0.0000 (1.0)           0;0  0.0047 (0.24)          1           1
test_get-get[3.53.2]     167.9010 (3.35)     167.9010 (3.35)     167.9010 (3.35)     0.0000 (1.0)      167.9010 (3.35)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.60.1]      50.7184 (1.01)      50.7184 (1.01)      50.7184 (1.01)     0.0000 (1.0)       50.7184 (1.01)     0.0000 (1.0)           0;0  0.0197 (0.99)          1           1
test_get-get[main]        50.0862 (1.0)       50.0862 (1.0)       50.0862 (1.0)      0.0000 (1.0)       50.0862 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     83.5343 (5.53)     83.5343 (5.53)     83.5343 (5.53)     0.0000 (1.0)      83.5343 (5.53)     0.0000 (1.0)           0;0  0.0120 (0.18)          1           1
test_get_url-get-url[3.10.0]     86.4875 (5.72)     86.4875 (5.72)     86.4875 (5.72)     0.0000 (1.0)      86.4875 (5.72)     0.0000 (1.0)           0;0  0.0116 (0.17)          1           1
test_get_url-get-url[3.53.2]     15.6786 (1.04)     15.6786 (1.04)     15.6786 (1.04)     0.0000 (1.0)      15.6786 (1.04)     0.0000 (1.0)           0;0  0.0638 (0.96)          1           1
test_get_url-get-url[3.60.1]     15.1095 (1.0)      15.1095 (1.0)      15.1095 (1.0)      0.0000 (1.0)      15.1095 (1.0)      0.0000 (1.0)           0;0  0.0662 (1.0)           1           1
test_get_url-get-url[main]       15.2307 (1.01)     15.2307 (1.01)     15.2307 (1.01)     0.0000 (1.0)      15.2307 (1.01)     0.0000 (1.0)           0;0  0.0657 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     160.9192 (1.10)     176.3866 (1.12)     169.8747 (1.13)     3.5777 (1.60)     169.9465 (1.14)     4.9667 (1.87)         32;0  5.8867 (0.88)        100           1
test_help---help[3.10.0]     161.8626 (1.11)     184.1717 (1.17)     168.8877 (1.12)     3.7989 (1.70)     168.6268 (1.13)     3.6929 (1.39)         28;7  5.9211 (0.89)        100           1
test_help---help[3.53.2]     160.2285 (1.09)     184.7776 (1.18)     171.0534 (1.14)     6.0957 (2.73)     171.3961 (1.14)     8.6101 (3.25)         35;0  5.8461 (0.88)        100           1
test_help---help[3.60.1]     154.9617 (1.06)     174.8605 (1.11)     161.6650 (1.08)     3.4511 (1.55)     161.6688 (1.08)     4.6753 (1.76)         30;2  6.1856 (0.93)        100           1
test_help---help[main]       146.3868 (1.0)      157.1773 (1.0)      150.2057 (1.0)      2.2305 (1.0)      149.6951 (1.0)      2.6522 (1.0)          29;4  6.6575 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     271.9447 (3.45)     271.9447 (3.45)     271.9447 (3.45)     0.0000 (1.0)      271.9447 (3.45)     0.0000 (1.0)           0;0  0.0037 (0.29)          1           1
test_import-import[3.10.0]     308.7148 (3.92)     308.7148 (3.92)     308.7148 (3.92)     0.0000 (1.0)      308.7148 (3.92)     0.0000 (1.0)           0;0  0.0032 (0.26)          1           1
test_import-import[3.60.1]      78.8483 (1.0)       78.8483 (1.0)       78.8483 (1.0)      0.0000 (1.0)       78.8483 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
test_import-import[main]        79.3027 (1.01)      79.3027 (1.01)      79.3027 (1.01)     0.0000 (1.0)       79.3027 (1.01)     0.0000 (1.0)           0;0  0.0126 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     196.3635 (4.24)     196.3635 (4.24)     196.3635 (4.24)     0.0000 (1.0)      196.3635 (4.24)     0.0000 (1.0)           0;0  0.0051 (0.24)          1           1
test_import_url-import-url[3.10.0]     199.2160 (4.31)     199.2160 (4.31)     199.2160 (4.31)     0.0000 (1.0)      199.2160 (4.31)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_import_url-import-url[3.53.2]     113.4482 (2.45)     113.4482 (2.45)     113.4482 (2.45)     0.0000 (1.0)      113.4482 (2.45)     0.0000 (1.0)           0;0  0.0088 (0.41)          1           1
test_import_url-import-url[3.60.1]      46.2655 (1.0)       46.2655 (1.0)       46.2655 (1.0)      0.0000 (1.0)       46.2655 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_import_url-import-url[main]        47.1545 (1.02)      47.1545 (1.02)      47.1545 (1.02)     0.0000 (1.0)       47.1545 (1.02)     0.0000 (1.0)           0;0  0.0212 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     395.7540 (1.02)     417.8128 (1.03)     401.6658 (1.02)      3.2517 (1.08)     401.1354 (1.02)     3.4787 (1.09)         20;4  2.4896 (0.98)        100           1
test_init-init[3.10.0]     404.8417 (1.04)     428.2475 (1.06)     410.3161 (1.04)      4.1374 (1.38)     409.4457 (1.04)     3.8461 (1.21)         22;4  2.4371 (0.96)        100           1
test_init-init[3.53.2]     388.6333 (1.0)      404.6494 (1.0)      394.3756 (1.0)       3.0030 (1.0)      394.0206 (1.0)      3.1800 (1.0)          26;5  2.5357 (1.0)         100           1
test_init-init[3.60.1]     392.2998 (1.01)     424.6577 (1.05)     400.4079 (1.02)      7.1626 (2.39)     397.6002 (1.01)     8.2680 (2.60)         22;3  2.4975 (0.98)        100           1
test_init-init[main]       430.3592 (1.11)     639.2049 (1.58)     442.5381 (1.12)     29.9957 (9.99)     436.6894 (1.11)     4.7965 (1.51)          4;5  2.2597 (0.89)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     584.1147 (1.05)     584.1147 (1.05)     584.1147 (1.05)     0.0000 (1.0)      584.1147 (1.05)     0.0000 (1.0)           0;0  1.7120 (0.95)          1           1
test_list-list[3.10.0]     839.7363 (1.51)     839.7363 (1.51)     839.7363 (1.51)     0.0000 (1.0)      839.7363 (1.51)     0.0000 (1.0)           0;0  1.1908 (0.66)          1           1
test_list-list[3.53.2]     637.8045 (1.15)     637.8045 (1.15)     637.8045 (1.15)     0.0000 (1.0)      637.8045 (1.15)     0.0000 (1.0)           0;0  1.5679 (0.87)          1           1
test_list-list[3.60.1]     612.8207 (1.10)     612.8207 (1.10)     612.8207 (1.10)     0.0000 (1.0)      612.8207 (1.10)     0.0000 (1.0)           0;0  1.6318 (0.91)          1           1
test_list-list[main]       554.7401 (1.0)      554.7401 (1.0)      554.7401 (1.0)      0.0000 (1.0)      554.7401 (1.0)      0.0000 (1.0)           0;0  1.8026 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     402.4169 (1.03)     402.4169 (1.03)     402.4169 (1.03)     0.0000 (1.0)      402.4169 (1.03)     0.0000 (1.0)           0;0  2.4850 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     391.2771 (1.0)      391.2771 (1.0)      391.2771 (1.0)      0.0000 (1.0)      391.2771 (1.0)      0.0000 (1.0)           0;0  2.5557 (1.0)           1           1
test_list-list-dvc-only[3.53.2]     395.3489 (1.01)     395.3489 (1.01)     395.3489 (1.01)     0.0000 (1.0)      395.3489 (1.01)     0.0000 (1.0)           0;0  2.5294 (0.99)          1           1
test_list-list-dvc-only[3.60.1]     395.7222 (1.01)     395.7222 (1.01)     395.7222 (1.01)     0.0000 (1.0)      395.7222 (1.01)     0.0000 (1.0)           0;0  2.5270 (0.99)          1           1
test_list-list-dvc-only[main]       416.7976 (1.07)     416.7976 (1.07)     416.7976 (1.07)     0.0000 (1.0)      416.7976 (1.07)     0.0000 (1.0)           0;0  2.3992 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4374 (1.01)     2.4374 (1.01)     2.4374 (1.01)     0.0000 (1.0)      2.4374 (1.01)     0.0000 (1.0)           0;0  0.4103 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.4252 (1.0)      2.4252 (1.0)      2.4252 (1.0)      0.0000 (1.0)      2.4252 (1.0)      0.0000 (1.0)           0;0  0.4123 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.5494 (1.05)     2.5494 (1.05)     2.5494 (1.05)     0.0000 (1.0)      2.5494 (1.05)     0.0000 (1.0)           0;0  0.3922 (0.95)          1           1
test_list-list-recursive[3.60.1]     2.5467 (1.05)     2.5467 (1.05)     2.5467 (1.05)     0.0000 (1.0)      2.5467 (1.05)     0.0000 (1.0)           0;0  0.3927 (0.95)          1           1
test_list-list-recursive[main]       2.5441 (1.05)     2.5441 (1.05)     2.5441 (1.05)     0.0000 (1.0)      2.5441 (1.05)     0.0000 (1.0)           0;0  0.3931 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     393.9883 (1.01)     393.9883 (1.01)     393.9883 (1.01)     0.0000 (1.0)      393.9883 (1.01)     0.0000 (1.0)           0;0  2.5381 (0.99)          1           1
test_list-list-shallow[3.10.0]     401.6734 (1.03)     401.6734 (1.03)     401.6734 (1.03)     0.0000 (1.0)      401.6734 (1.03)     0.0000 (1.0)           0;0  2.4896 (0.97)          1           1
test_list-list-shallow[3.53.2]     408.6373 (1.05)     408.6373 (1.05)     408.6373 (1.05)     0.0000 (1.0)      408.6373 (1.05)     0.0000 (1.0)           0;0  2.4472 (0.95)          1           1
test_list-list-shallow[3.60.1]     388.9905 (1.0)      388.9905 (1.0)      388.9905 (1.0)      0.0000 (1.0)      388.9905 (1.0)      0.0000 (1.0)           0;0  2.5708 (1.0)           1           1
test_list-list-shallow[main]       411.8217 (1.06)     411.8217 (1.06)     411.8217 (1.06)     0.0000 (1.0)      411.8217 (1.06)     0.0000 (1.0)           0;0  2.4282 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     8.6972 (3.26)     8.6972 (3.26)     8.6972 (3.26)     0.0000 (1.0)      8.6972 (3.26)     0.0000 (1.0)           0;0  0.1150 (0.31)          1           1
test_partial_add-add[3.10.0]     8.8463 (3.32)     8.8463 (3.32)     8.8463 (3.32)     0.0000 (1.0)      8.8463 (3.32)     0.0000 (1.0)           0;0  0.1130 (0.30)          1           1
test_partial_add-add[3.53.2]     7.9346 (2.98)     7.9346 (2.98)     7.9346 (2.98)     0.0000 (1.0)      7.9346 (2.98)     0.0000 (1.0)           0;0  0.1260 (0.34)          1           1
test_partial_add-add[3.60.1]     2.6660 (1.0)      2.6660 (1.0)      2.6660 (1.0)      0.0000 (1.0)      2.6660 (1.0)      0.0000 (1.0)           0;0  0.3751 (1.0)           1           1
test_partial_add-add[main]       3.5917 (1.35)     3.5917 (1.35)     3.5917 (1.35)     0.0000 (1.0)      3.5917 (1.35)     0.0000 (1.0)           0;0  0.2784 (0.74)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.3421 (4.48)     59.3421 (4.48)     59.3421 (4.48)     0.0000 (1.0)      59.3421 (4.48)     0.0000 (1.0)           0;0  0.0169 (0.22)          1           1
test_partial_add-add-partial[3.10.0]     57.9924 (4.37)     57.9924 (4.37)     57.9924 (4.37)     0.0000 (1.0)      57.9924 (4.37)     0.0000 (1.0)           0;0  0.0172 (0.23)          1           1
test_partial_add-add-partial[3.53.2]     53.4869 (4.03)     53.4869 (4.03)     53.4869 (4.03)     0.0000 (1.0)      53.4869 (4.03)     0.0000 (1.0)           0;0  0.0187 (0.25)          1           1
test_partial_add-add-partial[3.60.1]     13.3040 (1.00)     13.3040 (1.00)     13.3040 (1.00)     0.0000 (1.0)      13.3040 (1.00)     0.0000 (1.0)           0;0  0.0752 (1.00)          1           1
test_partial_add-add-partial[main]       13.2592 (1.0)      13.2592 (1.0)      13.2592 (1.0)      0.0000 (1.0)      13.2592 (1.0)      0.0000 (1.0)           0;0  0.0754 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4181 (1.0)      4.4181 (1.0)      4.4181 (1.0)      0.0000 (1.0)      4.4181 (1.0)      0.0000 (1.0)           0;0  0.2263 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8590 (1.33)     5.8590 (1.33)     5.8590 (1.33)     0.0000 (1.0)      5.8590 (1.33)     0.0000 (1.0)           0;0  0.1707 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.4999 (1.47)     6.4999 (1.47)     6.4999 (1.47)     0.0000 (1.0)      6.4999 (1.47)     0.0000 (1.0)           0;0  0.1538 (0.68)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6303 (1.50)     6.6303 (1.50)     6.6303 (1.50)     0.0000 (1.0)      6.6303 (1.50)     0.0000 (1.0)           0;0  0.1508 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       5.6177 (1.27)     5.6177 (1.27)     5.6177 (1.27)     0.0000 (1.0)      5.6177 (1.27)     0.0000 (1.0)           0;0  0.1780 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4510 (1.0)      2.4510 (1.0)      2.4510 (1.0)      0.0000 (1.0)      2.4510 (1.0)      0.0000 (1.0)           0;0  0.4080 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6961 (1.51)     3.6961 (1.51)     3.6961 (1.51)     0.0000 (1.0)      3.6961 (1.51)     0.0000 (1.0)           0;0  0.2706 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.6746 (1.50)     3.6746 (1.50)     3.6746 (1.50)     0.0000 (1.0)      3.6746 (1.50)     0.0000 (1.0)           0;0  0.2721 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.6432 (1.49)     3.6432 (1.49)     3.6432 (1.49)     0.0000 (1.0)      3.6432 (1.49)     0.0000 (1.0)           0;0  0.2745 (0.67)          1           1
test_partial_add-gc-noop[main]       2.8294 (1.15)     2.8294 (1.15)     2.8294 (1.15)     0.0000 (1.0)      2.8294 (1.15)     0.0000 (1.0)           0;0  0.3534 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     12.2376 (4.92)     12.2376 (4.92)     12.2376 (4.92)     0.0000 (1.0)      12.2376 (4.92)     0.0000 (1.0)           0;0  0.0817 (0.20)          1           1
test_partial_add-push[3.10.0]      5.1995 (2.09)      5.1995 (2.09)      5.1995 (2.09)     0.0000 (1.0)       5.1995 (2.09)     0.0000 (1.0)           0;0  0.1923 (0.48)          1           1
test_partial_add-push[3.53.2]      2.6483 (1.07)      2.6483 (1.07)      2.6483 (1.07)     0.0000 (1.0)       2.6483 (1.07)     0.0000 (1.0)           0;0  0.3776 (0.94)          1           1
test_partial_add-push[3.60.1]      2.4865 (1.0)       2.4865 (1.0)       2.4865 (1.0)      0.0000 (1.0)       2.4865 (1.0)      0.0000 (1.0)           0;0  0.4022 (1.0)           1           1
test_partial_add-push[main]        2.6942 (1.08)      2.6942 (1.08)      2.6942 (1.08)     0.0000 (1.0)       2.6942 (1.08)     0.0000 (1.0)           0;0  0.3712 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     69.9935 (4.99)     69.9935 (4.99)     69.9935 (4.99)     0.0000 (1.0)      69.9935 (4.99)     0.0000 (1.0)           0;0  0.0143 (0.20)          1           1
test_partial_add-push-partial[3.10.0]     29.3895 (2.10)     29.3895 (2.10)     29.3895 (2.10)     0.0000 (1.0)      29.3895 (2.10)     0.0000 (1.0)           0;0  0.0340 (0.48)          1           1
test_partial_add-push-partial[3.53.2]     14.0627 (1.00)     14.0627 (1.00)     14.0627 (1.00)     0.0000 (1.0)      14.0627 (1.00)     0.0000 (1.0)           0;0  0.0711 (1.00)          1           1
test_partial_add-push-partial[3.60.1]     14.0279 (1.0)      14.0279 (1.0)      14.0279 (1.0)      0.0000 (1.0)      14.0279 (1.0)      0.0000 (1.0)           0;0  0.0713 (1.0)           1           1
test_partial_add-push-partial[main]       14.0681 (1.00)     14.0681 (1.00)     14.0681 (1.00)     0.0000 (1.0)      14.0681 (1.00)     0.0000 (1.0)           0;0  0.0711 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     81.8802 (3.67)     81.8802 (3.67)     81.8802 (3.67)     0.0000 (1.0)      81.8802 (3.67)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_partial_remove-add[3.10.0]     81.8221 (3.67)     81.8221 (3.67)     81.8221 (3.67)     0.0000 (1.0)      81.8221 (3.67)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_partial_remove-add[3.53.2]     73.4336 (3.29)     73.4336 (3.29)     73.4336 (3.29)     0.0000 (1.0)      73.4336 (3.29)     0.0000 (1.0)           0;0  0.0136 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.3061 (1.0)      22.3061 (1.0)      22.3061 (1.0)      0.0000 (1.0)      22.3061 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
test_partial_remove-add[main]       23.6855 (1.06)     23.6855 (1.06)     23.6855 (1.06)     0.0000 (1.0)      23.6855 (1.06)     0.0000 (1.0)           0;0  0.0422 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     46.5634 (12.85)    46.5634 (12.85)    46.5634 (12.85)    0.0000 (1.0)      46.5634 (12.85)    0.0000 (1.0)           0;0  0.0215 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     47.5094 (13.11)    47.5094 (13.11)    47.5094 (13.11)    0.0000 (1.0)      47.5094 (13.11)    0.0000 (1.0)           0;0  0.0210 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     41.1897 (11.37)    41.1897 (11.37)    41.1897 (11.37)    0.0000 (1.0)      41.1897 (11.37)    0.0000 (1.0)           0;0  0.0243 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.6229 (1.0)       3.6229 (1.0)       3.6229 (1.0)      0.0000 (1.0)       3.6229 (1.0)      0.0000 (1.0)           0;0  0.2760 (1.0)           1           1
test_partial_remove-add-update[main]        3.7022 (1.02)      3.7022 (1.02)      3.7022 (1.02)     0.0000 (1.0)       3.7022 (1.02)     0.0000 (1.0)           0;0  0.2701 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6641 (1.0)      2.6641 (1.0)      2.6641 (1.0)      0.0000 (1.0)      2.6641 (1.0)      0.0000 (1.0)           0;0  0.3754 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.8839 (1.46)     3.8839 (1.46)     3.8839 (1.46)     0.0000 (1.0)      3.8839 (1.46)     0.0000 (1.0)           0;0  0.2575 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.7856 (1.42)     3.7856 (1.42)     3.7856 (1.42)     0.0000 (1.0)      3.7856 (1.42)     0.0000 (1.0)           0;0  0.2642 (0.70)          1           1
test_partial_remove-gc[3.60.1]     3.7723 (1.42)     3.7723 (1.42)     3.7723 (1.42)     0.0000 (1.0)      3.7723 (1.42)     0.0000 (1.0)           0;0  0.2651 (0.71)          1           1
test_partial_remove-gc[main]       2.9030 (1.09)     2.9030 (1.09)     2.9030 (1.09)     0.0000 (1.0)      2.9030 (1.09)     0.0000 (1.0)           0;0  0.3445 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1446 (1.0)      5.1446 (1.0)      5.1446 (1.0)      0.0000 (1.0)      5.1446 (1.0)      0.0000 (1.0)           0;0  0.1944 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.0453 (1.18)     6.0453 (1.18)     6.0453 (1.18)     0.0000 (1.0)      6.0453 (1.18)     0.0000 (1.0)           0;0  0.1654 (0.85)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.9351 (1.35)     6.9351 (1.35)     6.9351 (1.35)     0.0000 (1.0)      6.9351 (1.35)     0.0000 (1.0)           0;0  0.1442 (0.74)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.6630 (1.30)     6.6630 (1.30)     6.6630 (1.30)     0.0000 (1.0)      6.6630 (1.30)     0.0000 (1.0)           0;0  0.1501 (0.77)          1           1
test_partial_remove-gc-cloud[main]       5.6794 (1.10)     5.6794 (1.10)     5.6794 (1.10)     0.0000 (1.0)      5.6794 (1.10)     0.0000 (1.0)           0;0  0.1761 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     97.6473 (4.47)     97.6473 (4.47)     97.6473 (4.47)     0.0000 (1.0)      97.6473 (4.47)     0.0000 (1.0)           0;0  0.0102 (0.22)          1           1
test_partial_remove-push[3.10.0]     45.9720 (2.10)     45.9720 (2.10)     45.9720 (2.10)     0.0000 (1.0)      45.9720 (2.10)     0.0000 (1.0)           0;0  0.0218 (0.48)          1           1
test_partial_remove-push[3.53.2]     23.1533 (1.06)     23.1533 (1.06)     23.1533 (1.06)     0.0000 (1.0)      23.1533 (1.06)     0.0000 (1.0)           0;0  0.0432 (0.94)          1           1
test_partial_remove-push[3.60.1]     22.6861 (1.04)     22.6861 (1.04)     22.6861 (1.04)     0.0000 (1.0)      22.6861 (1.04)     0.0000 (1.0)           0;0  0.0441 (0.96)          1           1
test_partial_remove-push[main]       21.8486 (1.0)      21.8486 (1.0)      21.8486 (1.0)      0.0000 (1.0)      21.8486 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9497 (1.0)      3.9497 (1.0)      3.9497 (1.0)      0.0000 (1.0)      3.9497 (1.0)      0.0000 (1.0)           0;0  0.2532 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.0042 (1.01)     4.0042 (1.01)     4.0042 (1.01)     0.0000 (1.0)      4.0042 (1.01)     0.0000 (1.0)           0;0  0.2497 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     7.0759 (1.79)     7.0759 (1.79)     7.0759 (1.79)     0.0000 (1.0)      7.0759 (1.79)     0.0000 (1.0)           0;0  0.1413 (0.56)          1           1
test_partial_remove-push-update[3.60.1]     6.9312 (1.75)     6.9312 (1.75)     6.9312 (1.75)     0.0000 (1.0)      6.9312 (1.75)     0.0000 (1.0)           0;0  0.1443 (0.57)          1           1
test_partial_remove-push-update[main]       7.2806 (1.84)     7.2806 (1.84)     7.2806 (1.84)     0.0000 (1.0)      7.2806 (1.84)     0.0000 (1.0)           0;0  0.1374 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     537.3541 (1.0)      542.9247 (1.0)      540.6935 (1.0)      2.1136 (1.0)      541.2578 (1.0)      2.5894 (1.0)           2;0  1.8495 (1.0)           5           3
test_plots-plots-diff[3.10.0]     980.4667 (1.82)     993.2281 (1.83)     987.9412 (1.83)     5.0541 (2.39)     990.2632 (1.83)     7.0081 (2.71)          2;0  1.0122 (0.55)          5           3
test_plots-plots-diff[3.53.2]     948.1630 (1.76)     959.3509 (1.77)     955.5878 (1.77)     4.4443 (2.10)     956.9440 (1.77)     5.2205 (2.02)          1;0  1.0465 (0.57)          5           3
test_plots-plots-diff[3.60.1]     944.0687 (1.76)     954.1226 (1.76)     949.1193 (1.76)     4.7811 (2.26)     948.8384 (1.75)     9.2852 (3.59)          2;0  1.0536 (0.57)          5           3
test_plots-plots-diff[main]       952.5334 (1.77)     960.3573 (1.77)     955.5657 (1.77)     3.1828 (1.51)     955.3156 (1.76)     4.7953 (1.85)          1;0  1.0465 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       553.6741 (1.0)        558.0154 (1.0)        556.0596 (1.0)       1.6593 (1.0)        556.3863 (1.0)       2.3338 (1.0)           2;0  1.7984 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,212.2010 (2.19)     1,398.1920 (2.51)     1,253.5739 (2.25)     80.9727 (48.80)    1,220.4389 (2.19)     53.5759 (22.96)         1;1  0.7977 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]     1,018.5870 (1.84)     1,041.8425 (1.87)     1,027.7836 (1.85)      8.6172 (5.19)     1,026.6291 (1.85)      8.5368 (3.66)          2;0  0.9730 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]     1,022.1530 (1.85)     1,053.0309 (1.89)     1,031.4048 (1.85)     12.4178 (7.48)     1,026.2620 (1.84)     11.2253 (4.81)          1;1  0.9696 (0.54)          5           3
test_plots-plots-diff-json[main]       1,028.7042 (1.86)     1,049.5116 (1.88)     1,038.3020 (1.87)      7.5397 (4.54)     1,037.4059 (1.86)      8.3043 (3.56)          2;0  0.9631 (0.54)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     429.5211 (1.0)      438.7168 (1.0)      433.8508 (1.0)      3.3004 (1.0)      434.0497 (1.0)       3.2686 (1.0)           2;0  2.3049 (1.0)           5           3
test_plots-plots-show[3.10.0]     801.5295 (1.87)     823.7250 (1.88)     813.3387 (1.87)     9.8761 (2.99)     817.8955 (1.88)     17.0287 (5.21)          2;0  1.2295 (0.53)          5           3
test_plots-plots-show[3.53.2]     782.8076 (1.82)     801.3427 (1.83)     792.3944 (1.83)     8.1875 (2.48)     790.9980 (1.82)     14.8151 (4.53)          2;0  1.2620 (0.55)          5           3
test_plots-plots-show[3.60.1]     781.8893 (1.82)     793.8817 (1.81)     788.3934 (1.82)     4.4356 (1.34)     788.8985 (1.82)      5.5716 (1.70)          2;0  1.2684 (0.55)          5           3
test_plots-plots-show[main]       792.8855 (1.85)     807.2353 (1.84)     800.3075 (1.84)     5.1713 (1.57)     800.5867 (1.84)      5.6513 (1.73)          2;0  1.2495 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     446.6145 (1.0)      451.7616 (1.0)      449.3484 (1.0)      1.9377 (1.0)      449.2877 (1.0)      2.6467 (1.0)           2;0  2.2254 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     921.8511 (2.06)     931.3990 (2.06)     926.4997 (2.06)     3.6087 (1.86)     925.5877 (2.06)     4.8581 (1.84)          2;0  1.0793 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     828.9452 (1.86)     845.3078 (1.87)     835.1941 (1.86)     6.2496 (3.23)     833.5254 (1.86)     7.3936 (2.79)          1;0  1.1973 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     828.8272 (1.86)     835.2707 (1.85)     832.4143 (1.85)     2.3957 (1.24)     832.6326 (1.85)     3.0144 (1.14)          2;0  1.2013 (0.54)          5           3
test_plots-plots-show-json[main]       837.7242 (1.88)     856.7513 (1.90)     844.7442 (1.88)     7.1740 (3.70)     842.9968 (1.88)     6.9082 (2.61)          1;0  1.1838 (0.53)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     95.4048 (4.26)     95.4048 (4.26)     95.4048 (4.26)     0.0000 (1.0)      95.4048 (4.26)     0.0000 (1.0)           0;0  0.0105 (0.23)          1           1
test_push-push[3.10.0]     44.8181 (2.00)     44.8181 (2.00)     44.8181 (2.00)     0.0000 (1.0)      44.8181 (2.00)     0.0000 (1.0)           0;0  0.0223 (0.50)          1           1
test_push-push[3.53.2]     23.1685 (1.03)     23.1685 (1.03)     23.1685 (1.03)     0.0000 (1.0)      23.1685 (1.03)     0.0000 (1.0)           0;0  0.0432 (0.97)          1           1
test_push-push[3.60.1]     22.3972 (1.0)      22.3972 (1.0)      22.3972 (1.0)      0.0000 (1.0)      22.3972 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_push-push[main]       22.7439 (1.02)     22.7439 (1.02)     22.7439 (1.02)     0.0000 (1.0)      22.7439 (1.02)     0.0000 (1.0)           0;0  0.0440 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.3738 (4.83)     110.3738 (4.83)     110.3738 (4.83)     0.0000 (1.0)      110.3738 (4.83)     0.0000 (1.0)           0;0  0.0091 (0.21)          1           1
test_sharing-fetch[3.10.0]     115.8320 (5.07)     115.8320 (5.07)     115.8320 (5.07)     0.0000 (1.0)      115.8320 (5.07)     0.0000 (1.0)           0;0  0.0086 (0.20)          1           1
test_sharing-fetch[3.53.2]      33.5816 (1.47)      33.5816 (1.47)      33.5816 (1.47)     0.0000 (1.0)       33.5816 (1.47)     0.0000 (1.0)           0;0  0.0298 (0.68)          1           1
test_sharing-fetch[3.60.1]      23.8770 (1.05)      23.8770 (1.05)      23.8770 (1.05)     0.0000 (1.0)       23.8770 (1.05)     0.0000 (1.0)           0;0  0.0419 (0.96)          1           1
test_sharing-fetch[main]        22.8405 (1.0)       22.8405 (1.0)       22.8405 (1.0)      0.0000 (1.0)       22.8405 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.5419 (1.0)      1.5419 (1.0)      1.5419 (1.0)      0.0000 (1.0)      1.5419 (1.0)      0.0000 (1.0)           0;0  0.6485 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6854 (2.39)     3.6854 (2.39)     3.6854 (2.39)     0.0000 (1.0)      3.6854 (2.39)     0.0000 (1.0)           0;0  0.2713 (0.42)          1           1
test_sharing-fetch-noop[3.53.2]     7.6292 (4.95)     7.6292 (4.95)     7.6292 (4.95)     0.0000 (1.0)      7.6292 (4.95)     0.0000 (1.0)           0;0  0.1311 (0.20)          1           1
test_sharing-fetch-noop[3.60.1]     6.1850 (4.01)     6.1850 (4.01)     6.1850 (4.01)     0.0000 (1.0)      6.1850 (4.01)     0.0000 (1.0)           0;0  0.1617 (0.25)          1           1
test_sharing-fetch-noop[main]       6.0052 (3.89)     6.0052 (3.89)     6.0052 (3.89)     0.0000 (1.0)      6.0052 (3.89)     0.0000 (1.0)           0;0  0.1665 (0.26)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     97.7930 (4.30)     97.7930 (4.30)     97.7930 (4.30)     0.0000 (1.0)      97.7930 (4.30)     0.0000 (1.0)           0;0  0.0102 (0.23)          1           1
test_sharing-push[3.10.0]     45.3458 (1.99)     45.3458 (1.99)     45.3458 (1.99)     0.0000 (1.0)      45.3458 (1.99)     0.0000 (1.0)           0;0  0.0221 (0.50)          1           1
test_sharing-push[3.53.2]     26.3274 (1.16)     26.3274 (1.16)     26.3274 (1.16)     0.0000 (1.0)      26.3274 (1.16)     0.0000 (1.0)           0;0  0.0380 (0.86)          1           1
test_sharing-push[3.60.1]     24.1881 (1.06)     24.1881 (1.06)     24.1881 (1.06)     0.0000 (1.0)      24.1881 (1.06)     0.0000 (1.0)           0;0  0.0413 (0.94)          1           1
test_sharing-push[main]       22.7648 (1.0)      22.7648 (1.0)      22.7648 (1.0)      0.0000 (1.0)      22.7648 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1504 (1.01)     2.1504 (1.01)     2.1504 (1.01)     0.0000 (1.0)      2.1504 (1.01)     0.0000 (1.0)           0;0  0.4650 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.1315 (1.0)      2.1315 (1.0)      2.1315 (1.0)      0.0000 (1.0)      2.1315 (1.0)      0.0000 (1.0)           0;0  0.4691 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.3269 (2.97)     6.3269 (2.97)     6.3269 (2.97)     0.0000 (1.0)      6.3269 (2.97)     0.0000 (1.0)           0;0  0.1581 (0.34)          1           1
test_sharing-push-noop[3.60.1]     7.7448 (3.63)     7.7448 (3.63)     7.7448 (3.63)     0.0000 (1.0)      7.7448 (3.63)     0.0000 (1.0)           0;0  0.1291 (0.28)          1           1
test_sharing-push-noop[main]       6.1637 (2.89)     6.1637 (2.89)     6.1637 (2.89)     0.0000 (1.0)      6.1637 (2.89)     0.0000 (1.0)           0;0  0.1622 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     152.6069 (1.10)     152.6069 (1.10)     152.6069 (1.10)     0.0000 (1.0)      152.6069 (1.10)     0.0000 (1.0)           0;0  0.0066 (0.91)          1           1
test_sharing_azure-fetch[main]       139.0783 (1.0)      139.0783 (1.0)      139.0783 (1.0)      0.0000 (1.0)      139.0783 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4017 (1.00)     6.4017 (1.00)     6.4017 (1.00)     0.0000 (1.0)      6.4017 (1.00)     0.0000 (1.0)           0;0  0.1562 (1.00)          1           1
test_sharing_azure-fetch-noop[main]       6.3819 (1.0)      6.3819 (1.0)      6.3819 (1.0)      0.0000 (1.0)      6.3819 (1.0)      0.0000 (1.0)           0;0  0.1567 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     126.4501 (1.0)      126.4501 (1.0)      126.4501 (1.0)      0.0000 (1.0)      126.4501 (1.0)      0.0000 (1.0)           0;0  0.0079 (1.0)           1           1
test_sharing_azure-push[main]       127.1811 (1.01)     127.1811 (1.01)     127.1811 (1.01)     0.0000 (1.0)      127.1811 (1.01)     0.0000 (1.0)           0;0  0.0079 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.1207 (1.0)      6.1207 (1.0)      6.1207 (1.0)      0.0000 (1.0)      6.1207 (1.0)      0.0000 (1.0)           0;0  0.1634 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.4217 (1.05)     6.4217 (1.05)     6.4217 (1.05)     0.0000 (1.0)      6.4217 (1.05)     0.0000 (1.0)           0;0  0.1557 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     493.3355 (1.06)     493.3355 (1.06)     493.3355 (1.06)     0.0000 (1.0)      493.3355 (1.06)     0.0000 (1.0)           0;0  0.0020 (0.95)          1           1
test_sharing_s3-fetch[main]       467.1205 (1.0)      467.1205 (1.0)      467.1205 (1.0)      0.0000 (1.0)      467.1205 (1.0)      0.0000 (1.0)           0;0  0.0021 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2906 (1.0)      6.2906 (1.0)      6.2906 (1.0)      0.0000 (1.0)      6.2906 (1.0)      0.0000 (1.0)           0;0  0.1590 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.5827 (1.05)     6.5827 (1.05)     6.5827 (1.05)     0.0000 (1.0)      6.5827 (1.05)     0.0000 (1.0)           0;0  0.1519 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     525.5141 (1.01)     525.5141 (1.01)     525.5141 (1.01)     0.0000 (1.0)      525.5141 (1.01)     0.0000 (1.0)           0;0  0.0019 (0.99)          1           1
test_sharing_s3-push[main]       522.6782 (1.0)      522.6782 (1.0)      522.6782 (1.0)      0.0000 (1.0)      522.6782 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.7035 (1.0)      6.7035 (1.0)      6.7035 (1.0)      0.0000 (1.0)      6.7035 (1.0)      0.0000 (1.0)           0;0  0.1492 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.9615 (1.04)     6.9615 (1.04)     6.9615 (1.04)     0.0000 (1.0)      6.9615 (1.04)     0.0000 (1.0)           0;0  0.1436 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.0587 (3.70)     20.0587 (3.70)     20.0587 (3.70)     0.0000 (1.0)      20.0587 (3.70)     0.0000 (1.0)           0;0  0.0499 (0.27)          1           1
test_status-status[3.10.0]     20.6321 (3.81)     20.6321 (3.81)     20.6321 (3.81)     0.0000 (1.0)      20.6321 (3.81)     0.0000 (1.0)           0;0  0.0485 (0.26)          1           1
test_status-status[3.53.2]     18.2850 (3.37)     18.2850 (3.37)     18.2850 (3.37)     0.0000 (1.0)      18.2850 (3.37)     0.0000 (1.0)           0;0  0.0547 (0.30)          1           1
test_status-status[3.60.1]      5.4194 (1.0)       5.4194 (1.0)       5.4194 (1.0)      0.0000 (1.0)       5.4194 (1.0)      0.0000 (1.0)           0;0  0.1845 (1.0)           1           1
test_status-status[main]        5.7657 (1.06)      5.7657 (1.06)      5.7657 (1.06)     0.0000 (1.0)       5.7657 (1.06)     0.0000 (1.0)           0;0  0.1734 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8480 (1.78)     4.8480 (1.78)     4.8480 (1.78)     0.0000 (1.0)      4.8480 (1.78)     0.0000 (1.0)           0;0  0.2063 (0.56)          1           1
test_status-status-changed[3.10.0]     5.1603 (1.89)     5.1603 (1.89)     5.1603 (1.89)     0.0000 (1.0)      5.1603 (1.89)     0.0000 (1.0)           0;0  0.1938 (0.53)          1           1
test_status-status-changed[3.53.2]     5.0995 (1.87)     5.0995 (1.87)     5.0995 (1.87)     0.0000 (1.0)      5.0995 (1.87)     0.0000 (1.0)           0;0  0.1961 (0.54)          1           1
test_status-status-changed[3.60.1]     2.7304 (1.0)      2.7304 (1.0)      2.7304 (1.0)      0.0000 (1.0)      2.7304 (1.0)      0.0000 (1.0)           0;0  0.3662 (1.0)           1           1
test_status-status-changed[main]       2.8926 (1.06)     2.8926 (1.06)     2.8926 (1.06)     0.0000 (1.0)      2.8926 (1.06)     0.0000 (1.0)           0;0  0.3457 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0924 (1.95)     5.0924 (1.95)     5.0924 (1.95)     0.0000 (1.0)      5.0924 (1.95)     0.0000 (1.0)           0;0  0.1964 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.1160 (1.96)     5.1160 (1.96)     5.1160 (1.96)     0.0000 (1.0)      5.1160 (1.96)     0.0000 (1.0)           0;0  0.1955 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     5.0006 (1.91)     5.0006 (1.91)     5.0006 (1.91)     0.0000 (1.0)      5.0006 (1.91)     0.0000 (1.0)           0;0  0.2000 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.6129 (1.0)      2.6129 (1.0)      2.6129 (1.0)      0.0000 (1.0)      2.6129 (1.0)      0.0000 (1.0)           0;0  0.3827 (1.0)           1           1
test_status-status-changed-noop[main]       2.8278 (1.08)     2.8278 (1.08)     2.8278 (1.08)     0.0000 (1.0)      2.8278 (1.08)     0.0000 (1.0)           0;0  0.3536 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0510 (1.93)     5.0510 (1.93)     5.0510 (1.93)     0.0000 (1.0)      5.0510 (1.93)     0.0000 (1.0)           0;0  0.1980 (0.52)          1           1
test_status-status-noop[3.10.0]     5.1027 (1.95)     5.1027 (1.95)     5.1027 (1.95)     0.0000 (1.0)      5.1027 (1.95)     0.0000 (1.0)           0;0  0.1960 (0.51)          1           1
test_status-status-noop[3.53.2]     5.0354 (1.93)     5.0354 (1.93)     5.0354 (1.93)     0.0000 (1.0)      5.0354 (1.93)     0.0000 (1.0)           0;0  0.1986 (0.52)          1           1
test_status-status-noop[3.60.1]     2.6129 (1.0)      2.6129 (1.0)      2.6129 (1.0)      0.0000 (1.0)      2.6129 (1.0)      0.0000 (1.0)           0;0  0.3827 (1.0)           1           1
test_status-status-noop[main]       2.8437 (1.09)     2.8437 (1.09)     2.8437 (1.09)     0.0000 (1.0)      2.8437 (1.09)     0.0000 (1.0)           0;0  0.3517 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     154.9215 (5.42)     154.9215 (5.42)     154.9215 (5.42)     0.0000 (1.0)      154.9215 (5.42)     0.0000 (1.0)           0;0  0.0065 (0.18)          1           1
test_update-import-url[3.10.0]     159.3478 (5.58)     159.3478 (5.58)     159.3478 (5.58)     0.0000 (1.0)      159.3478 (5.58)     0.0000 (1.0)           0;0  0.0063 (0.18)          1           1
test_update-import-url[3.53.2]      81.5995 (2.86)      81.5995 (2.86)      81.5995 (2.86)     0.0000 (1.0)       81.5995 (2.86)     0.0000 (1.0)           0;0  0.0123 (0.35)          1           1
test_update-import-url[3.60.1]      28.5612 (1.0)       28.5612 (1.0)       28.5612 (1.0)      0.0000 (1.0)       28.5612 (1.0)      0.0000 (1.0)           0;0  0.0350 (1.0)           1           1
test_update-import-url[main]        29.9354 (1.05)      29.9354 (1.05)      29.9354 (1.05)     0.0000 (1.0)       29.9354 (1.05)     0.0000 (1.0)           0;0  0.0334 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     144.1684 (6.04)     144.1684 (6.04)     144.1684 (6.04)     0.0000 (1.0)      144.1684 (6.04)     0.0000 (1.0)           0;0  0.0069 (0.17)          1           1
test_update-update[3.10.0]     145.4057 (6.09)     145.4057 (6.09)     145.4057 (6.09)     0.0000 (1.0)      145.4057 (6.09)     0.0000 (1.0)           0;0  0.0069 (0.16)          1           1
test_update-update[3.53.2]      73.9744 (3.10)      73.9744 (3.10)      73.9744 (3.10)     0.0000 (1.0)       73.9744 (3.10)     0.0000 (1.0)           0;0  0.0135 (0.32)          1           1
test_update-update[3.60.1]      23.8592 (1.0)       23.8592 (1.0)       23.8592 (1.0)      0.0000 (1.0)       23.8592 (1.0)      0.0000 (1.0)           0;0  0.0419 (1.0)           1           1
test_update-update[main]        24.6856 (1.03)      24.6856 (1.03)      24.6856 (1.03)     0.0000 (1.0)       24.6856 (1.03)     0.0000 (1.0)           0;0  0.0405 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     11.8489 (1.79)     11.8489 (1.79)     11.8489 (1.79)     0.0000 (1.0)      11.8489 (1.79)     0.0000 (1.0)           0;0  0.0844 (0.56)          1           1
test_update-update-noop[3.10.0]     12.5523 (1.89)     12.5523 (1.89)     12.5523 (1.89)     0.0000 (1.0)      12.5523 (1.89)     0.0000 (1.0)           0;0  0.0797 (0.53)          1           1
test_update-update-noop[3.53.2]     12.2395 (1.85)     12.2395 (1.85)     12.2395 (1.85)     0.0000 (1.0)      12.2395 (1.85)     0.0000 (1.0)           0;0  0.0817 (0.54)          1           1
test_update-update-noop[3.60.1]      6.6314 (1.0)       6.6314 (1.0)       6.6314 (1.0)      0.0000 (1.0)       6.6314 (1.0)      0.0000 (1.0)           0;0  0.1508 (1.0)           1           1
test_update-update-noop[main]        7.3375 (1.11)      7.3375 (1.11)      7.3375 (1.11)     0.0000 (1.0)       7.3375 (1.11)     0.0000 (1.0)           0;0  0.1363 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean