Tue Feb 10 01:08:16 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     57.3802 (4.01)     57.3802 (4.01)     57.3802 (4.01)     0.0000 (1.0)      57.3802 (4.01)     0.0000 (1.0)           0;0  0.0174 (0.25)          1           1
test_add_copy-add[3.10.0]     57.5868 (4.03)     57.5868 (4.03)     57.5868 (4.03)     0.0000 (1.0)      57.5868 (4.03)     0.0000 (1.0)           0;0  0.0174 (0.25)          1           1
test_add_copy-add[3.53.2]     51.2384 (3.58)     51.2384 (3.58)     51.2384 (3.58)     0.0000 (1.0)      51.2384 (3.58)     0.0000 (1.0)           0;0  0.0195 (0.28)          1           1
test_add_copy-add[3.60.1]     14.3021 (1.0)      14.3021 (1.0)      14.3021 (1.0)      0.0000 (1.0)      14.3021 (1.0)      0.0000 (1.0)           0;0  0.0699 (1.0)           1           1
test_add_copy-add[main]       15.8947 (1.11)     15.8947 (1.11)     15.8947 (1.11)     0.0000 (1.0)      15.8947 (1.11)     0.0000 (1.0)           0;0  0.0629 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     19.8433 (5.31)     19.8433 (5.31)     19.8433 (5.31)     0.0000 (1.0)      19.8433 (5.31)     0.0000 (1.0)           0;0  0.0504 (0.19)          1           1
test_add_copy-add-noop[3.10.0]     19.6639 (5.27)     19.6639 (5.27)     19.6639 (5.27)     0.0000 (1.0)      19.6639 (5.27)     0.0000 (1.0)           0;0  0.0509 (0.19)          1           1
test_add_copy-add-noop[3.53.2]     19.5090 (5.22)     19.5090 (5.22)     19.5090 (5.22)     0.0000 (1.0)      19.5090 (5.22)     0.0000 (1.0)           0;0  0.0513 (0.19)          1           1
test_add_copy-add-noop[3.60.1]      3.7339 (1.0)       3.7339 (1.0)       3.7339 (1.0)      0.0000 (1.0)       3.7339 (1.0)      0.0000 (1.0)           0;0  0.2678 (1.0)           1           1
test_add_copy-add-noop[main]        3.9292 (1.05)      3.9292 (1.05)      3.9292 (1.05)     0.0000 (1.0)       3.9292 (1.05)     0.0000 (1.0)           0;0  0.2545 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     62.8467 (3.93)     62.8467 (3.93)     62.8467 (3.93)     0.0000 (1.0)      62.8467 (3.93)     0.0000 (1.0)           0;0  0.0159 (0.25)          1           1
test_add_hardlink-add[3.10.0]     63.0446 (3.94)     63.0446 (3.94)     63.0446 (3.94)     0.0000 (1.0)      63.0446 (3.94)     0.0000 (1.0)           0;0  0.0159 (0.25)          1           1
test_add_hardlink-add[3.53.2]     57.8190 (3.62)     57.8190 (3.62)     57.8190 (3.62)     0.0000 (1.0)      57.8190 (3.62)     0.0000 (1.0)           0;0  0.0173 (0.28)          1           1
test_add_hardlink-add[3.60.1]     15.9840 (1.0)      15.9840 (1.0)      15.9840 (1.0)      0.0000 (1.0)      15.9840 (1.0)      0.0000 (1.0)           0;0  0.0626 (1.0)           1           1
test_add_hardlink-add[main]       17.1969 (1.08)     17.1969 (1.08)     17.1969 (1.08)     0.0000 (1.0)      17.1969 (1.08)     0.0000 (1.0)           0;0  0.0582 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     31.5505 (7.55)     31.5505 (7.55)     31.5505 (7.55)     0.0000 (1.0)      31.5505 (7.55)     0.0000 (1.0)           0;0  0.0317 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     32.0970 (7.68)     32.0970 (7.68)     32.0970 (7.68)     0.0000 (1.0)      32.0970 (7.68)     0.0000 (1.0)           0;0  0.0312 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     30.3537 (7.27)     30.3537 (7.27)     30.3537 (7.27)     0.0000 (1.0)      30.3537 (7.27)     0.0000 (1.0)           0;0  0.0329 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.1774 (1.0)       4.1774 (1.0)       4.1774 (1.0)      0.0000 (1.0)       4.1774 (1.0)      0.0000 (1.0)           0;0  0.2394 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4663 (1.07)      4.4663 (1.07)      4.4663 (1.07)     0.0000 (1.0)       4.4663 (1.07)     0.0000 (1.0)           0;0  0.2239 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.7759 (1.90)     69.7759 (1.90)     69.7759 (1.90)     0.0000 (1.0)      69.7759 (1.90)     0.0000 (1.0)           0;0  0.0143 (0.53)          1           1
test_add_symlink-add[3.10.0]     69.7056 (1.90)     69.7056 (1.90)     69.7056 (1.90)     0.0000 (1.0)      69.7056 (1.90)     0.0000 (1.0)           0;0  0.0143 (0.53)          1           1
test_add_symlink-add[3.53.2]     64.7162 (1.77)     64.7162 (1.77)     64.7162 (1.77)     0.0000 (1.0)      64.7162 (1.77)     0.0000 (1.0)           0;0  0.0155 (0.57)          1           1
test_add_symlink-add[3.60.1]     36.6440 (1.0)      36.6440 (1.0)      36.6440 (1.0)      0.0000 (1.0)      36.6440 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
test_add_symlink-add[main]       37.9507 (1.04)     37.9507 (1.04)     37.9507 (1.04)     0.0000 (1.0)      37.9507 (1.04)     0.0000 (1.0)           0;0  0.0263 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.2723 (8.51)     46.2723 (8.51)     46.2723 (8.51)     0.0000 (1.0)      46.2723 (8.51)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     46.4140 (8.53)     46.4140 (8.53)     46.4140 (8.53)     0.0000 (1.0)      46.4140 (8.53)     0.0000 (1.0)           0;0  0.0215 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     45.1967 (8.31)     45.1967 (8.31)     45.1967 (8.31)     0.0000 (1.0)      45.1967 (8.31)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.4383 (1.0)       5.4383 (1.0)       5.4383 (1.0)      0.0000 (1.0)       5.4383 (1.0)      0.0000 (1.0)           0;0  0.1839 (1.0)           1           1
test_add_symlink-add-noop[main]        5.6533 (1.04)      5.6533 (1.04)      5.6533 (1.04)     0.0000 (1.0)       5.6533 (1.04)     0.0000 (1.0)           0;0  0.1769 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     29.2414 (2.27)     29.2414 (2.27)     29.2414 (2.27)     0.0000 (1.0)      29.2414 (2.27)     0.0000 (1.0)           0;0  0.0342 (0.44)          1           1
test_checkout_copy-checkout[3.10.0]     86.2000 (6.70)     86.2000 (6.70)     86.2000 (6.70)     0.0000 (1.0)      86.2000 (6.70)     0.0000 (1.0)           0;0  0.0116 (0.15)          1           1
test_checkout_copy-checkout[3.53.2]     17.0800 (1.33)     17.0800 (1.33)     17.0800 (1.33)     0.0000 (1.0)      17.0800 (1.33)     0.0000 (1.0)           0;0  0.0585 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     12.8623 (1.0)      12.8623 (1.0)      12.8623 (1.0)      0.0000 (1.0)      12.8623 (1.0)      0.0000 (1.0)           0;0  0.0777 (1.0)           1           1
test_checkout_copy-checkout[main]       13.3355 (1.04)     13.3355 (1.04)     13.3355 (1.04)     0.0000 (1.0)      13.3355 (1.04)     0.0000 (1.0)           0;0  0.0750 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     4.0381 (1.33)     4.0381 (1.33)     4.0381 (1.33)     0.0000 (1.0)      4.0381 (1.33)     0.0000 (1.0)           0;0  0.2476 (0.75)          1           1
test_checkout_copy-checkout-noop[3.10.0]     4.3667 (1.44)     4.3667 (1.44)     4.3667 (1.44)     0.0000 (1.0)      4.3667 (1.44)     0.0000 (1.0)           0;0  0.2290 (0.69)          1           1
test_checkout_copy-checkout-noop[3.53.2]     4.3732 (1.44)     4.3732 (1.44)     4.3732 (1.44)     0.0000 (1.0)      4.3732 (1.44)     0.0000 (1.0)           0;0  0.2287 (0.69)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.0320 (1.0)      3.0320 (1.0)      3.0320 (1.0)      0.0000 (1.0)      3.0320 (1.0)      0.0000 (1.0)           0;0  0.3298 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.2184 (1.06)     3.2184 (1.06)     3.2184 (1.06)     0.0000 (1.0)      3.2184 (1.06)     0.0000 (1.0)           0;0  0.3107 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     5.9095 (1.67)     5.9095 (1.67)     5.9095 (1.67)     0.0000 (1.0)      5.9095 (1.67)     0.0000 (1.0)           0;0  0.1692 (0.60)          1           1
test_checkout_copy-checkout-update[3.10.0]     4.9929 (1.41)     4.9929 (1.41)     4.9929 (1.41)     0.0000 (1.0)      4.9929 (1.41)     0.0000 (1.0)           0;0  0.2003 (0.71)          1           1
test_checkout_copy-checkout-update[3.53.2]     4.9365 (1.39)     4.9365 (1.39)     4.9365 (1.39)     0.0000 (1.0)      4.9365 (1.39)     0.0000 (1.0)           0;0  0.2026 (0.72)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.5388 (1.0)      3.5388 (1.0)      3.5388 (1.0)      0.0000 (1.0)      3.5388 (1.0)      0.0000 (1.0)           0;0  0.2826 (1.0)           1           1
test_checkout_copy-checkout-update[main]       3.8763 (1.10)     3.8763 (1.10)     3.8763 (1.10)     0.0000 (1.0)      3.8763 (1.10)     0.0000 (1.0)           0;0  0.2580 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.9800 (2.84)     21.9800 (2.84)     21.9800 (2.84)     0.0000 (1.0)      21.9800 (2.84)     0.0000 (1.0)           0;0  0.0455 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.7454 (2.17)     16.7454 (2.17)     16.7454 (2.17)     0.0000 (1.0)      16.7454 (2.17)     0.0000 (1.0)           0;0  0.0597 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.8091 (1.92)     14.8091 (1.92)     14.8091 (1.92)     0.0000 (1.0)      14.8091 (1.92)     0.0000 (1.0)           0;0  0.0675 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.7318 (1.0)       7.7318 (1.0)       7.7318 (1.0)      0.0000 (1.0)       7.7318 (1.0)      0.0000 (1.0)           0;0  0.1293 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.6457 (1.12)      8.6457 (1.12)      8.6457 (1.12)     0.0000 (1.0)       8.6457 (1.12)     0.0000 (1.0)           0;0  0.1157 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.8474 (1.68)     5.8474 (1.68)     5.8474 (1.68)     0.0000 (1.0)      5.8474 (1.68)     0.0000 (1.0)           0;0  0.1710 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.1081 (1.75)     6.1081 (1.75)     6.1081 (1.75)     0.0000 (1.0)      6.1081 (1.75)     0.0000 (1.0)           0;0  0.1637 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8827 (1.69)     5.8827 (1.69)     5.8827 (1.69)     0.0000 (1.0)      5.8827 (1.69)     0.0000 (1.0)           0;0  0.1700 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.4899 (1.0)      3.4899 (1.0)      3.4899 (1.0)      0.0000 (1.0)      3.4899 (1.0)      0.0000 (1.0)           0;0  0.2865 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6511 (1.05)     3.6511 (1.05)     3.6511 (1.05)     0.0000 (1.0)      3.6511 (1.05)     0.0000 (1.0)           0;0  0.2739 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.1615 (1.96)     8.1615 (1.96)     8.1615 (1.96)     0.0000 (1.0)      8.1615 (1.96)     0.0000 (1.0)           0;0  0.1225 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.8968 (1.66)     6.8968 (1.66)     6.8968 (1.66)     0.0000 (1.0)      6.8968 (1.66)     0.0000 (1.0)           0;0  0.1450 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6714 (1.61)     6.6714 (1.61)     6.6714 (1.61)     0.0000 (1.0)      6.6714 (1.61)     0.0000 (1.0)           0;0  0.1499 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.1542 (1.0)      4.1542 (1.0)      4.1542 (1.0)      0.0000 (1.0)      4.1542 (1.0)      0.0000 (1.0)           0;0  0.2407 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.6403 (1.12)     4.6403 (1.12)     4.6403 (1.12)     0.0000 (1.0)      4.6403 (1.12)     0.0000 (1.0)           0;0  0.2155 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     22.6714 (2.18)     22.6714 (2.18)     22.6714 (2.18)     0.0000 (1.0)      22.6714 (2.18)     0.0000 (1.0)           0;0  0.0441 (0.46)          1           1
test_checkout_symlink-checkout[3.10.0]     17.7289 (1.71)     17.7289 (1.71)     17.7289 (1.71)     0.0000 (1.0)      17.7289 (1.71)     0.0000 (1.0)           0;0  0.0564 (0.59)          1           1
test_checkout_symlink-checkout[3.53.2]     16.0027 (1.54)     16.0027 (1.54)     16.0027 (1.54)     0.0000 (1.0)      16.0027 (1.54)     0.0000 (1.0)           0;0  0.0625 (0.65)          1           1
test_checkout_symlink-checkout[3.60.1]     10.3772 (1.0)      10.3772 (1.0)      10.3772 (1.0)      0.0000 (1.0)      10.3772 (1.0)      0.0000 (1.0)           0;0  0.0964 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.2298 (1.08)     11.2298 (1.08)     11.2298 (1.08)     0.0000 (1.0)      11.2298 (1.08)     0.0000 (1.0)           0;0  0.0890 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     5.6103 (1.29)     5.6103 (1.29)     5.6103 (1.29)     0.0000 (1.0)      5.6103 (1.29)     0.0000 (1.0)           0;0  0.1782 (0.77)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.6250 (1.30)     5.6250 (1.30)     5.6250 (1.30)     0.0000 (1.0)      5.6250 (1.30)     0.0000 (1.0)           0;0  0.1778 (0.77)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     5.3479 (1.23)     5.3479 (1.23)     5.3479 (1.23)     0.0000 (1.0)      5.3479 (1.23)     0.0000 (1.0)           0;0  0.1870 (0.81)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3397 (1.0)      4.3397 (1.0)      4.3397 (1.0)      0.0000 (1.0)      4.3397 (1.0)      0.0000 (1.0)           0;0  0.2304 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.6371 (1.07)     4.6371 (1.07)     4.6371 (1.07)     0.0000 (1.0)      4.6371 (1.07)     0.0000 (1.0)           0;0  0.2157 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     8.8980 (1.48)     8.8980 (1.48)     8.8980 (1.48)     0.0000 (1.0)      8.8980 (1.48)     0.0000 (1.0)           0;0  0.1124 (0.67)          1           1
test_checkout_symlink-checkout-update[3.10.0]     7.4279 (1.24)     7.4279 (1.24)     7.4279 (1.24)     0.0000 (1.0)      7.4279 (1.24)     0.0000 (1.0)           0;0  0.1346 (0.81)          1           1
test_checkout_symlink-checkout-update[3.53.2]     7.3112 (1.22)     7.3112 (1.22)     7.3112 (1.22)     0.0000 (1.0)      7.3112 (1.22)     0.0000 (1.0)           0;0  0.1368 (0.82)          1           1
test_checkout_symlink-checkout-update[3.60.1]     6.0041 (1.0)      6.0041 (1.0)      6.0041 (1.0)      0.0000 (1.0)      6.0041 (1.0)      0.0000 (1.0)           0;0  0.1666 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.5406 (1.09)     6.5406 (1.09)     6.5406 (1.09)     0.0000 (1.0)      6.5406 (1.09)     0.0000 (1.0)           0;0  0.1529 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9702 (1.70)     3.9702 (1.70)     3.9702 (1.70)     0.0000 (1.0)      3.9702 (1.70)     0.0000 (1.0)           0;0  0.2519 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.8707 (2.08)     4.8707 (2.08)     4.8707 (2.08)     0.0000 (1.0)      4.8707 (2.08)     0.0000 (1.0)           0;0  0.2053 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.6800 (2.00)     4.6800 (2.00)     4.6800 (2.00)     0.0000 (1.0)      4.6800 (2.00)     0.0000 (1.0)           0;0  0.2137 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3405 (1.0)      2.3405 (1.0)      2.3405 (1.0)      0.0000 (1.0)      2.3405 (1.0)      0.0000 (1.0)           0;0  0.4273 (1.0)           1           1
test_data_status-data-changed[main]       2.6044 (1.11)     2.6044 (1.11)     2.6044 (1.11)     0.0000 (1.0)      2.6044 (1.11)     0.0000 (1.0)           0;0  0.3840 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1705 (1.75)     4.1705 (1.75)     4.1705 (1.75)     0.0000 (1.0)      4.1705 (1.75)     0.0000 (1.0)           0;0  0.2398 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8838 (2.04)     4.8838 (2.04)     4.8838 (2.04)     0.0000 (1.0)      4.8838 (2.04)     0.0000 (1.0)           0;0  0.2048 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8879 (2.05)     4.8879 (2.05)     4.8879 (2.05)     0.0000 (1.0)      4.8879 (2.05)     0.0000 (1.0)           0;0  0.2046 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3885 (1.0)      2.3885 (1.0)      2.3885 (1.0)      0.0000 (1.0)      2.3885 (1.0)      0.0000 (1.0)           0;0  0.4187 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6599 (1.11)     2.6599 (1.11)     2.6599 (1.11)     0.0000 (1.0)      2.6599 (1.11)     0.0000 (1.0)           0;0  0.3760 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     17.7577 (3.58)     17.7577 (3.58)     17.7577 (3.58)     0.0000 (1.0)      17.7577 (3.58)     0.0000 (1.0)           0;0  0.0563 (0.28)          1           1
test_data_status-data-new[3.10.0]     19.5042 (3.93)     19.5042 (3.93)     19.5042 (3.93)     0.0000 (1.0)      19.5042 (3.93)     0.0000 (1.0)           0;0  0.0513 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.8217 (3.79)     18.8217 (3.79)     18.8217 (3.79)     0.0000 (1.0)      18.8217 (3.79)     0.0000 (1.0)           0;0  0.0531 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9652 (1.0)       4.9652 (1.0)       4.9652 (1.0)      0.0000 (1.0)       4.9652 (1.0)      0.0000 (1.0)           0;0  0.2014 (1.0)           1           1
test_data_status-data-new[main]        5.4056 (1.09)      5.4056 (1.09)      5.4056 (1.09)     0.0000 (1.0)       5.4056 (1.09)     0.0000 (1.0)           0;0  0.1850 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0835 (1.75)     4.0835 (1.75)     4.0835 (1.75)     0.0000 (1.0)      4.0835 (1.75)     0.0000 (1.0)           0;0  0.2449 (0.57)          1           1
test_data_status-data-noop[3.10.0]     5.0353 (2.16)     5.0353 (2.16)     5.0353 (2.16)     0.0000 (1.0)      5.0353 (2.16)     0.0000 (1.0)           0;0  0.1986 (0.46)          1           1
test_data_status-data-noop[3.53.2]     4.8949 (2.10)     4.8949 (2.10)     4.8949 (2.10)     0.0000 (1.0)      4.8949 (2.10)     0.0000 (1.0)           0;0  0.2043 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3308 (1.0)      2.3308 (1.0)      2.3308 (1.0)      0.0000 (1.0)      2.3308 (1.0)      0.0000 (1.0)           0;0  0.4290 (1.0)           1           1
test_data_status-data-noop[main]       2.6143 (1.12)     2.6143 (1.12)     2.6143 (1.12)     0.0000 (1.0)      2.6143 (1.12)     0.0000 (1.0)           0;0  0.3825 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.7027 (1.28)     6.7027 (1.28)     6.7027 (1.28)     0.0000 (1.0)      6.7027 (1.28)     0.0000 (1.0)           0;0  0.1492 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6529 (1.46)     7.6529 (1.46)     7.6529 (1.46)     0.0000 (1.0)      7.6529 (1.46)     0.0000 (1.0)           0;0  0.1307 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6220 (1.46)     7.6220 (1.46)     7.6220 (1.46)     0.0000 (1.0)      7.6220 (1.46)     0.0000 (1.0)           0;0  0.1312 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.2274 (1.0)      5.2274 (1.0)      5.2274 (1.0)      0.0000 (1.0)      5.2274 (1.0)      0.0000 (1.0)           0;0  0.1913 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5077 (1.05)     5.5077 (1.05)     5.5077 (1.05)     0.0000 (1.0)      5.5077 (1.05)     0.0000 (1.0)           0;0  0.1816 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.7856 (1.27)     6.7856 (1.27)     6.7856 (1.27)     0.0000 (1.0)      6.7856 (1.27)     0.0000 (1.0)           0;0  0.1474 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6127 (1.42)     7.6127 (1.42)     7.6127 (1.42)     0.0000 (1.0)      7.6127 (1.42)     0.0000 (1.0)           0;0  0.1314 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.5928 (1.42)     7.5928 (1.42)     7.5928 (1.42)     0.0000 (1.0)      7.5928 (1.42)     0.0000 (1.0)           0;0  0.1317 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.3549 (1.0)      5.3549 (1.0)      5.3549 (1.0)      0.0000 (1.0)      5.3549 (1.0)      0.0000 (1.0)           0;0  0.1867 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.5775 (1.04)     5.5775 (1.04)     5.5775 (1.04)     0.0000 (1.0)      5.5775 (1.04)     0.0000 (1.0)           0;0  0.1793 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.7256 (2.72)     20.7256 (2.72)     20.7256 (2.72)     0.0000 (1.0)      20.7256 (2.72)     0.0000 (1.0)           0;0  0.0482 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.1304 (2.90)     22.1304 (2.90)     22.1304 (2.90)     0.0000 (1.0)      22.1304 (2.90)     0.0000 (1.0)           0;0  0.0452 (0.34)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.7845 (2.86)     21.7845 (2.86)     21.7845 (2.86)     0.0000 (1.0)      21.7845 (2.86)     0.0000 (1.0)           0;0  0.0459 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.6234 (1.0)       7.6234 (1.0)       7.6234 (1.0)      0.0000 (1.0)       7.6234 (1.0)      0.0000 (1.0)           0;0  0.1312 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2392 (1.08)      8.2392 (1.08)      8.2392 (1.08)     0.0000 (1.0)       8.2392 (1.08)     0.0000 (1.0)           0;0  0.1214 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.2139 (1.36)     6.2139 (1.36)     6.2139 (1.36)     0.0000 (1.0)      6.2139 (1.36)     0.0000 (1.0)           0;0  0.1609 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1480 (1.57)     7.1480 (1.57)     7.1480 (1.57)     0.0000 (1.0)      7.1480 (1.57)     0.0000 (1.0)           0;0  0.1399 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0774 (1.55)     7.0774 (1.55)     7.0774 (1.55)     0.0000 (1.0)      7.0774 (1.55)     0.0000 (1.0)           0;0  0.1413 (0.64)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5628 (1.0)      4.5628 (1.0)      4.5628 (1.0)      0.0000 (1.0)      4.5628 (1.0)      0.0000 (1.0)           0;0  0.2192 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0165 (1.10)     5.0165 (1.10)     5.0165 (1.10)     0.0000 (1.0)      5.0165 (1.10)     0.0000 (1.0)           0;0  0.1993 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.2208 (2.71)     18.2208 (2.71)     18.2208 (2.71)     0.0000 (1.0)      18.2208 (2.71)     0.0000 (1.0)           0;0  0.0549 (0.37)          1           1
test_diff-diff[3.10.0]     19.3765 (2.88)     19.3765 (2.88)     19.3765 (2.88)     0.0000 (1.0)      19.3765 (2.88)     0.0000 (1.0)           0;0  0.0516 (0.35)          1           1
test_diff-diff[3.53.2]     19.2211 (2.85)     19.2211 (2.85)     19.2211 (2.85)     0.0000 (1.0)      19.2211 (2.85)     0.0000 (1.0)           0;0  0.0520 (0.35)          1           1
test_diff-diff[3.60.1]      6.7335 (1.0)       6.7335 (1.0)       6.7335 (1.0)      0.0000 (1.0)       6.7335 (1.0)      0.0000 (1.0)           0;0  0.1485 (1.0)           1           1
test_diff-diff[main]        7.6648 (1.14)      7.6648 (1.14)      7.6648 (1.14)     0.0000 (1.0)       7.6648 (1.14)     0.0000 (1.0)           0;0  0.1305 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0150 (1.84)     6.0150 (1.84)     6.0150 (1.84)     0.0000 (1.0)      6.0150 (1.84)     0.0000 (1.0)           0;0  0.1663 (0.54)          1           1
test_diff-diff-changed[3.10.0]     6.5622 (2.01)     6.5622 (2.01)     6.5622 (2.01)     0.0000 (1.0)      6.5622 (2.01)     0.0000 (1.0)           0;0  0.1524 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.5160 (1.69)     5.5160 (1.69)     5.5160 (1.69)     0.0000 (1.0)      5.5160 (1.69)     0.0000 (1.0)           0;0  0.1813 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.2625 (1.0)      3.2625 (1.0)      3.2625 (1.0)      0.0000 (1.0)      3.2625 (1.0)      0.0000 (1.0)           0;0  0.3065 (1.0)           1           1
test_diff-diff-changed[main]       4.1137 (1.26)     4.1137 (1.26)     4.1137 (1.26)     0.0000 (1.0)      4.1137 (1.26)     0.0000 (1.0)           0;0  0.2431 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0298 (1.56)     5.0298 (1.56)     5.0298 (1.56)     0.0000 (1.0)      5.0298 (1.56)     0.0000 (1.0)           0;0  0.1988 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7881 (1.80)     5.7881 (1.80)     5.7881 (1.80)     0.0000 (1.0)      5.7881 (1.80)     0.0000 (1.0)           0;0  0.1728 (0.56)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5154 (1.71)     5.5154 (1.71)     5.5154 (1.71)     0.0000 (1.0)      5.5154 (1.71)     0.0000 (1.0)           0;0  0.1813 (0.58)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2180 (1.0)      3.2180 (1.0)      3.2180 (1.0)      0.0000 (1.0)      3.2180 (1.0)      0.0000 (1.0)           0;0  0.3108 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0799 (1.27)     4.0799 (1.27)     4.0799 (1.27)     0.0000 (1.0)      4.0799 (1.27)     0.0000 (1.0)           0;0  0.2451 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1818 (1.25)     4.1818 (1.25)     4.1818 (1.25)     0.0000 (1.0)      4.1818 (1.25)     0.0000 (1.0)           0;0  0.2391 (0.80)          1           1
test_diff-diff-noop[3.10.0]     5.1141 (1.52)     5.1141 (1.52)     5.1141 (1.52)     0.0000 (1.0)      5.1141 (1.52)     0.0000 (1.0)           0;0  0.1955 (0.66)          1           1
test_diff-diff-noop[3.53.2]     5.5221 (1.64)     5.5221 (1.64)     5.5221 (1.64)     0.0000 (1.0)      5.5221 (1.64)     0.0000 (1.0)           0;0  0.1811 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.3584 (1.0)      3.3584 (1.0)      3.3584 (1.0)      0.0000 (1.0)      3.3584 (1.0)      0.0000 (1.0)           0;0  0.2978 (1.0)           1           1
test_diff-diff-noop[main]       4.1695 (1.24)     4.1695 (1.24)     4.1695 (1.24)     0.0000 (1.0)      4.1695 (1.24)     0.0000 (1.0)           0;0  0.2398 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.3468 (1.0)       1.3468 (1.0)       1.3468 (1.0)      0.0000 (1.0)       1.3468 (1.0)      0.0000 (1.0)           0;0  0.7425 (1.0)           1           1
test_exp_show-exp[3.10.0]     12.7341 (9.46)     12.7341 (9.46)     12.7341 (9.46)     0.0000 (1.0)      12.7341 (9.46)     0.0000 (1.0)           0;0  0.0785 (0.11)          1           1
test_exp_show-exp[3.53.2]      7.5867 (5.63)      7.5867 (5.63)      7.5867 (5.63)     0.0000 (1.0)       7.5867 (5.63)     0.0000 (1.0)           0;0  0.1318 (0.18)          1           1
test_exp_show-exp[3.60.1]      7.6478 (5.68)      7.6478 (5.68)      7.6478 (5.68)     0.0000 (1.0)       7.6478 (5.68)     0.0000 (1.0)           0;0  0.1308 (0.18)          1           1
test_exp_show-exp[main]       11.0731 (8.22)     11.0731 (8.22)     11.0731 (8.22)     0.0000 (1.0)      11.0731 (8.22)     0.0000 (1.0)           0;0  0.0903 (0.12)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]      98.6131 (4.58)      98.6131 (4.58)      98.6131 (4.58)     0.0000 (1.0)       98.6131 (4.58)     0.0000 (1.0)           0;0  0.0101 (0.22)          1           1
test_fetch-fetch[3.10.0]     103.7329 (4.82)     103.7329 (4.82)     103.7329 (4.82)     0.0000 (1.0)      103.7329 (4.82)     0.0000 (1.0)           0;0  0.0096 (0.21)          1           1
test_fetch-fetch[3.53.2]      32.0071 (1.49)      32.0071 (1.49)      32.0071 (1.49)     0.0000 (1.0)       32.0071 (1.49)     0.0000 (1.0)           0;0  0.0312 (0.67)          1           1
test_fetch-fetch[3.60.1]      21.6674 (1.01)      21.6674 (1.01)      21.6674 (1.01)     0.0000 (1.0)       21.6674 (1.01)     0.0000 (1.0)           0;0  0.0462 (0.99)          1           1
test_fetch-fetch[main]        21.5268 (1.0)       21.5268 (1.0)       21.5268 (1.0)      0.0000 (1.0)       21.5268 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8884 (1.00)     2.8884 (1.00)     2.8884 (1.00)     0.0000 (1.0)      2.8884 (1.00)     0.0000 (1.0)           0;0  0.3462 (1.00)          1           1
test_gc-gc[3.10.0]     3.2078 (1.11)     3.2078 (1.11)     3.2078 (1.11)     0.0000 (1.0)      3.2078 (1.11)     0.0000 (1.0)           0;0  0.3117 (0.90)          1           1
test_gc-gc[3.53.2]     2.9435 (1.02)     2.9435 (1.02)     2.9435 (1.02)     0.0000 (1.0)      2.9435 (1.02)     0.0000 (1.0)           0;0  0.3397 (0.98)          1           1
test_gc-gc[3.60.1]     2.9656 (1.03)     2.9656 (1.03)     2.9656 (1.03)     0.0000 (1.0)      2.9656 (1.03)     0.0000 (1.0)           0;0  0.3372 (0.97)          1           1
test_gc-gc[main]       2.8881 (1.0)      2.8881 (1.0)      2.8881 (1.0)      0.0000 (1.0)      2.8881 (1.0)      0.0000 (1.0)           0;0  0.3462 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     171.7552 (3.38)     171.7552 (3.38)     171.7552 (3.38)     0.0000 (1.0)      171.7552 (3.38)     0.0000 (1.0)           0;0  0.0058 (0.30)          1           1
test_get-get[3.10.0]     206.9416 (4.07)     206.9416 (4.07)     206.9416 (4.07)     0.0000 (1.0)      206.9416 (4.07)     0.0000 (1.0)           0;0  0.0048 (0.25)          1           1
test_get-get[3.53.2]     150.5825 (2.96)     150.5825 (2.96)     150.5825 (2.96)     0.0000 (1.0)      150.5825 (2.96)     0.0000 (1.0)           0;0  0.0066 (0.34)          1           1
test_get-get[3.60.1]      51.9218 (1.02)      51.9218 (1.02)      51.9218 (1.02)     0.0000 (1.0)       51.9218 (1.02)     0.0000 (1.0)           0;0  0.0193 (0.98)          1           1
test_get-get[main]        50.7934 (1.0)       50.7934 (1.0)       50.7934 (1.0)      0.0000 (1.0)       50.7934 (1.0)      0.0000 (1.0)           0;0  0.0197 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     73.1887 (8.01)     73.1887 (8.01)     73.1887 (8.01)     0.0000 (1.0)      73.1887 (8.01)     0.0000 (1.0)           0;0  0.0137 (0.12)          1           1
test_get_url-get-url[3.10.0]     79.4554 (8.70)     79.4554 (8.70)     79.4554 (8.70)     0.0000 (1.0)      79.4554 (8.70)     0.0000 (1.0)           0;0  0.0126 (0.11)          1           1
test_get_url-get-url[3.53.2]      9.2187 (1.01)      9.2187 (1.01)      9.2187 (1.01)     0.0000 (1.0)       9.2187 (1.01)     0.0000 (1.0)           0;0  0.1085 (0.99)          1           1
test_get_url-get-url[3.60.1]      9.6164 (1.05)      9.6164 (1.05)      9.6164 (1.05)     0.0000 (1.0)       9.6164 (1.05)     0.0000 (1.0)           0;0  0.1040 (0.95)          1           1
test_get_url-get-url[main]        9.1327 (1.0)       9.1327 (1.0)       9.1327 (1.0)      0.0000 (1.0)       9.1327 (1.0)      0.0000 (1.0)           0;0  0.1095 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     164.8839 (1.06)     215.8821 (1.30)     169.0883 (1.06)     5.7979 (5.97)     167.8630 (1.06)     3.4848 (3.23)          4;4  5.9141 (0.94)        100           1
test_help---help[3.10.0]     160.3062 (1.03)     166.6820 (1.0)      161.9220 (1.02)     0.9713 (1.0)      161.8124 (1.03)     1.0833 (1.00)         24;3  6.1758 (0.98)        100           1
test_help---help[3.53.2]     163.4473 (1.05)     173.1254 (1.04)     165.3502 (1.04)     1.3428 (1.38)     165.1516 (1.05)     1.5277 (1.41)         20;3  6.0478 (0.96)        100           1
test_help---help[3.60.1]     163.4465 (1.05)     209.3974 (1.26)     165.7550 (1.04)     4.5042 (4.64)     165.2424 (1.05)     1.0805 (1.0)           2;2  6.0330 (0.96)        100           1
test_help---help[main]       155.6445 (1.0)      195.8626 (1.18)     159.3079 (1.0)      6.6103 (6.81)     157.6822 (1.0)      1.2353 (1.14)         6;11  6.2772 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     263.3921 (3.52)     263.3921 (3.52)     263.3921 (3.52)     0.0000 (1.0)      263.3921 (3.52)     0.0000 (1.0)           0;0  0.0038 (0.28)          1           1
test_import-import[3.10.0]     300.2987 (4.01)     300.2987 (4.01)     300.2987 (4.01)     0.0000 (1.0)      300.2987 (4.01)     0.0000 (1.0)           0;0  0.0033 (0.25)          1           1
test_import-import[3.60.1]      74.8467 (1.0)       74.8467 (1.0)       74.8467 (1.0)      0.0000 (1.0)       74.8467 (1.0)      0.0000 (1.0)           0;0  0.0134 (1.0)           1           1
test_import-import[main]        76.6141 (1.02)      76.6141 (1.02)      76.6141 (1.02)     0.0000 (1.0)       76.6141 (1.02)     0.0000 (1.0)           0;0  0.0131 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     192.8450 (4.20)     192.8450 (4.20)     192.8450 (4.20)     0.0000 (1.0)      192.8450 (4.20)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_import_url-import-url[3.10.0]     196.4739 (4.28)     196.4739 (4.28)     196.4739 (4.28)     0.0000 (1.0)      196.4739 (4.28)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_import_url-import-url[3.53.2]     116.3808 (2.53)     116.3808 (2.53)     116.3808 (2.53)     0.0000 (1.0)      116.3808 (2.53)     0.0000 (1.0)           0;0  0.0086 (0.39)          1           1
test_import_url-import-url[3.60.1]      45.9198 (1.0)       45.9198 (1.0)       45.9198 (1.0)      0.0000 (1.0)       45.9198 (1.0)      0.0000 (1.0)           0;0  0.0218 (1.0)           1           1
test_import_url-import-url[main]        47.7129 (1.04)      47.7129 (1.04)      47.7129 (1.04)     0.0000 (1.0)       47.7129 (1.04)     0.0000 (1.0)           0;0  0.0210 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     425.8438 (1.05)     457.5716 (1.02)     436.2629 (1.04)      7.4309 (1.33)     434.7580 (1.04)      7.7359 (1.15)         28;7  2.2922 (0.96)        100           1
test_init-init[3.10.0]     429.5313 (1.06)     460.0043 (1.02)     440.1325 (1.05)      5.5720 (1.0)      439.9487 (1.05)      6.9769 (1.04)         27;3  2.2720 (0.95)        100           1
test_init-init[3.53.2]     406.9020 (1.0)      449.1009 (1.0)      419.5216 (1.0)       7.2867 (1.31)     417.1853 (1.0)       6.8830 (1.03)         16;7  2.3837 (1.0)         100           1
test_init-init[3.60.1]     415.9268 (1.02)     454.7461 (1.01)     427.2545 (1.02)      6.5008 (1.17)     426.5900 (1.02)      6.7021 (1.0)          23;4  2.3405 (0.98)        100           1
test_init-init[main]       450.4637 (1.11)     615.8107 (1.37)     472.7260 (1.13)     24.3179 (4.36)     466.8850 (1.12)     18.5546 (2.77)          6;4  2.1154 (0.89)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     635.3313 (1.03)     635.3313 (1.03)     635.3313 (1.03)     0.0000 (1.0)      635.3313 (1.03)     0.0000 (1.0)           0;0  1.5740 (0.97)          1           1
test_list-list[3.10.0]     946.5567 (1.53)     946.5567 (1.53)     946.5567 (1.53)     0.0000 (1.0)      946.5567 (1.53)     0.0000 (1.0)           0;0  1.0565 (0.65)          1           1
test_list-list[3.53.2]     632.1341 (1.02)     632.1341 (1.02)     632.1341 (1.02)     0.0000 (1.0)      632.1341 (1.02)     0.0000 (1.0)           0;0  1.5819 (0.98)          1           1
test_list-list[3.60.1]     650.0515 (1.05)     650.0515 (1.05)     650.0515 (1.05)     0.0000 (1.0)      650.0515 (1.05)     0.0000 (1.0)           0;0  1.5383 (0.95)          1           1
test_list-list[main]       617.2185 (1.0)      617.2185 (1.0)      617.2185 (1.0)      0.0000 (1.0)      617.2185 (1.0)      0.0000 (1.0)           0;0  1.6202 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     445.6595 (1.06)     445.6595 (1.06)     445.6595 (1.06)     0.0000 (1.0)      445.6595 (1.06)     0.0000 (1.0)           0;0  2.2439 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     448.1161 (1.07)     448.1161 (1.07)     448.1161 (1.07)     0.0000 (1.0)      448.1161 (1.07)     0.0000 (1.0)           0;0  2.2316 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     418.9431 (1.00)     418.9431 (1.00)     418.9431 (1.00)     0.0000 (1.0)      418.9431 (1.00)     0.0000 (1.0)           0;0  2.3870 (1.00)          1           1
test_list-list-dvc-only[3.60.1]     418.8531 (1.0)      418.8531 (1.0)      418.8531 (1.0)      0.0000 (1.0)      418.8531 (1.0)      0.0000 (1.0)           0;0  2.3875 (1.0)           1           1
test_list-list-dvc-only[main]       424.8170 (1.01)     424.8170 (1.01)     424.8170 (1.01)     0.0000 (1.0)      424.8170 (1.01)     0.0000 (1.0)           0;0  2.3540 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4666 (1.0)      2.4666 (1.0)      2.4666 (1.0)      0.0000 (1.0)      2.4666 (1.0)      0.0000 (1.0)           0;0  0.4054 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5248 (1.02)     2.5248 (1.02)     2.5248 (1.02)     0.0000 (1.0)      2.5248 (1.02)     0.0000 (1.0)           0;0  0.3961 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.6859 (1.09)     2.6859 (1.09)     2.6859 (1.09)     0.0000 (1.0)      2.6859 (1.09)     0.0000 (1.0)           0;0  0.3723 (0.92)          1           1
test_list-list-recursive[3.60.1]     2.7547 (1.12)     2.7547 (1.12)     2.7547 (1.12)     0.0000 (1.0)      2.7547 (1.12)     0.0000 (1.0)           0;0  0.3630 (0.90)          1           1
test_list-list-recursive[main]       2.7491 (1.11)     2.7491 (1.11)     2.7491 (1.11)     0.0000 (1.0)      2.7491 (1.11)     0.0000 (1.0)           0;0  0.3638 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     445.3366 (1.06)     445.3366 (1.06)     445.3366 (1.06)     0.0000 (1.0)      445.3366 (1.06)     0.0000 (1.0)           0;0  2.2455 (0.95)          1           1
test_list-list-shallow[3.10.0]     447.2475 (1.06)     447.2475 (1.06)     447.2475 (1.06)     0.0000 (1.0)      447.2475 (1.06)     0.0000 (1.0)           0;0  2.2359 (0.94)          1           1
test_list-list-shallow[3.53.2]     422.1088 (1.0)      422.1088 (1.0)      422.1088 (1.0)      0.0000 (1.0)      422.1088 (1.0)      0.0000 (1.0)           0;0  2.3691 (1.0)           1           1
test_list-list-shallow[3.60.1]     422.7645 (1.00)     422.7645 (1.00)     422.7645 (1.00)     0.0000 (1.0)      422.7645 (1.00)     0.0000 (1.0)           0;0  2.3654 (1.00)          1           1
test_list-list-shallow[main]       429.0825 (1.02)     429.0825 (1.02)     429.0825 (1.02)     0.0000 (1.0)      429.0825 (1.02)     0.0000 (1.0)           0;0  2.3306 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.6122 (3.69)     71.6122 (3.69)     71.6122 (3.69)     0.0000 (1.0)      71.6122 (3.69)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.10.0]     72.4834 (3.73)     72.4834 (3.73)     72.4834 (3.73)     0.0000 (1.0)      72.4834 (3.73)     0.0000 (1.0)           0;0  0.0138 (0.27)          1           1
test_partial_add-add[3.53.2]     65.3064 (3.36)     65.3064 (3.36)     65.3064 (3.36)     0.0000 (1.0)      65.3064 (3.36)     0.0000 (1.0)           0;0  0.0153 (0.30)          1           1
test_partial_add-add[3.60.1]     19.4266 (1.0)      19.4266 (1.0)      19.4266 (1.0)      0.0000 (1.0)      19.4266 (1.0)      0.0000 (1.0)           0;0  0.0515 (1.0)           1           1
test_partial_add-add[main]       20.1104 (1.04)     20.1104 (1.04)     20.1104 (1.04)     0.0000 (1.0)      20.1104 (1.04)     0.0000 (1.0)           0;0  0.0497 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     60.1511 (8.05)     60.1511 (8.05)     60.1511 (8.05)     0.0000 (1.0)      60.1511 (8.05)     0.0000 (1.0)           0;0  0.0166 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     60.4324 (8.09)     60.4324 (8.09)     60.4324 (8.09)     0.0000 (1.0)      60.4324 (8.09)     0.0000 (1.0)           0;0  0.0165 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     55.4305 (7.42)     55.4305 (7.42)     55.4305 (7.42)     0.0000 (1.0)      55.4305 (7.42)     0.0000 (1.0)           0;0  0.0180 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.4716 (1.0)       7.4716 (1.0)       7.4716 (1.0)      0.0000 (1.0)       7.4716 (1.0)      0.0000 (1.0)           0;0  0.1338 (1.0)           1           1
test_partial_add-add-partial[main]        7.5461 (1.01)      7.5461 (1.01)      7.5461 (1.01)     0.0000 (1.0)       7.5461 (1.01)     0.0000 (1.0)           0;0  0.1325 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6457 (1.0)      4.6457 (1.0)      4.6457 (1.0)      0.0000 (1.0)      4.6457 (1.0)      0.0000 (1.0)           0;0  0.2153 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.0719 (1.31)     6.0719 (1.31)     6.0719 (1.31)     0.0000 (1.0)      6.0719 (1.31)     0.0000 (1.0)           0;0  0.1647 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.8897 (1.48)     6.8897 (1.48)     6.8897 (1.48)     0.0000 (1.0)      6.8897 (1.48)     0.0000 (1.0)           0;0  0.1451 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.9440 (1.49)     6.9440 (1.49)     6.9440 (1.49)     0.0000 (1.0)      6.9440 (1.49)     0.0000 (1.0)           0;0  0.1440 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       5.7941 (1.25)     5.7941 (1.25)     5.7941 (1.25)     0.0000 (1.0)      5.7941 (1.25)     0.0000 (1.0)           0;0  0.1726 (0.80)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5256 (1.0)      2.5256 (1.0)      2.5256 (1.0)      0.0000 (1.0)      2.5256 (1.0)      0.0000 (1.0)           0;0  0.3959 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7943 (1.50)     3.7943 (1.50)     3.7943 (1.50)     0.0000 (1.0)      3.7943 (1.50)     0.0000 (1.0)           0;0  0.2636 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.8736 (1.53)     3.8736 (1.53)     3.8736 (1.53)     0.0000 (1.0)      3.8736 (1.53)     0.0000 (1.0)           0;0  0.2582 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.9231 (1.55)     3.9231 (1.55)     3.9231 (1.55)     0.0000 (1.0)      3.9231 (1.55)     0.0000 (1.0)           0;0  0.2549 (0.64)          1           1
test_partial_add-gc-noop[main]       2.7752 (1.10)     2.7752 (1.10)     2.7752 (1.10)     0.0000 (1.0)      2.7752 (1.10)     0.0000 (1.0)           0;0  0.3603 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     78.1465 (4.07)     78.1465 (4.07)     78.1465 (4.07)     0.0000 (1.0)      78.1465 (4.07)     0.0000 (1.0)           0;0  0.0128 (0.25)          1           1
test_partial_add-push[3.10.0]     36.4258 (1.90)     36.4258 (1.90)     36.4258 (1.90)     0.0000 (1.0)      36.4258 (1.90)     0.0000 (1.0)           0;0  0.0275 (0.53)          1           1
test_partial_add-push[3.53.2]     19.6834 (1.02)     19.6834 (1.02)     19.6834 (1.02)     0.0000 (1.0)      19.6834 (1.02)     0.0000 (1.0)           0;0  0.0508 (0.98)          1           1
test_partial_add-push[3.60.1]     19.4390 (1.01)     19.4390 (1.01)     19.4390 (1.01)     0.0000 (1.0)      19.4390 (1.01)     0.0000 (1.0)           0;0  0.0514 (0.99)          1           1
test_partial_add-push[main]       19.2041 (1.0)      19.2041 (1.0)      19.2041 (1.0)      0.0000 (1.0)      19.2041 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.2113 (1.71)     17.2113 (1.71)     17.2113 (1.71)     0.0000 (1.0)      17.2113 (1.71)     0.0000 (1.0)           0;0  0.0581 (0.58)          1           1
test_partial_add-push-partial[3.10.0]     10.0559 (1.0)      10.0559 (1.0)      10.0559 (1.0)      0.0000 (1.0)      10.0559 (1.0)      0.0000 (1.0)           0;0  0.0994 (1.0)           1           1
test_partial_add-push-partial[3.53.2]     10.8489 (1.08)     10.8489 (1.08)     10.8489 (1.08)     0.0000 (1.0)      10.8489 (1.08)     0.0000 (1.0)           0;0  0.0922 (0.93)          1           1
test_partial_add-push-partial[3.60.1]     10.1472 (1.01)     10.1472 (1.01)     10.1472 (1.01)     0.0000 (1.0)      10.1472 (1.01)     0.0000 (1.0)           0;0  0.0985 (0.99)          1           1
test_partial_add-push-partial[main]       10.1624 (1.01)     10.1624 (1.01)     10.1624 (1.01)     0.0000 (1.0)      10.1624 (1.01)     0.0000 (1.0)           0;0  0.0984 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     81.3413 (3.69)     81.3413 (3.69)     81.3413 (3.69)     0.0000 (1.0)      81.3413 (3.69)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_partial_remove-add[3.10.0]     82.5812 (3.75)     82.5812 (3.75)     82.5812 (3.75)     0.0000 (1.0)      82.5812 (3.75)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_partial_remove-add[3.53.2]     74.0031 (3.36)     74.0031 (3.36)     74.0031 (3.36)     0.0000 (1.0)      74.0031 (3.36)     0.0000 (1.0)           0;0  0.0135 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.0344 (1.0)      22.0344 (1.0)      22.0344 (1.0)      0.0000 (1.0)      22.0344 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
test_partial_remove-add[main]       23.0600 (1.05)     23.0600 (1.05)     23.0600 (1.05)     0.0000 (1.0)      23.0600 (1.05)     0.0000 (1.0)           0;0  0.0434 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.2142 (8.06)     8.2142 (8.06)     8.2142 (8.06)     0.0000 (1.0)      8.2142 (8.06)     0.0000 (1.0)           0;0  0.1217 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.1605 (8.01)     8.1605 (8.01)     8.1605 (8.01)     0.0000 (1.0)      8.1605 (8.01)     0.0000 (1.0)           0;0  0.1225 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.2882 (7.16)     7.2882 (7.16)     7.2882 (7.16)     0.0000 (1.0)      7.2882 (7.16)     0.0000 (1.0)           0;0  0.1372 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0185 (1.0)      1.0185 (1.0)      1.0185 (1.0)      0.0000 (1.0)      1.0185 (1.0)      0.0000 (1.0)           0;0  0.9818 (1.0)           1           1
test_partial_remove-add-update[main]       1.0508 (1.03)     1.0508 (1.03)     1.0508 (1.03)     0.0000 (1.0)      1.0508 (1.03)     0.0000 (1.0)           0;0  0.9516 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1745 (1.0)      3.1745 (1.0)      3.1745 (1.0)      0.0000 (1.0)      3.1745 (1.0)      0.0000 (1.0)           0;0  0.3150 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5040 (1.10)     3.5040 (1.10)     3.5040 (1.10)     0.0000 (1.0)      3.5040 (1.10)     0.0000 (1.0)           0;0  0.2854 (0.91)          1           1
test_partial_remove-gc[3.53.2]     3.5351 (1.11)     3.5351 (1.11)     3.5351 (1.11)     0.0000 (1.0)      3.5351 (1.11)     0.0000 (1.0)           0;0  0.2829 (0.90)          1           1
test_partial_remove-gc[3.60.1]     3.7454 (1.18)     3.7454 (1.18)     3.7454 (1.18)     0.0000 (1.0)      3.7454 (1.18)     0.0000 (1.0)           0;0  0.2670 (0.85)          1           1
test_partial_remove-gc[main]       3.4453 (1.09)     3.4453 (1.09)     3.4453 (1.09)     0.0000 (1.0)      3.4453 (1.09)     0.0000 (1.0)           0;0  0.2902 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.6225 (1.02)     4.6225 (1.02)     4.6225 (1.02)     0.0000 (1.0)      4.6225 (1.02)     0.0000 (1.0)           0;0  0.2163 (0.98)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.0050 (1.10)     5.0050 (1.10)     5.0050 (1.10)     0.0000 (1.0)      5.0050 (1.10)     0.0000 (1.0)           0;0  0.1998 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.9917 (1.10)     4.9917 (1.10)     4.9917 (1.10)     0.0000 (1.0)      4.9917 (1.10)     0.0000 (1.0)           0;0  0.2003 (0.91)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8960 (1.08)     4.8960 (1.08)     4.8960 (1.08)     0.0000 (1.0)      4.8960 (1.08)     0.0000 (1.0)           0;0  0.2042 (0.93)          1           1
test_partial_remove-gc-cloud[main]       4.5525 (1.0)      4.5525 (1.0)      4.5525 (1.0)      0.0000 (1.0)      4.5525 (1.0)      0.0000 (1.0)           0;0  0.2197 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     90.5546 (4.17)     90.5546 (4.17)     90.5546 (4.17)     0.0000 (1.0)      90.5546 (4.17)     0.0000 (1.0)           0;0  0.0110 (0.24)          1           1
test_partial_remove-push[3.10.0]     41.5112 (1.91)     41.5112 (1.91)     41.5112 (1.91)     0.0000 (1.0)      41.5112 (1.91)     0.0000 (1.0)           0;0  0.0241 (0.52)          1           1
test_partial_remove-push[3.53.2]     22.6426 (1.04)     22.6426 (1.04)     22.6426 (1.04)     0.0000 (1.0)      22.6426 (1.04)     0.0000 (1.0)           0;0  0.0442 (0.96)          1           1
test_partial_remove-push[3.60.1]     21.7059 (1.00)     21.7059 (1.00)     21.7059 (1.00)     0.0000 (1.0)      21.7059 (1.00)     0.0000 (1.0)           0;0  0.0461 (1.00)          1           1
test_partial_remove-push[main]       21.6972 (1.0)      21.6972 (1.0)      21.6972 (1.0)      0.0000 (1.0)      21.6972 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7958 (1.0)      1.7958 (1.0)      1.7958 (1.0)      0.0000 (1.0)      1.7958 (1.0)      0.0000 (1.0)           0;0  0.5569 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8005 (1.00)     1.8005 (1.00)     1.8005 (1.00)     0.0000 (1.0)      1.8005 (1.00)     0.0000 (1.0)           0;0  0.5554 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.4621 (1.37)     2.4621 (1.37)     2.4621 (1.37)     0.0000 (1.0)      2.4621 (1.37)     0.0000 (1.0)           0;0  0.4062 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.6425 (1.47)     2.6425 (1.47)     2.6425 (1.47)     0.0000 (1.0)      2.6425 (1.47)     0.0000 (1.0)           0;0  0.3784 (0.68)          1           1
test_partial_remove-push-update[main]       2.5908 (1.44)     2.5908 (1.44)     2.5908 (1.44)     0.0000 (1.0)      2.5908 (1.44)     0.0000 (1.0)           0;0  0.3860 (0.69)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     555.6150 (1.0)      558.5255 (1.0)      557.0679 (1.0)       1.4023 (1.0)      556.9203 (1.0)       2.7395 (1.0)           3;0  1.7951 (1.0)           5           3
test_plots-plots-diff[3.10.0]     943.5197 (1.70)     952.3234 (1.71)     946.8428 (1.70)      3.2997 (2.35)     946.4679 (1.70)      3.1148 (1.14)          2;0  1.0561 (0.59)          5           3
test_plots-plots-diff[3.53.2]     888.3379 (1.60)     900.6328 (1.61)     897.0469 (1.61)      5.0087 (3.57)     898.1021 (1.61)      4.6664 (1.70)          1;1  1.1148 (0.62)          5           3
test_plots-plots-diff[3.60.1]     911.6071 (1.64)     928.2485 (1.66)     920.2123 (1.65)      7.4620 (5.32)     917.6232 (1.65)     13.1857 (4.81)          3;0  1.0867 (0.61)          5           3
test_plots-plots-diff[main]       908.2666 (1.63)     965.1224 (1.73)     927.1367 (1.66)     22.9595 (16.37)    922.3594 (1.66)     28.5994 (10.44)         1;0  1.0786 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       565.2701 (1.0)        568.8928 (1.0)        567.4049 (1.0)       1.4931 (1.0)        568.0427 (1.0)       2.3044 (1.0)           1;0  1.7624 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,171.4510 (2.07)     1,175.2423 (2.07)     1,173.0648 (2.07)      1.6147 (1.08)     1,173.0136 (2.07)      2.7695 (1.20)          1;0  0.8525 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]       964.0166 (1.71)     1,047.0587 (1.84)       996.3449 (1.76)     32.2671 (21.61)      983.9374 (1.73)     41.3227 (17.93)         2;0  1.0037 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       990.9752 (1.75)     1,036.4691 (1.82)     1,014.3606 (1.79)     18.0918 (12.12)    1,018.7785 (1.79)     28.1152 (12.20)         2;0  0.9858 (0.56)          5           3
test_plots-plots-diff-json[main]         971.7793 (1.72)       998.3889 (1.75)       983.3381 (1.73)      9.8083 (6.57)       982.1550 (1.73)     11.4680 (4.98)          2;0  1.0169 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     445.1145 (1.0)      455.1859 (1.0)      448.2640 (1.0)       3.9994 (4.27)     447.1577 (1.0)       3.7597 (3.60)          1;0  2.2308 (1.0)           5           3
test_plots-plots-show[3.10.0]     763.8594 (1.72)     790.0815 (1.74)     774.2725 (1.73)      9.9444 (10.62)    773.5228 (1.73)     11.9481 (11.44)         2;0  1.2915 (0.58)          5           3
test_plots-plots-show[3.53.2]     753.7148 (1.69)     791.0769 (1.74)     771.9796 (1.72)     15.5532 (16.61)    769.6632 (1.72)     26.5363 (25.41)         2;0  1.2954 (0.58)          5           3
test_plots-plots-show[3.60.1]     747.2771 (1.68)     749.8539 (1.65)     748.4659 (1.67)      0.9365 (1.0)      748.4909 (1.67)      1.0445 (1.0)           2;0  1.3361 (0.60)          5           3
test_plots-plots-show[main]       754.8242 (1.70)     765.2623 (1.68)     758.0020 (1.69)      4.1854 (4.47)     757.0220 (1.69)      3.9019 (3.74)          1;1  1.3193 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     462.3129 (1.0)      501.5119 (1.0)      473.3339 (1.0)      16.0042 (4.41)     466.8316 (1.0)      13.1599 (2.21)          1;1  2.1127 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     887.0522 (1.92)     902.0720 (1.80)     893.0550 (1.89)      6.3417 (1.75)     890.6186 (1.91)     10.2437 (1.72)          1;0  1.1198 (0.53)          5           3
test_plots-plots-show-json[3.53.2]     829.6733 (1.79)     852.3616 (1.70)     843.6839 (1.78)      9.3248 (2.57)     844.6936 (1.81)     14.2784 (2.39)          1;0  1.1853 (0.56)          5           3
test_plots-plots-show-json[3.60.1]     798.6067 (1.73)     807.4807 (1.61)     803.1523 (1.70)      3.6277 (1.0)      802.5151 (1.72)      5.9643 (1.0)           2;0  1.2451 (0.59)          5           3
test_plots-plots-show-json[main]       806.2607 (1.74)     820.9374 (1.64)     814.8073 (1.72)      5.4927 (1.51)     815.7765 (1.75)      6.6823 (1.12)          2;0  1.2273 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     98.8715 (4.40)     98.8715 (4.40)     98.8715 (4.40)     0.0000 (1.0)      98.8715 (4.40)     0.0000 (1.0)           0;0  0.0101 (0.23)          1           1
test_push-push[3.10.0]     45.6343 (2.03)     45.6343 (2.03)     45.6343 (2.03)     0.0000 (1.0)      45.6343 (2.03)     0.0000 (1.0)           0;0  0.0219 (0.49)          1           1
test_push-push[3.53.2]     23.8663 (1.06)     23.8663 (1.06)     23.8663 (1.06)     0.0000 (1.0)      23.8663 (1.06)     0.0000 (1.0)           0;0  0.0419 (0.94)          1           1
test_push-push[3.60.1]     22.4468 (1.0)      22.4468 (1.0)      22.4468 (1.0)      0.0000 (1.0)      22.4468 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_push-push[main]       22.5970 (1.01)     22.5970 (1.01)     22.5970 (1.01)     0.0000 (1.0)      22.5970 (1.01)     0.0000 (1.0)           0;0  0.0443 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     104.4840 (4.61)     104.4840 (4.61)     104.4840 (4.61)     0.0000 (1.0)      104.4840 (4.61)     0.0000 (1.0)           0;0  0.0096 (0.22)          1           1
test_sharing-fetch[3.10.0]     109.2353 (4.82)     109.2353 (4.82)     109.2353 (4.82)     0.0000 (1.0)      109.2353 (4.82)     0.0000 (1.0)           0;0  0.0092 (0.21)          1           1
test_sharing-fetch[3.53.2]      33.6345 (1.48)      33.6345 (1.48)      33.6345 (1.48)     0.0000 (1.0)       33.6345 (1.48)     0.0000 (1.0)           0;0  0.0297 (0.67)          1           1
test_sharing-fetch[3.60.1]      22.7657 (1.00)      22.7657 (1.00)      22.7657 (1.00)     0.0000 (1.0)       22.7657 (1.00)     0.0000 (1.0)           0;0  0.0439 (1.00)          1           1
test_sharing-fetch[main]        22.6627 (1.0)       22.6627 (1.0)       22.6627 (1.0)      0.0000 (1.0)       22.6627 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2721 (1.0)      1.2721 (1.0)      1.2721 (1.0)      0.0000 (1.0)      1.2721 (1.0)      0.0000 (1.0)           0;0  0.7861 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6648 (2.88)     3.6648 (2.88)     3.6648 (2.88)     0.0000 (1.0)      3.6648 (2.88)     0.0000 (1.0)           0;0  0.2729 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.8567 (4.60)     5.8567 (4.60)     5.8567 (4.60)     0.0000 (1.0)      5.8567 (4.60)     0.0000 (1.0)           0;0  0.1707 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9723 (4.69)     5.9723 (4.69)     5.9723 (4.69)     0.0000 (1.0)      5.9723 (4.69)     0.0000 (1.0)           0;0  0.1674 (0.21)          1           1
test_sharing-fetch-noop[main]       6.0103 (4.72)     6.0103 (4.72)     6.0103 (4.72)     0.0000 (1.0)      6.0103 (4.72)     0.0000 (1.0)           0;0  0.1664 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     92.3619 (4.10)     92.3619 (4.10)     92.3619 (4.10)     0.0000 (1.0)      92.3619 (4.10)     0.0000 (1.0)           0;0  0.0108 (0.24)          1           1
test_sharing-push[3.10.0]     43.1441 (1.91)     43.1441 (1.91)     43.1441 (1.91)     0.0000 (1.0)      43.1441 (1.91)     0.0000 (1.0)           0;0  0.0232 (0.52)          1           1
test_sharing-push[3.53.2]     22.9204 (1.02)     22.9204 (1.02)     22.9204 (1.02)     0.0000 (1.0)      22.9204 (1.02)     0.0000 (1.0)           0;0  0.0436 (0.98)          1           1
test_sharing-push[3.60.1]     22.5317 (1.0)      22.5317 (1.0)      22.5317 (1.0)      0.0000 (1.0)      22.5317 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_sharing-push[main]       22.6588 (1.01)     22.6588 (1.01)     22.6588 (1.01)     0.0000 (1.0)      22.6588 (1.01)     0.0000 (1.0)           0;0  0.0441 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0458 (1.0)      2.0458 (1.0)      2.0458 (1.0)      0.0000 (1.0)      2.0458 (1.0)      0.0000 (1.0)           0;0  0.4888 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0465 (1.00)     2.0465 (1.00)     2.0465 (1.00)     0.0000 (1.0)      2.0465 (1.00)     0.0000 (1.0)           0;0  0.4886 (1.00)          1           1
test_sharing-push-noop[3.53.2]     5.9750 (2.92)     5.9750 (2.92)     5.9750 (2.92)     0.0000 (1.0)      5.9750 (2.92)     0.0000 (1.0)           0;0  0.1674 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.1657 (3.01)     6.1657 (3.01)     6.1657 (3.01)     0.0000 (1.0)      6.1657 (3.01)     0.0000 (1.0)           0;0  0.1622 (0.33)          1           1
test_sharing-push-noop[main]       6.0331 (2.95)     6.0331 (2.95)     6.0331 (2.95)     0.0000 (1.0)      6.0331 (2.95)     0.0000 (1.0)           0;0  0.1658 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     164.2008 (1.05)     164.2008 (1.05)     164.2008 (1.05)     0.0000 (1.0)      164.2008 (1.05)     0.0000 (1.0)           0;0  0.0061 (0.95)          1           1
test_sharing_azure-fetch[main]       156.2004 (1.0)      156.2004 (1.0)      156.2004 (1.0)      0.0000 (1.0)      156.2004 (1.0)      0.0000 (1.0)           0;0  0.0064 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.0317 (1.0)      6.0317 (1.0)      6.0317 (1.0)      0.0000 (1.0)      6.0317 (1.0)      0.0000 (1.0)           0;0  0.1658 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.2172 (1.03)     6.2172 (1.03)     6.2172 (1.03)     0.0000 (1.0)      6.2172 (1.03)     0.0000 (1.0)           0;0  0.1608 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     160.1788 (1.01)     160.1788 (1.01)     160.1788 (1.01)     0.0000 (1.0)      160.1788 (1.01)     0.0000 (1.0)           0;0  0.0062 (0.99)          1           1
test_sharing_azure-push[main]       158.1856 (1.0)      158.1856 (1.0)      158.1856 (1.0)      0.0000 (1.0)      158.1856 (1.0)      0.0000 (1.0)           0;0  0.0063 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.2706 (1.00)     6.2706 (1.00)     6.2706 (1.00)     0.0000 (1.0)      6.2706 (1.00)     0.0000 (1.0)           0;0  0.1595 (1.00)          1           1
test_sharing_azure-push-noop[main]       6.2592 (1.0)      6.2592 (1.0)      6.2592 (1.0)      0.0000 (1.0)      6.2592 (1.0)      0.0000 (1.0)           0;0  0.1598 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     477.2464 (1.03)     477.2464 (1.03)     477.2464 (1.03)     0.0000 (1.0)      477.2464 (1.03)     0.0000 (1.0)           0;0  0.0021 (0.97)          1           1
test_sharing_s3-fetch[main]       462.0059 (1.0)      462.0059 (1.0)      462.0059 (1.0)      0.0000 (1.0)      462.0059 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.1657 (1.0)      6.1657 (1.0)      6.1657 (1.0)      0.0000 (1.0)      6.1657 (1.0)      0.0000 (1.0)           0;0  0.1622 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3300 (1.03)     6.3300 (1.03)     6.3300 (1.03)     0.0000 (1.0)      6.3300 (1.03)     0.0000 (1.0)           0;0  0.1580 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     519.3803 (1.0)      519.3803 (1.0)      519.3803 (1.0)      0.0000 (1.0)      519.3803 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
test_sharing_s3-push[main]       525.0744 (1.01)     525.0744 (1.01)     525.0744 (1.01)     0.0000 (1.0)      525.0744 (1.01)     0.0000 (1.0)           0;0  0.0019 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.4403 (1.0)      6.4403 (1.0)      6.4403 (1.0)      0.0000 (1.0)      6.4403 (1.0)      0.0000 (1.0)           0;0  0.1553 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.4489 (1.00)     6.4489 (1.00)     6.4489 (1.00)     0.0000 (1.0)      6.4489 (1.00)     0.0000 (1.0)           0;0  0.1551 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.4725 (3.62)     19.4725 (3.62)     19.4725 (3.62)     0.0000 (1.0)      19.4725 (3.62)     0.0000 (1.0)           0;0  0.0514 (0.28)          1           1
test_status-status[3.10.0]     19.8647 (3.70)     19.8647 (3.70)     19.8647 (3.70)     0.0000 (1.0)      19.8647 (3.70)     0.0000 (1.0)           0;0  0.0503 (0.27)          1           1
test_status-status[3.53.2]     18.0300 (3.36)     18.0300 (3.36)     18.0300 (3.36)     0.0000 (1.0)      18.0300 (3.36)     0.0000 (1.0)           0;0  0.0555 (0.30)          1           1
test_status-status[3.60.1]      5.3725 (1.0)       5.3725 (1.0)       5.3725 (1.0)      0.0000 (1.0)       5.3725 (1.0)      0.0000 (1.0)           0;0  0.1861 (1.0)           1           1
test_status-status[main]        5.6530 (1.05)      5.6530 (1.05)      5.6530 (1.05)     0.0000 (1.0)       5.6530 (1.05)     0.0000 (1.0)           0;0  0.1769 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.1016 (1.84)     5.1016 (1.84)     5.1016 (1.84)     0.0000 (1.0)      5.1016 (1.84)     0.0000 (1.0)           0;0  0.1960 (0.54)          1           1
test_status-status-changed[3.10.0]     5.2543 (1.90)     5.2543 (1.90)     5.2543 (1.90)     0.0000 (1.0)      5.2543 (1.90)     0.0000 (1.0)           0;0  0.1903 (0.53)          1           1
test_status-status-changed[3.53.2]     5.1124 (1.85)     5.1124 (1.85)     5.1124 (1.85)     0.0000 (1.0)      5.1124 (1.85)     0.0000 (1.0)           0;0  0.1956 (0.54)          1           1
test_status-status-changed[3.60.1]     2.7676 (1.0)      2.7676 (1.0)      2.7676 (1.0)      0.0000 (1.0)      2.7676 (1.0)      0.0000 (1.0)           0;0  0.3613 (1.0)           1           1
test_status-status-changed[main]       2.9473 (1.06)     2.9473 (1.06)     2.9473 (1.06)     0.0000 (1.0)      2.9473 (1.06)     0.0000 (1.0)           0;0  0.3393 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9247 (1.86)     4.9247 (1.86)     4.9247 (1.86)     0.0000 (1.0)      4.9247 (1.86)     0.0000 (1.0)           0;0  0.2031 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     5.1760 (1.96)     5.1760 (1.96)     5.1760 (1.96)     0.0000 (1.0)      5.1760 (1.96)     0.0000 (1.0)           0;0  0.1932 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     5.0544 (1.91)     5.0544 (1.91)     5.0544 (1.91)     0.0000 (1.0)      5.0544 (1.91)     0.0000 (1.0)           0;0  0.1978 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.6461 (1.0)      2.6461 (1.0)      2.6461 (1.0)      0.0000 (1.0)      2.6461 (1.0)      0.0000 (1.0)           0;0  0.3779 (1.0)           1           1
test_status-status-changed-noop[main]       2.8018 (1.06)     2.8018 (1.06)     2.8018 (1.06)     0.0000 (1.0)      2.8018 (1.06)     0.0000 (1.0)           0;0  0.3569 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9553 (1.88)     4.9553 (1.88)     4.9553 (1.88)     0.0000 (1.0)      4.9553 (1.88)     0.0000 (1.0)           0;0  0.2018 (0.53)          1           1
test_status-status-noop[3.10.0]     5.2045 (1.97)     5.2045 (1.97)     5.2045 (1.97)     0.0000 (1.0)      5.2045 (1.97)     0.0000 (1.0)           0;0  0.1921 (0.51)          1           1
test_status-status-noop[3.53.2]     5.0540 (1.91)     5.0540 (1.91)     5.0540 (1.91)     0.0000 (1.0)      5.0540 (1.91)     0.0000 (1.0)           0;0  0.1979 (0.52)          1           1
test_status-status-noop[3.60.1]     2.6396 (1.0)      2.6396 (1.0)      2.6396 (1.0)      0.0000 (1.0)      2.6396 (1.0)      0.0000 (1.0)           0;0  0.3788 (1.0)           1           1
test_status-status-noop[main]       2.8342 (1.07)     2.8342 (1.07)     2.8342 (1.07)     0.0000 (1.0)      2.8342 (1.07)     0.0000 (1.0)           0;0  0.3528 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     178.9264 (4.28)     178.9264 (4.28)     178.9264 (4.28)     0.0000 (1.0)      178.9264 (4.28)     0.0000 (1.0)           0;0  0.0056 (0.23)          1           1
test_update-import-url[3.10.0]     180.4638 (4.32)     180.4638 (4.32)     180.4638 (4.32)     0.0000 (1.0)      180.4638 (4.32)     0.0000 (1.0)           0;0  0.0055 (0.23)          1           1
test_update-import-url[3.53.2]     101.3433 (2.43)     101.3433 (2.43)     101.3433 (2.43)     0.0000 (1.0)      101.3433 (2.43)     0.0000 (1.0)           0;0  0.0099 (0.41)          1           1
test_update-import-url[3.60.1]      41.7885 (1.0)       41.7885 (1.0)       41.7885 (1.0)      0.0000 (1.0)       41.7885 (1.0)      0.0000 (1.0)           0;0  0.0239 (1.0)           1           1
test_update-import-url[main]        43.2591 (1.04)      43.2591 (1.04)      43.2591 (1.04)     0.0000 (1.0)       43.2591 (1.04)     0.0000 (1.0)           0;0  0.0231 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     163.2011 (4.92)     163.2011 (4.92)     163.2011 (4.92)     0.0000 (1.0)      163.2011 (4.92)     0.0000 (1.0)           0;0  0.0061 (0.20)          1           1
test_update-update[3.10.0]     165.7153 (4.99)     165.7153 (4.99)     165.7153 (4.99)     0.0000 (1.0)      165.7153 (4.99)     0.0000 (1.0)           0;0  0.0060 (0.20)          1           1
test_update-update[3.53.2]      93.0944 (2.81)      93.0944 (2.81)      93.0944 (2.81)     0.0000 (1.0)       93.0944 (2.81)     0.0000 (1.0)           0;0  0.0107 (0.36)          1           1
test_update-update[3.60.1]      33.1829 (1.0)       33.1829 (1.0)       33.1829 (1.0)      0.0000 (1.0)       33.1829 (1.0)      0.0000 (1.0)           0;0  0.0301 (1.0)           1           1
test_update-update[main]        33.7267 (1.02)      33.7267 (1.02)      33.7267 (1.02)     0.0000 (1.0)       33.7267 (1.02)     0.0000 (1.0)           0;0  0.0297 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     12.6544 (1.65)     12.6544 (1.65)     12.6544 (1.65)     0.0000 (1.0)      12.6544 (1.65)     0.0000 (1.0)           0;0  0.0790 (0.60)          1           1
test_update-update-noop[3.10.0]     13.2825 (1.74)     13.2825 (1.74)     13.2825 (1.74)     0.0000 (1.0)      13.2825 (1.74)     0.0000 (1.0)           0;0  0.0753 (0.58)          1           1
test_update-update-noop[3.53.2]     12.7081 (1.66)     12.7081 (1.66)     12.7081 (1.66)     0.0000 (1.0)      12.7081 (1.66)     0.0000 (1.0)           0;0  0.0787 (0.60)          1           1
test_update-update-noop[3.60.1]      7.6490 (1.0)       7.6490 (1.0)       7.6490 (1.0)      0.0000 (1.0)       7.6490 (1.0)      0.0000 (1.0)           0;0  0.1307 (1.0)           1           1
test_update-update-noop[main]        8.2425 (1.08)      8.2425 (1.08)      8.2425 (1.08)     0.0000 (1.0)       8.2425 (1.08)     0.0000 (1.0)           0;0  0.1213 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean