Tue Mar 17 00:56:23 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     78.1863 (3.61)     78.1863 (3.61)     78.1863 (3.61)     0.0000 (1.0)      78.1863 (3.61)     0.0000 (1.0)           0;0  0.0128 (0.28)          1           1
test_add_copy-add[3.10.0]     78.5582 (3.62)     78.5582 (3.62)     78.5582 (3.62)     0.0000 (1.0)      78.5582 (3.62)     0.0000 (1.0)           0;0  0.0127 (0.28)          1           1
test_add_copy-add[3.53.2]     70.3636 (3.25)     70.3636 (3.25)     70.3636 (3.25)     0.0000 (1.0)      70.3636 (3.25)     0.0000 (1.0)           0;0  0.0142 (0.31)          1           1
test_add_copy-add[3.60.1]     21.6779 (1.0)      21.6779 (1.0)      21.6779 (1.0)      0.0000 (1.0)      21.6779 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
test_add_copy-add[main]       22.8934 (1.06)     22.8934 (1.06)     22.8934 (1.06)     0.0000 (1.0)      22.8934 (1.06)     0.0000 (1.0)           0;0  0.0437 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     23.6084 (5.60)     23.6084 (5.60)     23.6084 (5.60)     0.0000 (1.0)      23.6084 (5.60)     0.0000 (1.0)           0;0  0.0424 (0.18)          1           1
test_add_copy-add-noop[3.10.0]     23.8179 (5.64)     23.8179 (5.64)     23.8179 (5.64)     0.0000 (1.0)      23.8179 (5.64)     0.0000 (1.0)           0;0  0.0420 (0.18)          1           1
test_add_copy-add-noop[3.53.2]     22.4335 (5.32)     22.4335 (5.32)     22.4335 (5.32)     0.0000 (1.0)      22.4335 (5.32)     0.0000 (1.0)           0;0  0.0446 (0.19)          1           1
test_add_copy-add-noop[3.60.1]      4.2193 (1.0)       4.2193 (1.0)       4.2193 (1.0)      0.0000 (1.0)       4.2193 (1.0)      0.0000 (1.0)           0;0  0.2370 (1.0)           1           1
test_add_copy-add-noop[main]        4.4887 (1.06)      4.4887 (1.06)      4.4887 (1.06)     0.0000 (1.0)       4.4887 (1.06)     0.0000 (1.0)           0;0  0.2228 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.5135 (4.13)     66.5135 (4.13)     66.5135 (4.13)     0.0000 (1.0)      66.5135 (4.13)     0.0000 (1.0)           0;0  0.0150 (0.24)          1           1
test_add_hardlink-add[3.10.0]     67.1952 (4.17)     67.1952 (4.17)     67.1952 (4.17)     0.0000 (1.0)      67.1952 (4.17)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.7799 (3.90)     62.7799 (3.90)     62.7799 (3.90)     0.0000 (1.0)      62.7799 (3.90)     0.0000 (1.0)           0;0  0.0159 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.1119 (1.0)      16.1119 (1.0)      16.1119 (1.0)      0.0000 (1.0)      16.1119 (1.0)      0.0000 (1.0)           0;0  0.0621 (1.0)           1           1
test_add_hardlink-add[main]       17.7961 (1.10)     17.7961 (1.10)     17.7961 (1.10)     0.0000 (1.0)      17.7961 (1.10)     0.0000 (1.0)           0;0  0.0562 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.4242 (8.23)     33.4242 (8.23)     33.4242 (8.23)     0.0000 (1.0)      33.4242 (8.23)     0.0000 (1.0)           0;0  0.0299 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     33.9119 (8.35)     33.9119 (8.35)     33.9119 (8.35)     0.0000 (1.0)      33.9119 (8.35)     0.0000 (1.0)           0;0  0.0295 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     31.8527 (7.85)     31.8527 (7.85)     31.8527 (7.85)     0.0000 (1.0)      31.8527 (7.85)     0.0000 (1.0)           0;0  0.0314 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.0591 (1.0)       4.0591 (1.0)       4.0591 (1.0)      0.0000 (1.0)       4.0591 (1.0)      0.0000 (1.0)           0;0  0.2464 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.2552 (1.05)      4.2552 (1.05)      4.2552 (1.05)     0.0000 (1.0)       4.2552 (1.05)     0.0000 (1.0)           0;0  0.2350 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.7428 (1.90)     69.7428 (1.90)     69.7428 (1.90)     0.0000 (1.0)      69.7428 (1.90)     0.0000 (1.0)           0;0  0.0143 (0.53)          1           1
test_add_symlink-add[3.10.0]     70.4180 (1.92)     70.4180 (1.92)     70.4180 (1.92)     0.0000 (1.0)      70.4180 (1.92)     0.0000 (1.0)           0;0  0.0142 (0.52)          1           1
test_add_symlink-add[3.53.2]     65.3930 (1.78)     65.3930 (1.78)     65.3930 (1.78)     0.0000 (1.0)      65.3930 (1.78)     0.0000 (1.0)           0;0  0.0153 (0.56)          1           1
test_add_symlink-add[3.60.1]     36.6754 (1.0)      36.6754 (1.0)      36.6754 (1.0)      0.0000 (1.0)      36.6754 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
test_add_symlink-add[main]       38.4055 (1.05)     38.4055 (1.05)     38.4055 (1.05)     0.0000 (1.0)      38.4055 (1.05)     0.0000 (1.0)           0;0  0.0260 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.3133 (8.25)     45.3133 (8.25)     45.3133 (8.25)     0.0000 (1.0)      45.3133 (8.25)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.2702 (8.25)     45.2702 (8.25)     45.2702 (8.25)     0.0000 (1.0)      45.2702 (8.25)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.6908 (8.14)     44.6908 (8.14)     44.6908 (8.14)     0.0000 (1.0)      44.6908 (8.14)     0.0000 (1.0)           0;0  0.0224 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.4901 (1.0)       5.4901 (1.0)       5.4901 (1.0)      0.0000 (1.0)       5.4901 (1.0)      0.0000 (1.0)           0;0  0.1821 (1.0)           1           1
test_add_symlink-add-noop[main]        5.6940 (1.04)      5.6940 (1.04)      5.6940 (1.04)     0.0000 (1.0)       5.6940 (1.04)     0.0000 (1.0)           0;0  0.1756 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     27.3766 (2.15)     27.3766 (2.15)     27.3766 (2.15)     0.0000 (1.0)      27.3766 (2.15)     0.0000 (1.0)           0;0  0.0365 (0.46)          1           1
test_checkout_copy-checkout[3.10.0]     89.3327 (7.02)     89.3327 (7.02)     89.3327 (7.02)     0.0000 (1.0)      89.3327 (7.02)     0.0000 (1.0)           0;0  0.0112 (0.14)          1           1
test_checkout_copy-checkout[3.53.2]     17.1381 (1.35)     17.1381 (1.35)     17.1381 (1.35)     0.0000 (1.0)      17.1381 (1.35)     0.0000 (1.0)           0;0  0.0583 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     12.7195 (1.0)      12.7195 (1.0)      12.7195 (1.0)      0.0000 (1.0)      12.7195 (1.0)      0.0000 (1.0)           0;0  0.0786 (1.0)           1           1
test_checkout_copy-checkout[main]       13.9319 (1.10)     13.9319 (1.10)     13.9319 (1.10)     0.0000 (1.0)      13.9319 (1.10)     0.0000 (1.0)           0;0  0.0718 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     4.1255 (1.35)     4.1255 (1.35)     4.1255 (1.35)     0.0000 (1.0)      4.1255 (1.35)     0.0000 (1.0)           0;0  0.2424 (0.74)          1           1
test_checkout_copy-checkout-noop[3.10.0]     4.4127 (1.45)     4.4127 (1.45)     4.4127 (1.45)     0.0000 (1.0)      4.4127 (1.45)     0.0000 (1.0)           0;0  0.2266 (0.69)          1           1
test_checkout_copy-checkout-noop[3.53.2]     4.3133 (1.41)     4.3133 (1.41)     4.3133 (1.41)     0.0000 (1.0)      4.3133 (1.41)     0.0000 (1.0)           0;0  0.2318 (0.71)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.0483 (1.0)      3.0483 (1.0)      3.0483 (1.0)      0.0000 (1.0)      3.0483 (1.0)      0.0000 (1.0)           0;0  0.3281 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.1668 (1.04)     3.1668 (1.04)     3.1668 (1.04)     0.0000 (1.0)      3.1668 (1.04)     0.0000 (1.0)           0;0  0.3158 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     6.0340 (1.73)     6.0340 (1.73)     6.0340 (1.73)     0.0000 (1.0)      6.0340 (1.73)     0.0000 (1.0)           0;0  0.1657 (0.58)          1           1
test_checkout_copy-checkout-update[3.10.0]     5.0625 (1.45)     5.0625 (1.45)     5.0625 (1.45)     0.0000 (1.0)      5.0625 (1.45)     0.0000 (1.0)           0;0  0.1975 (0.69)          1           1
test_checkout_copy-checkout-update[3.53.2]     4.9712 (1.42)     4.9712 (1.42)     4.9712 (1.42)     0.0000 (1.0)      4.9712 (1.42)     0.0000 (1.0)           0;0  0.2012 (0.70)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.4934 (1.0)      3.4934 (1.0)      3.4934 (1.0)      0.0000 (1.0)      3.4934 (1.0)      0.0000 (1.0)           0;0  0.2863 (1.0)           1           1
test_checkout_copy-checkout-update[main]       3.8591 (1.10)     3.8591 (1.10)     3.8591 (1.10)     0.0000 (1.0)      3.8591 (1.10)     0.0000 (1.0)           0;0  0.2591 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     23.3324 (2.92)     23.3324 (2.92)     23.3324 (2.92)     0.0000 (1.0)      23.3324 (2.92)     0.0000 (1.0)           0;0  0.0429 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.2190 (2.15)     17.2190 (2.15)     17.2190 (2.15)     0.0000 (1.0)      17.2190 (2.15)     0.0000 (1.0)           0;0  0.0581 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.5232 (1.94)     15.5232 (1.94)     15.5232 (1.94)     0.0000 (1.0)      15.5232 (1.94)     0.0000 (1.0)           0;0  0.0644 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      8.0030 (1.0)       8.0030 (1.0)       8.0030 (1.0)      0.0000 (1.0)       8.0030 (1.0)      0.0000 (1.0)           0;0  0.1250 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.4612 (1.06)      8.4612 (1.06)      8.4612 (1.06)     0.0000 (1.0)       8.4612 (1.06)     0.0000 (1.0)           0;0  0.1182 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.0948 (1.77)     6.0948 (1.77)     6.0948 (1.77)     0.0000 (1.0)      6.0948 (1.77)     0.0000 (1.0)           0;0  0.1641 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8806 (1.71)     5.8806 (1.71)     5.8806 (1.71)     0.0000 (1.0)      5.8806 (1.71)     0.0000 (1.0)           0;0  0.1701 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7245 (1.66)     5.7245 (1.66)     5.7245 (1.66)     0.0000 (1.0)      5.7245 (1.66)     0.0000 (1.0)           0;0  0.1747 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.4477 (1.0)      3.4477 (1.0)      3.4477 (1.0)      0.0000 (1.0)      3.4477 (1.0)      0.0000 (1.0)           0;0  0.2901 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5440 (1.03)     3.5440 (1.03)     3.5440 (1.03)     0.0000 (1.0)      3.5440 (1.03)     0.0000 (1.0)           0;0  0.2822 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.1137 (1.99)     8.1137 (1.99)     8.1137 (1.99)     0.0000 (1.0)      8.1137 (1.99)     0.0000 (1.0)           0;0  0.1232 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5072 (1.60)     6.5072 (1.60)     6.5072 (1.60)     0.0000 (1.0)      6.5072 (1.60)     0.0000 (1.0)           0;0  0.1537 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.7004 (1.65)     6.7004 (1.65)     6.7004 (1.65)     0.0000 (1.0)      6.7004 (1.65)     0.0000 (1.0)           0;0  0.1492 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.0688 (1.0)      4.0688 (1.0)      4.0688 (1.0)      0.0000 (1.0)      4.0688 (1.0)      0.0000 (1.0)           0;0  0.2458 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4665 (1.10)     4.4665 (1.10)     4.4665 (1.10)     0.0000 (1.0)      4.4665 (1.10)     0.0000 (1.0)           0;0  0.2239 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     23.8074 (2.28)     23.8074 (2.28)     23.8074 (2.28)     0.0000 (1.0)      23.8074 (2.28)     0.0000 (1.0)           0;0  0.0420 (0.44)          1           1
test_checkout_symlink-checkout[3.10.0]     18.3340 (1.76)     18.3340 (1.76)     18.3340 (1.76)     0.0000 (1.0)      18.3340 (1.76)     0.0000 (1.0)           0;0  0.0545 (0.57)          1           1
test_checkout_symlink-checkout[3.53.2]     16.4800 (1.58)     16.4800 (1.58)     16.4800 (1.58)     0.0000 (1.0)      16.4800 (1.58)     0.0000 (1.0)           0;0  0.0607 (0.63)          1           1
test_checkout_symlink-checkout[3.60.1]     10.4212 (1.0)      10.4212 (1.0)      10.4212 (1.0)      0.0000 (1.0)      10.4212 (1.0)      0.0000 (1.0)           0;0  0.0960 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.3057 (1.08)     11.3057 (1.08)     11.3057 (1.08)     0.0000 (1.0)      11.3057 (1.08)     0.0000 (1.0)           0;0  0.0885 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     5.9902 (1.36)     5.9902 (1.36)     5.9902 (1.36)     0.0000 (1.0)      5.9902 (1.36)     0.0000 (1.0)           0;0  0.1669 (0.74)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.7328 (1.30)     5.7328 (1.30)     5.7328 (1.30)     0.0000 (1.0)      5.7328 (1.30)     0.0000 (1.0)           0;0  0.1744 (0.77)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     5.5351 (1.26)     5.5351 (1.26)     5.5351 (1.26)     0.0000 (1.0)      5.5351 (1.26)     0.0000 (1.0)           0;0  0.1807 (0.80)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.4073 (1.0)      4.4073 (1.0)      4.4073 (1.0)      0.0000 (1.0)      4.4073 (1.0)      0.0000 (1.0)           0;0  0.2269 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5304 (1.03)     4.5304 (1.03)     4.5304 (1.03)     0.0000 (1.0)      4.5304 (1.03)     0.0000 (1.0)           0;0  0.2207 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.0090 (1.49)     9.0090 (1.49)     9.0090 (1.49)     0.0000 (1.0)      9.0090 (1.49)     0.0000 (1.0)           0;0  0.1110 (0.67)          1           1
test_checkout_symlink-checkout-update[3.10.0]     7.4717 (1.23)     7.4717 (1.23)     7.4717 (1.23)     0.0000 (1.0)      7.4717 (1.23)     0.0000 (1.0)           0;0  0.1338 (0.81)          1           1
test_checkout_symlink-checkout-update[3.53.2]     7.4402 (1.23)     7.4402 (1.23)     7.4402 (1.23)     0.0000 (1.0)      7.4402 (1.23)     0.0000 (1.0)           0;0  0.1344 (0.82)          1           1
test_checkout_symlink-checkout-update[3.60.1]     6.0651 (1.0)      6.0651 (1.0)      6.0651 (1.0)      0.0000 (1.0)      6.0651 (1.0)      0.0000 (1.0)           0;0  0.1649 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.6193 (1.09)     6.6193 (1.09)     6.6193 (1.09)     0.0000 (1.0)      6.6193 (1.09)     0.0000 (1.0)           0;0  0.1511 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0592 (1.78)     4.0592 (1.78)     4.0592 (1.78)     0.0000 (1.0)      4.0592 (1.78)     0.0000 (1.0)           0;0  0.2464 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.9371 (2.16)     4.9371 (2.16)     4.9371 (2.16)     0.0000 (1.0)      4.9371 (2.16)     0.0000 (1.0)           0;0  0.2025 (0.46)          1           1
test_data_status-data-changed[3.53.2]     4.7604 (2.08)     4.7604 (2.08)     4.7604 (2.08)     0.0000 (1.0)      4.7604 (2.08)     0.0000 (1.0)           0;0  0.2101 (0.48)          1           1
test_data_status-data-changed[3.60.1]     2.2862 (1.0)      2.2862 (1.0)      2.2862 (1.0)      0.0000 (1.0)      2.2862 (1.0)      0.0000 (1.0)           0;0  0.4374 (1.0)           1           1
test_data_status-data-changed[main]       2.5844 (1.13)     2.5844 (1.13)     2.5844 (1.13)     0.0000 (1.0)      2.5844 (1.13)     0.0000 (1.0)           0;0  0.3869 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0932 (1.81)     4.0932 (1.81)     4.0932 (1.81)     0.0000 (1.0)      4.0932 (1.81)     0.0000 (1.0)           0;0  0.2443 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9040 (2.17)     4.9040 (2.17)     4.9040 (2.17)     0.0000 (1.0)      4.9040 (2.17)     0.0000 (1.0)           0;0  0.2039 (0.46)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8523 (2.14)     4.8523 (2.14)     4.8523 (2.14)     0.0000 (1.0)      4.8523 (2.14)     0.0000 (1.0)           0;0  0.2061 (0.47)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2625 (1.0)      2.2625 (1.0)      2.2625 (1.0)      0.0000 (1.0)      2.2625 (1.0)      0.0000 (1.0)           0;0  0.4420 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6265 (1.16)     2.6265 (1.16)     2.6265 (1.16)     0.0000 (1.0)      2.6265 (1.16)     0.0000 (1.0)           0;0  0.3807 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.7987 (3.80)     18.7987 (3.80)     18.7987 (3.80)     0.0000 (1.0)      18.7987 (3.80)     0.0000 (1.0)           0;0  0.0532 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.1377 (4.07)     20.1377 (4.07)     20.1377 (4.07)     0.0000 (1.0)      20.1377 (4.07)     0.0000 (1.0)           0;0  0.0497 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.3455 (3.91)     19.3455 (3.91)     19.3455 (3.91)     0.0000 (1.0)      19.3455 (3.91)     0.0000 (1.0)           0;0  0.0517 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9530 (1.0)       4.9530 (1.0)       4.9530 (1.0)      0.0000 (1.0)       4.9530 (1.0)      0.0000 (1.0)           0;0  0.2019 (1.0)           1           1
test_data_status-data-new[main]        5.1708 (1.04)      5.1708 (1.04)      5.1708 (1.04)     0.0000 (1.0)       5.1708 (1.04)     0.0000 (1.0)           0;0  0.1934 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.3016 (1.88)     4.3016 (1.88)     4.3016 (1.88)     0.0000 (1.0)      4.3016 (1.88)     0.0000 (1.0)           0;0  0.2325 (0.53)          1           1
test_data_status-data-noop[3.10.0]     4.9833 (2.18)     4.9833 (2.18)     4.9833 (2.18)     0.0000 (1.0)      4.9833 (2.18)     0.0000 (1.0)           0;0  0.2007 (0.46)          1           1
test_data_status-data-noop[3.53.2]     4.7303 (2.07)     4.7303 (2.07)     4.7303 (2.07)     0.0000 (1.0)      4.7303 (2.07)     0.0000 (1.0)           0;0  0.2114 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.2821 (1.0)      2.2821 (1.0)      2.2821 (1.0)      0.0000 (1.0)      2.2821 (1.0)      0.0000 (1.0)           0;0  0.4382 (1.0)           1           1
test_data_status-data-noop[main]       3.1201 (1.37)     3.1201 (1.37)     3.1201 (1.37)     0.0000 (1.0)      3.1201 (1.37)     0.0000 (1.0)           0;0  0.3205 (0.73)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.8935 (1.27)     6.8935 (1.27)     6.8935 (1.27)     0.0000 (1.0)      6.8935 (1.27)     0.0000 (1.0)           0;0  0.1451 (0.79)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8680 (1.45)     7.8680 (1.45)     7.8680 (1.45)     0.0000 (1.0)      7.8680 (1.45)     0.0000 (1.0)           0;0  0.1271 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8188 (1.44)     7.8188 (1.44)     7.8188 (1.44)     0.0000 (1.0)      7.8188 (1.44)     0.0000 (1.0)           0;0  0.1279 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4320 (1.0)      5.4320 (1.0)      5.4320 (1.0)      0.0000 (1.0)      5.4320 (1.0)      0.0000 (1.0)           0;0  0.1841 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.8574 (1.08)     5.8574 (1.08)     5.8574 (1.08)     0.0000 (1.0)      5.8574 (1.08)     0.0000 (1.0)           0;0  0.1707 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.9017 (1.25)     6.9017 (1.25)     6.9017 (1.25)     0.0000 (1.0)      6.9017 (1.25)     0.0000 (1.0)           0;0  0.1449 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     8.0059 (1.45)     8.0059 (1.45)     8.0059 (1.45)     0.0000 (1.0)      8.0059 (1.45)     0.0000 (1.0)           0;0  0.1249 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     8.0716 (1.46)     8.0716 (1.46)     8.0716 (1.46)     0.0000 (1.0)      8.0716 (1.46)     0.0000 (1.0)           0;0  0.1239 (0.68)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5159 (1.0)      5.5159 (1.0)      5.5159 (1.0)      0.0000 (1.0)      5.5159 (1.0)      0.0000 (1.0)           0;0  0.1813 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8797 (1.07)     5.8797 (1.07)     5.8797 (1.07)     0.0000 (1.0)      5.8797 (1.07)     0.0000 (1.0)           0;0  0.1701 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.6999 (2.70)     21.6999 (2.70)     21.6999 (2.70)     0.0000 (1.0)      21.6999 (2.70)     0.0000 (1.0)           0;0  0.0461 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.6096 (2.93)     23.6096 (2.93)     23.6096 (2.93)     0.0000 (1.0)      23.6096 (2.93)     0.0000 (1.0)           0;0  0.0424 (0.34)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.8586 (2.84)     22.8586 (2.84)     22.8586 (2.84)     0.0000 (1.0)      22.8586 (2.84)     0.0000 (1.0)           0;0  0.0437 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0501 (1.0)       8.0501 (1.0)       8.0501 (1.0)      0.0000 (1.0)       8.0501 (1.0)      0.0000 (1.0)           0;0  0.1242 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4086 (1.04)      8.4086 (1.04)      8.4086 (1.04)     0.0000 (1.0)       8.4086 (1.04)     0.0000 (1.0)           0;0  0.1189 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.3948 (1.34)     6.3948 (1.34)     6.3948 (1.34)     0.0000 (1.0)      6.3948 (1.34)     0.0000 (1.0)           0;0  0.1564 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.4620 (1.56)     7.4620 (1.56)     7.4620 (1.56)     0.0000 (1.0)      7.4620 (1.56)     0.0000 (1.0)           0;0  0.1340 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.4157 (1.55)     7.4157 (1.55)     7.4157 (1.55)     0.0000 (1.0)      7.4157 (1.55)     0.0000 (1.0)           0;0  0.1348 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7837 (1.0)      4.7837 (1.0)      4.7837 (1.0)      0.0000 (1.0)      4.7837 (1.0)      0.0000 (1.0)           0;0  0.2090 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0985 (1.07)     5.0985 (1.07)     5.0985 (1.07)     0.0000 (1.0)      5.0985 (1.07)     0.0000 (1.0)           0;0  0.1961 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.5983 (2.77)     18.5983 (2.77)     18.5983 (2.77)     0.0000 (1.0)      18.5983 (2.77)     0.0000 (1.0)           0;0  0.0538 (0.36)          1           1
test_diff-diff[3.10.0]     19.5333 (2.91)     19.5333 (2.91)     19.5333 (2.91)     0.0000 (1.0)      19.5333 (2.91)     0.0000 (1.0)           0;0  0.0512 (0.34)          1           1
test_diff-diff[3.53.2]     19.4536 (2.90)     19.4536 (2.90)     19.4536 (2.90)     0.0000 (1.0)      19.4536 (2.90)     0.0000 (1.0)           0;0  0.0514 (0.34)          1           1
test_diff-diff[3.60.1]      6.7038 (1.0)       6.7038 (1.0)       6.7038 (1.0)      0.0000 (1.0)       6.7038 (1.0)      0.0000 (1.0)           0;0  0.1492 (1.0)           1           1
test_diff-diff[main]        7.8284 (1.17)      7.8284 (1.17)      7.8284 (1.17)     0.0000 (1.0)       7.8284 (1.17)     0.0000 (1.0)           0;0  0.1277 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.8362 (1.82)     5.8362 (1.82)     5.8362 (1.82)     0.0000 (1.0)      5.8362 (1.82)     0.0000 (1.0)           0;0  0.1713 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.5185 (2.03)     6.5185 (2.03)     6.5185 (2.03)     0.0000 (1.0)      6.5185 (2.03)     0.0000 (1.0)           0;0  0.1534 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.5906 (1.74)     5.5906 (1.74)     5.5906 (1.74)     0.0000 (1.0)      5.5906 (1.74)     0.0000 (1.0)           0;0  0.1789 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.2065 (1.0)      3.2065 (1.0)      3.2065 (1.0)      0.0000 (1.0)      3.2065 (1.0)      0.0000 (1.0)           0;0  0.3119 (1.0)           1           1
test_diff-diff-changed[main]       4.0510 (1.26)     4.0510 (1.26)     4.0510 (1.26)     0.0000 (1.0)      4.0510 (1.26)     0.0000 (1.0)           0;0  0.2469 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1391 (1.58)     5.1391 (1.58)     5.1391 (1.58)     0.0000 (1.0)      5.1391 (1.58)     0.0000 (1.0)           0;0  0.1946 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6038 (1.73)     5.6038 (1.73)     5.6038 (1.73)     0.0000 (1.0)      5.6038 (1.73)     0.0000 (1.0)           0;0  0.1785 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4170 (1.67)     5.4170 (1.67)     5.4170 (1.67)     0.0000 (1.0)      5.4170 (1.67)     0.0000 (1.0)           0;0  0.1846 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2434 (1.0)      3.2434 (1.0)      3.2434 (1.0)      0.0000 (1.0)      3.2434 (1.0)      0.0000 (1.0)           0;0  0.3083 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0528 (1.25)     4.0528 (1.25)     4.0528 (1.25)     0.0000 (1.0)      4.0528 (1.25)     0.0000 (1.0)           0;0  0.2467 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1130 (1.28)     4.1130 (1.28)     4.1130 (1.28)     0.0000 (1.0)      4.1130 (1.28)     0.0000 (1.0)           0;0  0.2431 (0.78)          1           1
test_diff-diff-noop[3.10.0]     4.7176 (1.47)     4.7176 (1.47)     4.7176 (1.47)     0.0000 (1.0)      4.7176 (1.47)     0.0000 (1.0)           0;0  0.2120 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.6653 (1.76)     5.6653 (1.76)     5.6653 (1.76)     0.0000 (1.0)      5.6653 (1.76)     0.0000 (1.0)           0;0  0.1765 (0.57)          1           1
test_diff-diff-noop[3.60.1]     3.2139 (1.0)      3.2139 (1.0)      3.2139 (1.0)      0.0000 (1.0)      3.2139 (1.0)      0.0000 (1.0)           0;0  0.3111 (1.0)           1           1
test_diff-diff-noop[main]       3.9979 (1.24)     3.9979 (1.24)     3.9979 (1.24)     0.0000 (1.0)      3.9979 (1.24)     0.0000 (1.0)           0;0  0.2501 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.2061 (1.0)      1.2061 (1.0)      1.2061 (1.0)      0.0000 (1.0)      1.2061 (1.0)      0.0000 (1.0)           0;0  0.8291 (1.0)           1           1
test_exp_show-exp[3.10.0]     3.7764 (3.13)     3.7764 (3.13)     3.7764 (3.13)     0.0000 (1.0)      3.7764 (3.13)     0.0000 (1.0)           0;0  0.2648 (0.32)          1           1
test_exp_show-exp[3.53.2]     3.3236 (2.76)     3.3236 (2.76)     3.3236 (2.76)     0.0000 (1.0)      3.3236 (2.76)     0.0000 (1.0)           0;0  0.3009 (0.36)          1           1
test_exp_show-exp[3.60.1]     2.8252 (2.34)     2.8252 (2.34)     2.8252 (2.34)     0.0000 (1.0)      2.8252 (2.34)     0.0000 (1.0)           0;0  0.3540 (0.43)          1           1
test_exp_show-exp[main]       5.9732 (4.95)     5.9732 (4.95)     5.9732 (4.95)     0.0000 (1.0)      5.9732 (4.95)     0.0000 (1.0)           0;0  0.1674 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     113.5969 (4.69)     113.5969 (4.69)     113.5969 (4.69)     0.0000 (1.0)      113.5969 (4.69)     0.0000 (1.0)           0;0  0.0088 (0.21)          1           1
test_fetch-fetch[3.10.0]     121.6481 (5.02)     121.6481 (5.02)     121.6481 (5.02)     0.0000 (1.0)      121.6481 (5.02)     0.0000 (1.0)           0;0  0.0082 (0.20)          1           1
test_fetch-fetch[3.53.2]      34.9583 (1.44)      34.9583 (1.44)      34.9583 (1.44)     0.0000 (1.0)       34.9583 (1.44)     0.0000 (1.0)           0;0  0.0286 (0.69)          1           1
test_fetch-fetch[3.60.1]      24.2361 (1.0)       24.2361 (1.0)       24.2361 (1.0)      0.0000 (1.0)       24.2361 (1.0)      0.0000 (1.0)           0;0  0.0413 (1.0)           1           1
test_fetch-fetch[main]        24.2673 (1.00)      24.2673 (1.00)      24.2673 (1.00)     0.0000 (1.0)       24.2673 (1.00)     0.0000 (1.0)           0;0  0.0412 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8224 (1.0)      2.8224 (1.0)      2.8224 (1.0)      0.0000 (1.0)      2.8224 (1.0)      0.0000 (1.0)           0;0  0.3543 (1.0)           1           1
test_gc-gc[3.10.0]     3.1071 (1.10)     3.1071 (1.10)     3.1071 (1.10)     0.0000 (1.0)      3.1071 (1.10)     0.0000 (1.0)           0;0  0.3218 (0.91)          1           1
test_gc-gc[3.53.2]     2.8619 (1.01)     2.8619 (1.01)     2.8619 (1.01)     0.0000 (1.0)      2.8619 (1.01)     0.0000 (1.0)           0;0  0.3494 (0.99)          1           1
test_gc-gc[3.60.1]     2.9524 (1.05)     2.9524 (1.05)     2.9524 (1.05)     0.0000 (1.0)      2.9524 (1.05)     0.0000 (1.0)           0;0  0.3387 (0.96)          1           1
test_gc-gc[main]       3.1967 (1.13)     3.1967 (1.13)     3.1967 (1.13)     0.0000 (1.0)      3.1967 (1.13)     0.0000 (1.0)           0;0  0.3128 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     181.6211 (3.42)     181.6211 (3.42)     181.6211 (3.42)     0.0000 (1.0)      181.6211 (3.42)     0.0000 (1.0)           0;0  0.0055 (0.29)          1           1
test_get-get[3.10.0]     217.0554 (4.09)     217.0554 (4.09)     217.0554 (4.09)     0.0000 (1.0)      217.0554 (4.09)     0.0000 (1.0)           0;0  0.0046 (0.24)          1           1
test_get-get[3.53.2]     163.9015 (3.09)     163.9015 (3.09)     163.9015 (3.09)     0.0000 (1.0)      163.9015 (3.09)     0.0000 (1.0)           0;0  0.0061 (0.32)          1           1
test_get-get[3.60.1]      53.0606 (1.0)       53.0606 (1.0)       53.0606 (1.0)      0.0000 (1.0)       53.0606 (1.0)      0.0000 (1.0)           0;0  0.0188 (1.0)           1           1
test_get-get[main]        53.3240 (1.00)      53.3240 (1.00)      53.3240 (1.00)     0.0000 (1.0)       53.3240 (1.00)     0.0000 (1.0)           0;0  0.0188 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     88.5451 (5.21)     88.5451 (5.21)     88.5451 (5.21)     0.0000 (1.0)      88.5451 (5.21)     0.0000 (1.0)           0;0  0.0113 (0.19)          1           1
test_get_url-get-url[3.10.0]     91.7007 (5.40)     91.7007 (5.40)     91.7007 (5.40)     0.0000 (1.0)      91.7007 (5.40)     0.0000 (1.0)           0;0  0.0109 (0.19)          1           1
test_get_url-get-url[3.53.2]     17.1276 (1.01)     17.1276 (1.01)     17.1276 (1.01)     0.0000 (1.0)      17.1276 (1.01)     0.0000 (1.0)           0;0  0.0584 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.9818 (1.0)      16.9818 (1.0)      16.9818 (1.0)      0.0000 (1.0)      16.9818 (1.0)      0.0000 (1.0)           0;0  0.0589 (1.0)           1           1
test_get_url-get-url[main]       17.1496 (1.01)     17.1496 (1.01)     17.1496 (1.01)     0.0000 (1.0)      17.1496 (1.01)     0.0000 (1.0)           0;0  0.0583 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     152.9310 (1.05)     165.6006 (1.05)     157.7892 (1.07)     2.9196 (1.78)     157.4989 (1.07)     4.2618 (2.12)         35;0  6.3376 (0.94)        100           1
test_help---help[3.10.0]     150.6522 (1.03)     161.4498 (1.03)     154.7377 (1.05)     2.2561 (1.37)     154.5869 (1.05)     3.3617 (1.67)         34;1  6.4625 (0.96)        100           1
test_help---help[3.53.2]     152.9399 (1.05)     160.6756 (1.02)     156.2692 (1.06)     1.6440 (1.0)      156.0239 (1.06)     2.0134 (1.0)          32;2  6.3992 (0.95)        100           1
test_help---help[3.60.1]     153.6022 (1.05)     166.3336 (1.06)     156.2194 (1.06)     1.9914 (1.21)     156.0215 (1.06)     2.2919 (1.14)         24;3  6.4013 (0.95)        100           1
test_help---help[main]       145.7278 (1.0)      157.2741 (1.0)      147.8323 (1.0)      1.7839 (1.09)     147.3099 (1.0)      2.2783 (1.13)         23;2  6.7644 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     272.6482 (3.33)     272.6482 (3.33)     272.6482 (3.33)     0.0000 (1.0)      272.6482 (3.33)     0.0000 (1.0)           0;0  0.0037 (0.30)          1           1
test_import-import[3.10.0]     306.5293 (3.74)     306.5293 (3.74)     306.5293 (3.74)     0.0000 (1.0)      306.5293 (3.74)     0.0000 (1.0)           0;0  0.0033 (0.27)          1           1
test_import-import[3.60.1]      81.9076 (1.0)       81.9076 (1.0)       81.9076 (1.0)      0.0000 (1.0)       81.9076 (1.0)      0.0000 (1.0)           0;0  0.0122 (1.0)           1           1
test_import-import[main]        82.0456 (1.00)      82.0456 (1.00)      82.0456 (1.00)     0.0000 (1.0)       82.0456 (1.00)     0.0000 (1.0)           0;0  0.0122 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     203.4877 (4.30)     203.4877 (4.30)     203.4877 (4.30)     0.0000 (1.0)      203.4877 (4.30)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.10.0]     206.4949 (4.36)     206.4949 (4.36)     206.4949 (4.36)     0.0000 (1.0)      206.4949 (4.36)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_import_url-import-url[3.53.2]     117.0912 (2.47)     117.0912 (2.47)     117.0912 (2.47)     0.0000 (1.0)      117.0912 (2.47)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_import_url-import-url[3.60.1]      47.3524 (1.0)       47.3524 (1.0)       47.3524 (1.0)      0.0000 (1.0)       47.3524 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
test_import_url-import-url[main]        48.8168 (1.03)      48.8168 (1.03)      48.8168 (1.03)     0.0000 (1.0)       48.8168 (1.03)     0.0000 (1.0)           0;0  0.0205 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     400.6205 (1.03)     434.5831 (1.02)     410.0185 (1.02)      7.5426 (1.0)      407.7670 (1.03)      7.8808 (1.83)         24;6  2.4389 (0.98)        100           1
test_init-init[3.10.0]     407.2960 (1.05)     666.6270 (1.56)     423.9536 (1.06)     26.1772 (3.47)     418.9014 (1.05)     14.8460 (3.45)          2;1  2.3587 (0.94)        100           1
test_init-init[3.53.2]     388.7161 (1.0)      427.8082 (1.0)      400.1535 (1.0)       7.7886 (1.03)     398.9512 (1.00)     10.6067 (2.47)         31;2  2.4990 (1.0)         100           1
test_init-init[3.60.1]     390.7449 (1.01)     437.8118 (1.02)     400.5814 (1.00)      9.1947 (1.22)     397.6022 (1.0)       8.6798 (2.02)         16;6  2.4964 (1.00)        100           1
test_init-init[main]       428.9506 (1.10)     502.9975 (1.18)     436.7924 (1.09)      9.2210 (1.22)     433.8829 (1.09)      4.2992 (1.0)          8;10  2.2894 (0.92)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     558.8419 (1.03)     558.8419 (1.03)     558.8419 (1.03)     0.0000 (1.0)      558.8419 (1.03)     0.0000 (1.0)           0;0  1.7894 (0.97)          1           1
test_list-list[3.10.0]     824.6226 (1.52)     824.6226 (1.52)     824.6226 (1.52)     0.0000 (1.0)      824.6226 (1.52)     0.0000 (1.0)           0;0  1.2127 (0.66)          1           1
test_list-list[3.53.2]     581.7593 (1.07)     581.7593 (1.07)     581.7593 (1.07)     0.0000 (1.0)      581.7593 (1.07)     0.0000 (1.0)           0;0  1.7189 (0.93)          1           1
test_list-list[3.60.1]     578.8250 (1.06)     578.8250 (1.06)     578.8250 (1.06)     0.0000 (1.0)      578.8250 (1.06)     0.0000 (1.0)           0;0  1.7276 (0.94)          1           1
test_list-list[main]       543.8125 (1.0)      543.8125 (1.0)      543.8125 (1.0)      0.0000 (1.0)      543.8125 (1.0)      0.0000 (1.0)           0;0  1.8389 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     391.1832 (1.05)     391.1832 (1.05)     391.1832 (1.05)     0.0000 (1.0)      391.1832 (1.05)     0.0000 (1.0)           0;0  2.5563 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     399.4404 (1.07)     399.4404 (1.07)     399.4404 (1.07)     0.0000 (1.0)      399.4404 (1.07)     0.0000 (1.0)           0;0  2.5035 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     482.8584 (1.29)     482.8584 (1.29)     482.8584 (1.29)     0.0000 (1.0)      482.8584 (1.29)     0.0000 (1.0)           0;0  2.0710 (0.77)          1           1
test_list-list-dvc-only[3.60.1]     372.9879 (1.0)      372.9879 (1.0)      372.9879 (1.0)      0.0000 (1.0)      372.9879 (1.0)      0.0000 (1.0)           0;0  2.6811 (1.0)           1           1
test_list-list-dvc-only[main]       381.1270 (1.02)     381.1270 (1.02)     381.1270 (1.02)     0.0000 (1.0)      381.1270 (1.02)     0.0000 (1.0)           0;0  2.6238 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.2943 (1.0)      2.2943 (1.0)      2.2943 (1.0)      0.0000 (1.0)      2.2943 (1.0)      0.0000 (1.0)           0;0  0.4359 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.3887 (1.04)     2.3887 (1.04)     2.3887 (1.04)     0.0000 (1.0)      2.3887 (1.04)     0.0000 (1.0)           0;0  0.4186 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.4348 (1.06)     2.4348 (1.06)     2.4348 (1.06)     0.0000 (1.0)      2.4348 (1.06)     0.0000 (1.0)           0;0  0.4107 (0.94)          1           1
test_list-list-recursive[3.60.1]     2.4571 (1.07)     2.4571 (1.07)     2.4571 (1.07)     0.0000 (1.0)      2.4571 (1.07)     0.0000 (1.0)           0;0  0.4070 (0.93)          1           1
test_list-list-recursive[main]       2.5142 (1.10)     2.5142 (1.10)     2.5142 (1.10)     0.0000 (1.0)      2.5142 (1.10)     0.0000 (1.0)           0;0  0.3977 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     387.4966 (1.05)     387.4966 (1.05)     387.4966 (1.05)     0.0000 (1.0)      387.4966 (1.05)     0.0000 (1.0)           0;0  2.5807 (0.95)          1           1
test_list-list-shallow[3.10.0]     385.8015 (1.04)     385.8015 (1.04)     385.8015 (1.04)     0.0000 (1.0)      385.8015 (1.04)     0.0000 (1.0)           0;0  2.5920 (0.96)          1           1
test_list-list-shallow[3.53.2]     373.1630 (1.01)     373.1630 (1.01)     373.1630 (1.01)     0.0000 (1.0)      373.1630 (1.01)     0.0000 (1.0)           0;0  2.6798 (0.99)          1           1
test_list-list-shallow[3.60.1]     369.4030 (1.0)      369.4030 (1.0)      369.4030 (1.0)      0.0000 (1.0)      369.4030 (1.0)      0.0000 (1.0)           0;0  2.7071 (1.0)           1           1
test_list-list-shallow[main]       394.0498 (1.07)     394.0498 (1.07)     394.0498 (1.07)     0.0000 (1.0)      394.0498 (1.07)     0.0000 (1.0)           0;0  2.5377 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.4319 (2.91)     12.4319 (2.91)     12.4319 (2.91)     0.0000 (1.0)      12.4319 (2.91)     0.0000 (1.0)           0;0  0.0804 (0.34)          1           1
test_partial_add-add[3.10.0]     12.8964 (3.02)     12.8964 (3.02)     12.8964 (3.02)     0.0000 (1.0)      12.8964 (3.02)     0.0000 (1.0)           0;0  0.0775 (0.33)          1           1
test_partial_add-add[3.53.2]     11.3650 (2.66)     11.3650 (2.66)     11.3650 (2.66)     0.0000 (1.0)      11.3650 (2.66)     0.0000 (1.0)           0;0  0.0880 (0.38)          1           1
test_partial_add-add[3.60.1]      4.2762 (1.0)       4.2762 (1.0)       4.2762 (1.0)      0.0000 (1.0)       4.2762 (1.0)      0.0000 (1.0)           0;0  0.2338 (1.0)           1           1
test_partial_add-add[main]        4.9630 (1.16)      4.9630 (1.16)      4.9630 (1.16)     0.0000 (1.0)       4.9630 (1.16)     0.0000 (1.0)           0;0  0.2015 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     81.5246 (3.84)     81.5246 (3.84)     81.5246 (3.84)     0.0000 (1.0)      81.5246 (3.84)     0.0000 (1.0)           0;0  0.0123 (0.26)          1           1
test_partial_add-add-partial[3.10.0]     81.5651 (3.84)     81.5651 (3.84)     81.5651 (3.84)     0.0000 (1.0)      81.5651 (3.84)     0.0000 (1.0)           0;0  0.0123 (0.26)          1           1
test_partial_add-add-partial[3.53.2]     73.4860 (3.46)     73.4860 (3.46)     73.4860 (3.46)     0.0000 (1.0)      73.4860 (3.46)     0.0000 (1.0)           0;0  0.0136 (0.29)          1           1
test_partial_add-add-partial[3.60.1]     21.2459 (1.0)      21.2459 (1.0)      21.2459 (1.0)      0.0000 (1.0)      21.2459 (1.0)      0.0000 (1.0)           0;0  0.0471 (1.0)           1           1
test_partial_add-add-partial[main]       21.4585 (1.01)     21.4585 (1.01)     21.4585 (1.01)     0.0000 (1.0)      21.4585 (1.01)     0.0000 (1.0)           0;0  0.0466 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.7153 (1.0)      4.7153 (1.0)      4.7153 (1.0)      0.0000 (1.0)      4.7153 (1.0)      0.0000 (1.0)           0;0  0.2121 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.2310 (1.32)     6.2310 (1.32)     6.2310 (1.32)     0.0000 (1.0)      6.2310 (1.32)     0.0000 (1.0)           0;0  0.1605 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1519 (1.52)     7.1519 (1.52)     7.1519 (1.52)     0.0000 (1.0)      7.1519 (1.52)     0.0000 (1.0)           0;0  0.1398 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.2706 (1.54)     7.2706 (1.54)     7.2706 (1.54)     0.0000 (1.0)      7.2706 (1.54)     0.0000 (1.0)           0;0  0.1375 (0.65)          1           1
test_partial_add-gc-cloud-noop[main]       6.3823 (1.35)     6.3823 (1.35)     6.3823 (1.35)     0.0000 (1.0)      6.3823 (1.35)     0.0000 (1.0)           0;0  0.1567 (0.74)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7618 (1.0)      2.7618 (1.0)      2.7618 (1.0)      0.0000 (1.0)      2.7618 (1.0)      0.0000 (1.0)           0;0  0.3621 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9684 (1.44)     3.9684 (1.44)     3.9684 (1.44)     0.0000 (1.0)      3.9684 (1.44)     0.0000 (1.0)           0;0  0.2520 (0.70)          1           1
test_partial_add-gc-noop[3.53.2]     4.0007 (1.45)     4.0007 (1.45)     4.0007 (1.45)     0.0000 (1.0)      4.0007 (1.45)     0.0000 (1.0)           0;0  0.2500 (0.69)          1           1
test_partial_add-gc-noop[3.60.1]     4.0671 (1.47)     4.0671 (1.47)     4.0671 (1.47)     0.0000 (1.0)      4.0671 (1.47)     0.0000 (1.0)           0;0  0.2459 (0.68)          1           1
test_partial_add-gc-noop[main]       3.2266 (1.17)     3.2266 (1.17)     3.2266 (1.17)     0.0000 (1.0)      3.2266 (1.17)     0.0000 (1.0)           0;0  0.3099 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.8911 (3.90)     14.8911 (3.90)     14.8911 (3.90)     0.0000 (1.0)      14.8911 (3.90)     0.0000 (1.0)           0;0  0.0672 (0.26)          1           1
test_partial_add-push[3.10.0]      7.3617 (1.93)      7.3617 (1.93)      7.3617 (1.93)     0.0000 (1.0)       7.3617 (1.93)     0.0000 (1.0)           0;0  0.1358 (0.52)          1           1
test_partial_add-push[3.53.2]      3.8984 (1.02)      3.8984 (1.02)      3.8984 (1.02)     0.0000 (1.0)       3.8984 (1.02)     0.0000 (1.0)           0;0  0.2565 (0.98)          1           1
test_partial_add-push[3.60.1]      3.8178 (1.0)       3.8178 (1.0)       3.8178 (1.0)      0.0000 (1.0)       3.8178 (1.0)      0.0000 (1.0)           0;0  0.2619 (1.0)           1           1
test_partial_add-push[main]        4.0744 (1.07)      4.0744 (1.07)      4.0744 (1.07)     0.0000 (1.0)       4.0744 (1.07)     0.0000 (1.0)           0;0  0.2454 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     88.9669 (4.18)     88.9669 (4.18)     88.9669 (4.18)     0.0000 (1.0)      88.9669 (4.18)     0.0000 (1.0)           0;0  0.0112 (0.24)          1           1
test_partial_add-push-partial[3.10.0]     43.0906 (2.02)     43.0906 (2.02)     43.0906 (2.02)     0.0000 (1.0)      43.0906 (2.02)     0.0000 (1.0)           0;0  0.0232 (0.49)          1           1
test_partial_add-push-partial[3.53.2]     22.7302 (1.07)     22.7302 (1.07)     22.7302 (1.07)     0.0000 (1.0)      22.7302 (1.07)     0.0000 (1.0)           0;0  0.0440 (0.94)          1           1
test_partial_add-push-partial[3.60.1]     21.6771 (1.02)     21.6771 (1.02)     21.6771 (1.02)     0.0000 (1.0)      21.6771 (1.02)     0.0000 (1.0)           0;0  0.0461 (0.98)          1           1
test_partial_add-push-partial[main]       21.3025 (1.0)      21.3025 (1.0)      21.3025 (1.0)      0.0000 (1.0)      21.3025 (1.0)      0.0000 (1.0)           0;0  0.0469 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     56.5488 (4.00)     56.5488 (4.00)     56.5488 (4.00)     0.0000 (1.0)      56.5488 (4.00)     0.0000 (1.0)           0;0  0.0177 (0.25)          1           1
test_partial_remove-add[3.10.0]     57.4406 (4.06)     57.4406 (4.06)     57.4406 (4.06)     0.0000 (1.0)      57.4406 (4.06)     0.0000 (1.0)           0;0  0.0174 (0.25)          1           1
test_partial_remove-add[3.53.2]     50.5332 (3.57)     50.5332 (3.57)     50.5332 (3.57)     0.0000 (1.0)      50.5332 (3.57)     0.0000 (1.0)           0;0  0.0198 (0.28)          1           1
test_partial_remove-add[3.60.1]     14.1472 (1.0)      14.1472 (1.0)      14.1472 (1.0)      0.0000 (1.0)      14.1472 (1.0)      0.0000 (1.0)           0;0  0.0707 (1.0)           1           1
test_partial_remove-add[main]       15.7040 (1.11)     15.7040 (1.11)     15.7040 (1.11)     0.0000 (1.0)      15.7040 (1.11)     0.0000 (1.0)           0;0  0.0637 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     31.3975 (9.67)     31.3975 (9.67)     31.3975 (9.67)     0.0000 (1.0)      31.3975 (9.67)     0.0000 (1.0)           0;0  0.0318 (0.10)          1           1
test_partial_remove-add-update[3.10.0]     31.8479 (9.80)     31.8479 (9.80)     31.8479 (9.80)     0.0000 (1.0)      31.8479 (9.80)     0.0000 (1.0)           0;0  0.0314 (0.10)          1           1
test_partial_remove-add-update[3.53.2]     27.8733 (8.58)     27.8733 (8.58)     27.8733 (8.58)     0.0000 (1.0)      27.8733 (8.58)     0.0000 (1.0)           0;0  0.0359 (0.12)          1           1
test_partial_remove-add-update[3.60.1]      3.2484 (1.0)       3.2484 (1.0)       3.2484 (1.0)      0.0000 (1.0)       3.2484 (1.0)      0.0000 (1.0)           0;0  0.3078 (1.0)           1           1
test_partial_remove-add-update[main]        3.2950 (1.01)      3.2950 (1.01)      3.2950 (1.01)     0.0000 (1.0)       3.2950 (1.01)     0.0000 (1.0)           0;0  0.3035 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.2795 (1.0)      2.2795 (1.0)      2.2795 (1.0)      0.0000 (1.0)      2.2795 (1.0)      0.0000 (1.0)           0;0  0.4387 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.3308 (1.46)     3.3308 (1.46)     3.3308 (1.46)     0.0000 (1.0)      3.3308 (1.46)     0.0000 (1.0)           0;0  0.3002 (0.68)          1           1
test_partial_remove-gc[3.53.2]     3.3292 (1.46)     3.3292 (1.46)     3.3292 (1.46)     0.0000 (1.0)      3.3292 (1.46)     0.0000 (1.0)           0;0  0.3004 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.3097 (1.45)     3.3097 (1.45)     3.3097 (1.45)     0.0000 (1.0)      3.3097 (1.45)     0.0000 (1.0)           0;0  0.3021 (0.69)          1           1
test_partial_remove-gc[main]       2.5488 (1.12)     2.5488 (1.12)     2.5488 (1.12)     0.0000 (1.0)      2.5488 (1.12)     0.0000 (1.0)           0;0  0.3923 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.1452 (1.0)      4.1452 (1.0)      4.1452 (1.0)      0.0000 (1.0)      4.1452 (1.0)      0.0000 (1.0)           0;0  0.2412 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.6687 (1.37)     5.6687 (1.37)     5.6687 (1.37)     0.0000 (1.0)      5.6687 (1.37)     0.0000 (1.0)           0;0  0.1764 (0.73)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.0205 (1.45)     6.0205 (1.45)     6.0205 (1.45)     0.0000 (1.0)      6.0205 (1.45)     0.0000 (1.0)           0;0  0.1661 (0.69)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.0161 (1.45)     6.0161 (1.45)     6.0161 (1.45)     0.0000 (1.0)      6.0161 (1.45)     0.0000 (1.0)           0;0  0.1662 (0.69)          1           1
test_partial_remove-gc-cloud[main]       5.2201 (1.26)     5.2201 (1.26)     5.2201 (1.26)     0.0000 (1.0)      5.2201 (1.26)     0.0000 (1.0)           0;0  0.1916 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     82.1592 (5.85)     82.1592 (5.85)     82.1592 (5.85)     0.0000 (1.0)      82.1592 (5.85)     0.0000 (1.0)           0;0  0.0122 (0.17)          1           1
test_partial_remove-push[3.10.0]     35.3428 (2.52)     35.3428 (2.52)     35.3428 (2.52)     0.0000 (1.0)      35.3428 (2.52)     0.0000 (1.0)           0;0  0.0283 (0.40)          1           1
test_partial_remove-push[3.53.2]     14.9352 (1.06)     14.9352 (1.06)     14.9352 (1.06)     0.0000 (1.0)      14.9352 (1.06)     0.0000 (1.0)           0;0  0.0670 (0.94)          1           1
test_partial_remove-push[3.60.1]     14.0495 (1.0)      14.0495 (1.0)      14.0495 (1.0)      0.0000 (1.0)      14.0495 (1.0)      0.0000 (1.0)           0;0  0.0712 (1.0)           1           1
test_partial_remove-push[main]       14.3281 (1.02)     14.3281 (1.02)     14.3281 (1.02)     0.0000 (1.0)      14.3281 (1.02)     0.0000 (1.0)           0;0  0.0698 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.3342 (1.0)      3.3342 (1.0)      3.3342 (1.0)      0.0000 (1.0)      3.3342 (1.0)      0.0000 (1.0)           0;0  0.2999 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.4977 (1.05)     3.4977 (1.05)     3.4977 (1.05)     0.0000 (1.0)      3.4977 (1.05)     0.0000 (1.0)           0;0  0.2859 (0.95)          1           1
test_partial_remove-push-update[3.53.2]     6.0395 (1.81)     6.0395 (1.81)     6.0395 (1.81)     0.0000 (1.0)      6.0395 (1.81)     0.0000 (1.0)           0;0  0.1656 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     6.1052 (1.83)     6.1052 (1.83)     6.1052 (1.83)     0.0000 (1.0)      6.1052 (1.83)     0.0000 (1.0)           0;0  0.1638 (0.55)          1           1
test_partial_remove-push-update[main]       6.1403 (1.84)     6.1403 (1.84)     6.1403 (1.84)     0.0000 (1.0)      6.1403 (1.84)     0.0000 (1.0)           0;0  0.1629 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     545.3969 (1.0)        559.9121 (1.0)        550.1410 (1.0)      5.8241 (1.73)       549.3974 (1.0)       6.6240 (1.36)          1;0  1.8177 (1.0)           5           3
test_plots-plots-diff[3.10.0]     995.0892 (1.82)     1,003.3390 (1.79)     1,000.0969 (1.82)     3.3594 (1.0)      1,001.6851 (1.82)      4.8719 (1.0)           1;0  0.9999 (0.55)          5           3
test_plots-plots-diff[3.53.2]     968.7479 (1.78)       981.8918 (1.75)       973.1089 (1.77)     5.8862 (1.75)       969.5866 (1.76)      9.0587 (1.86)          1;0  1.0276 (0.57)          5           3
test_plots-plots-diff[3.60.1]     966.4707 (1.77)       977.0692 (1.75)       972.3872 (1.77)     4.0129 (1.19)       973.5599 (1.77)      5.2716 (1.08)          2;0  1.0284 (0.57)          5           3
test_plots-plots-diff[main]       976.9009 (1.79)       996.9615 (1.78)       984.3677 (1.79)     8.2486 (2.46)       980.8124 (1.79)     12.0451 (2.47)          1;0  1.0159 (0.56)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       561.1235 (1.0)        563.9665 (1.0)        562.7497 (1.0)      1.3477 (1.0)        563.5276 (1.0)       2.3768 (1.22)          1;0  1.7770 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,224.8853 (2.18)     1,230.9073 (2.18)     1,227.9741 (2.18)     2.1430 (1.59)     1,228.1930 (2.18)      1.9505 (1.0)           2;0  0.8143 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]     1,035.2210 (1.84)     1,042.8407 (1.85)     1,040.3244 (1.85)     3.2663 (2.42)     1,041.8226 (1.85)      4.8025 (2.46)          1;0  0.9612 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]     1,034.4310 (1.84)     1,047.7898 (1.86)     1,042.1783 (1.85)     5.1755 (3.84)     1,041.7619 (1.85)      7.0447 (3.61)          2;0  0.9595 (0.54)          5           3
test_plots-plots-diff-json[main]       1,052.5167 (1.88)     1,065.6480 (1.89)     1,058.7600 (1.88)     5.9677 (4.43)     1,056.8773 (1.88)     10.9107 (5.59)          2;0  0.9445 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     441.6178 (1.0)      445.3553 (1.0)      443.6270 (1.0)      1.5012 (1.0)      444.0419 (1.0)      2.3611 (1.0)           2;0  2.2541 (1.0)           5           3
test_plots-plots-show[3.10.0]     811.3260 (1.84)     817.2295 (1.84)     814.4520 (1.84)     2.1549 (1.44)     814.7755 (1.83)     2.5272 (1.07)          2;0  1.2278 (0.54)          5           3
test_plots-plots-show[3.53.2]     799.0993 (1.81)     804.1985 (1.81)     802.4674 (1.81)     2.0521 (1.37)     802.5946 (1.81)     2.5057 (1.06)          1;0  1.2462 (0.55)          5           3
test_plots-plots-show[3.60.1]     796.8084 (1.80)     809.8976 (1.82)     801.7791 (1.81)     5.0379 (3.36)     799.6079 (1.80)     5.8077 (2.46)          1;0  1.2472 (0.55)          5           3
test_plots-plots-show[main]       810.8059 (1.84)     818.7073 (1.84)     813.9460 (1.83)     2.9251 (1.95)     813.2945 (1.83)     2.9239 (1.24)          2;0  1.2286 (0.55)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     452.7621 (1.0)      458.4045 (1.0)      455.1623 (1.0)      2.1512 (1.0)      455.4590 (1.0)      2.7104 (1.0)           2;0  2.1970 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     937.8951 (2.07)     953.5555 (2.08)     945.0975 (2.08)     6.0560 (2.82)     946.1558 (2.08)     8.5974 (3.17)          2;0  1.0581 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     844.7150 (1.87)     852.9617 (1.86)     849.1362 (1.87)     3.6402 (1.69)     850.3404 (1.87)     6.4591 (2.38)          2;0  1.1777 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     842.1587 (1.86)     852.8736 (1.86)     846.7325 (1.86)     4.2549 (1.98)     845.4586 (1.86)     6.3709 (2.35)          2;0  1.1810 (0.54)          5           3
test_plots-plots-show-json[main]       856.7727 (1.89)     871.0088 (1.90)     864.5836 (1.90)     5.7847 (2.69)     863.1665 (1.90)     8.9279 (3.29)          2;0  1.1566 (0.53)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     80.4960 (5.53)     80.4960 (5.53)     80.4960 (5.53)     0.0000 (1.0)      80.4960 (5.53)     0.0000 (1.0)           0;0  0.0124 (0.18)          1           1
test_push-push[3.10.0]     34.3419 (2.36)     34.3419 (2.36)     34.3419 (2.36)     0.0000 (1.0)      34.3419 (2.36)     0.0000 (1.0)           0;0  0.0291 (0.42)          1           1
test_push-push[3.53.2]     15.2883 (1.05)     15.2883 (1.05)     15.2883 (1.05)     0.0000 (1.0)      15.2883 (1.05)     0.0000 (1.0)           0;0  0.0654 (0.95)          1           1
test_push-push[3.60.1]     14.7125 (1.01)     14.7125 (1.01)     14.7125 (1.01)     0.0000 (1.0)      14.7125 (1.01)     0.0000 (1.0)           0;0  0.0680 (0.99)          1           1
test_push-push[main]       14.5597 (1.0)      14.5597 (1.0)      14.5597 (1.0)      0.0000 (1.0)      14.5597 (1.0)      0.0000 (1.0)           0;0  0.0687 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     113.6549 (4.94)     113.6549 (4.94)     113.6549 (4.94)     0.0000 (1.0)      113.6549 (4.94)     0.0000 (1.0)           0;0  0.0088 (0.20)          1           1
test_sharing-fetch[3.10.0]     118.9037 (5.17)     118.9037 (5.17)     118.9037 (5.17)     0.0000 (1.0)      118.9037 (5.17)     0.0000 (1.0)           0;0  0.0084 (0.19)          1           1
test_sharing-fetch[3.53.2]      34.0481 (1.48)      34.0481 (1.48)      34.0481 (1.48)     0.0000 (1.0)       34.0481 (1.48)     0.0000 (1.0)           0;0  0.0294 (0.68)          1           1
test_sharing-fetch[3.60.1]      23.4105 (1.02)      23.4105 (1.02)      23.4105 (1.02)     0.0000 (1.0)       23.4105 (1.02)     0.0000 (1.0)           0;0  0.0427 (0.98)          1           1
test_sharing-fetch[main]        23.0086 (1.0)       23.0086 (1.0)       23.0086 (1.0)      0.0000 (1.0)       23.0086 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2952 (1.0)      1.2952 (1.0)      1.2952 (1.0)      0.0000 (1.0)      1.2952 (1.0)      0.0000 (1.0)           0;0  0.7721 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7976 (2.93)     3.7976 (2.93)     3.7976 (2.93)     0.0000 (1.0)      3.7976 (2.93)     0.0000 (1.0)           0;0  0.2633 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     6.0584 (4.68)     6.0584 (4.68)     6.0584 (4.68)     0.0000 (1.0)      6.0584 (4.68)     0.0000 (1.0)           0;0  0.1651 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     6.0188 (4.65)     6.0188 (4.65)     6.0188 (4.65)     0.0000 (1.0)      6.0188 (4.65)     0.0000 (1.0)           0;0  0.1661 (0.22)          1           1
test_sharing-fetch-noop[main]       6.0046 (4.64)     6.0046 (4.64)     6.0046 (4.64)     0.0000 (1.0)      6.0046 (4.64)     0.0000 (1.0)           0;0  0.1665 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     101.4994 (4.44)     101.4994 (4.44)     101.4994 (4.44)     0.0000 (1.0)      101.4994 (4.44)     0.0000 (1.0)           0;0  0.0099 (0.23)          1           1
test_sharing-push[3.10.0]      49.7239 (2.17)      49.7239 (2.17)      49.7239 (2.17)     0.0000 (1.0)       49.7239 (2.17)     0.0000 (1.0)           0;0  0.0201 (0.46)          1           1
test_sharing-push[3.53.2]      23.8140 (1.04)      23.8140 (1.04)      23.8140 (1.04)     0.0000 (1.0)       23.8140 (1.04)     0.0000 (1.0)           0;0  0.0420 (0.96)          1           1
test_sharing-push[3.60.1]      22.8721 (1.0)       22.8721 (1.0)       22.8721 (1.0)      0.0000 (1.0)       22.8721 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
test_sharing-push[main]        23.3146 (1.02)      23.3146 (1.02)      23.3146 (1.02)     0.0000 (1.0)       23.3146 (1.02)     0.0000 (1.0)           0;0  0.0429 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1231 (1.0)      2.1231 (1.0)      2.1231 (1.0)      0.0000 (1.0)      2.1231 (1.0)      0.0000 (1.0)           0;0  0.4710 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2338 (1.05)     2.2338 (1.05)     2.2338 (1.05)     0.0000 (1.0)      2.2338 (1.05)     0.0000 (1.0)           0;0  0.4477 (0.95)          1           1
test_sharing-push-noop[3.53.2]     6.3624 (3.00)     6.3624 (3.00)     6.3624 (3.00)     0.0000 (1.0)      6.3624 (3.00)     0.0000 (1.0)           0;0  0.1572 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.3193 (2.98)     6.3193 (2.98)     6.3193 (2.98)     0.0000 (1.0)      6.3193 (2.98)     0.0000 (1.0)           0;0  0.1582 (0.34)          1           1
test_sharing-push-noop[main]       5.9870 (2.82)     5.9870 (2.82)     5.9870 (2.82)     0.0000 (1.0)      5.9870 (2.82)     0.0000 (1.0)           0;0  0.1670 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     201.1692 (1.09)     201.1692 (1.09)     201.1692 (1.09)     0.0000 (1.0)      201.1692 (1.09)     0.0000 (1.0)           0;0  0.0050 (0.92)          1           1
test_sharing_azure-fetch[main]       184.1412 (1.0)      184.1412 (1.0)      184.1412 (1.0)      0.0000 (1.0)      184.1412 (1.0)      0.0000 (1.0)           0;0  0.0054 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3416 (1.0)      6.3416 (1.0)      6.3416 (1.0)      0.0000 (1.0)      6.3416 (1.0)      0.0000 (1.0)           0;0  0.1577 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4787 (1.02)     6.4787 (1.02)     6.4787 (1.02)     0.0000 (1.0)      6.4787 (1.02)     0.0000 (1.0)           0;0  0.1544 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     200.2752 (1.02)     200.2752 (1.02)     200.2752 (1.02)     0.0000 (1.0)      200.2752 (1.02)     0.0000 (1.0)           0;0  0.0050 (0.98)          1           1
test_sharing_azure-push[main]       195.8181 (1.0)      195.8181 (1.0)      195.8181 (1.0)      0.0000 (1.0)      195.8181 (1.0)      0.0000 (1.0)           0;0  0.0051 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.8675 (1.01)     6.8675 (1.01)     6.8675 (1.01)     0.0000 (1.0)      6.8675 (1.01)     0.0000 (1.0)           0;0  0.1456 (0.99)          1           1
test_sharing_azure-push-noop[main]       6.7894 (1.0)      6.7894 (1.0)      6.7894 (1.0)      0.0000 (1.0)      6.7894 (1.0)      0.0000 (1.0)           0;0  0.1473 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     408.3813 (1.02)     408.3813 (1.02)     408.3813 (1.02)     0.0000 (1.0)      408.3813 (1.02)     0.0000 (1.0)           0;0  0.0024 (0.98)          1           1
test_sharing_s3-fetch[main]       401.6388 (1.0)      401.6388 (1.0)      401.6388 (1.0)      0.0000 (1.0)      401.6388 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6207 (1.0)      6.6207 (1.0)      6.6207 (1.0)      0.0000 (1.0)      6.6207 (1.0)      0.0000 (1.0)           0;0  0.1510 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7983 (1.03)     6.7983 (1.03)     6.7983 (1.03)     0.0000 (1.0)      6.7983 (1.03)     0.0000 (1.0)           0;0  0.1471 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     400.9969 (1.0)      400.9969 (1.0)      400.9969 (1.0)      0.0000 (1.0)      400.9969 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
test_sharing_s3-push[main]       403.5990 (1.01)     403.5990 (1.01)     403.5990 (1.01)     0.0000 (1.0)      403.5990 (1.01)     0.0000 (1.0)           0;0  0.0025 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9362 (1.01)     6.9362 (1.01)     6.9362 (1.01)     0.0000 (1.0)      6.9362 (1.01)     0.0000 (1.0)           0;0  0.1442 (0.99)          1           1
test_sharing_s3-push-noop[main]       6.8641 (1.0)      6.8641 (1.0)      6.8641 (1.0)      0.0000 (1.0)      6.8641 (1.0)      0.0000 (1.0)           0;0  0.1457 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.0063 (3.63)     20.0063 (3.63)     20.0063 (3.63)     0.0000 (1.0)      20.0063 (3.63)     0.0000 (1.0)           0;0  0.0500 (0.28)          1           1
test_status-status[3.10.0]     20.4860 (3.71)     20.4860 (3.71)     20.4860 (3.71)     0.0000 (1.0)      20.4860 (3.71)     0.0000 (1.0)           0;0  0.0488 (0.27)          1           1
test_status-status[3.53.2]     18.4238 (3.34)     18.4238 (3.34)     18.4238 (3.34)     0.0000 (1.0)      18.4238 (3.34)     0.0000 (1.0)           0;0  0.0543 (0.30)          1           1
test_status-status[3.60.1]      5.5185 (1.0)       5.5185 (1.0)       5.5185 (1.0)      0.0000 (1.0)       5.5185 (1.0)      0.0000 (1.0)           0;0  0.1812 (1.0)           1           1
test_status-status[main]        5.6957 (1.03)      5.6957 (1.03)      5.6957 (1.03)     0.0000 (1.0)       5.6957 (1.03)     0.0000 (1.0)           0;0  0.1756 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9604 (1.82)     4.9604 (1.82)     4.9604 (1.82)     0.0000 (1.0)      4.9604 (1.82)     0.0000 (1.0)           0;0  0.2016 (0.55)          1           1
test_status-status-changed[3.10.0]     5.3465 (1.97)     5.3465 (1.97)     5.3465 (1.97)     0.0000 (1.0)      5.3465 (1.97)     0.0000 (1.0)           0;0  0.1870 (0.51)          1           1
test_status-status-changed[3.53.2]     5.1900 (1.91)     5.1900 (1.91)     5.1900 (1.91)     0.0000 (1.0)      5.1900 (1.91)     0.0000 (1.0)           0;0  0.1927 (0.52)          1           1
test_status-status-changed[3.60.1]     2.7208 (1.0)      2.7208 (1.0)      2.7208 (1.0)      0.0000 (1.0)      2.7208 (1.0)      0.0000 (1.0)           0;0  0.3675 (1.0)           1           1
test_status-status-changed[main]       3.1319 (1.15)     3.1319 (1.15)     3.1319 (1.15)     0.0000 (1.0)      3.1319 (1.15)     0.0000 (1.0)           0;0  0.3193 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9867 (1.93)     4.9867 (1.93)     4.9867 (1.93)     0.0000 (1.0)      4.9867 (1.93)     0.0000 (1.0)           0;0  0.2005 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.0423 (1.95)     5.0423 (1.95)     5.0423 (1.95)     0.0000 (1.0)      5.0423 (1.95)     0.0000 (1.0)           0;0  0.1983 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     4.9552 (1.92)     4.9552 (1.92)     4.9552 (1.92)     0.0000 (1.0)      4.9552 (1.92)     0.0000 (1.0)           0;0  0.2018 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.5863 (1.0)      2.5863 (1.0)      2.5863 (1.0)      0.0000 (1.0)      2.5863 (1.0)      0.0000 (1.0)           0;0  0.3867 (1.0)           1           1
test_status-status-changed-noop[main]       2.7088 (1.05)     2.7088 (1.05)     2.7088 (1.05)     0.0000 (1.0)      2.7088 (1.05)     0.0000 (1.0)           0;0  0.3692 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9165 (1.89)     4.9165 (1.89)     4.9165 (1.89)     0.0000 (1.0)      4.9165 (1.89)     0.0000 (1.0)           0;0  0.2034 (0.53)          1           1
test_status-status-noop[3.10.0]     5.3077 (2.04)     5.3077 (2.04)     5.3077 (2.04)     0.0000 (1.0)      5.3077 (2.04)     0.0000 (1.0)           0;0  0.1884 (0.49)          1           1
test_status-status-noop[3.53.2]     5.1096 (1.96)     5.1096 (1.96)     5.1096 (1.96)     0.0000 (1.0)      5.1096 (1.96)     0.0000 (1.0)           0;0  0.1957 (0.51)          1           1
test_status-status-noop[3.60.1]     2.6075 (1.0)      2.6075 (1.0)      2.6075 (1.0)      0.0000 (1.0)      2.6075 (1.0)      0.0000 (1.0)           0;0  0.3835 (1.0)           1           1
test_status-status-noop[main]       2.6978 (1.03)     2.6978 (1.03)     2.6978 (1.03)     0.0000 (1.0)      2.6978 (1.03)     0.0000 (1.0)           0;0  0.3707 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     198.6086 (4.26)     198.6086 (4.26)     198.6086 (4.26)     0.0000 (1.0)      198.6086 (4.26)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.10.0]     204.1163 (4.38)     204.1163 (4.38)     204.1163 (4.38)     0.0000 (1.0)      204.1163 (4.38)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.53.2]     117.6014 (2.52)     117.6014 (2.52)     117.6014 (2.52)     0.0000 (1.0)      117.6014 (2.52)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_update-import-url[3.60.1]      46.6488 (1.0)       46.6488 (1.0)       46.6488 (1.0)      0.0000 (1.0)       46.6488 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_update-import-url[main]        47.9641 (1.03)      47.9641 (1.03)      47.9641 (1.03)     0.0000 (1.0)       47.9641 (1.03)     0.0000 (1.0)           0;0  0.0208 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     184.3311 (5.31)     184.3311 (5.31)     184.3311 (5.31)     0.0000 (1.0)      184.3311 (5.31)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.10.0]     189.1413 (5.44)     189.1413 (5.44)     189.1413 (5.44)     0.0000 (1.0)      189.1413 (5.44)     0.0000 (1.0)           0;0  0.0053 (0.18)          1           1
test_update-update[3.53.2]     110.0640 (3.17)     110.0640 (3.17)     110.0640 (3.17)     0.0000 (1.0)      110.0640 (3.17)     0.0000 (1.0)           0;0  0.0091 (0.32)          1           1
test_update-update[3.60.1]      34.7419 (1.0)       34.7419 (1.0)       34.7419 (1.0)      0.0000 (1.0)       34.7419 (1.0)      0.0000 (1.0)           0;0  0.0288 (1.0)           1           1
test_update-update[main]        35.7225 (1.03)      35.7225 (1.03)      35.7225 (1.03)     0.0000 (1.0)       35.7225 (1.03)     0.0000 (1.0)           0;0  0.0280 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.8822 (2.31)     16.8822 (2.31)     16.8822 (2.31)     0.0000 (1.0)      16.8822 (2.31)     0.0000 (1.0)           0;0  0.0592 (0.43)          1           1
test_update-update-noop[3.10.0]     17.5398 (2.40)     17.5398 (2.40)     17.5398 (2.40)     0.0000 (1.0)      17.5398 (2.40)     0.0000 (1.0)           0;0  0.0570 (0.42)          1           1
test_update-update-noop[3.53.2]     17.1266 (2.34)     17.1266 (2.34)     17.1266 (2.34)     0.0000 (1.0)      17.1266 (2.34)     0.0000 (1.0)           0;0  0.0584 (0.43)          1           1
test_update-update-noop[3.60.1]      7.3080 (1.0)       7.3080 (1.0)       7.3080 (1.0)      0.0000 (1.0)       7.3080 (1.0)      0.0000 (1.0)           0;0  0.1368 (1.0)           1           1
test_update-update-noop[main]        7.9902 (1.09)      7.9902 (1.09)      7.9902 (1.09)     0.0000 (1.0)       7.9902 (1.09)     0.0000 (1.0)           0;0  0.1252 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean