Thu Mar 26 01:04:40 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     77.9166 (3.59)     77.9166 (3.59)     77.9166 (3.59)     0.0000 (1.0)      77.9166 (3.59)     0.0000 (1.0)           0;0  0.0128 (0.28)          1           1
test_add_copy-add[3.10.0]     79.1867 (3.65)     79.1867 (3.65)     79.1867 (3.65)     0.0000 (1.0)      79.1867 (3.65)     0.0000 (1.0)           0;0  0.0126 (0.27)          1           1
test_add_copy-add[3.53.2]     69.8573 (3.22)     69.8573 (3.22)     69.8573 (3.22)     0.0000 (1.0)      69.8573 (3.22)     0.0000 (1.0)           0;0  0.0143 (0.31)          1           1
test_add_copy-add[3.60.1]     21.7185 (1.0)      21.7185 (1.0)      21.7185 (1.0)      0.0000 (1.0)      21.7185 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
test_add_copy-add[main]       22.8736 (1.05)     22.8736 (1.05)     22.8736 (1.05)     0.0000 (1.0)      22.8736 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     23.7354 (5.58)     23.7354 (5.58)     23.7354 (5.58)     0.0000 (1.0)      23.7354 (5.58)     0.0000 (1.0)           0;0  0.0421 (0.18)          1           1
test_add_copy-add-noop[3.10.0]     24.1274 (5.68)     24.1274 (5.68)     24.1274 (5.68)     0.0000 (1.0)      24.1274 (5.68)     0.0000 (1.0)           0;0  0.0414 (0.18)          1           1
test_add_copy-add-noop[3.53.2]     22.6567 (5.33)     22.6567 (5.33)     22.6567 (5.33)     0.0000 (1.0)      22.6567 (5.33)     0.0000 (1.0)           0;0  0.0441 (0.19)          1           1
test_add_copy-add-noop[3.60.1]      4.2507 (1.0)       4.2507 (1.0)       4.2507 (1.0)      0.0000 (1.0)       4.2507 (1.0)      0.0000 (1.0)           0;0  0.2353 (1.0)           1           1
test_add_copy-add-noop[main]        4.4301 (1.04)      4.4301 (1.04)      4.4301 (1.04)     0.0000 (1.0)       4.4301 (1.04)     0.0000 (1.0)           0;0  0.2257 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     61.3116 (3.95)     61.3116 (3.95)     61.3116 (3.95)     0.0000 (1.0)      61.3116 (3.95)     0.0000 (1.0)           0;0  0.0163 (0.25)          1           1
test_add_hardlink-add[3.10.0]     63.4790 (4.09)     63.4790 (4.09)     63.4790 (4.09)     0.0000 (1.0)      63.4790 (4.09)     0.0000 (1.0)           0;0  0.0158 (0.24)          1           1
test_add_hardlink-add[3.53.2]     57.0259 (3.68)     57.0259 (3.68)     57.0259 (3.68)     0.0000 (1.0)      57.0259 (3.68)     0.0000 (1.0)           0;0  0.0175 (0.27)          1           1
test_add_hardlink-add[3.60.1]     15.5115 (1.0)      15.5115 (1.0)      15.5115 (1.0)      0.0000 (1.0)      15.5115 (1.0)      0.0000 (1.0)           0;0  0.0645 (1.0)           1           1
test_add_hardlink-add[main]       16.8354 (1.09)     16.8354 (1.09)     16.8354 (1.09)     0.0000 (1.0)      16.8354 (1.09)     0.0000 (1.0)           0;0  0.0594 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     30.8620 (7.89)     30.8620 (7.89)     30.8620 (7.89)     0.0000 (1.0)      30.8620 (7.89)     0.0000 (1.0)           0;0  0.0324 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     31.2828 (8.00)     31.2828 (8.00)     31.2828 (8.00)     0.0000 (1.0)      31.2828 (8.00)     0.0000 (1.0)           0;0  0.0320 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     29.3221 (7.50)     29.3221 (7.50)     29.3221 (7.50)     0.0000 (1.0)      29.3221 (7.50)     0.0000 (1.0)           0;0  0.0341 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      3.9099 (1.0)       3.9099 (1.0)       3.9099 (1.0)      0.0000 (1.0)       3.9099 (1.0)      0.0000 (1.0)           0;0  0.2558 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.2206 (1.08)      4.2206 (1.08)      4.2206 (1.08)     0.0000 (1.0)       4.2206 (1.08)     0.0000 (1.0)           0;0  0.2369 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.0171 (1.94)     72.0171 (1.94)     72.0171 (1.94)     0.0000 (1.0)      72.0171 (1.94)     0.0000 (1.0)           0;0  0.0139 (0.52)          1           1
test_add_symlink-add[3.10.0]     72.8767 (1.96)     72.8767 (1.96)     72.8767 (1.96)     0.0000 (1.0)      72.8767 (1.96)     0.0000 (1.0)           0;0  0.0137 (0.51)          1           1
test_add_symlink-add[3.53.2]     66.9798 (1.80)     66.9798 (1.80)     66.9798 (1.80)     0.0000 (1.0)      66.9798 (1.80)     0.0000 (1.0)           0;0  0.0149 (0.55)          1           1
test_add_symlink-add[3.60.1]     37.1359 (1.0)      37.1359 (1.0)      37.1359 (1.0)      0.0000 (1.0)      37.1359 (1.0)      0.0000 (1.0)           0;0  0.0269 (1.0)           1           1
test_add_symlink-add[main]       38.7904 (1.04)     38.7904 (1.04)     38.7904 (1.04)     0.0000 (1.0)      38.7904 (1.04)     0.0000 (1.0)           0;0  0.0258 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.3136 (8.51)     45.3136 (8.51)     45.3136 (8.51)     0.0000 (1.0)      45.3136 (8.51)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.6253 (8.57)     45.6253 (8.57)     45.6253 (8.57)     0.0000 (1.0)      45.6253 (8.57)     0.0000 (1.0)           0;0  0.0219 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.9711 (8.45)     44.9711 (8.45)     44.9711 (8.45)     0.0000 (1.0)      44.9711 (8.45)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.3224 (1.0)       5.3224 (1.0)       5.3224 (1.0)      0.0000 (1.0)       5.3224 (1.0)      0.0000 (1.0)           0;0  0.1879 (1.0)           1           1
test_add_symlink-add-noop[main]        5.5121 (1.04)      5.5121 (1.04)      5.5121 (1.04)     0.0000 (1.0)       5.5121 (1.04)     0.0000 (1.0)           0;0  0.1814 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     27.0701 (2.14)     27.0701 (2.14)     27.0701 (2.14)     0.0000 (1.0)      27.0701 (2.14)     0.0000 (1.0)           0;0  0.0369 (0.47)          1           1
test_checkout_copy-checkout[3.10.0]     86.3422 (6.81)     86.3422 (6.81)     86.3422 (6.81)     0.0000 (1.0)      86.3422 (6.81)     0.0000 (1.0)           0;0  0.0116 (0.15)          1           1
test_checkout_copy-checkout[3.53.2]     17.6129 (1.39)     17.6129 (1.39)     17.6129 (1.39)     0.0000 (1.0)      17.6129 (1.39)     0.0000 (1.0)           0;0  0.0568 (0.72)          1           1
test_checkout_copy-checkout[3.60.1]     12.6767 (1.0)      12.6767 (1.0)      12.6767 (1.0)      0.0000 (1.0)      12.6767 (1.0)      0.0000 (1.0)           0;0  0.0789 (1.0)           1           1
test_checkout_copy-checkout[main]       13.2456 (1.04)     13.2456 (1.04)     13.2456 (1.04)     0.0000 (1.0)      13.2456 (1.04)     0.0000 (1.0)           0;0  0.0755 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     4.1057 (1.39)     4.1057 (1.39)     4.1057 (1.39)     0.0000 (1.0)      4.1057 (1.39)     0.0000 (1.0)           0;0  0.2436 (0.72)          1           1
test_checkout_copy-checkout-noop[3.10.0]     4.3539 (1.48)     4.3539 (1.48)     4.3539 (1.48)     0.0000 (1.0)      4.3539 (1.48)     0.0000 (1.0)           0;0  0.2297 (0.68)          1           1
test_checkout_copy-checkout-noop[3.53.2]     4.2612 (1.45)     4.2612 (1.45)     4.2612 (1.45)     0.0000 (1.0)      4.2612 (1.45)     0.0000 (1.0)           0;0  0.2347 (0.69)          1           1
test_checkout_copy-checkout-noop[3.60.1]     2.9468 (1.0)      2.9468 (1.0)      2.9468 (1.0)      0.0000 (1.0)      2.9468 (1.0)      0.0000 (1.0)           0;0  0.3394 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.1223 (1.06)     3.1223 (1.06)     3.1223 (1.06)     0.0000 (1.0)      3.1223 (1.06)     0.0000 (1.0)           0;0  0.3203 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     5.8920 (1.72)     5.8920 (1.72)     5.8920 (1.72)     0.0000 (1.0)      5.8920 (1.72)     0.0000 (1.0)           0;0  0.1697 (0.58)          1           1
test_checkout_copy-checkout-update[3.10.0]     5.0408 (1.47)     5.0408 (1.47)     5.0408 (1.47)     0.0000 (1.0)      5.0408 (1.47)     0.0000 (1.0)           0;0  0.1984 (0.68)          1           1
test_checkout_copy-checkout-update[3.53.2]     4.9423 (1.44)     4.9423 (1.44)     4.9423 (1.44)     0.0000 (1.0)      4.9423 (1.44)     0.0000 (1.0)           0;0  0.2023 (0.69)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.4208 (1.0)      3.4208 (1.0)      3.4208 (1.0)      0.0000 (1.0)      3.4208 (1.0)      0.0000 (1.0)           0;0  0.2923 (1.0)           1           1
test_checkout_copy-checkout-update[main]       3.8533 (1.13)     3.8533 (1.13)     3.8533 (1.13)     0.0000 (1.0)      3.8533 (1.13)     0.0000 (1.0)           0;0  0.2595 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.6128 (3.03)     22.6128 (3.03)     22.6128 (3.03)     0.0000 (1.0)      22.6128 (3.03)     0.0000 (1.0)           0;0  0.0442 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.8954 (2.26)     16.8954 (2.26)     16.8954 (2.26)     0.0000 (1.0)      16.8954 (2.26)     0.0000 (1.0)           0;0  0.0592 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.2653 (2.04)     15.2653 (2.04)     15.2653 (2.04)     0.0000 (1.0)      15.2653 (2.04)     0.0000 (1.0)           0;0  0.0655 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4741 (1.0)       7.4741 (1.0)       7.4741 (1.0)      0.0000 (1.0)       7.4741 (1.0)      0.0000 (1.0)           0;0  0.1338 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2303 (1.10)      8.2303 (1.10)      8.2303 (1.10)     0.0000 (1.0)       8.2303 (1.10)     0.0000 (1.0)           0;0  0.1215 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5460 (1.70)     5.5460 (1.70)     5.5460 (1.70)     0.0000 (1.0)      5.5460 (1.70)     0.0000 (1.0)           0;0  0.1803 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8144 (1.78)     5.8144 (1.78)     5.8144 (1.78)     0.0000 (1.0)      5.8144 (1.78)     0.0000 (1.0)           0;0  0.1720 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6080 (1.72)     5.6080 (1.72)     5.6080 (1.72)     0.0000 (1.0)      5.6080 (1.72)     0.0000 (1.0)           0;0  0.1783 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2610 (1.0)      3.2610 (1.0)      3.2610 (1.0)      0.0000 (1.0)      3.2610 (1.0)      0.0000 (1.0)           0;0  0.3067 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4967 (1.07)     3.4967 (1.07)     3.4967 (1.07)     0.0000 (1.0)      3.4967 (1.07)     0.0000 (1.0)           0;0  0.2860 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6659 (1.96)     7.6659 (1.96)     7.6659 (1.96)     0.0000 (1.0)      7.6659 (1.96)     0.0000 (1.0)           0;0  0.1304 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6086 (1.69)     6.6086 (1.69)     6.6086 (1.69)     0.0000 (1.0)      6.6086 (1.69)     0.0000 (1.0)           0;0  0.1513 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4193 (1.64)     6.4193 (1.64)     6.4193 (1.64)     0.0000 (1.0)      6.4193 (1.64)     0.0000 (1.0)           0;0  0.1558 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9170 (1.0)      3.9170 (1.0)      3.9170 (1.0)      0.0000 (1.0)      3.9170 (1.0)      0.0000 (1.0)           0;0  0.2553 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.2954 (1.10)     4.2954 (1.10)     4.2954 (1.10)     0.0000 (1.0)      4.2954 (1.10)     0.0000 (1.0)           0;0  0.2328 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.3252 (2.40)     24.3252 (2.40)     24.3252 (2.40)     0.0000 (1.0)      24.3252 (2.40)     0.0000 (1.0)           0;0  0.0411 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     19.6271 (1.93)     19.6271 (1.93)     19.6271 (1.93)     0.0000 (1.0)      19.6271 (1.93)     0.0000 (1.0)           0;0  0.0509 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.1267 (1.69)     17.1267 (1.69)     17.1267 (1.69)     0.0000 (1.0)      17.1267 (1.69)     0.0000 (1.0)           0;0  0.0584 (0.59)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1495 (1.0)      10.1495 (1.0)      10.1495 (1.0)      0.0000 (1.0)      10.1495 (1.0)      0.0000 (1.0)           0;0  0.0985 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.8430 (1.07)     10.8430 (1.07)     10.8430 (1.07)     0.0000 (1.0)      10.8430 (1.07)     0.0000 (1.0)           0;0  0.0922 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6519 (1.60)     6.6519 (1.60)     6.6519 (1.60)     0.0000 (1.0)      6.6519 (1.60)     0.0000 (1.0)           0;0  0.1503 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9964 (1.68)     6.9964 (1.68)     6.9964 (1.68)     0.0000 (1.0)      6.9964 (1.68)     0.0000 (1.0)           0;0  0.1429 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6468 (1.60)     6.6468 (1.60)     6.6468 (1.60)     0.0000 (1.0)      6.6468 (1.60)     0.0000 (1.0)           0;0  0.1504 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1631 (1.0)      4.1631 (1.0)      4.1631 (1.0)      0.0000 (1.0)      4.1631 (1.0)      0.0000 (1.0)           0;0  0.2402 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5219 (1.09)     4.5219 (1.09)     4.5219 (1.09)     0.0000 (1.0)      4.5219 (1.09)     0.0000 (1.0)           0;0  0.2211 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.6340 (1.66)     9.6340 (1.66)     9.6340 (1.66)     0.0000 (1.0)      9.6340 (1.66)     0.0000 (1.0)           0;0  0.1038 (0.60)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.6943 (1.50)     8.6943 (1.50)     8.6943 (1.50)     0.0000 (1.0)      8.6943 (1.50)     0.0000 (1.0)           0;0  0.1150 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.4107 (1.45)     8.4107 (1.45)     8.4107 (1.45)     0.0000 (1.0)      8.4107 (1.45)     0.0000 (1.0)           0;0  0.1189 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.8090 (1.0)      5.8090 (1.0)      5.8090 (1.0)      0.0000 (1.0)      5.8090 (1.0)      0.0000 (1.0)           0;0  0.1721 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.0947 (1.05)     6.0947 (1.05)     6.0947 (1.05)     0.0000 (1.0)      6.0947 (1.05)     0.0000 (1.0)           0;0  0.1641 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2274 (1.78)     4.2274 (1.78)     4.2274 (1.78)     0.0000 (1.0)      4.2274 (1.78)     0.0000 (1.0)           0;0  0.2366 (0.56)          1           1
test_data_status-data-changed[3.10.0]     5.1118 (2.15)     5.1118 (2.15)     5.1118 (2.15)     0.0000 (1.0)      5.1118 (2.15)     0.0000 (1.0)           0;0  0.1956 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.9449 (2.08)     4.9449 (2.08)     4.9449 (2.08)     0.0000 (1.0)      4.9449 (2.08)     0.0000 (1.0)           0;0  0.2022 (0.48)          1           1
test_data_status-data-changed[3.60.1]     2.3778 (1.0)      2.3778 (1.0)      2.3778 (1.0)      0.0000 (1.0)      2.3778 (1.0)      0.0000 (1.0)           0;0  0.4206 (1.0)           1           1
test_data_status-data-changed[main]       2.6495 (1.11)     2.6495 (1.11)     2.6495 (1.11)     0.0000 (1.0)      2.6495 (1.11)     0.0000 (1.0)           0;0  0.3774 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2827 (1.77)     4.2827 (1.77)     4.2827 (1.77)     0.0000 (1.0)      4.2827 (1.77)     0.0000 (1.0)           0;0  0.2335 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0491 (2.08)     5.0491 (2.08)     5.0491 (2.08)     0.0000 (1.0)      5.0491 (2.08)     0.0000 (1.0)           0;0  0.1981 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8602 (2.00)     4.8602 (2.00)     4.8602 (2.00)     0.0000 (1.0)      4.8602 (2.00)     0.0000 (1.0)           0;0  0.2058 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4241 (1.0)      2.4241 (1.0)      2.4241 (1.0)      0.0000 (1.0)      2.4241 (1.0)      0.0000 (1.0)           0;0  0.4125 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6829 (1.11)     2.6829 (1.11)     2.6829 (1.11)     0.0000 (1.0)      2.6829 (1.11)     0.0000 (1.0)           0;0  0.3727 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.4905 (3.84)     19.4905 (3.84)     19.4905 (3.84)     0.0000 (1.0)      19.4905 (3.84)     0.0000 (1.0)           0;0  0.0513 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.5215 (4.05)     20.5215 (4.05)     20.5215 (4.05)     0.0000 (1.0)      20.5215 (4.05)     0.0000 (1.0)           0;0  0.0487 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.2273 (3.99)     20.2273 (3.99)     20.2273 (3.99)     0.0000 (1.0)      20.2273 (3.99)     0.0000 (1.0)           0;0  0.0494 (0.25)          1           1
test_data_status-data-new[3.60.1]      5.0731 (1.0)       5.0731 (1.0)       5.0731 (1.0)      0.0000 (1.0)       5.0731 (1.0)      0.0000 (1.0)           0;0  0.1971 (1.0)           1           1
test_data_status-data-new[main]        5.3953 (1.06)      5.3953 (1.06)      5.3953 (1.06)     0.0000 (1.0)       5.3953 (1.06)     0.0000 (1.0)           0;0  0.1853 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1776 (1.74)     4.1776 (1.74)     4.1776 (1.74)     0.0000 (1.0)      4.1776 (1.74)     0.0000 (1.0)           0;0  0.2394 (0.57)          1           1
test_data_status-data-noop[3.10.0]     5.0593 (2.11)     5.0593 (2.11)     5.0593 (2.11)     0.0000 (1.0)      5.0593 (2.11)     0.0000 (1.0)           0;0  0.1977 (0.47)          1           1
test_data_status-data-noop[3.53.2]     4.8914 (2.04)     4.8914 (2.04)     4.8914 (2.04)     0.0000 (1.0)      4.8914 (2.04)     0.0000 (1.0)           0;0  0.2044 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.3972 (1.0)      2.3972 (1.0)      2.3972 (1.0)      0.0000 (1.0)      2.3972 (1.0)      0.0000 (1.0)           0;0  0.4172 (1.0)           1           1
test_data_status-data-noop[main]       2.6882 (1.12)     2.6882 (1.12)     2.6882 (1.12)     0.0000 (1.0)      2.6882 (1.12)     0.0000 (1.0)           0;0  0.3720 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     5.6955 (1.16)     5.6955 (1.16)     5.6955 (1.16)     0.0000 (1.0)      5.6955 (1.16)     0.0000 (1.0)           0;0  0.1756 (0.86)          1           1
test_data_status_all_flags-data-changed[3.10.0]     6.2764 (1.28)     6.2764 (1.28)     6.2764 (1.28)     0.0000 (1.0)      6.2764 (1.28)     0.0000 (1.0)           0;0  0.1593 (0.78)          1           1
test_data_status_all_flags-data-changed[3.53.2]     6.2656 (1.28)     6.2656 (1.28)     6.2656 (1.28)     0.0000 (1.0)      6.2656 (1.28)     0.0000 (1.0)           0;0  0.1596 (0.78)          1           1
test_data_status_all_flags-data-changed[3.60.1]     4.9084 (1.0)      4.9084 (1.0)      4.9084 (1.0)      0.0000 (1.0)      4.9084 (1.0)      0.0000 (1.0)           0;0  0.2037 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.2944 (1.08)     5.2944 (1.08)     5.2944 (1.08)     0.0000 (1.0)      5.2944 (1.08)     0.0000 (1.0)           0;0  0.1889 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     5.8256 (1.20)     5.8256 (1.20)     5.8256 (1.20)     0.0000 (1.0)      5.8256 (1.20)     0.0000 (1.0)           0;0  0.1717 (0.83)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     6.3638 (1.31)     6.3638 (1.31)     6.3638 (1.31)     0.0000 (1.0)      6.3638 (1.31)     0.0000 (1.0)           0;0  0.1571 (0.76)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     6.3595 (1.31)     6.3595 (1.31)     6.3595 (1.31)     0.0000 (1.0)      6.3595 (1.31)     0.0000 (1.0)           0;0  0.1572 (0.76)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     4.8605 (1.0)      4.8605 (1.0)      4.8605 (1.0)      0.0000 (1.0)      4.8605 (1.0)      0.0000 (1.0)           0;0  0.2057 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.3007 (1.09)     5.3007 (1.09)     5.3007 (1.09)     0.0000 (1.0)      5.3007 (1.09)     0.0000 (1.0)           0;0  0.1887 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     15.8151 (2.41)     15.8151 (2.41)     15.8151 (2.41)     0.0000 (1.0)      15.8151 (2.41)     0.0000 (1.0)           0;0  0.0632 (0.41)          1           1
test_data_status_all_flags-data-new[3.10.0]     16.8125 (2.57)     16.8125 (2.57)     16.8125 (2.57)     0.0000 (1.0)      16.8125 (2.57)     0.0000 (1.0)           0;0  0.0595 (0.39)          1           1
test_data_status_all_flags-data-new[3.53.2]     16.5748 (2.53)     16.5748 (2.53)     16.5748 (2.53)     0.0000 (1.0)      16.5748 (2.53)     0.0000 (1.0)           0;0  0.0603 (0.40)          1           1
test_data_status_all_flags-data-new[3.60.1]      6.5510 (1.0)       6.5510 (1.0)       6.5510 (1.0)      0.0000 (1.0)       6.5510 (1.0)      0.0000 (1.0)           0;0  0.1526 (1.0)           1           1
test_data_status_all_flags-data-new[main]        7.0986 (1.08)      7.0986 (1.08)      7.0986 (1.08)     0.0000 (1.0)       7.0986 (1.08)     0.0000 (1.0)           0;0  0.1409 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     5.1025 (1.20)     5.1025 (1.20)     5.1025 (1.20)     0.0000 (1.0)      5.1025 (1.20)     0.0000 (1.0)           0;0  0.1960 (0.83)          1           1
test_data_status_all_flags-data-noop[3.10.0]     5.7125 (1.35)     5.7125 (1.35)     5.7125 (1.35)     0.0000 (1.0)      5.7125 (1.35)     0.0000 (1.0)           0;0  0.1751 (0.74)          1           1
test_data_status_all_flags-data-noop[3.53.2]     5.6054 (1.32)     5.6054 (1.32)     5.6054 (1.32)     0.0000 (1.0)      5.6054 (1.32)     0.0000 (1.0)           0;0  0.1784 (0.76)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.2359 (1.0)      4.2359 (1.0)      4.2359 (1.0)      0.0000 (1.0)      4.2359 (1.0)      0.0000 (1.0)           0;0  0.2361 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.6649 (1.10)     4.6649 (1.10)     4.6649 (1.10)     0.0000 (1.0)      4.6649 (1.10)     0.0000 (1.0)           0;0  0.2144 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     15.9637 (2.48)     15.9637 (2.48)     15.9637 (2.48)     0.0000 (1.0)      15.9637 (2.48)     0.0000 (1.0)           0;0  0.0626 (0.40)          1           1
test_diff-diff[3.10.0]     17.3547 (2.70)     17.3547 (2.70)     17.3547 (2.70)     0.0000 (1.0)      17.3547 (2.70)     0.0000 (1.0)           0;0  0.0576 (0.37)          1           1
test_diff-diff[3.53.2]     17.1308 (2.66)     17.1308 (2.66)     17.1308 (2.66)     0.0000 (1.0)      17.1308 (2.66)     0.0000 (1.0)           0;0  0.0584 (0.38)          1           1
test_diff-diff[3.60.1]      6.4301 (1.0)       6.4301 (1.0)       6.4301 (1.0)      0.0000 (1.0)       6.4301 (1.0)      0.0000 (1.0)           0;0  0.1555 (1.0)           1           1
test_diff-diff[main]        7.5298 (1.17)      7.5298 (1.17)      7.5298 (1.17)     0.0000 (1.0)       7.5298 (1.17)     0.0000 (1.0)           0;0  0.1328 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.1813 (1.53)     5.1813 (1.53)     5.1813 (1.53)     0.0000 (1.0)      5.1813 (1.53)     0.0000 (1.0)           0;0  0.1930 (0.65)          1           1
test_diff-diff-changed[3.10.0]     5.2487 (1.55)     5.2487 (1.55)     5.2487 (1.55)     0.0000 (1.0)      5.2487 (1.55)     0.0000 (1.0)           0;0  0.1905 (0.64)          1           1
test_diff-diff-changed[3.53.2]     4.2506 (1.26)     4.2506 (1.26)     4.2506 (1.26)     0.0000 (1.0)      4.2506 (1.26)     0.0000 (1.0)           0;0  0.2353 (0.80)          1           1
test_diff-diff-changed[3.60.1]     3.3813 (1.0)      3.3813 (1.0)      3.3813 (1.0)      0.0000 (1.0)      3.3813 (1.0)      0.0000 (1.0)           0;0  0.2957 (1.0)           1           1
test_diff-diff-changed[main]       4.1721 (1.23)     4.1721 (1.23)     4.1721 (1.23)     0.0000 (1.0)      4.1721 (1.23)     0.0000 (1.0)           0;0  0.2397 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.3641 (1.31)     4.3641 (1.31)     4.3641 (1.31)     0.0000 (1.0)      4.3641 (1.31)     0.0000 (1.0)           0;0  0.2291 (0.76)          1           1
test_diff-diff-changed-noop[3.10.0]     4.4444 (1.33)     4.4444 (1.33)     4.4444 (1.33)     0.0000 (1.0)      4.4444 (1.33)     0.0000 (1.0)           0;0  0.2250 (0.75)          1           1
test_diff-diff-changed-noop[3.53.2]     4.3683 (1.31)     4.3683 (1.31)     4.3683 (1.31)     0.0000 (1.0)      4.3683 (1.31)     0.0000 (1.0)           0;0  0.2289 (0.76)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3305 (1.0)      3.3305 (1.0)      3.3305 (1.0)      0.0000 (1.0)      3.3305 (1.0)      0.0000 (1.0)           0;0  0.3003 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1990 (1.26)     4.1990 (1.26)     4.1990 (1.26)     0.0000 (1.0)      4.1990 (1.26)     0.0000 (1.0)           0;0  0.2382 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.4014 (1.01)     3.4014 (1.01)     3.4014 (1.01)     0.0000 (1.0)      3.4014 (1.01)     0.0000 (1.0)           0;0  0.2940 (0.99)          1           1
test_diff-diff-noop[3.10.0]     3.6845 (1.09)     3.6845 (1.09)     3.6845 (1.09)     0.0000 (1.0)      3.6845 (1.09)     0.0000 (1.0)           0;0  0.2714 (0.92)          1           1
test_diff-diff-noop[3.53.2]     4.2407 (1.26)     4.2407 (1.26)     4.2407 (1.26)     0.0000 (1.0)      4.2407 (1.26)     0.0000 (1.0)           0;0  0.2358 (0.80)          1           1
test_diff-diff-noop[3.60.1]     3.3779 (1.0)      3.3779 (1.0)      3.3779 (1.0)      0.0000 (1.0)      3.3779 (1.0)      0.0000 (1.0)           0;0  0.2960 (1.0)           1           1
test_diff-diff-noop[main]       4.2090 (1.25)     4.2090 (1.25)     4.2090 (1.25)     0.0000 (1.0)      4.2090 (1.25)     0.0000 (1.0)           0;0  0.2376 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.2791 (1.0)      1.2791 (1.0)      1.2791 (1.0)      0.0000 (1.0)      1.2791 (1.0)      0.0000 (1.0)           0;0  0.7818 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.5179 (3.53)     4.5179 (3.53)     4.5179 (3.53)     0.0000 (1.0)      4.5179 (3.53)     0.0000 (1.0)           0;0  0.2213 (0.28)          1           1
test_exp_show-exp[3.53.2]     3.0373 (2.37)     3.0373 (2.37)     3.0373 (2.37)     0.0000 (1.0)      3.0373 (2.37)     0.0000 (1.0)           0;0  0.3292 (0.42)          1           1
test_exp_show-exp[3.60.1]     2.6086 (2.04)     2.6086 (2.04)     2.6086 (2.04)     0.0000 (1.0)      2.6086 (2.04)     0.0000 (1.0)           0;0  0.3833 (0.49)          1           1
test_exp_show-exp[main]       5.3223 (4.16)     5.3223 (4.16)     5.3223 (4.16)     0.0000 (1.0)      5.3223 (4.16)     0.0000 (1.0)           0;0  0.1879 (0.24)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     112.1454 (4.73)     112.1454 (4.73)     112.1454 (4.73)     0.0000 (1.0)      112.1454 (4.73)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_fetch-fetch[3.10.0]     117.5445 (4.96)     117.5445 (4.96)     117.5445 (4.96)     0.0000 (1.0)      117.5445 (4.96)     0.0000 (1.0)           0;0  0.0085 (0.20)          1           1
test_fetch-fetch[3.53.2]      35.1345 (1.48)      35.1345 (1.48)      35.1345 (1.48)     0.0000 (1.0)       35.1345 (1.48)     0.0000 (1.0)           0;0  0.0285 (0.67)          1           1
test_fetch-fetch[3.60.1]      23.9804 (1.01)      23.9804 (1.01)      23.9804 (1.01)     0.0000 (1.0)       23.9804 (1.01)     0.0000 (1.0)           0;0  0.0417 (0.99)          1           1
test_fetch-fetch[main]        23.6931 (1.0)       23.6931 (1.0)       23.6931 (1.0)      0.0000 (1.0)       23.6931 (1.0)      0.0000 (1.0)           0;0  0.0422 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.1229 (1.0)      2.1229 (1.0)      2.1229 (1.0)      0.0000 (1.0)      2.1229 (1.0)      0.0000 (1.0)           0;0  0.4711 (1.0)           1           1
test_gc-gc[3.10.0]     2.3750 (1.12)     2.3750 (1.12)     2.3750 (1.12)     0.0000 (1.0)      2.3750 (1.12)     0.0000 (1.0)           0;0  0.4211 (0.89)          1           1
test_gc-gc[3.53.2]     2.1324 (1.00)     2.1324 (1.00)     2.1324 (1.00)     0.0000 (1.0)      2.1324 (1.00)     0.0000 (1.0)           0;0  0.4689 (1.00)          1           1
test_gc-gc[3.60.1]     2.1698 (1.02)     2.1698 (1.02)     2.1698 (1.02)     0.0000 (1.0)      2.1698 (1.02)     0.0000 (1.0)           0;0  0.4609 (0.98)          1           1
test_gc-gc[main]       2.2151 (1.04)     2.2151 (1.04)     2.2151 (1.04)     0.0000 (1.0)      2.2151 (1.04)     0.0000 (1.0)           0;0  0.4515 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     190.5351 (3.28)     190.5351 (3.28)     190.5351 (3.28)     0.0000 (1.0)      190.5351 (3.28)     0.0000 (1.0)           0;0  0.0052 (0.30)          1           1
test_get-get[3.10.0]     226.0264 (3.89)     226.0264 (3.89)     226.0264 (3.89)     0.0000 (1.0)      226.0264 (3.89)     0.0000 (1.0)           0;0  0.0044 (0.26)          1           1
test_get-get[3.53.2]     179.6235 (3.09)     179.6235 (3.09)     179.6235 (3.09)     0.0000 (1.0)      179.6235 (3.09)     0.0000 (1.0)           0;0  0.0056 (0.32)          1           1
test_get-get[3.60.1]      58.0939 (1.0)       58.0939 (1.0)       58.0939 (1.0)      0.0000 (1.0)       58.0939 (1.0)      0.0000 (1.0)           0;0  0.0172 (1.0)           1           1
test_get-get[main]        59.4151 (1.02)      59.4151 (1.02)      59.4151 (1.02)     0.0000 (1.0)       59.4151 (1.02)     0.0000 (1.0)           0;0  0.0168 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     92.0384 (5.39)     92.0384 (5.39)     92.0384 (5.39)     0.0000 (1.0)      92.0384 (5.39)     0.0000 (1.0)           0;0  0.0109 (0.19)          1           1
test_get_url-get-url[3.10.0]     96.0167 (5.62)     96.0167 (5.62)     96.0167 (5.62)     0.0000 (1.0)      96.0167 (5.62)     0.0000 (1.0)           0;0  0.0104 (0.18)          1           1
test_get_url-get-url[3.53.2]     17.2084 (1.01)     17.2084 (1.01)     17.2084 (1.01)     0.0000 (1.0)      17.2084 (1.01)     0.0000 (1.0)           0;0  0.0581 (0.99)          1           1
test_get_url-get-url[3.60.1]     17.0758 (1.0)      17.0758 (1.0)      17.0758 (1.0)      0.0000 (1.0)      17.0758 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
test_get_url-get-url[main]       17.1712 (1.01)     17.1712 (1.01)     17.1712 (1.01)     0.0000 (1.0)      17.1712 (1.01)     0.0000 (1.0)           0;0  0.0582 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     152.5664 (1.05)     169.6671 (1.0)      162.1505 (1.08)     3.9786 (1.16)     162.5048 (1.09)     5.3824 (2.35)         30;0  6.1671 (0.93)        100           1
test_help---help[3.10.0]     151.8224 (1.04)     171.4234 (1.01)     159.6413 (1.06)     4.6142 (1.34)     159.3306 (1.06)     6.7846 (2.96)         38;0  6.2640 (0.94)        100           1
test_help---help[3.53.2]     153.9377 (1.06)     184.9482 (1.09)     157.9808 (1.05)     3.8884 (1.13)     156.7346 (1.05)     2.8449 (1.24)         13;7  6.3299 (0.95)        100           1
test_help---help[3.60.1]     152.2008 (1.04)     178.5313 (1.05)     159.5830 (1.06)     4.4350 (1.29)     158.3921 (1.06)     4.5738 (1.99)         22;6  6.2663 (0.94)        100           1
test_help---help[main]       145.7301 (1.0)      177.5588 (1.05)     150.1746 (1.0)      3.4419 (1.0)      149.7268 (1.0)      2.2944 (1.0)           7;3  6.6589 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     272.0229 (3.32)     272.0229 (3.32)     272.0229 (3.32)     0.0000 (1.0)      272.0229 (3.32)     0.0000 (1.0)           0;0  0.0037 (0.30)          1           1
test_import-import[3.10.0]     307.7131 (3.75)     307.7131 (3.75)     307.7131 (3.75)     0.0000 (1.0)      307.7131 (3.75)     0.0000 (1.0)           0;0  0.0032 (0.27)          1           1
test_import-import[3.60.1]      81.9707 (1.0)       81.9707 (1.0)       81.9707 (1.0)      0.0000 (1.0)       81.9707 (1.0)      0.0000 (1.0)           0;0  0.0122 (1.0)           1           1
test_import-import[main]        82.4027 (1.01)      82.4027 (1.01)      82.4027 (1.01)     0.0000 (1.0)       82.4027 (1.01)     0.0000 (1.0)           0;0  0.0121 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     177.7815 (4.08)     177.7815 (4.08)     177.7815 (4.08)     0.0000 (1.0)      177.7815 (4.08)     0.0000 (1.0)           0;0  0.0056 (0.24)          1           1
test_import_url-import-url[3.10.0]     184.3502 (4.23)     184.3502 (4.23)     184.3502 (4.23)     0.0000 (1.0)      184.3502 (4.23)     0.0000 (1.0)           0;0  0.0054 (0.24)          1           1
test_import_url-import-url[3.53.2]     103.6871 (2.38)     103.6871 (2.38)     103.6871 (2.38)     0.0000 (1.0)      103.6871 (2.38)     0.0000 (1.0)           0;0  0.0096 (0.42)          1           1
test_import_url-import-url[3.60.1]      43.5553 (1.0)       43.5553 (1.0)       43.5553 (1.0)      0.0000 (1.0)       43.5553 (1.0)      0.0000 (1.0)           0;0  0.0230 (1.0)           1           1
test_import_url-import-url[main]        45.4312 (1.04)      45.4312 (1.04)      45.4312 (1.04)     0.0000 (1.0)       45.4312 (1.04)     0.0000 (1.0)           0;0  0.0220 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     416.3919 (1.04)     458.3549 (1.05)     433.2320 (1.05)      8.7352 (1.22)     432.6633 (1.05)     10.0023 (1.07)         29;4  2.3082 (0.95)        100           1
test_init-init[3.10.0]     424.4138 (1.06)     493.1764 (1.13)     443.1489 (1.07)     10.4115 (1.46)     441.5240 (1.07)     13.9158 (1.49)         23;2  2.2566 (0.93)        100           1
test_init-init[3.53.2]     399.9728 (1.0)      436.7836 (1.0)      412.7572 (1.0)       7.1497 (1.0)      411.3843 (1.0)       9.3522 (1.0)          27;3  2.4227 (1.0)         100           1
test_init-init[3.60.1]     404.5634 (1.01)     460.7187 (1.05)     418.9292 (1.01)     10.3527 (1.45)     415.9257 (1.01)     10.3121 (1.10)         21;8  2.3870 (0.99)        100           1
test_init-init[main]       445.0907 (1.11)     508.1051 (1.16)     461.3357 (1.12)     11.2750 (1.58)     459.8526 (1.12)     12.3110 (1.32)         24;5  2.1676 (0.89)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     665.0318 (1.02)     665.0318 (1.02)     665.0318 (1.02)     0.0000 (1.0)      665.0318 (1.02)     0.0000 (1.0)           0;0  1.5037 (0.98)          1           1
test_list-list[3.10.0]     998.9867 (1.53)     998.9867 (1.53)     998.9867 (1.53)     0.0000 (1.0)      998.9867 (1.53)     0.0000 (1.0)           0;0  1.0010 (0.65)          1           1
test_list-list[3.53.2]     660.9314 (1.01)     660.9314 (1.01)     660.9314 (1.01)     0.0000 (1.0)      660.9314 (1.01)     0.0000 (1.0)           0;0  1.5130 (0.99)          1           1
test_list-list[3.60.1]     751.4873 (1.15)     751.4873 (1.15)     751.4873 (1.15)     0.0000 (1.0)      751.4873 (1.15)     0.0000 (1.0)           0;0  1.3307 (0.87)          1           1
test_list-list[main]       652.0269 (1.0)      652.0269 (1.0)      652.0269 (1.0)      0.0000 (1.0)      652.0269 (1.0)      0.0000 (1.0)           0;0  1.5337 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     453.8471 (1.04)     453.8471 (1.04)     453.8471 (1.04)     0.0000 (1.0)      453.8471 (1.04)     0.0000 (1.0)           0;0  2.2034 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     479.4364 (1.10)     479.4364 (1.10)     479.4364 (1.10)     0.0000 (1.0)      479.4364 (1.10)     0.0000 (1.0)           0;0  2.0858 (0.91)          1           1
test_list-list-dvc-only[3.53.2]     435.6678 (1.0)      435.6678 (1.0)      435.6678 (1.0)      0.0000 (1.0)      435.6678 (1.0)      0.0000 (1.0)           0;0  2.2953 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     492.0419 (1.13)     492.0419 (1.13)     492.0419 (1.13)     0.0000 (1.0)      492.0419 (1.13)     0.0000 (1.0)           0;0  2.0323 (0.89)          1           1
test_list-list-dvc-only[main]       456.1905 (1.05)     456.1905 (1.05)     456.1905 (1.05)     0.0000 (1.0)      456.1905 (1.05)     0.0000 (1.0)           0;0  2.1921 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6396 (1.01)     2.6396 (1.01)     2.6396 (1.01)     0.0000 (1.0)      2.6396 (1.01)     0.0000 (1.0)           0;0  0.3789 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.7514 (1.06)     2.7514 (1.06)     2.7514 (1.06)     0.0000 (1.0)      2.7514 (1.06)     0.0000 (1.0)           0;0  0.3634 (0.95)          1           1
test_list-list-recursive[3.53.2]     2.6050 (1.0)      2.6050 (1.0)      2.6050 (1.0)      0.0000 (1.0)      2.6050 (1.0)      0.0000 (1.0)           0;0  0.3839 (1.0)           1           1
test_list-list-recursive[3.60.1]     2.8615 (1.10)     2.8615 (1.10)     2.8615 (1.10)     0.0000 (1.0)      2.8615 (1.10)     0.0000 (1.0)           0;0  0.3495 (0.91)          1           1
test_list-list-recursive[main]       2.7420 (1.05)     2.7420 (1.05)     2.7420 (1.05)     0.0000 (1.0)      2.7420 (1.05)     0.0000 (1.0)           0;0  0.3647 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     450.9442 (1.05)     450.9442 (1.05)     450.9442 (1.05)     0.0000 (1.0)      450.9442 (1.05)     0.0000 (1.0)           0;0  2.2176 (0.95)          1           1
test_list-list-shallow[3.10.0]     478.3744 (1.12)     478.3744 (1.12)     478.3744 (1.12)     0.0000 (1.0)      478.3744 (1.12)     0.0000 (1.0)           0;0  2.0904 (0.90)          1           1
test_list-list-shallow[3.53.2]     428.3196 (1.0)      428.3196 (1.0)      428.3196 (1.0)      0.0000 (1.0)      428.3196 (1.0)      0.0000 (1.0)           0;0  2.3347 (1.0)           1           1
test_list-list-shallow[3.60.1]     432.1349 (1.01)     432.1349 (1.01)     432.1349 (1.01)     0.0000 (1.0)      432.1349 (1.01)     0.0000 (1.0)           0;0  2.3141 (0.99)          1           1
test_list-list-shallow[main]       484.7927 (1.13)     484.7927 (1.13)     484.7927 (1.13)     0.0000 (1.0)      484.7927 (1.13)     0.0000 (1.0)           0;0  2.0627 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.0616 (3.05)     12.0616 (3.05)     12.0616 (3.05)     0.0000 (1.0)      12.0616 (3.05)     0.0000 (1.0)           0;0  0.0829 (0.33)          1           1
test_partial_add-add[3.10.0]     12.5382 (3.17)     12.5382 (3.17)     12.5382 (3.17)     0.0000 (1.0)      12.5382 (3.17)     0.0000 (1.0)           0;0  0.0798 (0.32)          1           1
test_partial_add-add[3.53.2]     11.0485 (2.80)     11.0485 (2.80)     11.0485 (2.80)     0.0000 (1.0)      11.0485 (2.80)     0.0000 (1.0)           0;0  0.0905 (0.36)          1           1
test_partial_add-add[3.60.1]      3.9502 (1.0)       3.9502 (1.0)       3.9502 (1.0)      0.0000 (1.0)       3.9502 (1.0)      0.0000 (1.0)           0;0  0.2531 (1.0)           1           1
test_partial_add-add[main]        5.0065 (1.27)      5.0065 (1.27)      5.0065 (1.27)     0.0000 (1.0)       5.0065 (1.27)     0.0000 (1.0)           0;0  0.1997 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     79.9466 (3.88)     79.9466 (3.88)     79.9466 (3.88)     0.0000 (1.0)      79.9466 (3.88)     0.0000 (1.0)           0;0  0.0125 (0.26)          1           1
test_partial_add-add-partial[3.10.0]     80.6160 (3.92)     80.6160 (3.92)     80.6160 (3.92)     0.0000 (1.0)      80.6160 (3.92)     0.0000 (1.0)           0;0  0.0124 (0.26)          1           1
test_partial_add-add-partial[3.53.2]     73.6547 (3.58)     73.6547 (3.58)     73.6547 (3.58)     0.0000 (1.0)      73.6547 (3.58)     0.0000 (1.0)           0;0  0.0136 (0.28)          1           1
test_partial_add-add-partial[3.60.1]     20.5862 (1.0)      20.5862 (1.0)      20.5862 (1.0)      0.0000 (1.0)      20.5862 (1.0)      0.0000 (1.0)           0;0  0.0486 (1.0)           1           1
test_partial_add-add-partial[main]       21.1684 (1.03)     21.1684 (1.03)     21.1684 (1.03)     0.0000 (1.0)      21.1684 (1.03)     0.0000 (1.0)           0;0  0.0472 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6650 (1.0)      4.6650 (1.0)      4.6650 (1.0)      0.0000 (1.0)      4.6650 (1.0)      0.0000 (1.0)           0;0  0.2144 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.0827 (1.30)     6.0827 (1.30)     6.0827 (1.30)     0.0000 (1.0)      6.0827 (1.30)     0.0000 (1.0)           0;0  0.1644 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9154 (1.48)     6.9154 (1.48)     6.9154 (1.48)     0.0000 (1.0)      6.9154 (1.48)     0.0000 (1.0)           0;0  0.1446 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.0852 (1.52)     7.0852 (1.52)     7.0852 (1.52)     0.0000 (1.0)      7.0852 (1.52)     0.0000 (1.0)           0;0  0.1411 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.3442 (1.36)     6.3442 (1.36)     6.3442 (1.36)     0.0000 (1.0)      6.3442 (1.36)     0.0000 (1.0)           0;0  0.1576 (0.74)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5831 (1.0)      2.5831 (1.0)      2.5831 (1.0)      0.0000 (1.0)      2.5831 (1.0)      0.0000 (1.0)           0;0  0.3871 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8562 (1.49)     3.8562 (1.49)     3.8562 (1.49)     0.0000 (1.0)      3.8562 (1.49)     0.0000 (1.0)           0;0  0.2593 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.8598 (1.49)     3.8598 (1.49)     3.8598 (1.49)     0.0000 (1.0)      3.8598 (1.49)     0.0000 (1.0)           0;0  0.2591 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.9502 (1.53)     3.9502 (1.53)     3.9502 (1.53)     0.0000 (1.0)      3.9502 (1.53)     0.0000 (1.0)           0;0  0.2532 (0.65)          1           1
test_partial_add-gc-noop[main]       3.1018 (1.20)     3.1018 (1.20)     3.1018 (1.20)     0.0000 (1.0)      3.1018 (1.20)     0.0000 (1.0)           0;0  0.3224 (0.83)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.0858 (3.80)     14.0858 (3.80)     14.0858 (3.80)     0.0000 (1.0)      14.0858 (3.80)     0.0000 (1.0)           0;0  0.0710 (0.26)          1           1
test_partial_add-push[3.10.0]      6.8597 (1.85)      6.8597 (1.85)      6.8597 (1.85)     0.0000 (1.0)       6.8597 (1.85)     0.0000 (1.0)           0;0  0.1458 (0.54)          1           1
test_partial_add-push[3.53.2]      3.7088 (1.0)       3.7088 (1.0)       3.7088 (1.0)      0.0000 (1.0)       3.7088 (1.0)      0.0000 (1.0)           0;0  0.2696 (1.0)           1           1
test_partial_add-push[3.60.1]      3.7805 (1.02)      3.7805 (1.02)      3.7805 (1.02)     0.0000 (1.0)       3.7805 (1.02)     0.0000 (1.0)           0;0  0.2645 (0.98)          1           1
test_partial_add-push[main]        3.8929 (1.05)      3.8929 (1.05)      3.8929 (1.05)     0.0000 (1.0)       3.8929 (1.05)     0.0000 (1.0)           0;0  0.2569 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     83.3938 (3.95)     83.3938 (3.95)     83.3938 (3.95)     0.0000 (1.0)      83.3938 (3.95)     0.0000 (1.0)           0;0  0.0120 (0.25)          1           1
test_partial_add-push-partial[3.10.0]     40.1918 (1.90)     40.1918 (1.90)     40.1918 (1.90)     0.0000 (1.0)      40.1918 (1.90)     0.0000 (1.0)           0;0  0.0249 (0.53)          1           1
test_partial_add-push-partial[3.53.2]     21.4533 (1.02)     21.4533 (1.02)     21.4533 (1.02)     0.0000 (1.0)      21.4533 (1.02)     0.0000 (1.0)           0;0  0.0466 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     21.1025 (1.0)      21.1025 (1.0)      21.1025 (1.0)      0.0000 (1.0)      21.1025 (1.0)      0.0000 (1.0)           0;0  0.0474 (1.0)           1           1
test_partial_add-push-partial[main]       21.1553 (1.00)     21.1553 (1.00)     21.1553 (1.00)     0.0000 (1.0)      21.1553 (1.00)     0.0000 (1.0)           0;0  0.0473 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     89.0481 (3.80)     89.0481 (3.80)     89.0481 (3.80)     0.0000 (1.0)      89.0481 (3.80)     0.0000 (1.0)           0;0  0.0112 (0.26)          1           1
test_partial_remove-add[3.10.0]     89.2309 (3.81)     89.2309 (3.81)     89.2309 (3.81)     0.0000 (1.0)      89.2309 (3.81)     0.0000 (1.0)           0;0  0.0112 (0.26)          1           1
test_partial_remove-add[3.53.2]     79.7105 (3.40)     79.7105 (3.40)     79.7105 (3.40)     0.0000 (1.0)      79.7105 (3.40)     0.0000 (1.0)           0;0  0.0125 (0.29)          1           1
test_partial_remove-add[3.60.1]     23.4213 (1.0)      23.4213 (1.0)      23.4213 (1.0)      0.0000 (1.0)      23.4213 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
test_partial_remove-add[main]       24.9636 (1.07)     24.9636 (1.07)     24.9636 (1.07)     0.0000 (1.0)      24.9636 (1.07)     0.0000 (1.0)           0;0  0.0401 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     49.3798 (12.74)    49.3798 (12.74)    49.3798 (12.74)    0.0000 (1.0)      49.3798 (12.74)    0.0000 (1.0)           0;0  0.0203 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     50.2352 (12.96)    50.2352 (12.96)    50.2352 (12.96)    0.0000 (1.0)      50.2352 (12.96)    0.0000 (1.0)           0;0  0.0199 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     45.3519 (11.70)    45.3519 (11.70)    45.3519 (11.70)    0.0000 (1.0)      45.3519 (11.70)    0.0000 (1.0)           0;0  0.0220 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.8760 (1.0)       3.8760 (1.0)       3.8760 (1.0)      0.0000 (1.0)       3.8760 (1.0)      0.0000 (1.0)           0;0  0.2580 (1.0)           1           1
test_partial_remove-add-update[main]        4.0498 (1.04)      4.0498 (1.04)      4.0498 (1.04)     0.0000 (1.0)       4.0498 (1.04)     0.0000 (1.0)           0;0  0.2469 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6841 (1.0)      2.6841 (1.0)      2.6841 (1.0)      0.0000 (1.0)      2.6841 (1.0)      0.0000 (1.0)           0;0  0.3726 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.8688 (1.44)     3.8688 (1.44)     3.8688 (1.44)     0.0000 (1.0)      3.8688 (1.44)     0.0000 (1.0)           0;0  0.2585 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.8396 (1.43)     3.8396 (1.43)     3.8396 (1.43)     0.0000 (1.0)      3.8396 (1.43)     0.0000 (1.0)           0;0  0.2604 (0.70)          1           1
test_partial_remove-gc[3.60.1]     3.9107 (1.46)     3.9107 (1.46)     3.9107 (1.46)     0.0000 (1.0)      3.9107 (1.46)     0.0000 (1.0)           0;0  0.2557 (0.69)          1           1
test_partial_remove-gc[main]       2.9435 (1.10)     2.9435 (1.10)     2.9435 (1.10)     0.0000 (1.0)      2.9435 (1.10)     0.0000 (1.0)           0;0  0.3397 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.9055 (1.0)      4.9055 (1.0)      4.9055 (1.0)      0.0000 (1.0)      4.9055 (1.0)      0.0000 (1.0)           0;0  0.2039 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.2225 (1.27)     6.2225 (1.27)     6.2225 (1.27)     0.0000 (1.0)      6.2225 (1.27)     0.0000 (1.0)           0;0  0.1607 (0.79)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8088 (1.39)     6.8088 (1.39)     6.8088 (1.39)     0.0000 (1.0)      6.8088 (1.39)     0.0000 (1.0)           0;0  0.1469 (0.72)          1           1
test_partial_remove-gc-cloud[3.60.1]     7.1938 (1.47)     7.1938 (1.47)     7.1938 (1.47)     0.0000 (1.0)      7.1938 (1.47)     0.0000 (1.0)           0;0  0.1390 (0.68)          1           1
test_partial_remove-gc-cloud[main]       6.1252 (1.25)     6.1252 (1.25)     6.1252 (1.25)     0.0000 (1.0)      6.1252 (1.25)     0.0000 (1.0)           0;0  0.1633 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     98.5462 (4.14)     98.5462 (4.14)     98.5462 (4.14)     0.0000 (1.0)      98.5462 (4.14)     0.0000 (1.0)           0;0  0.0101 (0.24)          1           1
test_partial_remove-push[3.10.0]     46.3887 (1.95)     46.3887 (1.95)     46.3887 (1.95)     0.0000 (1.0)      46.3887 (1.95)     0.0000 (1.0)           0;0  0.0216 (0.51)          1           1
test_partial_remove-push[3.53.2]     24.1469 (1.01)     24.1469 (1.01)     24.1469 (1.01)     0.0000 (1.0)      24.1469 (1.01)     0.0000 (1.0)           0;0  0.0414 (0.99)          1           1
test_partial_remove-push[3.60.1]     23.8123 (1.0)      23.8123 (1.0)      23.8123 (1.0)      0.0000 (1.0)      23.8123 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
test_partial_remove-push[main]       23.8569 (1.00)     23.8569 (1.00)     23.8569 (1.00)     0.0000 (1.0)      23.8569 (1.00)     0.0000 (1.0)           0;0  0.0419 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.2544 (1.0)      4.2544 (1.0)      4.2544 (1.0)      0.0000 (1.0)      4.2544 (1.0)      0.0000 (1.0)           0;0  0.2351 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.2596 (1.00)     4.2596 (1.00)     4.2596 (1.00)     0.0000 (1.0)      4.2596 (1.00)     0.0000 (1.0)           0;0  0.2348 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     7.6492 (1.80)     7.6492 (1.80)     7.6492 (1.80)     0.0000 (1.0)      7.6492 (1.80)     0.0000 (1.0)           0;0  0.1307 (0.56)          1           1
test_partial_remove-push-update[3.60.1]     7.6129 (1.79)     7.6129 (1.79)     7.6129 (1.79)     0.0000 (1.0)      7.6129 (1.79)     0.0000 (1.0)           0;0  0.1314 (0.56)          1           1
test_partial_remove-push-update[main]       7.6538 (1.80)     7.6538 (1.80)     7.6538 (1.80)     0.0000 (1.0)      7.6538 (1.80)     0.0000 (1.0)           0;0  0.1307 (0.56)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]       565.1317 (1.0)        580.0639 (1.0)        571.6961 (1.0)       5.7562 (1.48)       570.1512 (1.0)       8.1068 (2.23)          2;0  1.7492 (1.0)           5           3
test_plots-plots-diff[3.10.0]     1,029.3199 (1.82)     1,069.8601 (1.84)     1,053.7114 (1.84)     15.0850 (3.88)     1,057.8485 (1.86)     15.8427 (4.37)          2;0  0.9490 (0.54)          5           3
test_plots-plots-diff[3.53.2]     1,027.8731 (1.82)     1,037.0076 (1.79)     1,032.7665 (1.81)      4.2704 (1.10)     1,033.7449 (1.81)      8.0932 (2.23)          1;0  0.9683 (0.55)          5           3
test_plots-plots-diff[3.60.1]       953.7981 (1.69)       964.6519 (1.66)       959.6967 (1.68)      3.8901 (1.0)        960.3201 (1.68)      3.6291 (1.0)           2;0  1.0420 (0.60)          5           3
test_plots-plots-diff[main]         975.4258 (1.73)     1,016.1463 (1.75)       994.6097 (1.74)     17.1944 (4.42)       998.6963 (1.75)     28.9547 (7.98)          2;0  1.0054 (0.57)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       580.8697 (1.0)        603.6973 (1.0)        592.1000 (1.0)       9.6295 (1.43)       595.2721 (1.0)      15.9887 (1.51)          2;0  1.6889 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,238.0773 (2.13)     1,312.0013 (2.17)     1,269.6245 (2.14)     26.9252 (3.99)     1,267.2792 (2.13)     27.1865 (2.56)          2;0  0.7876 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]     1,108.3302 (1.91)     1,125.1181 (1.86)     1,117.5011 (1.89)      6.7495 (1.0)      1,119.3339 (1.88)     10.6226 (1.0)           2;0  0.8949 (0.53)          5           3
test_plots-plots-diff-json[3.60.1]     1,043.3838 (1.80)     1,077.3280 (1.78)     1,060.5259 (1.79)     12.2599 (1.82)     1,061.8401 (1.78)     13.5566 (1.28)          2;0  0.9429 (0.56)          5           3
test_plots-plots-diff-json[main]       1,064.0854 (1.83)     1,113.5893 (1.84)     1,084.4838 (1.83)     21.2312 (3.15)     1,073.0423 (1.80)     33.7260 (3.17)          1;0  0.9221 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     457.1346 (1.0)      469.8330 (1.0)      464.6207 (1.0)       4.8080 (1.0)      465.4486 (1.0)       6.0847 (1.29)          2;0  2.1523 (1.0)           5           3
test_plots-plots-show[3.10.0]     813.9471 (1.78)     851.0888 (1.81)     835.0142 (1.80)     14.9652 (3.11)     838.9675 (1.80)     23.4145 (4.97)          2;0  1.1976 (0.56)          5           3
test_plots-plots-show[3.53.2]     804.1497 (1.76)     845.3230 (1.80)     817.7986 (1.76)     16.8904 (3.51)     809.0057 (1.74)     21.2664 (4.51)          1;0  1.2228 (0.57)          5           3
test_plots-plots-show[3.60.1]     798.2232 (1.75)     811.1895 (1.73)     807.7365 (1.74)      5.3993 (1.12)     809.6956 (1.74)      4.7158 (1.0)           1;1  1.2380 (0.58)          5           3
test_plots-plots-show[main]       844.9458 (1.85)     867.9076 (1.85)     854.6821 (1.84)      8.4521 (1.76)     853.4905 (1.83)      9.4118 (2.00)          2;0  1.1700 (0.54)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------------
Name (time in ms)                           Min                   Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     481.0179 (1.0)        487.9734 (1.0)      485.1438 (1.0)       2.6208 (1.0)      485.7613 (1.0)       3.1750 (1.0)           2;0  2.0612 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     955.3306 (1.99)     1,029.1945 (2.11)     991.5307 (2.04)     28.8891 (11.02)    997.8111 (2.05)     43.1107 (13.58)         2;0  1.0085 (0.49)          5           3
test_plots-plots-show-json[3.53.2]     879.3380 (1.83)       920.2576 (1.89)     896.6938 (1.85)     16.9106 (6.45)     896.2461 (1.85)     27.6780 (8.72)          2;0  1.1152 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     853.8756 (1.78)       891.4046 (1.83)     867.4614 (1.79)     14.3307 (5.47)     863.9655 (1.78)     14.9814 (4.72)          1;0  1.1528 (0.56)          5           3
test_plots-plots-show-json[main]       864.3411 (1.80)       897.6069 (1.84)     886.1630 (1.83)     12.7093 (4.85)     890.0656 (1.83)     10.0746 (3.17)          1;1  1.1285 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     81.6643 (5.64)     81.6643 (5.64)     81.6643 (5.64)     0.0000 (1.0)      81.6643 (5.64)     0.0000 (1.0)           0;0  0.0122 (0.18)          1           1
test_push-push[3.10.0]     34.9547 (2.42)     34.9547 (2.42)     34.9547 (2.42)     0.0000 (1.0)      34.9547 (2.42)     0.0000 (1.0)           0;0  0.0286 (0.41)          1           1
test_push-push[3.53.2]     15.1497 (1.05)     15.1497 (1.05)     15.1497 (1.05)     0.0000 (1.0)      15.1497 (1.05)     0.0000 (1.0)           0;0  0.0660 (0.96)          1           1
test_push-push[3.60.1]     15.0128 (1.04)     15.0128 (1.04)     15.0128 (1.04)     0.0000 (1.0)      15.0128 (1.04)     0.0000 (1.0)           0;0  0.0666 (0.96)          1           1
test_push-push[main]       14.4682 (1.0)      14.4682 (1.0)      14.4682 (1.0)      0.0000 (1.0)      14.4682 (1.0)      0.0000 (1.0)           0;0  0.0691 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     112.8574 (4.87)     112.8574 (4.87)     112.8574 (4.87)     0.0000 (1.0)      112.8574 (4.87)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_sharing-fetch[3.10.0]     119.0403 (5.13)     119.0403 (5.13)     119.0403 (5.13)     0.0000 (1.0)      119.0403 (5.13)     0.0000 (1.0)           0;0  0.0084 (0.19)          1           1
test_sharing-fetch[3.53.2]      33.4887 (1.44)      33.4887 (1.44)      33.4887 (1.44)     0.0000 (1.0)       33.4887 (1.44)     0.0000 (1.0)           0;0  0.0299 (0.69)          1           1
test_sharing-fetch[3.60.1]      23.1965 (1.0)       23.1965 (1.0)       23.1965 (1.0)      0.0000 (1.0)       23.1965 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
test_sharing-fetch[main]        23.4067 (1.01)      23.4067 (1.01)      23.4067 (1.01)     0.0000 (1.0)       23.4067 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3131 (1.0)      1.3131 (1.0)      1.3131 (1.0)      0.0000 (1.0)      1.3131 (1.0)      0.0000 (1.0)           0;0  0.7615 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8212 (2.91)     3.8212 (2.91)     3.8212 (2.91)     0.0000 (1.0)      3.8212 (2.91)     0.0000 (1.0)           0;0  0.2617 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     6.0400 (4.60)     6.0400 (4.60)     6.0400 (4.60)     0.0000 (1.0)      6.0400 (4.60)     0.0000 (1.0)           0;0  0.1656 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     6.0626 (4.62)     6.0626 (4.62)     6.0626 (4.62)     0.0000 (1.0)      6.0626 (4.62)     0.0000 (1.0)           0;0  0.1649 (0.22)          1           1
test_sharing-fetch-noop[main]       6.1269 (4.67)     6.1269 (4.67)     6.1269 (4.67)     0.0000 (1.0)      6.1269 (4.67)     0.0000 (1.0)           0;0  0.1632 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     100.9147 (4.38)     100.9147 (4.38)     100.9147 (4.38)     0.0000 (1.0)      100.9147 (4.38)     0.0000 (1.0)           0;0  0.0099 (0.23)          1           1
test_sharing-push[3.10.0]      49.4204 (2.14)      49.4204 (2.14)      49.4204 (2.14)     0.0000 (1.0)       49.4204 (2.14)     0.0000 (1.0)           0;0  0.0202 (0.47)          1           1
test_sharing-push[3.53.2]      23.9204 (1.04)      23.9204 (1.04)      23.9204 (1.04)     0.0000 (1.0)       23.9204 (1.04)     0.0000 (1.0)           0;0  0.0418 (0.96)          1           1
test_sharing-push[3.60.1]      23.0592 (1.0)       23.0592 (1.0)       23.0592 (1.0)      0.0000 (1.0)       23.0592 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
test_sharing-push[main]        23.7931 (1.03)      23.7931 (1.03)      23.7931 (1.03)     0.0000 (1.0)       23.7931 (1.03)     0.0000 (1.0)           0;0  0.0420 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0969 (1.0)      2.0969 (1.0)      2.0969 (1.0)      0.0000 (1.0)      2.0969 (1.0)      0.0000 (1.0)           0;0  0.4769 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2396 (1.07)     2.2396 (1.07)     2.2396 (1.07)     0.0000 (1.0)      2.2396 (1.07)     0.0000 (1.0)           0;0  0.4465 (0.94)          1           1
test_sharing-push-noop[3.53.2]     6.3362 (3.02)     6.3362 (3.02)     6.3362 (3.02)     0.0000 (1.0)      6.3362 (3.02)     0.0000 (1.0)           0;0  0.1578 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.4752 (3.09)     6.4752 (3.09)     6.4752 (3.09)     0.0000 (1.0)      6.4752 (3.09)     0.0000 (1.0)           0;0  0.1544 (0.32)          1           1
test_sharing-push-noop[main]       6.1723 (2.94)     6.1723 (2.94)     6.1723 (2.94)     0.0000 (1.0)      6.1723 (2.94)     0.0000 (1.0)           0;0  0.1620 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     152.5132 (1.09)     152.5132 (1.09)     152.5132 (1.09)     0.0000 (1.0)      152.5132 (1.09)     0.0000 (1.0)           0;0  0.0066 (0.92)          1           1
test_sharing_azure-fetch[main]       140.3405 (1.0)      140.3405 (1.0)      140.3405 (1.0)      0.0000 (1.0)      140.3405 (1.0)      0.0000 (1.0)           0;0  0.0071 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4726 (1.0)      6.4726 (1.0)      6.4726 (1.0)      0.0000 (1.0)      6.4726 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4807 (1.00)     6.4807 (1.00)     6.4807 (1.00)     0.0000 (1.0)      6.4807 (1.00)     0.0000 (1.0)           0;0  0.1543 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     123.8560 (1.0)      123.8560 (1.0)      123.8560 (1.0)      0.0000 (1.0)      123.8560 (1.0)      0.0000 (1.0)           0;0  0.0081 (1.0)           1           1
test_sharing_azure-push[main]       125.9173 (1.02)     125.9173 (1.02)     125.9173 (1.02)     0.0000 (1.0)      125.9173 (1.02)     0.0000 (1.0)           0;0  0.0079 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.5145 (1.0)      6.5145 (1.0)      6.5145 (1.0)      0.0000 (1.0)      6.5145 (1.0)      0.0000 (1.0)           0;0  0.1535 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.6665 (1.02)     6.6665 (1.02)     6.6665 (1.02)     0.0000 (1.0)      6.6665 (1.02)     0.0000 (1.0)           0;0  0.1500 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     438.4730 (1.04)     438.4730 (1.04)     438.4730 (1.04)     0.0000 (1.0)      438.4730 (1.04)     0.0000 (1.0)           0;0  0.0023 (0.97)          1           1
test_sharing_s3-fetch[main]       423.4607 (1.0)      423.4607 (1.0)      423.4607 (1.0)      0.0000 (1.0)      423.4607 (1.0)      0.0000 (1.0)           0;0  0.0024 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2944 (1.0)      6.2944 (1.0)      6.2944 (1.0)      0.0000 (1.0)      6.2944 (1.0)      0.0000 (1.0)           0;0  0.1589 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.4101 (1.02)     6.4101 (1.02)     6.4101 (1.02)     0.0000 (1.0)      6.4101 (1.02)     0.0000 (1.0)           0;0  0.1560 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     451.9684 (1.01)     451.9684 (1.01)     451.9684 (1.01)     0.0000 (1.0)      451.9684 (1.01)     0.0000 (1.0)           0;0  0.0022 (0.99)          1           1
test_sharing_s3-push[main]       449.2968 (1.0)      449.2968 (1.0)      449.2968 (1.0)      0.0000 (1.0)      449.2968 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.6552 (1.0)      6.6552 (1.0)      6.6552 (1.0)      0.0000 (1.0)      6.6552 (1.0)      0.0000 (1.0)           0;0  0.1503 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.7653 (1.02)     6.7653 (1.02)     6.7653 (1.02)     0.0000 (1.0)      6.7653 (1.02)     0.0000 (1.0)           0;0  0.1478 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.4839 (3.79)     20.4839 (3.79)     20.4839 (3.79)     0.0000 (1.0)      20.4839 (3.79)     0.0000 (1.0)           0;0  0.0488 (0.26)          1           1
test_status-status[3.10.0]     20.9265 (3.87)     20.9265 (3.87)     20.9265 (3.87)     0.0000 (1.0)      20.9265 (3.87)     0.0000 (1.0)           0;0  0.0478 (0.26)          1           1
test_status-status[3.53.2]     19.1470 (3.54)     19.1470 (3.54)     19.1470 (3.54)     0.0000 (1.0)      19.1470 (3.54)     0.0000 (1.0)           0;0  0.0522 (0.28)          1           1
test_status-status[3.60.1]      5.4050 (1.0)       5.4050 (1.0)       5.4050 (1.0)      0.0000 (1.0)       5.4050 (1.0)      0.0000 (1.0)           0;0  0.1850 (1.0)           1           1
test_status-status[main]        5.5107 (1.02)      5.5107 (1.02)      5.5107 (1.02)     0.0000 (1.0)       5.5107 (1.02)     0.0000 (1.0)           0;0  0.1815 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8850 (1.78)     4.8850 (1.78)     4.8850 (1.78)     0.0000 (1.0)      4.8850 (1.78)     0.0000 (1.0)           0;0  0.2047 (0.56)          1           1
test_status-status-changed[3.10.0]     5.4001 (1.97)     5.4001 (1.97)     5.4001 (1.97)     0.0000 (1.0)      5.4001 (1.97)     0.0000 (1.0)           0;0  0.1852 (0.51)          1           1
test_status-status-changed[3.53.2]     5.1757 (1.89)     5.1757 (1.89)     5.1757 (1.89)     0.0000 (1.0)      5.1757 (1.89)     0.0000 (1.0)           0;0  0.1932 (0.53)          1           1
test_status-status-changed[3.60.1]     2.7441 (1.0)      2.7441 (1.0)      2.7441 (1.0)      0.0000 (1.0)      2.7441 (1.0)      0.0000 (1.0)           0;0  0.3644 (1.0)           1           1
test_status-status-changed[main]       2.9327 (1.07)     2.9327 (1.07)     2.9327 (1.07)     0.0000 (1.0)      2.9327 (1.07)     0.0000 (1.0)           0;0  0.3410 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0563 (1.93)     5.0563 (1.93)     5.0563 (1.93)     0.0000 (1.0)      5.0563 (1.93)     0.0000 (1.0)           0;0  0.1978 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.1636 (1.97)     5.1636 (1.97)     5.1636 (1.97)     0.0000 (1.0)      5.1636 (1.97)     0.0000 (1.0)           0;0  0.1937 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     5.0875 (1.94)     5.0875 (1.94)     5.0875 (1.94)     0.0000 (1.0)      5.0875 (1.94)     0.0000 (1.0)           0;0  0.1966 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.6257 (1.0)      2.6257 (1.0)      2.6257 (1.0)      0.0000 (1.0)      2.6257 (1.0)      0.0000 (1.0)           0;0  0.3808 (1.0)           1           1
test_status-status-changed-noop[main]       2.7900 (1.06)     2.7900 (1.06)     2.7900 (1.06)     0.0000 (1.0)      2.7900 (1.06)     0.0000 (1.0)           0;0  0.3584 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0794 (1.95)     5.0794 (1.95)     5.0794 (1.95)     0.0000 (1.0)      5.0794 (1.95)     0.0000 (1.0)           0;0  0.1969 (0.51)          1           1
test_status-status-noop[3.10.0]     5.3256 (2.04)     5.3256 (2.04)     5.3256 (2.04)     0.0000 (1.0)      5.3256 (2.04)     0.0000 (1.0)           0;0  0.1878 (0.49)          1           1
test_status-status-noop[3.53.2]     5.0903 (1.95)     5.0903 (1.95)     5.0903 (1.95)     0.0000 (1.0)      5.0903 (1.95)     0.0000 (1.0)           0;0  0.1965 (0.51)          1           1
test_status-status-noop[3.60.1]     2.6108 (1.0)      2.6108 (1.0)      2.6108 (1.0)      0.0000 (1.0)      2.6108 (1.0)      0.0000 (1.0)           0;0  0.3830 (1.0)           1           1
test_status-status-noop[main]       2.7980 (1.07)     2.7980 (1.07)     2.7980 (1.07)     0.0000 (1.0)      2.7980 (1.07)     0.0000 (1.0)           0;0  0.3574 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     187.8227 (4.26)     187.8227 (4.26)     187.8227 (4.26)     0.0000 (1.0)      187.8227 (4.26)     0.0000 (1.0)           0;0  0.0053 (0.23)          1           1
test_update-import-url[3.10.0]     192.1602 (4.36)     192.1602 (4.36)     192.1602 (4.36)     0.0000 (1.0)      192.1602 (4.36)     0.0000 (1.0)           0;0  0.0052 (0.23)          1           1
test_update-import-url[3.53.2]     106.6873 (2.42)     106.6873 (2.42)     106.6873 (2.42)     0.0000 (1.0)      106.6873 (2.42)     0.0000 (1.0)           0;0  0.0094 (0.41)          1           1
test_update-import-url[3.60.1]      44.0566 (1.0)       44.0566 (1.0)       44.0566 (1.0)      0.0000 (1.0)       44.0566 (1.0)      0.0000 (1.0)           0;0  0.0227 (1.0)           1           1
test_update-import-url[main]        45.3217 (1.03)      45.3217 (1.03)      45.3217 (1.03)     0.0000 (1.0)       45.3217 (1.03)     0.0000 (1.0)           0;0  0.0221 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     170.5419 (5.03)     170.5419 (5.03)     170.5419 (5.03)     0.0000 (1.0)      170.5419 (5.03)     0.0000 (1.0)           0;0  0.0059 (0.20)          1           1
test_update-update[3.10.0]     173.2395 (5.11)     173.2395 (5.11)     173.2395 (5.11)     0.0000 (1.0)      173.2395 (5.11)     0.0000 (1.0)           0;0  0.0058 (0.20)          1           1
test_update-update[3.53.2]      95.9391 (2.83)      95.9391 (2.83)      95.9391 (2.83)     0.0000 (1.0)       95.9391 (2.83)     0.0000 (1.0)           0;0  0.0104 (0.35)          1           1
test_update-update[3.60.1]      33.9034 (1.0)       33.9034 (1.0)       33.9034 (1.0)      0.0000 (1.0)       33.9034 (1.0)      0.0000 (1.0)           0;0  0.0295 (1.0)           1           1
test_update-update[main]        34.7084 (1.02)      34.7084 (1.02)      34.7084 (1.02)     0.0000 (1.0)       34.7084 (1.02)     0.0000 (1.0)           0;0  0.0288 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     13.2697 (1.73)     13.2697 (1.73)     13.2697 (1.73)     0.0000 (1.0)      13.2697 (1.73)     0.0000 (1.0)           0;0  0.0754 (0.58)          1           1
test_update-update-noop[3.10.0]     13.5615 (1.76)     13.5615 (1.76)     13.5615 (1.76)     0.0000 (1.0)      13.5615 (1.76)     0.0000 (1.0)           0;0  0.0737 (0.57)          1           1
test_update-update-noop[3.53.2]     13.0494 (1.70)     13.0494 (1.70)     13.0494 (1.70)     0.0000 (1.0)      13.0494 (1.70)     0.0000 (1.0)           0;0  0.0766 (0.59)          1           1
test_update-update-noop[3.60.1]      7.6849 (1.0)       7.6849 (1.0)       7.6849 (1.0)      0.0000 (1.0)       7.6849 (1.0)      0.0000 (1.0)           0;0  0.1301 (1.0)           1           1
test_update-update-noop[main]        8.3171 (1.08)      8.3171 (1.08)      8.3171 (1.08)     0.0000 (1.0)       8.3171 (1.08)     0.0000 (1.0)           0;0  0.1202 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean