Mon Mar 16 01:31:21 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     88.1554 (3.67)     88.1554 (3.67)     88.1554 (3.67)     0.0000 (1.0)      88.1554 (3.67)     0.0000 (1.0)           0;0  0.0113 (0.27)          1           1
test_add_copy-add[3.10.0]     87.9203 (3.66)     87.9203 (3.66)     87.9203 (3.66)     0.0000 (1.0)      87.9203 (3.66)     0.0000 (1.0)           0;0  0.0114 (0.27)          1           1
test_add_copy-add[3.53.2]     78.6378 (3.28)     78.6378 (3.28)     78.6378 (3.28)     0.0000 (1.0)      78.6378 (3.28)     0.0000 (1.0)           0;0  0.0127 (0.31)          1           1
test_add_copy-add[3.60.1]     24.0099 (1.0)      24.0099 (1.0)      24.0099 (1.0)      0.0000 (1.0)      24.0099 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
test_add_copy-add[main]       25.3863 (1.06)     25.3863 (1.06)     25.3863 (1.06)     0.0000 (1.0)      25.3863 (1.06)     0.0000 (1.0)           0;0  0.0394 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     28.8510 (6.36)     28.8510 (6.36)     28.8510 (6.36)     0.0000 (1.0)      28.8510 (6.36)     0.0000 (1.0)           0;0  0.0347 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     28.8173 (6.35)     28.8173 (6.35)     28.8173 (6.35)     0.0000 (1.0)      28.8173 (6.35)     0.0000 (1.0)           0;0  0.0347 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     27.1810 (5.99)     27.1810 (5.99)     27.1810 (5.99)     0.0000 (1.0)      27.1810 (5.99)     0.0000 (1.0)           0;0  0.0368 (0.17)          1           1
test_add_copy-add-noop[3.60.1]      4.5382 (1.0)       4.5382 (1.0)       4.5382 (1.0)      0.0000 (1.0)       4.5382 (1.0)      0.0000 (1.0)           0;0  0.2204 (1.0)           1           1
test_add_copy-add-noop[main]        4.9432 (1.09)      4.9432 (1.09)      4.9432 (1.09)     0.0000 (1.0)       4.9432 (1.09)     0.0000 (1.0)           0;0  0.2023 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     69.0017 (4.26)     69.0017 (4.26)     69.0017 (4.26)     0.0000 (1.0)      69.0017 (4.26)     0.0000 (1.0)           0;0  0.0145 (0.23)          1           1
test_add_hardlink-add[3.10.0]     70.0525 (4.33)     70.0525 (4.33)     70.0525 (4.33)     0.0000 (1.0)      70.0525 (4.33)     0.0000 (1.0)           0;0  0.0143 (0.23)          1           1
test_add_hardlink-add[3.53.2]     64.0995 (3.96)     64.0995 (3.96)     64.0995 (3.96)     0.0000 (1.0)      64.0995 (3.96)     0.0000 (1.0)           0;0  0.0156 (0.25)          1           1
test_add_hardlink-add[3.60.1]     16.1867 (1.0)      16.1867 (1.0)      16.1867 (1.0)      0.0000 (1.0)      16.1867 (1.0)      0.0000 (1.0)           0;0  0.0618 (1.0)           1           1
test_add_hardlink-add[main]       17.8158 (1.10)     17.8158 (1.10)     17.8158 (1.10)     0.0000 (1.0)      17.8158 (1.10)     0.0000 (1.0)           0;0  0.0561 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.7909 (8.03)     34.7909 (8.03)     34.7909 (8.03)     0.0000 (1.0)      34.7909 (8.03)     0.0000 (1.0)           0;0  0.0287 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     35.0812 (8.10)     35.0812 (8.10)     35.0812 (8.10)     0.0000 (1.0)      35.0812 (8.10)     0.0000 (1.0)           0;0  0.0285 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     33.1209 (7.65)     33.1209 (7.65)     33.1209 (7.65)     0.0000 (1.0)      33.1209 (7.65)     0.0000 (1.0)           0;0  0.0302 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3308 (1.0)       4.3308 (1.0)       4.3308 (1.0)      0.0000 (1.0)       4.3308 (1.0)      0.0000 (1.0)           0;0  0.2309 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4671 (1.03)      4.4671 (1.03)      4.4671 (1.03)     0.0000 (1.0)       4.4671 (1.03)     0.0000 (1.0)           0;0  0.2239 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.7073 (1.96)     71.7073 (1.96)     71.7073 (1.96)     0.0000 (1.0)      71.7073 (1.96)     0.0000 (1.0)           0;0  0.0139 (0.51)          1           1
test_add_symlink-add[3.10.0]     72.4358 (1.98)     72.4358 (1.98)     72.4358 (1.98)     0.0000 (1.0)      72.4358 (1.98)     0.0000 (1.0)           0;0  0.0138 (0.50)          1           1
test_add_symlink-add[3.53.2]     67.1621 (1.84)     67.1621 (1.84)     67.1621 (1.84)     0.0000 (1.0)      67.1621 (1.84)     0.0000 (1.0)           0;0  0.0149 (0.54)          1           1
test_add_symlink-add[3.60.1]     36.5161 (1.0)      36.5161 (1.0)      36.5161 (1.0)      0.0000 (1.0)      36.5161 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
test_add_symlink-add[main]       37.6748 (1.03)     37.6748 (1.03)     37.6748 (1.03)     0.0000 (1.0)      37.6748 (1.03)     0.0000 (1.0)           0;0  0.0265 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.2627 (8.47)     45.2627 (8.47)     45.2627 (8.47)     0.0000 (1.0)      45.2627 (8.47)     0.0000 (1.0)           0;0  0.0221 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.7169 (8.55)     45.7169 (8.55)     45.7169 (8.55)     0.0000 (1.0)      45.7169 (8.55)     0.0000 (1.0)           0;0  0.0219 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.7871 (8.38)     44.7871 (8.38)     44.7871 (8.38)     0.0000 (1.0)      44.7871 (8.38)     0.0000 (1.0)           0;0  0.0223 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.3460 (1.0)       5.3460 (1.0)       5.3460 (1.0)      0.0000 (1.0)       5.3460 (1.0)      0.0000 (1.0)           0;0  0.1871 (1.0)           1           1
test_add_symlink-add-noop[main]        5.4402 (1.02)      5.4402 (1.02)      5.4402 (1.02)     0.0000 (1.0)       5.4402 (1.02)     0.0000 (1.0)           0;0  0.1838 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.9365 (1.91)      40.9365 (1.91)      40.9365 (1.91)     0.0000 (1.0)       40.9365 (1.91)     0.0000 (1.0)           0;0  0.0244 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     105.0550 (4.90)     105.0550 (4.90)     105.0550 (4.90)     0.0000 (1.0)      105.0550 (4.90)     0.0000 (1.0)           0;0  0.0095 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      28.6815 (1.34)      28.6815 (1.34)      28.6815 (1.34)     0.0000 (1.0)       28.6815 (1.34)     0.0000 (1.0)           0;0  0.0349 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]      21.4335 (1.0)       21.4335 (1.0)       21.4335 (1.0)      0.0000 (1.0)       21.4335 (1.0)      0.0000 (1.0)           0;0  0.0467 (1.0)           1           1
test_checkout_copy-checkout[main]        22.1051 (1.03)      22.1051 (1.03)      22.1051 (1.03)     0.0000 (1.0)       22.1051 (1.03)     0.0000 (1.0)           0;0  0.0452 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6330 (1.75)     5.6330 (1.75)     5.6330 (1.75)     0.0000 (1.0)      5.6330 (1.75)     0.0000 (1.0)           0;0  0.1775 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8549 (1.82)     5.8549 (1.82)     5.8549 (1.82)     0.0000 (1.0)      5.8549 (1.82)     0.0000 (1.0)           0;0  0.1708 (0.55)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7090 (1.77)     5.7090 (1.77)     5.7090 (1.77)     0.0000 (1.0)      5.7090 (1.77)     0.0000 (1.0)           0;0  0.1752 (0.56)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2181 (1.0)      3.2181 (1.0)      3.2181 (1.0)      0.0000 (1.0)      3.2181 (1.0)      0.0000 (1.0)           0;0  0.3107 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3341 (1.04)     3.3341 (1.04)     3.3341 (1.04)     0.0000 (1.0)      3.3341 (1.04)     0.0000 (1.0)           0;0  0.2999 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.6411 (1.99)     7.6411 (1.99)     7.6411 (1.99)     0.0000 (1.0)      7.6411 (1.99)     0.0000 (1.0)           0;0  0.1309 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4938 (1.69)     6.4938 (1.69)     6.4938 (1.69)     0.0000 (1.0)      6.4938 (1.69)     0.0000 (1.0)           0;0  0.1540 (0.59)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3263 (1.65)     6.3263 (1.65)     6.3263 (1.65)     0.0000 (1.0)      6.3263 (1.65)     0.0000 (1.0)           0;0  0.1581 (0.61)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8359 (1.0)      3.8359 (1.0)      3.8359 (1.0)      0.0000 (1.0)      3.8359 (1.0)      0.0000 (1.0)           0;0  0.2607 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.2827 (1.12)     4.2827 (1.12)     4.2827 (1.12)     0.0000 (1.0)      4.2827 (1.12)     0.0000 (1.0)           0;0  0.2335 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.4484 (2.82)     21.4484 (2.82)     21.4484 (2.82)     0.0000 (1.0)      21.4484 (2.82)     0.0000 (1.0)           0;0  0.0466 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.4798 (2.16)     16.4798 (2.16)     16.4798 (2.16)     0.0000 (1.0)      16.4798 (2.16)     0.0000 (1.0)           0;0  0.0607 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.7484 (1.94)     14.7484 (1.94)     14.7484 (1.94)     0.0000 (1.0)      14.7484 (1.94)     0.0000 (1.0)           0;0  0.0678 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6149 (1.0)       7.6149 (1.0)       7.6149 (1.0)      0.0000 (1.0)       7.6149 (1.0)      0.0000 (1.0)           0;0  0.1313 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2016 (1.08)      8.2016 (1.08)      8.2016 (1.08)     0.0000 (1.0)       8.2016 (1.08)     0.0000 (1.0)           0;0  0.1219 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5938 (1.68)     5.5938 (1.68)     5.5938 (1.68)     0.0000 (1.0)      5.5938 (1.68)     0.0000 (1.0)           0;0  0.1788 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8525 (1.76)     5.8525 (1.76)     5.8525 (1.76)     0.0000 (1.0)      5.8525 (1.76)     0.0000 (1.0)           0;0  0.1709 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5784 (1.67)     5.5784 (1.67)     5.5784 (1.67)     0.0000 (1.0)      5.5784 (1.67)     0.0000 (1.0)           0;0  0.1793 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3315 (1.0)      3.3315 (1.0)      3.3315 (1.0)      0.0000 (1.0)      3.3315 (1.0)      0.0000 (1.0)           0;0  0.3002 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3921 (1.02)     3.3921 (1.02)     3.3921 (1.02)     0.0000 (1.0)      3.3921 (1.02)     0.0000 (1.0)           0;0  0.2948 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.8716 (2.02)     7.8716 (2.02)     7.8716 (2.02)     0.0000 (1.0)      7.8716 (2.02)     0.0000 (1.0)           0;0  0.1270 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6388 (1.70)     6.6388 (1.70)     6.6388 (1.70)     0.0000 (1.0)      6.6388 (1.70)     0.0000 (1.0)           0;0  0.1506 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.5817 (1.69)     6.5817 (1.69)     6.5817 (1.69)     0.0000 (1.0)      6.5817 (1.69)     0.0000 (1.0)           0;0  0.1519 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8991 (1.0)      3.8991 (1.0)      3.8991 (1.0)      0.0000 (1.0)      3.8991 (1.0)      0.0000 (1.0)           0;0  0.2565 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4134 (1.13)     4.4134 (1.13)     4.4134 (1.13)     0.0000 (1.0)      4.4134 (1.13)     0.0000 (1.0)           0;0  0.2266 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     23.7084 (2.24)     23.7084 (2.24)     23.7084 (2.24)     0.0000 (1.0)      23.7084 (2.24)     0.0000 (1.0)           0;0  0.0422 (0.45)          1           1
test_checkout_symlink-checkout[3.10.0]     18.3630 (1.74)     18.3630 (1.74)     18.3630 (1.74)     0.0000 (1.0)      18.3630 (1.74)     0.0000 (1.0)           0;0  0.0545 (0.58)          1           1
test_checkout_symlink-checkout[3.53.2]     16.9883 (1.61)     16.9883 (1.61)     16.9883 (1.61)     0.0000 (1.0)      16.9883 (1.61)     0.0000 (1.0)           0;0  0.0589 (0.62)          1           1
test_checkout_symlink-checkout[3.60.1]     10.5630 (1.0)      10.5630 (1.0)      10.5630 (1.0)      0.0000 (1.0)      10.5630 (1.0)      0.0000 (1.0)           0;0  0.0947 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.5392 (1.09)     11.5392 (1.09)     11.5392 (1.09)     0.0000 (1.0)      11.5392 (1.09)     0.0000 (1.0)           0;0  0.0867 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.0068 (1.31)     6.0068 (1.31)     6.0068 (1.31)     0.0000 (1.0)      6.0068 (1.31)     0.0000 (1.0)           0;0  0.1665 (0.76)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.9502 (1.30)     5.9502 (1.30)     5.9502 (1.30)     0.0000 (1.0)      5.9502 (1.30)     0.0000 (1.0)           0;0  0.1681 (0.77)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     5.7280 (1.25)     5.7280 (1.25)     5.7280 (1.25)     0.0000 (1.0)      5.7280 (1.25)     0.0000 (1.0)           0;0  0.1746 (0.80)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.5792 (1.0)      4.5792 (1.0)      4.5792 (1.0)      0.0000 (1.0)      4.5792 (1.0)      0.0000 (1.0)           0;0  0.2184 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.7314 (1.03)     4.7314 (1.03)     4.7314 (1.03)     0.0000 (1.0)      4.7314 (1.03)     0.0000 (1.0)           0;0  0.2114 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.5349 (1.51)     9.5349 (1.51)     9.5349 (1.51)     0.0000 (1.0)      9.5349 (1.51)     0.0000 (1.0)           0;0  0.1049 (0.66)          1           1
test_checkout_symlink-checkout-update[3.10.0]     7.8157 (1.24)     7.8157 (1.24)     7.8157 (1.24)     0.0000 (1.0)      7.8157 (1.24)     0.0000 (1.0)           0;0  0.1279 (0.81)          1           1
test_checkout_symlink-checkout-update[3.53.2]     7.5529 (1.20)     7.5529 (1.20)     7.5529 (1.20)     0.0000 (1.0)      7.5529 (1.20)     0.0000 (1.0)           0;0  0.1324 (0.83)          1           1
test_checkout_symlink-checkout-update[3.60.1]     6.3025 (1.0)      6.3025 (1.0)      6.3025 (1.0)      0.0000 (1.0)      6.3025 (1.0)      0.0000 (1.0)           0;0  0.1587 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.8364 (1.08)     6.8364 (1.08)     6.8364 (1.08)     0.0000 (1.0)      6.8364 (1.08)     0.0000 (1.0)           0;0  0.1463 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2447 (1.78)     4.2447 (1.78)     4.2447 (1.78)     0.0000 (1.0)      4.2447 (1.78)     0.0000 (1.0)           0;0  0.2356 (0.56)          1           1
test_data_status-data-changed[3.10.0]     5.0058 (2.10)     5.0058 (2.10)     5.0058 (2.10)     0.0000 (1.0)      5.0058 (2.10)     0.0000 (1.0)           0;0  0.1998 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.8859 (2.05)     4.8859 (2.05)     4.8859 (2.05)     0.0000 (1.0)      4.8859 (2.05)     0.0000 (1.0)           0;0  0.2047 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.3803 (1.0)      2.3803 (1.0)      2.3803 (1.0)      0.0000 (1.0)      2.3803 (1.0)      0.0000 (1.0)           0;0  0.4201 (1.0)           1           1
test_data_status-data-changed[main]       2.5803 (1.08)     2.5803 (1.08)     2.5803 (1.08)     0.0000 (1.0)      2.5803 (1.08)     0.0000 (1.0)           0;0  0.3875 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1822 (1.76)     4.1822 (1.76)     4.1822 (1.76)     0.0000 (1.0)      4.1822 (1.76)     0.0000 (1.0)           0;0  0.2391 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9838 (2.10)     4.9838 (2.10)     4.9838 (2.10)     0.0000 (1.0)      4.9838 (2.10)     0.0000 (1.0)           0;0  0.2007 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8206 (2.03)     4.8206 (2.03)     4.8206 (2.03)     0.0000 (1.0)      4.8206 (2.03)     0.0000 (1.0)           0;0  0.2074 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3718 (1.0)      2.3718 (1.0)      2.3718 (1.0)      0.0000 (1.0)      2.3718 (1.0)      0.0000 (1.0)           0;0  0.4216 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5992 (1.10)     2.5992 (1.10)     2.5992 (1.10)     0.0000 (1.0)      2.5992 (1.10)     0.0000 (1.0)           0;0  0.3847 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.8515 (3.65)     18.8515 (3.65)     18.8515 (3.65)     0.0000 (1.0)      18.8515 (3.65)     0.0000 (1.0)           0;0  0.0530 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.7227 (3.82)     19.7227 (3.82)     19.7227 (3.82)     0.0000 (1.0)      19.7227 (3.82)     0.0000 (1.0)           0;0  0.0507 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.3811 (3.75)     19.3811 (3.75)     19.3811 (3.75)     0.0000 (1.0)      19.3811 (3.75)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_data_status-data-new[3.60.1]      5.1663 (1.0)       5.1663 (1.0)       5.1663 (1.0)      0.0000 (1.0)       5.1663 (1.0)      0.0000 (1.0)           0;0  0.1936 (1.0)           1           1
test_data_status-data-new[main]        5.2572 (1.02)      5.2572 (1.02)      5.2572 (1.02)     0.0000 (1.0)       5.2572 (1.02)     0.0000 (1.0)           0;0  0.1902 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0772 (1.70)     4.0772 (1.70)     4.0772 (1.70)     0.0000 (1.0)      4.0772 (1.70)     0.0000 (1.0)           0;0  0.2453 (0.59)          1           1
test_data_status-data-noop[3.10.0]     5.0279 (2.10)     5.0279 (2.10)     5.0279 (2.10)     0.0000 (1.0)      5.0279 (2.10)     0.0000 (1.0)           0;0  0.1989 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.9694 (2.08)     4.9694 (2.08)     4.9694 (2.08)     0.0000 (1.0)      4.9694 (2.08)     0.0000 (1.0)           0;0  0.2012 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3931 (1.0)      2.3931 (1.0)      2.3931 (1.0)      0.0000 (1.0)      2.3931 (1.0)      0.0000 (1.0)           0;0  0.4179 (1.0)           1           1
test_data_status-data-noop[main]       2.5800 (1.08)     2.5800 (1.08)     2.5800 (1.08)     0.0000 (1.0)      2.5800 (1.08)     0.0000 (1.0)           0;0  0.3876 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.8830 (1.28)     6.8830 (1.28)     6.8830 (1.28)     0.0000 (1.0)      6.8830 (1.28)     0.0000 (1.0)           0;0  0.1453 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8582 (1.46)     7.8582 (1.46)     7.8582 (1.46)     0.0000 (1.0)      7.8582 (1.46)     0.0000 (1.0)           0;0  0.1273 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7811 (1.44)     7.7811 (1.44)     7.7811 (1.44)     0.0000 (1.0)      7.7811 (1.44)     0.0000 (1.0)           0;0  0.1285 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.3910 (1.0)      5.3910 (1.0)      5.3910 (1.0)      0.0000 (1.0)      5.3910 (1.0)      0.0000 (1.0)           0;0  0.1855 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.7155 (1.06)     5.7155 (1.06)     5.7155 (1.06)     0.0000 (1.0)      5.7155 (1.06)     0.0000 (1.0)           0;0  0.1750 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.9379 (1.24)     6.9379 (1.24)     6.9379 (1.24)     0.0000 (1.0)      6.9379 (1.24)     0.0000 (1.0)           0;0  0.1441 (0.81)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8501 (1.40)     7.8501 (1.40)     7.8501 (1.40)     0.0000 (1.0)      7.8501 (1.40)     0.0000 (1.0)           0;0  0.1274 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7429 (1.38)     7.7429 (1.38)     7.7429 (1.38)     0.0000 (1.0)      7.7429 (1.38)     0.0000 (1.0)           0;0  0.1292 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5927 (1.0)      5.5927 (1.0)      5.5927 (1.0)      0.0000 (1.0)      5.5927 (1.0)      0.0000 (1.0)           0;0  0.1788 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8027 (1.04)     5.8027 (1.04)     5.8027 (1.04)     0.0000 (1.0)      5.8027 (1.04)     0.0000 (1.0)           0;0  0.1723 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.5500 (2.60)     21.5500 (2.60)     21.5500 (2.60)     0.0000 (1.0)      21.5500 (2.60)     0.0000 (1.0)           0;0  0.0464 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.4588 (2.83)     23.4588 (2.83)     23.4588 (2.83)     0.0000 (1.0)      23.4588 (2.83)     0.0000 (1.0)           0;0  0.0426 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.7286 (2.74)     22.7286 (2.74)     22.7286 (2.74)     0.0000 (1.0)      22.7286 (2.74)     0.0000 (1.0)           0;0  0.0440 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.2911 (1.0)       8.2911 (1.0)       8.2911 (1.0)      0.0000 (1.0)       8.2911 (1.0)      0.0000 (1.0)           0;0  0.1206 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.9915 (1.08)      8.9915 (1.08)      8.9915 (1.08)     0.0000 (1.0)       8.9915 (1.08)     0.0000 (1.0)           0;0  0.1112 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.3610 (1.34)     6.3610 (1.34)     6.3610 (1.34)     0.0000 (1.0)      6.3610 (1.34)     0.0000 (1.0)           0;0  0.1572 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.4567 (1.57)     7.4567 (1.57)     7.4567 (1.57)     0.0000 (1.0)      7.4567 (1.57)     0.0000 (1.0)           0;0  0.1341 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.3842 (1.55)     7.3842 (1.55)     7.3842 (1.55)     0.0000 (1.0)      7.3842 (1.55)     0.0000 (1.0)           0;0  0.1354 (0.64)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7570 (1.0)      4.7570 (1.0)      4.7570 (1.0)      0.0000 (1.0)      4.7570 (1.0)      0.0000 (1.0)           0;0  0.2102 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.1137 (1.07)     5.1137 (1.07)     5.1137 (1.07)     0.0000 (1.0)      5.1137 (1.07)     0.0000 (1.0)           0;0  0.1956 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     13.5646 (2.47)     13.5646 (2.47)     13.5646 (2.47)     0.0000 (1.0)      13.5646 (2.47)     0.0000 (1.0)           0;0  0.0737 (0.40)          1           1
test_diff-diff[3.10.0]     14.4726 (2.64)     14.4726 (2.64)     14.4726 (2.64)     0.0000 (1.0)      14.4726 (2.64)     0.0000 (1.0)           0;0  0.0691 (0.38)          1           1
test_diff-diff[3.53.2]     14.7903 (2.69)     14.7903 (2.69)     14.7903 (2.69)     0.0000 (1.0)      14.7903 (2.69)     0.0000 (1.0)           0;0  0.0676 (0.37)          1           1
test_diff-diff[3.60.1]      5.4916 (1.0)       5.4916 (1.0)       5.4916 (1.0)      0.0000 (1.0)       5.4916 (1.0)      0.0000 (1.0)           0;0  0.1821 (1.0)           1           1
test_diff-diff[main]        6.1782 (1.13)      6.1782 (1.13)      6.1782 (1.13)     0.0000 (1.0)       6.1782 (1.13)     0.0000 (1.0)           0;0  0.1619 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     4.6364 (1.53)     4.6364 (1.53)     4.6364 (1.53)     0.0000 (1.0)      4.6364 (1.53)     0.0000 (1.0)           0;0  0.2157 (0.65)          1           1
test_diff-diff-changed[3.10.0]     5.2034 (1.72)     5.2034 (1.72)     5.2034 (1.72)     0.0000 (1.0)      5.2034 (1.72)     0.0000 (1.0)           0;0  0.1922 (0.58)          1           1
test_diff-diff-changed[3.53.2]     4.2571 (1.40)     4.2571 (1.40)     4.2571 (1.40)     0.0000 (1.0)      4.2571 (1.40)     0.0000 (1.0)           0;0  0.2349 (0.71)          1           1
test_diff-diff-changed[3.60.1]     3.0315 (1.0)      3.0315 (1.0)      3.0315 (1.0)      0.0000 (1.0)      3.0315 (1.0)      0.0000 (1.0)           0;0  0.3299 (1.0)           1           1
test_diff-diff-changed[main]       3.7035 (1.22)     3.7035 (1.22)     3.7035 (1.22)     0.0000 (1.0)      3.7035 (1.22)     0.0000 (1.0)           0;0  0.2700 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     3.9794 (1.31)     3.9794 (1.31)     3.9794 (1.31)     0.0000 (1.0)      3.9794 (1.31)     0.0000 (1.0)           0;0  0.2513 (0.76)          1           1
test_diff-diff-changed-noop[3.10.0]     4.5645 (1.50)     4.5645 (1.50)     4.5645 (1.50)     0.0000 (1.0)      4.5645 (1.50)     0.0000 (1.0)           0;0  0.2191 (0.67)          1           1
test_diff-diff-changed-noop[3.53.2]     4.3448 (1.43)     4.3448 (1.43)     4.3448 (1.43)     0.0000 (1.0)      4.3448 (1.43)     0.0000 (1.0)           0;0  0.2302 (0.70)          1           1
test_diff-diff-changed-noop[3.60.1]     3.0401 (1.0)      3.0401 (1.0)      3.0401 (1.0)      0.0000 (1.0)      3.0401 (1.0)      0.0000 (1.0)           0;0  0.3289 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.6966 (1.22)     3.6966 (1.22)     3.6966 (1.22)     0.0000 (1.0)      3.6966 (1.22)     0.0000 (1.0)           0;0  0.2705 (0.82)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     2.9983 (1.0)      2.9983 (1.0)      2.9983 (1.0)      0.0000 (1.0)      2.9983 (1.0)      0.0000 (1.0)           0;0  0.3335 (1.0)           1           1
test_diff-diff-noop[3.10.0]     3.4790 (1.16)     3.4790 (1.16)     3.4790 (1.16)     0.0000 (1.0)      3.4790 (1.16)     0.0000 (1.0)           0;0  0.2874 (0.86)          1           1
test_diff-diff-noop[3.53.2]     4.2642 (1.42)     4.2642 (1.42)     4.2642 (1.42)     0.0000 (1.0)      4.2642 (1.42)     0.0000 (1.0)           0;0  0.2345 (0.70)          1           1
test_diff-diff-noop[3.60.1]     3.0175 (1.01)     3.0175 (1.01)     3.0175 (1.01)     0.0000 (1.0)      3.0175 (1.01)     0.0000 (1.0)           0;0  0.3314 (0.99)          1           1
test_diff-diff-noop[main]       3.6754 (1.23)     3.6754 (1.23)     3.6754 (1.23)     0.0000 (1.0)      3.6754 (1.23)     0.0000 (1.0)           0;0  0.2721 (0.82)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.1935 (1.0)      1.1935 (1.0)      1.1935 (1.0)      0.0000 (1.0)      1.1935 (1.0)      0.0000 (1.0)           0;0  0.8379 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.0496 (3.39)     4.0496 (3.39)     4.0496 (3.39)     0.0000 (1.0)      4.0496 (3.39)     0.0000 (1.0)           0;0  0.2469 (0.29)          1           1
test_exp_show-exp[3.53.2]     2.4707 (2.07)     2.4707 (2.07)     2.4707 (2.07)     0.0000 (1.0)      2.4707 (2.07)     0.0000 (1.0)           0;0  0.4047 (0.48)          1           1
test_exp_show-exp[3.60.1]     2.6468 (2.22)     2.6468 (2.22)     2.6468 (2.22)     0.0000 (1.0)      2.6468 (2.22)     0.0000 (1.0)           0;0  0.3778 (0.45)          1           1
test_exp_show-exp[main]       7.0072 (5.87)     7.0072 (5.87)     7.0072 (5.87)     0.0000 (1.0)      7.0072 (5.87)     0.0000 (1.0)           0;0  0.1427 (0.17)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     111.8256 (4.66)     111.8256 (4.66)     111.8256 (4.66)     0.0000 (1.0)      111.8256 (4.66)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_fetch-fetch[3.10.0]     117.9576 (4.91)     117.9576 (4.91)     117.9576 (4.91)     0.0000 (1.0)      117.9576 (4.91)     0.0000 (1.0)           0;0  0.0085 (0.20)          1           1
test_fetch-fetch[3.53.2]      35.6031 (1.48)      35.6031 (1.48)      35.6031 (1.48)     0.0000 (1.0)       35.6031 (1.48)     0.0000 (1.0)           0;0  0.0281 (0.67)          1           1
test_fetch-fetch[3.60.1]      24.1999 (1.01)      24.1999 (1.01)      24.1999 (1.01)     0.0000 (1.0)       24.1999 (1.01)     0.0000 (1.0)           0;0  0.0413 (0.99)          1           1
test_fetch-fetch[main]        24.0085 (1.0)       24.0085 (1.0)       24.0085 (1.0)      0.0000 (1.0)       24.0085 (1.0)      0.0000 (1.0)           0;0  0.0417 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8186 (1.0)      2.8186 (1.0)      2.8186 (1.0)      0.0000 (1.0)      2.8186 (1.0)      0.0000 (1.0)           0;0  0.3548 (1.0)           1           1
test_gc-gc[3.10.0]     3.1264 (1.11)     3.1264 (1.11)     3.1264 (1.11)     0.0000 (1.0)      3.1264 (1.11)     0.0000 (1.0)           0;0  0.3199 (0.90)          1           1
test_gc-gc[3.53.2]     2.8757 (1.02)     2.8757 (1.02)     2.8757 (1.02)     0.0000 (1.0)      2.8757 (1.02)     0.0000 (1.0)           0;0  0.3477 (0.98)          1           1
test_gc-gc[3.60.1]     2.9584 (1.05)     2.9584 (1.05)     2.9584 (1.05)     0.0000 (1.0)      2.9584 (1.05)     0.0000 (1.0)           0;0  0.3380 (0.95)          1           1
test_gc-gc[main]       3.0529 (1.08)     3.0529 (1.08)     3.0529 (1.08)     0.0000 (1.0)      3.0529 (1.08)     0.0000 (1.0)           0;0  0.3276 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     191.9974 (3.40)     191.9974 (3.40)     191.9974 (3.40)     0.0000 (1.0)      191.9974 (3.40)     0.0000 (1.0)           0;0  0.0052 (0.29)          1           1
test_get-get[3.10.0]     227.0251 (4.03)     227.0251 (4.03)     227.0251 (4.03)     0.0000 (1.0)      227.0251 (4.03)     0.0000 (1.0)           0;0  0.0044 (0.25)          1           1
test_get-get[3.53.2]     170.7115 (3.03)     170.7115 (3.03)     170.7115 (3.03)     0.0000 (1.0)      170.7115 (3.03)     0.0000 (1.0)           0;0  0.0059 (0.33)          1           1
test_get-get[3.60.1]      58.1774 (1.03)      58.1774 (1.03)      58.1774 (1.03)     0.0000 (1.0)       58.1774 (1.03)     0.0000 (1.0)           0;0  0.0172 (0.97)          1           1
test_get-get[main]        56.3963 (1.0)       56.3963 (1.0)       56.3963 (1.0)      0.0000 (1.0)       56.3963 (1.0)      0.0000 (1.0)           0;0  0.0177 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     95.9965 (5.55)     95.9965 (5.55)     95.9965 (5.55)     0.0000 (1.0)      95.9965 (5.55)     0.0000 (1.0)           0;0  0.0104 (0.18)          1           1
test_get_url-get-url[3.10.0]     98.0654 (5.67)     98.0654 (5.67)     98.0654 (5.67)     0.0000 (1.0)      98.0654 (5.67)     0.0000 (1.0)           0;0  0.0102 (0.18)          1           1
test_get_url-get-url[3.53.2]     17.3925 (1.01)     17.3925 (1.01)     17.3925 (1.01)     0.0000 (1.0)      17.3925 (1.01)     0.0000 (1.0)           0;0  0.0575 (0.99)          1           1
test_get_url-get-url[3.60.1]     17.2990 (1.0)      17.2990 (1.0)      17.2990 (1.0)      0.0000 (1.0)      17.2990 (1.0)      0.0000 (1.0)           0;0  0.0578 (1.0)           1           1
test_get_url-get-url[main]       17.5974 (1.02)     17.5974 (1.02)     17.5974 (1.02)     0.0000 (1.0)      17.5974 (1.02)     0.0000 (1.0)           0;0  0.0568 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     152.2418 (1.04)     163.7481 (1.0)      155.8145 (1.01)     2.3980 (1.10)     155.2939 (1.02)     2.9168 (1.11)         30;2  6.4179 (0.99)        100           1
test_help---help[3.10.0]     151.2727 (1.03)     169.1138 (1.03)     155.3054 (1.01)     3.0491 (1.39)     154.7215 (1.01)     3.4520 (1.32)         24;3  6.4389 (0.99)        100           1
test_help---help[3.53.2]     154.5708 (1.05)     166.6885 (1.02)     160.5988 (1.04)     2.1871 (1.0)      160.5976 (1.05)     2.6191 (1.0)          26;4  6.2267 (0.96)        100           1
test_help---help[3.60.1]     156.1281 (1.06)     207.9057 (1.27)     162.8089 (1.06)     6.0163 (2.75)     161.9497 (1.06)     4.3773 (1.67)          7;3  6.1422 (0.94)        100           1
test_help---help[main]       147.0430 (1.0)      197.3960 (1.21)     153.7135 (1.0)      5.9234 (2.71)     152.8256 (1.0)      4.4624 (1.70)          4;2  6.5056 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     215.4337 (3.75)     215.4337 (3.75)     215.4337 (3.75)     0.0000 (1.0)      215.4337 (3.75)     0.0000 (1.0)           0;0  0.0046 (0.27)          1           1
test_import-import[3.10.0]     246.4054 (4.29)     246.4054 (4.29)     246.4054 (4.29)     0.0000 (1.0)      246.4054 (4.29)     0.0000 (1.0)           0;0  0.0041 (0.23)          1           1
test_import-import[3.60.1]      57.4897 (1.0)       57.4897 (1.0)       57.4897 (1.0)      0.0000 (1.0)       57.4897 (1.0)      0.0000 (1.0)           0;0  0.0174 (1.0)           1           1
test_import-import[main]        58.2003 (1.01)      58.2003 (1.01)      58.2003 (1.01)     0.0000 (1.0)       58.2003 (1.01)     0.0000 (1.0)           0;0  0.0172 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     207.5403 (4.34)     207.5403 (4.34)     207.5403 (4.34)     0.0000 (1.0)      207.5403 (4.34)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_import_url-import-url[3.10.0]     210.3127 (4.40)     210.3127 (4.40)     210.3127 (4.40)     0.0000 (1.0)      210.3127 (4.40)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_import_url-import-url[3.53.2]     118.7191 (2.48)     118.7191 (2.48)     118.7191 (2.48)     0.0000 (1.0)      118.7191 (2.48)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_import_url-import-url[3.60.1]      47.8431 (1.0)       47.8431 (1.0)       47.8431 (1.0)      0.0000 (1.0)       47.8431 (1.0)      0.0000 (1.0)           0;0  0.0209 (1.0)           1           1
test_import_url-import-url[main]        49.1339 (1.03)      49.1339 (1.03)      49.1339 (1.03)     0.0000 (1.0)       49.1339 (1.03)     0.0000 (1.0)           0;0  0.0204 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     412.1955 (1.02)     460.9215 (1.06)     426.4194 (1.03)      8.0716 (1.10)     425.0972 (1.02)     11.4008 (1.50)         26;1  2.3451 (0.98)        100           1
test_init-init[3.10.0]     422.0461 (1.04)     474.5942 (1.09)     435.8973 (1.05)      8.2349 (1.12)     434.4732 (1.05)      7.5864 (1.0)          22;5  2.2941 (0.95)        100           1
test_init-init[3.53.2]     404.0952 (1.0)      434.9692 (1.0)      415.9751 (1.0)       7.3565 (1.0)      414.8119 (1.0)      10.7529 (1.42)         33;0  2.4040 (1.0)         100           1
test_init-init[3.60.1]     404.7823 (1.00)     444.3340 (1.02)     417.4031 (1.00)      7.6080 (1.03)     416.8023 (1.00)     11.4068 (1.50)         29;1  2.3958 (1.00)        100           1
test_init-init[main]       446.1100 (1.10)     562.6871 (1.29)     464.7762 (1.12)     17.5751 (2.39)     461.1731 (1.11)     11.0743 (1.46)          6;5  2.1516 (0.90)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     665.0830 (1.04)     665.0830 (1.04)     665.0830 (1.04)     0.0000 (1.0)      665.0830 (1.04)     0.0000 (1.0)           0;0  1.5036 (0.96)          1           1
test_list-list[3.10.0]     958.2548 (1.50)     958.2548 (1.50)     958.2548 (1.50)     0.0000 (1.0)      958.2548 (1.50)     0.0000 (1.0)           0;0  1.0436 (0.67)          1           1
test_list-list[3.53.2]     639.4418 (1.0)      639.4418 (1.0)      639.4418 (1.0)      0.0000 (1.0)      639.4418 (1.0)      0.0000 (1.0)           0;0  1.5639 (1.0)           1           1
test_list-list[3.60.1]     681.9658 (1.07)     681.9658 (1.07)     681.9658 (1.07)     0.0000 (1.0)      681.9658 (1.07)     0.0000 (1.0)           0;0  1.4663 (0.94)          1           1
test_list-list[main]       688.9066 (1.08)     688.9066 (1.08)     688.9066 (1.08)     0.0000 (1.0)      688.9066 (1.08)     0.0000 (1.0)           0;0  1.4516 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     450.2419 (1.06)     450.2419 (1.06)     450.2419 (1.06)     0.0000 (1.0)      450.2419 (1.06)     0.0000 (1.0)           0;0  2.2210 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     456.7571 (1.08)     456.7571 (1.08)     456.7571 (1.08)     0.0000 (1.0)      456.7571 (1.08)     0.0000 (1.0)           0;0  2.1893 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     440.9025 (1.04)     440.9025 (1.04)     440.9025 (1.04)     0.0000 (1.0)      440.9025 (1.04)     0.0000 (1.0)           0;0  2.2681 (0.96)          1           1
test_list-list-dvc-only[3.60.1]     423.8951 (1.0)      423.8951 (1.0)      423.8951 (1.0)      0.0000 (1.0)      423.8951 (1.0)      0.0000 (1.0)           0;0  2.3591 (1.0)           1           1
test_list-list-dvc-only[main]       435.4846 (1.03)     435.4846 (1.03)     435.4846 (1.03)     0.0000 (1.0)      435.4846 (1.03)     0.0000 (1.0)           0;0  2.2963 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6434 (1.01)     2.6434 (1.01)     2.6434 (1.01)     0.0000 (1.0)      2.6434 (1.01)     0.0000 (1.0)           0;0  0.3783 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.6451 (1.01)     2.6451 (1.01)     2.6451 (1.01)     0.0000 (1.0)      2.6451 (1.01)     0.0000 (1.0)           0;0  0.3781 (0.99)          1           1
test_list-list-recursive[3.53.2]     2.7194 (1.04)     2.7194 (1.04)     2.7194 (1.04)     0.0000 (1.0)      2.7194 (1.04)     0.0000 (1.0)           0;0  0.3677 (0.96)          1           1
test_list-list-recursive[3.60.1]     2.6235 (1.0)      2.6235 (1.0)      2.6235 (1.0)      0.0000 (1.0)      2.6235 (1.0)      0.0000 (1.0)           0;0  0.3812 (1.0)           1           1
test_list-list-recursive[main]       2.7567 (1.05)     2.7567 (1.05)     2.7567 (1.05)     0.0000 (1.0)      2.7567 (1.05)     0.0000 (1.0)           0;0  0.3628 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     459.2313 (1.10)     459.2313 (1.10)     459.2313 (1.10)     0.0000 (1.0)      459.2313 (1.10)     0.0000 (1.0)           0;0  2.1776 (0.91)          1           1
test_list-list-shallow[3.10.0]     456.3130 (1.10)     456.3130 (1.10)     456.3130 (1.10)     0.0000 (1.0)      456.3130 (1.10)     0.0000 (1.0)           0;0  2.1915 (0.91)          1           1
test_list-list-shallow[3.53.2]     416.2818 (1.0)      416.2818 (1.0)      416.2818 (1.0)      0.0000 (1.0)      416.2818 (1.0)      0.0000 (1.0)           0;0  2.4022 (1.0)           1           1
test_list-list-shallow[3.60.1]     448.9695 (1.08)     448.9695 (1.08)     448.9695 (1.08)     0.0000 (1.0)      448.9695 (1.08)     0.0000 (1.0)           0;0  2.2273 (0.93)          1           1
test_list-list-shallow[main]       436.1112 (1.05)     436.1112 (1.05)     436.1112 (1.05)     0.0000 (1.0)      436.1112 (1.05)     0.0000 (1.0)           0;0  2.2930 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.5560 (3.14)     12.5560 (3.14)     12.5560 (3.14)     0.0000 (1.0)      12.5560 (3.14)     0.0000 (1.0)           0;0  0.0796 (0.32)          1           1
test_partial_add-add[3.10.0]     12.8874 (3.23)     12.8874 (3.23)     12.8874 (3.23)     0.0000 (1.0)      12.8874 (3.23)     0.0000 (1.0)           0;0  0.0776 (0.31)          1           1
test_partial_add-add[3.53.2]     11.2561 (2.82)     11.2561 (2.82)     11.2561 (2.82)     0.0000 (1.0)      11.2561 (2.82)     0.0000 (1.0)           0;0  0.0888 (0.35)          1           1
test_partial_add-add[3.60.1]      3.9949 (1.0)       3.9949 (1.0)       3.9949 (1.0)      0.0000 (1.0)       3.9949 (1.0)      0.0000 (1.0)           0;0  0.2503 (1.0)           1           1
test_partial_add-add[main]        4.8645 (1.22)      4.8645 (1.22)      4.8645 (1.22)     0.0000 (1.0)       4.8645 (1.22)     0.0000 (1.0)           0;0  0.2056 (0.82)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     82.7947 (3.98)     82.7947 (3.98)     82.7947 (3.98)     0.0000 (1.0)      82.7947 (3.98)     0.0000 (1.0)           0;0  0.0121 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     83.7539 (4.02)     83.7539 (4.02)     83.7539 (4.02)     0.0000 (1.0)      83.7539 (4.02)     0.0000 (1.0)           0;0  0.0119 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     76.3145 (3.67)     76.3145 (3.67)     76.3145 (3.67)     0.0000 (1.0)      76.3145 (3.67)     0.0000 (1.0)           0;0  0.0131 (0.27)          1           1
test_partial_add-add-partial[3.60.1]     20.8187 (1.0)      20.8187 (1.0)      20.8187 (1.0)      0.0000 (1.0)      20.8187 (1.0)      0.0000 (1.0)           0;0  0.0480 (1.0)           1           1
test_partial_add-add-partial[main]       21.0289 (1.01)     21.0289 (1.01)     21.0289 (1.01)     0.0000 (1.0)      21.0289 (1.01)     0.0000 (1.0)           0;0  0.0476 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.8667 (1.0)      4.8667 (1.0)      4.8667 (1.0)      0.0000 (1.0)      4.8667 (1.0)      0.0000 (1.0)           0;0  0.2055 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.2024 (1.27)     6.2024 (1.27)     6.2024 (1.27)     0.0000 (1.0)      6.2024 (1.27)     0.0000 (1.0)           0;0  0.1612 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.2895 (1.50)     7.2895 (1.50)     7.2895 (1.50)     0.0000 (1.0)      7.2895 (1.50)     0.0000 (1.0)           0;0  0.1372 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.1572 (1.47)     7.1572 (1.47)     7.1572 (1.47)     0.0000 (1.0)      7.1572 (1.47)     0.0000 (1.0)           0;0  0.1397 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       6.3660 (1.31)     6.3660 (1.31)     6.3660 (1.31)     0.0000 (1.0)      6.3660 (1.31)     0.0000 (1.0)           0;0  0.1571 (0.76)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6859 (1.0)      2.6859 (1.0)      2.6859 (1.0)      0.0000 (1.0)      2.6859 (1.0)      0.0000 (1.0)           0;0  0.3723 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9924 (1.49)     3.9924 (1.49)     3.9924 (1.49)     0.0000 (1.0)      3.9924 (1.49)     0.0000 (1.0)           0;0  0.2505 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     4.0232 (1.50)     4.0232 (1.50)     4.0232 (1.50)     0.0000 (1.0)      4.0232 (1.50)     0.0000 (1.0)           0;0  0.2486 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.9716 (1.48)     3.9716 (1.48)     3.9716 (1.48)     0.0000 (1.0)      3.9716 (1.48)     0.0000 (1.0)           0;0  0.2518 (0.68)          1           1
test_partial_add-gc-noop[main]       3.1000 (1.15)     3.1000 (1.15)     3.1000 (1.15)     0.0000 (1.0)      3.1000 (1.15)     0.0000 (1.0)           0;0  0.3226 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.2246 (3.82)     14.2246 (3.82)     14.2246 (3.82)     0.0000 (1.0)      14.2246 (3.82)     0.0000 (1.0)           0;0  0.0703 (0.26)          1           1
test_partial_add-push[3.10.0]      6.9861 (1.88)      6.9861 (1.88)      6.9861 (1.88)     0.0000 (1.0)       6.9861 (1.88)     0.0000 (1.0)           0;0  0.1431 (0.53)          1           1
test_partial_add-push[3.53.2]      3.8517 (1.03)      3.8517 (1.03)      3.8517 (1.03)     0.0000 (1.0)       3.8517 (1.03)     0.0000 (1.0)           0;0  0.2596 (0.97)          1           1
test_partial_add-push[3.60.1]      3.7242 (1.0)       3.7242 (1.0)       3.7242 (1.0)      0.0000 (1.0)       3.7242 (1.0)      0.0000 (1.0)           0;0  0.2685 (1.0)           1           1
test_partial_add-push[main]        3.9127 (1.05)      3.9127 (1.05)      3.9127 (1.05)     0.0000 (1.0)       3.9127 (1.05)     0.0000 (1.0)           0;0  0.2556 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     84.2921 (4.01)     84.2921 (4.01)     84.2921 (4.01)     0.0000 (1.0)      84.2921 (4.01)     0.0000 (1.0)           0;0  0.0119 (0.25)          1           1
test_partial_add-push-partial[3.10.0]     40.1036 (1.91)     40.1036 (1.91)     40.1036 (1.91)     0.0000 (1.0)      40.1036 (1.91)     0.0000 (1.0)           0;0  0.0249 (0.52)          1           1
test_partial_add-push-partial[3.53.2]     22.2186 (1.06)     22.2186 (1.06)     22.2186 (1.06)     0.0000 (1.0)      22.2186 (1.06)     0.0000 (1.0)           0;0  0.0450 (0.95)          1           1
test_partial_add-push-partial[3.60.1]     20.9986 (1.0)      20.9986 (1.0)      20.9986 (1.0)      0.0000 (1.0)      20.9986 (1.0)      0.0000 (1.0)           0;0  0.0476 (1.0)           1           1
test_partial_add-push-partial[main]       21.1195 (1.01)     21.1195 (1.01)     21.1195 (1.01)     0.0000 (1.0)      21.1195 (1.01)     0.0000 (1.0)           0;0  0.0473 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.2724 (3.68)     85.2724 (3.68)     85.2724 (3.68)     0.0000 (1.0)      85.2724 (3.68)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     86.4356 (3.73)     86.4356 (3.73)     86.4356 (3.73)     0.0000 (1.0)      86.4356 (3.73)     0.0000 (1.0)           0;0  0.0116 (0.27)          1           1
test_partial_remove-add[3.53.2]     76.8992 (3.32)     76.8992 (3.32)     76.8992 (3.32)     0.0000 (1.0)      76.8992 (3.32)     0.0000 (1.0)           0;0  0.0130 (0.30)          1           1
test_partial_remove-add[3.60.1]     23.1641 (1.0)      23.1641 (1.0)      23.1641 (1.0)      0.0000 (1.0)      23.1641 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
test_partial_remove-add[main]       25.0799 (1.08)     25.0799 (1.08)     25.0799 (1.08)     0.0000 (1.0)      25.0799 (1.08)     0.0000 (1.0)           0;0  0.0399 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     47.8633 (12.47)    47.8633 (12.47)    47.8633 (12.47)    0.0000 (1.0)      47.8633 (12.47)    0.0000 (1.0)           0;0  0.0209 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     48.6528 (12.68)    48.6528 (12.68)    48.6528 (12.68)    0.0000 (1.0)      48.6528 (12.68)    0.0000 (1.0)           0;0  0.0206 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.8242 (11.42)    43.8242 (11.42)    43.8242 (11.42)    0.0000 (1.0)      43.8242 (11.42)    0.0000 (1.0)           0;0  0.0228 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.8383 (1.0)       3.8383 (1.0)       3.8383 (1.0)      0.0000 (1.0)       3.8383 (1.0)      0.0000 (1.0)           0;0  0.2605 (1.0)           1           1
test_partial_remove-add-update[main]        4.1056 (1.07)      4.1056 (1.07)      4.1056 (1.07)     0.0000 (1.0)       4.1056 (1.07)     0.0000 (1.0)           0;0  0.2436 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.7606 (1.0)      2.7606 (1.0)      2.7606 (1.0)      0.0000 (1.0)      2.7606 (1.0)      0.0000 (1.0)           0;0  0.3622 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.8552 (1.40)     3.8552 (1.40)     3.8552 (1.40)     0.0000 (1.0)      3.8552 (1.40)     0.0000 (1.0)           0;0  0.2594 (0.72)          1           1
test_partial_remove-gc[3.53.2]     3.8823 (1.41)     3.8823 (1.41)     3.8823 (1.41)     0.0000 (1.0)      3.8823 (1.41)     0.0000 (1.0)           0;0  0.2576 (0.71)          1           1
test_partial_remove-gc[3.60.1]     3.8243 (1.39)     3.8243 (1.39)     3.8243 (1.39)     0.0000 (1.0)      3.8243 (1.39)     0.0000 (1.0)           0;0  0.2615 (0.72)          1           1
test_partial_remove-gc[main]       2.9874 (1.08)     2.9874 (1.08)     2.9874 (1.08)     0.0000 (1.0)      2.9874 (1.08)     0.0000 (1.0)           0;0  0.3347 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8411 (1.0)      4.8411 (1.0)      4.8411 (1.0)      0.0000 (1.0)      4.8411 (1.0)      0.0000 (1.0)           0;0  0.2066 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.0270 (1.24)     6.0270 (1.24)     6.0270 (1.24)     0.0000 (1.0)      6.0270 (1.24)     0.0000 (1.0)           0;0  0.1659 (0.80)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.9020 (1.43)     6.9020 (1.43)     6.9020 (1.43)     0.0000 (1.0)      6.9020 (1.43)     0.0000 (1.0)           0;0  0.1449 (0.70)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.5916 (1.36)     6.5916 (1.36)     6.5916 (1.36)     0.0000 (1.0)      6.5916 (1.36)     0.0000 (1.0)           0;0  0.1517 (0.73)          1           1
test_partial_remove-gc-cloud[main]       6.1781 (1.28)     6.1781 (1.28)     6.1781 (1.28)     0.0000 (1.0)      6.1781 (1.28)     0.0000 (1.0)           0;0  0.1619 (0.78)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     103.1557 (4.46)     103.1557 (4.46)     103.1557 (4.46)     0.0000 (1.0)      103.1557 (4.46)     0.0000 (1.0)           0;0  0.0097 (0.22)          1           1
test_partial_remove-push[3.10.0]      49.5707 (2.14)      49.5707 (2.14)      49.5707 (2.14)     0.0000 (1.0)       49.5707 (2.14)     0.0000 (1.0)           0;0  0.0202 (0.47)          1           1
test_partial_remove-push[3.53.2]      24.5387 (1.06)      24.5387 (1.06)      24.5387 (1.06)     0.0000 (1.0)       24.5387 (1.06)     0.0000 (1.0)           0;0  0.0408 (0.94)          1           1
test_partial_remove-push[3.60.1]      23.1193 (1.0)       23.1193 (1.0)       23.1193 (1.0)      0.0000 (1.0)       23.1193 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
test_partial_remove-push[main]        23.4978 (1.02)      23.4978 (1.02)      23.4978 (1.02)     0.0000 (1.0)       23.4978 (1.02)     0.0000 (1.0)           0;0  0.0426 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.2585 (1.01)     4.2585 (1.01)     4.2585 (1.01)     0.0000 (1.0)      4.2585 (1.01)     0.0000 (1.0)           0;0  0.2348 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     4.2269 (1.0)      4.2269 (1.0)      4.2269 (1.0)      0.0000 (1.0)      4.2269 (1.0)      0.0000 (1.0)           0;0  0.2366 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.6239 (1.80)     7.6239 (1.80)     7.6239 (1.80)     0.0000 (1.0)      7.6239 (1.80)     0.0000 (1.0)           0;0  0.1312 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.6476 (1.81)     7.6476 (1.81)     7.6476 (1.81)     0.0000 (1.0)      7.6476 (1.81)     0.0000 (1.0)           0;0  0.1308 (0.55)          1           1
test_partial_remove-push-update[main]       7.6495 (1.81)     7.6495 (1.81)     7.6495 (1.81)     0.0000 (1.0)      7.6495 (1.81)     0.0000 (1.0)           0;0  0.1307 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]       543.4756 (1.0)        546.3322 (1.0)        545.3323 (1.0)       1.3318 (1.0)        546.2103 (1.0)       2.1670 (1.0)           1;0  1.8337 (1.0)           5           3
test_plots-plots-diff[3.10.0]     1,040.0899 (1.91)     1,052.6453 (1.93)     1,046.7500 (1.92)      5.3384 (4.01)     1,045.7257 (1.91)      9.1607 (4.23)          2;0  0.9553 (0.52)          5           3
test_plots-plots-diff[3.53.2]       986.3625 (1.81)     1,006.9092 (1.84)       997.1935 (1.83)      8.2862 (6.22)       997.8313 (1.83)     13.5162 (6.24)          2;0  1.0028 (0.55)          5           3
test_plots-plots-diff[3.60.1]       973.8349 (1.79)     1,034.6743 (1.89)     1,002.6473 (1.84)     29.1263 (21.87)      999.6778 (1.83)     56.6793 (26.16)         1;0  0.9974 (0.54)          5           3
test_plots-plots-diff[main]         990.2423 (1.82)       999.1652 (1.83)       994.2794 (1.82)      4.0752 (3.06)       992.9358 (1.82)      7.4627 (3.44)          1;0  1.0058 (0.55)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       562.3655 (1.0)        573.4074 (1.0)        566.4371 (1.0)       4.6485 (1.0)        563.7267 (1.0)       6.7158 (1.11)          1;0  1.7654 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,236.2053 (2.20)     1,285.8233 (2.24)     1,258.4958 (2.22)     21.7950 (4.69)     1,249.5515 (2.22)     37.7008 (6.21)          2;0  0.7946 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]     1,081.7127 (1.92)     1,093.6466 (1.91)     1,090.1213 (1.92)      5.0203 (1.08)     1,092.6735 (1.94)      6.0673 (1.0)           1;0  0.9173 (0.52)          5           3
test_plots-plots-diff-json[3.60.1]     1,041.6733 (1.85)     1,060.5275 (1.85)     1,052.7418 (1.86)      7.1940 (1.55)     1,055.6283 (1.87)      8.8863 (1.46)          2;0  0.9499 (0.54)          5           3
test_plots-plots-diff-json[main]       1,066.1642 (1.90)     1,091.3190 (1.90)     1,076.1408 (1.90)     10.1539 (2.18)     1,074.3309 (1.91)     15.3802 (2.53)          1;0  0.9292 (0.53)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     437.7648 (1.0)      441.2187 (1.0)      439.2532 (1.0)       1.2684 (1.0)      439.1870 (1.0)       1.4127 (1.0)           2;0  2.2766 (1.0)           5           3
test_plots-plots-show[3.10.0]     857.3754 (1.96)     871.2401 (1.97)     863.2674 (1.97)      5.8232 (4.59)     861.9142 (1.96)      9.7647 (6.91)          2;0  1.1584 (0.51)          5           3
test_plots-plots-show[3.53.2]     801.2180 (1.83)     819.0656 (1.86)     807.9912 (1.84)      6.9665 (5.49)     807.6008 (1.84)      8.9379 (6.33)          1;0  1.2376 (0.54)          5           3
test_plots-plots-show[3.60.1]     811.6630 (1.85)     840.4732 (1.90)     826.8927 (1.88)     10.9053 (8.60)     830.3037 (1.89)     14.4070 (10.20)         2;0  1.2093 (0.53)          5           3
test_plots-plots-show[main]       811.8313 (1.85)     836.8306 (1.90)     826.3345 (1.88)     11.6624 (9.19)     831.3177 (1.89)     21.1832 (14.99)         1;0  1.2102 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     457.3841 (1.0)      461.8978 (1.0)      459.2831 (1.0)       2.0024 (1.0)      458.2866 (1.0)       3.3940 (1.0)           1;0  2.1773 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     984.2602 (2.15)     993.0058 (2.15)     987.3479 (2.15)      3.5254 (1.76)     987.1025 (2.15)      4.6521 (1.37)          1;0  1.0128 (0.47)          5           3
test_plots-plots-show-json[3.53.2]     856.0546 (1.87)     886.2636 (1.92)     870.5272 (1.90)     10.7648 (5.38)     870.3372 (1.90)     10.1106 (2.98)          2;0  1.1487 (0.53)          5           3
test_plots-plots-show-json[3.60.1]     871.8831 (1.91)     910.5356 (1.97)     887.1467 (1.93)     14.6565 (7.32)     887.1350 (1.94)     16.8815 (4.97)          2;0  1.1272 (0.52)          5           3
test_plots-plots-show-json[main]       860.2656 (1.88)     894.1392 (1.94)     876.7270 (1.91)     12.6136 (6.30)     874.6981 (1.91)     16.5150 (4.87)          2;0  1.1406 (0.52)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     98.4918 (4.14)     98.4918 (4.14)     98.4918 (4.14)     0.0000 (1.0)      98.4918 (4.14)     0.0000 (1.0)           0;0  0.0102 (0.24)          1           1
test_push-push[3.10.0]     47.1784 (1.98)     47.1784 (1.98)     47.1784 (1.98)     0.0000 (1.0)      47.1784 (1.98)     0.0000 (1.0)           0;0  0.0212 (0.50)          1           1
test_push-push[3.53.2]     24.0171 (1.01)     24.0171 (1.01)     24.0171 (1.01)     0.0000 (1.0)      24.0171 (1.01)     0.0000 (1.0)           0;0  0.0416 (0.99)          1           1
test_push-push[3.60.1]     23.8304 (1.00)     23.8304 (1.00)     23.8304 (1.00)     0.0000 (1.0)      23.8304 (1.00)     0.0000 (1.0)           0;0  0.0420 (1.00)          1           1
test_push-push[main]       23.7838 (1.0)      23.7838 (1.0)      23.7838 (1.0)      0.0000 (1.0)      23.7838 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.9361 (4.80)     110.9361 (4.80)     110.9361 (4.80)     0.0000 (1.0)      110.9361 (4.80)     0.0000 (1.0)           0;0  0.0090 (0.21)          1           1
test_sharing-fetch[3.10.0]     115.9702 (5.01)     115.9702 (5.01)     115.9702 (5.01)     0.0000 (1.0)      115.9702 (5.01)     0.0000 (1.0)           0;0  0.0086 (0.20)          1           1
test_sharing-fetch[3.53.2]      34.2993 (1.48)      34.2993 (1.48)      34.2993 (1.48)     0.0000 (1.0)       34.2993 (1.48)     0.0000 (1.0)           0;0  0.0292 (0.67)          1           1
test_sharing-fetch[3.60.1]      23.2465 (1.01)      23.2465 (1.01)      23.2465 (1.01)     0.0000 (1.0)       23.2465 (1.01)     0.0000 (1.0)           0;0  0.0430 (0.99)          1           1
test_sharing-fetch[main]        23.1298 (1.0)       23.1298 (1.0)       23.1298 (1.0)      0.0000 (1.0)       23.1298 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2393 (1.0)      1.2393 (1.0)      1.2393 (1.0)      0.0000 (1.0)      1.2393 (1.0)      0.0000 (1.0)           0;0  0.8069 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7982 (3.06)     3.7982 (3.06)     3.7982 (3.06)     0.0000 (1.0)      3.7982 (3.06)     0.0000 (1.0)           0;0  0.2633 (0.33)          1           1
test_sharing-fetch-noop[3.53.2]     5.9166 (4.77)     5.9166 (4.77)     5.9166 (4.77)     0.0000 (1.0)      5.9166 (4.77)     0.0000 (1.0)           0;0  0.1690 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     6.0255 (4.86)     6.0255 (4.86)     6.0255 (4.86)     0.0000 (1.0)      6.0255 (4.86)     0.0000 (1.0)           0;0  0.1660 (0.21)          1           1
test_sharing-fetch-noop[main]       6.1654 (4.97)     6.1654 (4.97)     6.1654 (4.97)     0.0000 (1.0)      6.1654 (4.97)     0.0000 (1.0)           0;0  0.1622 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     98.3702 (4.31)     98.3702 (4.31)     98.3702 (4.31)     0.0000 (1.0)      98.3702 (4.31)     0.0000 (1.0)           0;0  0.0102 (0.23)          1           1
test_sharing-push[3.10.0]     47.2769 (2.07)     47.2769 (2.07)     47.2769 (2.07)     0.0000 (1.0)      47.2769 (2.07)     0.0000 (1.0)           0;0  0.0212 (0.48)          1           1
test_sharing-push[3.53.2]     23.8919 (1.05)     23.8919 (1.05)     23.8919 (1.05)     0.0000 (1.0)      23.8919 (1.05)     0.0000 (1.0)           0;0  0.0419 (0.95)          1           1
test_sharing-push[3.60.1]     22.7994 (1.0)      22.7994 (1.0)      22.7994 (1.0)      0.0000 (1.0)      22.7994 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
test_sharing-push[main]       23.2695 (1.02)     23.2695 (1.02)     23.2695 (1.02)     0.0000 (1.0)      23.2695 (1.02)     0.0000 (1.0)           0;0  0.0430 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0888 (1.0)      2.0888 (1.0)      2.0888 (1.0)      0.0000 (1.0)      2.0888 (1.0)      0.0000 (1.0)           0;0  0.4787 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1029 (1.01)     2.1029 (1.01)     2.1029 (1.01)     0.0000 (1.0)      2.1029 (1.01)     0.0000 (1.0)           0;0  0.4755 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.2011 (2.97)     6.2011 (2.97)     6.2011 (2.97)     0.0000 (1.0)      6.2011 (2.97)     0.0000 (1.0)           0;0  0.1613 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.3283 (3.03)     6.3283 (3.03)     6.3283 (3.03)     0.0000 (1.0)      6.3283 (3.03)     0.0000 (1.0)           0;0  0.1580 (0.33)          1           1
test_sharing-push-noop[main]       6.2360 (2.99)     6.2360 (2.99)     6.2360 (2.99)     0.0000 (1.0)      6.2360 (2.99)     0.0000 (1.0)           0;0  0.1604 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     357.3476 (1.05)     357.3476 (1.05)     357.3476 (1.05)     0.0000 (1.0)      357.3476 (1.05)     0.0000 (1.0)           0;0  0.0028 (0.95)          1           1
test_sharing_azure-fetch[main]       339.7586 (1.0)      339.7586 (1.0)      339.7586 (1.0)      0.0000 (1.0)      339.7586 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.8448 (1.0)      6.8448 (1.0)      6.8448 (1.0)      0.0000 (1.0)      6.8448 (1.0)      0.0000 (1.0)           0;0  0.1461 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.8954 (1.01)     6.8954 (1.01)     6.8954 (1.01)     0.0000 (1.0)      6.8954 (1.01)     0.0000 (1.0)           0;0  0.1450 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     358.7706 (1.00)     358.7706 (1.00)     358.7706 (1.00)     0.0000 (1.0)      358.7706 (1.00)     0.0000 (1.0)           0;0  0.0028 (1.00)          1           1
test_sharing_azure-push[main]       358.2445 (1.0)      358.2445 (1.0)      358.2445 (1.0)      0.0000 (1.0)      358.2445 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.8532 (1.0)      7.8532 (1.0)      7.8532 (1.0)      0.0000 (1.0)      7.8532 (1.0)      0.0000 (1.0)           0;0  0.1273 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.9736 (1.02)     7.9736 (1.02)     7.9736 (1.02)     0.0000 (1.0)      7.9736 (1.02)     0.0000 (1.0)           0;0  0.1254 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     716.8916 (1.02)     716.8916 (1.02)     716.8916 (1.02)     0.0000 (1.0)      716.8916 (1.02)     0.0000 (1.0)           0;0  0.0014 (0.98)          1           1
test_sharing_s3-fetch[main]       703.5522 (1.0)      703.5522 (1.0)      703.5522 (1.0)      0.0000 (1.0)      703.5522 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.7367 (1.0)      6.7367 (1.0)      6.7367 (1.0)      0.0000 (1.0)      6.7367 (1.0)      0.0000 (1.0)           0;0  0.1484 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.9070 (1.03)     6.9070 (1.03)     6.9070 (1.03)     0.0000 (1.0)      6.9070 (1.03)     0.0000 (1.0)           0;0  0.1448 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,019.9068 (1.01)     1,019.9068 (1.01)     1,019.9068 (1.01)     0.0000 (1.0)      1,019.9068 (1.01)     0.0000 (1.0)           0;0  0.0010 (0.99)          1           1
test_sharing_s3-push[main]       1,009.2481 (1.0)      1,009.2481 (1.0)      1,009.2481 (1.0)      0.0000 (1.0)      1,009.2481 (1.0)      0.0000 (1.0)           0;0  0.0010 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.7368 (1.06)     7.7368 (1.06)     7.7368 (1.06)     0.0000 (1.0)      7.7368 (1.06)     0.0000 (1.0)           0;0  0.1293 (0.95)          1           1
test_sharing_s3-push-noop[main]       7.3290 (1.0)      7.3290 (1.0)      7.3290 (1.0)      0.0000 (1.0)      7.3290 (1.0)      0.0000 (1.0)           0;0  0.1364 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.1625 (3.83)     20.1625 (3.83)     20.1625 (3.83)     0.0000 (1.0)      20.1625 (3.83)     0.0000 (1.0)           0;0  0.0496 (0.26)          1           1
test_status-status[3.10.0]     20.7261 (3.94)     20.7261 (3.94)     20.7261 (3.94)     0.0000 (1.0)      20.7261 (3.94)     0.0000 (1.0)           0;0  0.0482 (0.25)          1           1
test_status-status[3.53.2]     18.6024 (3.53)     18.6024 (3.53)     18.6024 (3.53)     0.0000 (1.0)      18.6024 (3.53)     0.0000 (1.0)           0;0  0.0538 (0.28)          1           1
test_status-status[3.60.1]      5.2665 (1.0)       5.2665 (1.0)       5.2665 (1.0)      0.0000 (1.0)       5.2665 (1.0)      0.0000 (1.0)           0;0  0.1899 (1.0)           1           1
test_status-status[main]        5.3779 (1.02)      5.3779 (1.02)      5.3779 (1.02)     0.0000 (1.0)       5.3779 (1.02)     0.0000 (1.0)           0;0  0.1859 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.0341 (1.91)     5.0341 (1.91)     5.0341 (1.91)     0.0000 (1.0)      5.0341 (1.91)     0.0000 (1.0)           0;0  0.1986 (0.52)          1           1
test_status-status-changed[3.10.0]     5.1684 (1.96)     5.1684 (1.96)     5.1684 (1.96)     0.0000 (1.0)      5.1684 (1.96)     0.0000 (1.0)           0;0  0.1935 (0.51)          1           1
test_status-status-changed[3.53.2]     4.9871 (1.89)     4.9871 (1.89)     4.9871 (1.89)     0.0000 (1.0)      4.9871 (1.89)     0.0000 (1.0)           0;0  0.2005 (0.53)          1           1
test_status-status-changed[3.60.1]     2.6413 (1.0)      2.6413 (1.0)      2.6413 (1.0)      0.0000 (1.0)      2.6413 (1.0)      0.0000 (1.0)           0;0  0.3786 (1.0)           1           1
test_status-status-changed[main]       2.7858 (1.05)     2.7858 (1.05)     2.7858 (1.05)     0.0000 (1.0)      2.7858 (1.05)     0.0000 (1.0)           0;0  0.3590 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0171 (2.00)     5.0171 (2.00)     5.0171 (2.00)     0.0000 (1.0)      5.0171 (2.00)     0.0000 (1.0)           0;0  0.1993 (0.50)          1           1
test_status-status-changed-noop[3.10.0]     5.0990 (2.03)     5.0990 (2.03)     5.0990 (2.03)     0.0000 (1.0)      5.0990 (2.03)     0.0000 (1.0)           0;0  0.1961 (0.49)          1           1
test_status-status-changed-noop[3.53.2]     4.9430 (1.97)     4.9430 (1.97)     4.9430 (1.97)     0.0000 (1.0)      4.9430 (1.97)     0.0000 (1.0)           0;0  0.2023 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.5106 (1.0)      2.5106 (1.0)      2.5106 (1.0)      0.0000 (1.0)      2.5106 (1.0)      0.0000 (1.0)           0;0  0.3983 (1.0)           1           1
test_status-status-changed-noop[main]       2.7981 (1.11)     2.7981 (1.11)     2.7981 (1.11)     0.0000 (1.0)      2.7981 (1.11)     0.0000 (1.0)           0;0  0.3574 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8418 (1.91)     4.8418 (1.91)     4.8418 (1.91)     0.0000 (1.0)      4.8418 (1.91)     0.0000 (1.0)           0;0  0.2065 (0.52)          1           1
test_status-status-noop[3.10.0]     5.1944 (2.05)     5.1944 (2.05)     5.1944 (2.05)     0.0000 (1.0)      5.1944 (2.05)     0.0000 (1.0)           0;0  0.1925 (0.49)          1           1
test_status-status-noop[3.53.2]     4.9589 (1.95)     4.9589 (1.95)     4.9589 (1.95)     0.0000 (1.0)      4.9589 (1.95)     0.0000 (1.0)           0;0  0.2017 (0.51)          1           1
test_status-status-noop[3.60.1]     2.5392 (1.0)      2.5392 (1.0)      2.5392 (1.0)      0.0000 (1.0)      2.5392 (1.0)      0.0000 (1.0)           0;0  0.3938 (1.0)           1           1
test_status-status-noop[main]       2.6898 (1.06)     2.6898 (1.06)     2.6898 (1.06)     0.0000 (1.0)      2.6898 (1.06)     0.0000 (1.0)           0;0  0.3718 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     206.8106 (4.39)     206.8106 (4.39)     206.8106 (4.39)     0.0000 (1.0)      206.8106 (4.39)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_update-import-url[3.10.0]     205.8659 (4.37)     205.8659 (4.37)     205.8659 (4.37)     0.0000 (1.0)      205.8659 (4.37)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.53.2]     116.6388 (2.47)     116.6388 (2.47)     116.6388 (2.47)     0.0000 (1.0)      116.6388 (2.47)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      47.1337 (1.0)       47.1337 (1.0)       47.1337 (1.0)      0.0000 (1.0)       47.1337 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
test_update-import-url[main]        48.8499 (1.04)      48.8499 (1.04)      48.8499 (1.04)     0.0000 (1.0)       48.8499 (1.04)     0.0000 (1.0)           0;0  0.0205 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     188.4968 (5.32)     188.4968 (5.32)     188.4968 (5.32)     0.0000 (1.0)      188.4968 (5.32)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.10.0]     192.9429 (5.44)     192.9429 (5.44)     192.9429 (5.44)     0.0000 (1.0)      192.9429 (5.44)     0.0000 (1.0)           0;0  0.0052 (0.18)          1           1
test_update-update[3.53.2]     108.2777 (3.05)     108.2777 (3.05)     108.2777 (3.05)     0.0000 (1.0)      108.2777 (3.05)     0.0000 (1.0)           0;0  0.0092 (0.33)          1           1
test_update-update[3.60.1]      35.4643 (1.0)       35.4643 (1.0)       35.4643 (1.0)      0.0000 (1.0)       35.4643 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.3004 (1.02)      36.3004 (1.02)      36.3004 (1.02)     0.0000 (1.0)       36.3004 (1.02)     0.0000 (1.0)           0;0  0.0275 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.2277 (2.19)     17.2277 (2.19)     17.2277 (2.19)     0.0000 (1.0)      17.2277 (2.19)     0.0000 (1.0)           0;0  0.0580 (0.46)          1           1
test_update-update-noop[3.10.0]     18.4932 (2.35)     18.4932 (2.35)     18.4932 (2.35)     0.0000 (1.0)      18.4932 (2.35)     0.0000 (1.0)           0;0  0.0541 (0.43)          1           1
test_update-update-noop[3.53.2]     17.2978 (2.20)     17.2978 (2.20)     17.2978 (2.20)     0.0000 (1.0)      17.2978 (2.20)     0.0000 (1.0)           0;0  0.0578 (0.46)          1           1
test_update-update-noop[3.60.1]      7.8717 (1.0)       7.8717 (1.0)       7.8717 (1.0)      0.0000 (1.0)       7.8717 (1.0)      0.0000 (1.0)           0;0  0.1270 (1.0)           1           1
test_update-update-noop[main]        8.1733 (1.04)      8.1733 (1.04)      8.1733 (1.04)     0.0000 (1.0)       8.1733 (1.04)     0.0000 (1.0)           0;0  0.1223 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean