Sat Feb 21 00:52:22 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     82.3389 (3.72)     82.3389 (3.72)     82.3389 (3.72)     0.0000 (1.0)      82.3389 (3.72)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_add_copy-add[3.10.0]     83.0363 (3.75)     83.0363 (3.75)     83.0363 (3.75)     0.0000 (1.0)      83.0363 (3.75)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_add_copy-add[3.53.2]     74.3104 (3.36)     74.3104 (3.36)     74.3104 (3.36)     0.0000 (1.0)      74.3104 (3.36)     0.0000 (1.0)           0;0  0.0135 (0.30)          1           1
test_add_copy-add[3.60.1]     22.1395 (1.0)      22.1395 (1.0)      22.1395 (1.0)      0.0000 (1.0)      22.1395 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_add_copy-add[main]       23.2059 (1.05)     23.2059 (1.05)     23.2059 (1.05)     0.0000 (1.0)      23.2059 (1.05)     0.0000 (1.0)           0;0  0.0431 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.2668 (6.75)     27.2668 (6.75)     27.2668 (6.75)     0.0000 (1.0)      27.2668 (6.75)     0.0000 (1.0)           0;0  0.0367 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     27.5491 (6.82)     27.5491 (6.82)     27.5491 (6.82)     0.0000 (1.0)      27.5491 (6.82)     0.0000 (1.0)           0;0  0.0363 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.2825 (6.51)     26.2825 (6.51)     26.2825 (6.51)     0.0000 (1.0)      26.2825 (6.51)     0.0000 (1.0)           0;0  0.0380 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.0388 (1.0)       4.0388 (1.0)       4.0388 (1.0)      0.0000 (1.0)       4.0388 (1.0)      0.0000 (1.0)           0;0  0.2476 (1.0)           1           1
test_add_copy-add-noop[main]        4.2467 (1.05)      4.2467 (1.05)      4.2467 (1.05)     0.0000 (1.0)       4.2467 (1.05)     0.0000 (1.0)           0;0  0.2355 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     62.8869 (3.96)     62.8869 (3.96)     62.8869 (3.96)     0.0000 (1.0)      62.8869 (3.96)     0.0000 (1.0)           0;0  0.0159 (0.25)          1           1
test_add_hardlink-add[3.10.0]     62.8508 (3.96)     62.8508 (3.96)     62.8508 (3.96)     0.0000 (1.0)      62.8508 (3.96)     0.0000 (1.0)           0;0  0.0159 (0.25)          1           1
test_add_hardlink-add[3.53.2]     58.5982 (3.69)     58.5982 (3.69)     58.5982 (3.69)     0.0000 (1.0)      58.5982 (3.69)     0.0000 (1.0)           0;0  0.0171 (0.27)          1           1
test_add_hardlink-add[3.60.1]     15.8637 (1.0)      15.8637 (1.0)      15.8637 (1.0)      0.0000 (1.0)      15.8637 (1.0)      0.0000 (1.0)           0;0  0.0630 (1.0)           1           1
test_add_hardlink-add[main]       17.1339 (1.08)     17.1339 (1.08)     17.1339 (1.08)     0.0000 (1.0)      17.1339 (1.08)     0.0000 (1.0)           0;0  0.0584 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     31.8022 (7.66)     31.8022 (7.66)     31.8022 (7.66)     0.0000 (1.0)      31.8022 (7.66)     0.0000 (1.0)           0;0  0.0314 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     31.9762 (7.70)     31.9762 (7.70)     31.9762 (7.70)     0.0000 (1.0)      31.9762 (7.70)     0.0000 (1.0)           0;0  0.0313 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     30.0154 (7.23)     30.0154 (7.23)     30.0154 (7.23)     0.0000 (1.0)      30.0154 (7.23)     0.0000 (1.0)           0;0  0.0333 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.1525 (1.0)       4.1525 (1.0)       4.1525 (1.0)      0.0000 (1.0)       4.1525 (1.0)      0.0000 (1.0)           0;0  0.2408 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4793 (1.08)      4.4793 (1.08)      4.4793 (1.08)     0.0000 (1.0)       4.4793 (1.08)     0.0000 (1.0)           0;0  0.2233 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.5825 (1.97)     71.5825 (1.97)     71.5825 (1.97)     0.0000 (1.0)      71.5825 (1.97)     0.0000 (1.0)           0;0  0.0140 (0.51)          1           1
test_add_symlink-add[3.10.0]     72.5534 (1.99)     72.5534 (1.99)     72.5534 (1.99)     0.0000 (1.0)      72.5534 (1.99)     0.0000 (1.0)           0;0  0.0138 (0.50)          1           1
test_add_symlink-add[3.53.2]     68.0636 (1.87)     68.0636 (1.87)     68.0636 (1.87)     0.0000 (1.0)      68.0636 (1.87)     0.0000 (1.0)           0;0  0.0147 (0.53)          1           1
test_add_symlink-add[3.60.1]     36.4119 (1.0)      36.4119 (1.0)      36.4119 (1.0)      0.0000 (1.0)      36.4119 (1.0)      0.0000 (1.0)           0;0  0.0275 (1.0)           1           1
test_add_symlink-add[main]       38.7269 (1.06)     38.7269 (1.06)     38.7269 (1.06)     0.0000 (1.0)      38.7269 (1.06)     0.0000 (1.0)           0;0  0.0258 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.0805 (8.29)     46.0805 (8.29)     46.0805 (8.29)     0.0000 (1.0)      46.0805 (8.29)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.9512 (8.26)     45.9512 (8.26)     45.9512 (8.26)     0.0000 (1.0)      45.9512 (8.26)     0.0000 (1.0)           0;0  0.0218 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.0540 (8.28)     46.0540 (8.28)     46.0540 (8.28)     0.0000 (1.0)      46.0540 (8.28)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5614 (1.0)       5.5614 (1.0)       5.5614 (1.0)      0.0000 (1.0)       5.5614 (1.0)      0.0000 (1.0)           0;0  0.1798 (1.0)           1           1
test_add_symlink-add-noop[main]        6.1325 (1.10)      6.1325 (1.10)      6.1325 (1.10)     0.0000 (1.0)       6.1325 (1.10)     0.0000 (1.0)           0;0  0.1631 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.9789 (1.92)      40.9789 (1.92)      40.9789 (1.92)     0.0000 (1.0)       40.9789 (1.92)     0.0000 (1.0)           0;0  0.0244 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     102.3239 (4.80)     102.3239 (4.80)     102.3239 (4.80)     0.0000 (1.0)      102.3239 (4.80)     0.0000 (1.0)           0;0  0.0098 (0.21)          1           1
test_checkout_copy-checkout[3.53.2]      28.2745 (1.33)      28.2745 (1.33)      28.2745 (1.33)     0.0000 (1.0)       28.2745 (1.33)     0.0000 (1.0)           0;0  0.0354 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]      21.3331 (1.0)       21.3331 (1.0)       21.3331 (1.0)      0.0000 (1.0)       21.3331 (1.0)      0.0000 (1.0)           0;0  0.0469 (1.0)           1           1
test_checkout_copy-checkout[main]        22.2878 (1.04)      22.2878 (1.04)      22.2878 (1.04)     0.0000 (1.0)       22.2878 (1.04)     0.0000 (1.0)           0;0  0.0449 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6578 (1.67)     5.6578 (1.67)     5.6578 (1.67)     0.0000 (1.0)      5.6578 (1.67)     0.0000 (1.0)           0;0  0.1767 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9205 (1.75)     5.9205 (1.75)     5.9205 (1.75)     0.0000 (1.0)      5.9205 (1.75)     0.0000 (1.0)           0;0  0.1689 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7037 (1.68)     5.7037 (1.68)     5.7037 (1.68)     0.0000 (1.0)      5.7037 (1.68)     0.0000 (1.0)           0;0  0.1753 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3891 (1.0)      3.3891 (1.0)      3.3891 (1.0)      0.0000 (1.0)      3.3891 (1.0)      0.0000 (1.0)           0;0  0.2951 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6065 (1.06)     3.6065 (1.06)     3.6065 (1.06)     0.0000 (1.0)      3.6065 (1.06)     0.0000 (1.0)           0;0  0.2773 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9231 (1.97)     7.9231 (1.97)     7.9231 (1.97)     0.0000 (1.0)      7.9231 (1.97)     0.0000 (1.0)           0;0  0.1262 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6779 (1.66)     6.6779 (1.66)     6.6779 (1.66)     0.0000 (1.0)      6.6779 (1.66)     0.0000 (1.0)           0;0  0.1497 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5632 (1.63)     6.5632 (1.63)     6.5632 (1.63)     0.0000 (1.0)      6.5632 (1.63)     0.0000 (1.0)           0;0  0.1524 (0.61)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0168 (1.0)      4.0168 (1.0)      4.0168 (1.0)      0.0000 (1.0)      4.0168 (1.0)      0.0000 (1.0)           0;0  0.2490 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5555 (1.13)     4.5555 (1.13)     4.5555 (1.13)     0.0000 (1.0)      4.5555 (1.13)     0.0000 (1.0)           0;0  0.2195 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     14.9477 (2.54)     14.9477 (2.54)     14.9477 (2.54)     0.0000 (1.0)      14.9477 (2.54)     0.0000 (1.0)           0;0  0.0669 (0.39)          1           1
test_checkout_hardlink-checkout[3.10.0]     11.5865 (1.97)     11.5865 (1.97)     11.5865 (1.97)     0.0000 (1.0)      11.5865 (1.97)     0.0000 (1.0)           0;0  0.0863 (0.51)          1           1
test_checkout_hardlink-checkout[3.53.2]     10.5124 (1.78)     10.5124 (1.78)     10.5124 (1.78)     0.0000 (1.0)      10.5124 (1.78)     0.0000 (1.0)           0;0  0.0951 (0.56)          1           1
test_checkout_hardlink-checkout[3.60.1]      5.8900 (1.0)       5.8900 (1.0)       5.8900 (1.0)      0.0000 (1.0)       5.8900 (1.0)      0.0000 (1.0)           0;0  0.1698 (1.0)           1           1
test_checkout_hardlink-checkout[main]        6.5597 (1.11)      6.5597 (1.11)      6.5597 (1.11)     0.0000 (1.0)       6.5597 (1.11)     0.0000 (1.0)           0;0  0.1524 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     4.0534 (1.29)     4.0534 (1.29)     4.0534 (1.29)     0.0000 (1.0)      4.0534 (1.29)     0.0000 (1.0)           0;0  0.2467 (0.77)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     4.4252 (1.41)     4.4252 (1.41)     4.4252 (1.41)     0.0000 (1.0)      4.4252 (1.41)     0.0000 (1.0)           0;0  0.2260 (0.71)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     4.2912 (1.37)     4.2912 (1.37)     4.2912 (1.37)     0.0000 (1.0)      4.2912 (1.37)     0.0000 (1.0)           0;0  0.2330 (0.73)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.1325 (1.0)      3.1325 (1.0)      3.1325 (1.0)      0.0000 (1.0)      3.1325 (1.0)      0.0000 (1.0)           0;0  0.3192 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.2003 (1.02)     3.2003 (1.02)     3.2003 (1.02)     0.0000 (1.0)      3.2003 (1.02)     0.0000 (1.0)           0;0  0.3125 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     5.8522 (1.65)     5.8522 (1.65)     5.8522 (1.65)     0.0000 (1.0)      5.8522 (1.65)     0.0000 (1.0)           0;0  0.1709 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     5.0768 (1.43)     5.0768 (1.43)     5.0768 (1.43)     0.0000 (1.0)      5.0768 (1.43)     0.0000 (1.0)           0;0  0.1970 (0.70)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     5.0259 (1.41)     5.0259 (1.41)     5.0259 (1.41)     0.0000 (1.0)      5.0259 (1.41)     0.0000 (1.0)           0;0  0.1990 (0.71)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.5522 (1.0)      3.5522 (1.0)      3.5522 (1.0)      0.0000 (1.0)      3.5522 (1.0)      0.0000 (1.0)           0;0  0.2815 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.9122 (1.10)     3.9122 (1.10)     3.9122 (1.10)     0.0000 (1.0)      3.9122 (1.10)     0.0000 (1.0)           0;0  0.2556 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.5908 (2.44)     24.5908 (2.44)     24.5908 (2.44)     0.0000 (1.0)      24.5908 (2.44)     0.0000 (1.0)           0;0  0.0407 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     19.3212 (1.92)     19.3212 (1.92)     19.3212 (1.92)     0.0000 (1.0)      19.3212 (1.92)     0.0000 (1.0)           0;0  0.0518 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.6585 (1.75)     17.6585 (1.75)     17.6585 (1.75)     0.0000 (1.0)      17.6585 (1.75)     0.0000 (1.0)           0;0  0.0566 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.0736 (1.0)      10.0736 (1.0)      10.0736 (1.0)      0.0000 (1.0)      10.0736 (1.0)      0.0000 (1.0)           0;0  0.0993 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.7593 (1.07)     10.7593 (1.07)     10.7593 (1.07)     0.0000 (1.0)      10.7593 (1.07)     0.0000 (1.0)           0;0  0.0929 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6115 (1.60)     6.6115 (1.60)     6.6115 (1.60)     0.0000 (1.0)      6.6115 (1.60)     0.0000 (1.0)           0;0  0.1513 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7591 (1.63)     6.7591 (1.63)     6.7591 (1.63)     0.0000 (1.0)      6.7591 (1.63)     0.0000 (1.0)           0;0  0.1479 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6181 (1.60)     6.6181 (1.60)     6.6181 (1.60)     0.0000 (1.0)      6.6181 (1.60)     0.0000 (1.0)           0;0  0.1511 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1350 (1.0)      4.1350 (1.0)      4.1350 (1.0)      0.0000 (1.0)      4.1350 (1.0)      0.0000 (1.0)           0;0  0.2418 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3985 (1.06)     4.3985 (1.06)     4.3985 (1.06)     0.0000 (1.0)      4.3985 (1.06)     0.0000 (1.0)           0;0  0.2274 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.5379 (1.68)     9.5379 (1.68)     9.5379 (1.68)     0.0000 (1.0)      9.5379 (1.68)     0.0000 (1.0)           0;0  0.1048 (0.60)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.5187 (1.50)     8.5187 (1.50)     8.5187 (1.50)     0.0000 (1.0)      8.5187 (1.50)     0.0000 (1.0)           0;0  0.1174 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.4465 (1.49)     8.4465 (1.49)     8.4465 (1.49)     0.0000 (1.0)      8.4465 (1.49)     0.0000 (1.0)           0;0  0.1184 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.6878 (1.0)      5.6878 (1.0)      5.6878 (1.0)      0.0000 (1.0)      5.6878 (1.0)      0.0000 (1.0)           0;0  0.1758 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.0506 (1.06)     6.0506 (1.06)     6.0506 (1.06)     0.0000 (1.0)      6.0506 (1.06)     0.0000 (1.0)           0;0  0.1653 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9227 (1.68)     3.9227 (1.68)     3.9227 (1.68)     0.0000 (1.0)      3.9227 (1.68)     0.0000 (1.0)           0;0  0.2549 (0.60)          1           1
test_data_status-data-changed[3.10.0]     4.9395 (2.11)     4.9395 (2.11)     4.9395 (2.11)     0.0000 (1.0)      4.9395 (2.11)     0.0000 (1.0)           0;0  0.2024 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.7310 (2.02)     4.7310 (2.02)     4.7310 (2.02)     0.0000 (1.0)      4.7310 (2.02)     0.0000 (1.0)           0;0  0.2114 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.3387 (1.0)      2.3387 (1.0)      2.3387 (1.0)      0.0000 (1.0)      2.3387 (1.0)      0.0000 (1.0)           0;0  0.4276 (1.0)           1           1
test_data_status-data-changed[main]       2.5298 (1.08)     2.5298 (1.08)     2.5298 (1.08)     0.0000 (1.0)      2.5298 (1.08)     0.0000 (1.0)           0;0  0.3953 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1113 (1.76)     4.1113 (1.76)     4.1113 (1.76)     0.0000 (1.0)      4.1113 (1.76)     0.0000 (1.0)           0;0  0.2432 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8742 (2.08)     4.8742 (2.08)     4.8742 (2.08)     0.0000 (1.0)      4.8742 (2.08)     0.0000 (1.0)           0;0  0.2052 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8680 (2.08)     4.8680 (2.08)     4.8680 (2.08)     0.0000 (1.0)      4.8680 (2.08)     0.0000 (1.0)           0;0  0.2054 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3391 (1.0)      2.3391 (1.0)      2.3391 (1.0)      0.0000 (1.0)      2.3391 (1.0)      0.0000 (1.0)           0;0  0.4275 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5189 (1.08)     2.5189 (1.08)     2.5189 (1.08)     0.0000 (1.0)      2.5189 (1.08)     0.0000 (1.0)           0;0  0.3970 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     17.9094 (3.63)     17.9094 (3.63)     17.9094 (3.63)     0.0000 (1.0)      17.9094 (3.63)     0.0000 (1.0)           0;0  0.0558 (0.28)          1           1
test_data_status-data-new[3.10.0]     19.4794 (3.95)     19.4794 (3.95)     19.4794 (3.95)     0.0000 (1.0)      19.4794 (3.95)     0.0000 (1.0)           0;0  0.0513 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.7300 (3.80)     18.7300 (3.80)     18.7300 (3.80)     0.0000 (1.0)      18.7300 (3.80)     0.0000 (1.0)           0;0  0.0534 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9336 (1.0)       4.9336 (1.0)       4.9336 (1.0)      0.0000 (1.0)       4.9336 (1.0)      0.0000 (1.0)           0;0  0.2027 (1.0)           1           1
test_data_status-data-new[main]        5.2752 (1.07)      5.2752 (1.07)      5.2752 (1.07)     0.0000 (1.0)       5.2752 (1.07)     0.0000 (1.0)           0;0  0.1896 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0325 (1.74)     4.0325 (1.74)     4.0325 (1.74)     0.0000 (1.0)      4.0325 (1.74)     0.0000 (1.0)           0;0  0.2480 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.8986 (2.11)     4.8986 (2.11)     4.8986 (2.11)     0.0000 (1.0)      4.8986 (2.11)     0.0000 (1.0)           0;0  0.2041 (0.47)          1           1
test_data_status-data-noop[3.53.2]     4.8668 (2.10)     4.8668 (2.10)     4.8668 (2.10)     0.0000 (1.0)      4.8668 (2.10)     0.0000 (1.0)           0;0  0.2055 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3219 (1.0)      2.3219 (1.0)      2.3219 (1.0)      0.0000 (1.0)      2.3219 (1.0)      0.0000 (1.0)           0;0  0.4307 (1.0)           1           1
test_data_status-data-noop[main]       2.5361 (1.09)     2.5361 (1.09)     2.5361 (1.09)     0.0000 (1.0)      2.5361 (1.09)     0.0000 (1.0)           0;0  0.3943 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.3649 (1.14)     6.3649 (1.14)     6.3649 (1.14)     0.0000 (1.0)      6.3649 (1.14)     0.0000 (1.0)           0;0  0.1571 (0.88)          1           1
test_data_status_all_flags-data-changed[3.10.0]     6.6390 (1.19)     6.6390 (1.19)     6.6390 (1.19)     0.0000 (1.0)      6.6390 (1.19)     0.0000 (1.0)           0;0  0.1506 (0.84)          1           1
test_data_status_all_flags-data-changed[3.53.2]     6.5290 (1.17)     6.5290 (1.17)     6.5290 (1.17)     0.0000 (1.0)      6.5290 (1.17)     0.0000 (1.0)           0;0  0.1532 (0.85)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5787 (1.0)      5.5787 (1.0)      5.5787 (1.0)      0.0000 (1.0)      5.5787 (1.0)      0.0000 (1.0)           0;0  0.1793 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9717 (1.07)     5.9717 (1.07)     5.9717 (1.07)     0.0000 (1.0)      5.9717 (1.07)     0.0000 (1.0)           0;0  0.1675 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.2868 (1.14)     6.2868 (1.14)     6.2868 (1.14)     0.0000 (1.0)      6.2868 (1.14)     0.0000 (1.0)           0;0  0.1591 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     6.5533 (1.19)     6.5533 (1.19)     6.5533 (1.19)     0.0000 (1.0)      6.5533 (1.19)     0.0000 (1.0)           0;0  0.1526 (0.84)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     6.4829 (1.18)     6.4829 (1.18)     6.4829 (1.18)     0.0000 (1.0)      6.4829 (1.18)     0.0000 (1.0)           0;0  0.1543 (0.85)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5166 (1.0)      5.5166 (1.0)      5.5166 (1.0)      0.0000 (1.0)      5.5166 (1.0)      0.0000 (1.0)           0;0  0.1813 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.9420 (1.08)     5.9420 (1.08)     5.9420 (1.08)     0.0000 (1.0)      5.9420 (1.08)     0.0000 (1.0)           0;0  0.1683 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     18.9509 (2.48)     18.9509 (2.48)     18.9509 (2.48)     0.0000 (1.0)      18.9509 (2.48)     0.0000 (1.0)           0;0  0.0528 (0.40)          1           1
test_data_status_all_flags-data-new[3.10.0]     20.2319 (2.65)     20.2319 (2.65)     20.2319 (2.65)     0.0000 (1.0)      20.2319 (2.65)     0.0000 (1.0)           0;0  0.0494 (0.38)          1           1
test_data_status_all_flags-data-new[3.53.2]     19.8595 (2.60)     19.8595 (2.60)     19.8595 (2.60)     0.0000 (1.0)      19.8595 (2.60)     0.0000 (1.0)           0;0  0.0504 (0.38)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.6278 (1.0)       7.6278 (1.0)       7.6278 (1.0)      0.0000 (1.0)       7.6278 (1.0)      0.0000 (1.0)           0;0  0.1311 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2557 (1.08)      8.2557 (1.08)      8.2557 (1.08)     0.0000 (1.0)       8.2557 (1.08)     0.0000 (1.0)           0;0  0.1211 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     5.7784 (1.22)     5.7784 (1.22)     5.7784 (1.22)     0.0000 (1.0)      5.7784 (1.22)     0.0000 (1.0)           0;0  0.1731 (0.82)          1           1
test_data_status_all_flags-data-noop[3.10.0]     6.0385 (1.28)     6.0385 (1.28)     6.0385 (1.28)     0.0000 (1.0)      6.0385 (1.28)     0.0000 (1.0)           0;0  0.1656 (0.78)          1           1
test_data_status_all_flags-data-noop[3.53.2]     5.9520 (1.26)     5.9520 (1.26)     5.9520 (1.26)     0.0000 (1.0)      5.9520 (1.26)     0.0000 (1.0)           0;0  0.1680 (0.80)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7354 (1.0)      4.7354 (1.0)      4.7354 (1.0)      0.0000 (1.0)      4.7354 (1.0)      0.0000 (1.0)           0;0  0.2112 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2767 (1.11)     5.2767 (1.11)     5.2767 (1.11)     0.0000 (1.0)      5.2767 (1.11)     0.0000 (1.0)           0;0  0.1895 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.7066 (2.73)     17.7066 (2.73)     17.7066 (2.73)     0.0000 (1.0)      17.7066 (2.73)     0.0000 (1.0)           0;0  0.0565 (0.37)          1           1
test_diff-diff[3.10.0]     18.5572 (2.86)     18.5572 (2.86)     18.5572 (2.86)     0.0000 (1.0)      18.5572 (2.86)     0.0000 (1.0)           0;0  0.0539 (0.35)          1           1
test_diff-diff[3.53.2]     18.2580 (2.81)     18.2580 (2.81)     18.2580 (2.81)     0.0000 (1.0)      18.2580 (2.81)     0.0000 (1.0)           0;0  0.0548 (0.36)          1           1
test_diff-diff[3.60.1]      6.4917 (1.0)       6.4917 (1.0)       6.4917 (1.0)      0.0000 (1.0)       6.4917 (1.0)      0.0000 (1.0)           0;0  0.1540 (1.0)           1           1
test_diff-diff[main]        7.5677 (1.17)      7.5677 (1.17)      7.5677 (1.17)     0.0000 (1.0)       7.5677 (1.17)     0.0000 (1.0)           0;0  0.1321 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.8606 (1.83)     5.8606 (1.83)     5.8606 (1.83)     0.0000 (1.0)      5.8606 (1.83)     0.0000 (1.0)           0;0  0.1706 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.5265 (2.04)     6.5265 (2.04)     6.5265 (2.04)     0.0000 (1.0)      6.5265 (2.04)     0.0000 (1.0)           0;0  0.1532 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.6257 (1.76)     5.6257 (1.76)     5.6257 (1.76)     0.0000 (1.0)      5.6257 (1.76)     0.0000 (1.0)           0;0  0.1778 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.2031 (1.0)      3.2031 (1.0)      3.2031 (1.0)      0.0000 (1.0)      3.2031 (1.0)      0.0000 (1.0)           0;0  0.3122 (1.0)           1           1
test_diff-diff-changed[main]       4.0216 (1.26)     4.0216 (1.26)     4.0216 (1.26)     0.0000 (1.0)      4.0216 (1.26)     0.0000 (1.0)           0;0  0.2487 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.9795 (1.54)     4.9795 (1.54)     4.9795 (1.54)     0.0000 (1.0)      4.9795 (1.54)     0.0000 (1.0)           0;0  0.2008 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.5810 (1.73)     5.5810 (1.73)     5.5810 (1.73)     0.0000 (1.0)      5.5810 (1.73)     0.0000 (1.0)           0;0  0.1792 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4728 (1.69)     5.4728 (1.69)     5.4728 (1.69)     0.0000 (1.0)      5.4728 (1.69)     0.0000 (1.0)           0;0  0.1827 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2293 (1.0)      3.2293 (1.0)      3.2293 (1.0)      0.0000 (1.0)      3.2293 (1.0)      0.0000 (1.0)           0;0  0.3097 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.9798 (1.23)     3.9798 (1.23)     3.9798 (1.23)     0.0000 (1.0)      3.9798 (1.23)     0.0000 (1.0)           0;0  0.2513 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0537 (1.26)     4.0537 (1.26)     4.0537 (1.26)     0.0000 (1.0)      4.0537 (1.26)     0.0000 (1.0)           0;0  0.2467 (0.79)          1           1
test_diff-diff-noop[3.10.0]     4.9004 (1.52)     4.9004 (1.52)     4.9004 (1.52)     0.0000 (1.0)      4.9004 (1.52)     0.0000 (1.0)           0;0  0.2041 (0.66)          1           1
test_diff-diff-noop[3.53.2]     5.5059 (1.71)     5.5059 (1.71)     5.5059 (1.71)     0.0000 (1.0)      5.5059 (1.71)     0.0000 (1.0)           0;0  0.1816 (0.58)          1           1
test_diff-diff-noop[3.60.1]     3.2165 (1.0)      3.2165 (1.0)      3.2165 (1.0)      0.0000 (1.0)      3.2165 (1.0)      0.0000 (1.0)           0;0  0.3109 (1.0)           1           1
test_diff-diff-noop[main]       3.9997 (1.24)     3.9997 (1.24)     3.9997 (1.24)     0.0000 (1.0)      3.9997 (1.24)     0.0000 (1.0)           0;0  0.2500 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.1936 (1.0)       1.1936 (1.0)       1.1936 (1.0)      0.0000 (1.0)       1.1936 (1.0)      0.0000 (1.0)           0;0  0.8378 (1.0)           1           1
test_exp_show-exp[3.10.0]     11.1576 (9.35)     11.1576 (9.35)     11.1576 (9.35)     0.0000 (1.0)      11.1576 (9.35)     0.0000 (1.0)           0;0  0.0896 (0.11)          1           1
test_exp_show-exp[3.53.2]      6.0366 (5.06)      6.0366 (5.06)      6.0366 (5.06)     0.0000 (1.0)       6.0366 (5.06)     0.0000 (1.0)           0;0  0.1657 (0.20)          1           1
test_exp_show-exp[3.60.1]      6.3622 (5.33)      6.3622 (5.33)      6.3622 (5.33)     0.0000 (1.0)       6.3622 (5.33)     0.0000 (1.0)           0;0  0.1572 (0.19)          1           1
test_exp_show-exp[main]       12.0148 (10.07)    12.0148 (10.07)    12.0148 (10.07)    0.0000 (1.0)      12.0148 (10.07)    0.0000 (1.0)           0;0  0.0832 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     107.9446 (4.59)     107.9446 (4.59)     107.9446 (4.59)     0.0000 (1.0)      107.9446 (4.59)     0.0000 (1.0)           0;0  0.0093 (0.22)          1           1
test_fetch-fetch[3.10.0]     113.6596 (4.83)     113.6596 (4.83)     113.6596 (4.83)     0.0000 (1.0)      113.6596 (4.83)     0.0000 (1.0)           0;0  0.0088 (0.21)          1           1
test_fetch-fetch[3.53.2]      33.7508 (1.43)      33.7508 (1.43)      33.7508 (1.43)     0.0000 (1.0)       33.7508 (1.43)     0.0000 (1.0)           0;0  0.0296 (0.70)          1           1
test_fetch-fetch[3.60.1]      24.0474 (1.02)      24.0474 (1.02)      24.0474 (1.02)     0.0000 (1.0)       24.0474 (1.02)     0.0000 (1.0)           0;0  0.0416 (0.98)          1           1
test_fetch-fetch[main]        23.5261 (1.0)       23.5261 (1.0)       23.5261 (1.0)      0.0000 (1.0)       23.5261 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8946 (1.0)      2.8946 (1.0)      2.8946 (1.0)      0.0000 (1.0)      2.8946 (1.0)      0.0000 (1.0)           0;0  0.3455 (1.0)           1           1
test_gc-gc[3.10.0]     3.1979 (1.10)     3.1979 (1.10)     3.1979 (1.10)     0.0000 (1.0)      3.1979 (1.10)     0.0000 (1.0)           0;0  0.3127 (0.91)          1           1
test_gc-gc[3.53.2]     2.9370 (1.01)     2.9370 (1.01)     2.9370 (1.01)     0.0000 (1.0)      2.9370 (1.01)     0.0000 (1.0)           0;0  0.3405 (0.99)          1           1
test_gc-gc[3.60.1]     2.9141 (1.01)     2.9141 (1.01)     2.9141 (1.01)     0.0000 (1.0)      2.9141 (1.01)     0.0000 (1.0)           0;0  0.3432 (0.99)          1           1
test_gc-gc[main]       2.9287 (1.01)     2.9287 (1.01)     2.9287 (1.01)     0.0000 (1.0)      2.9287 (1.01)     0.0000 (1.0)           0;0  0.3414 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     153.0165 (3.84)     153.0165 (3.84)     153.0165 (3.84)     0.0000 (1.0)      153.0165 (3.84)     0.0000 (1.0)           0;0  0.0065 (0.26)          1           1
test_get-get[3.10.0]     183.5003 (4.60)     183.5003 (4.60)     183.5003 (4.60)     0.0000 (1.0)      183.5003 (4.60)     0.0000 (1.0)           0;0  0.0054 (0.22)          1           1
test_get-get[3.53.2]     130.0290 (3.26)     130.0290 (3.26)     130.0290 (3.26)     0.0000 (1.0)      130.0290 (3.26)     0.0000 (1.0)           0;0  0.0077 (0.31)          1           1
test_get-get[3.60.1]      39.8815 (1.00)      39.8815 (1.00)      39.8815 (1.00)     0.0000 (1.0)       39.8815 (1.00)     0.0000 (1.0)           0;0  0.0251 (1.00)          1           1
test_get-get[main]        39.8578 (1.0)       39.8578 (1.0)       39.8578 (1.0)      0.0000 (1.0)       39.8578 (1.0)      0.0000 (1.0)           0;0  0.0251 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     86.8881 (5.22)     86.8881 (5.22)     86.8881 (5.22)     0.0000 (1.0)      86.8881 (5.22)     0.0000 (1.0)           0;0  0.0115 (0.19)          1           1
test_get_url-get-url[3.10.0]     88.8966 (5.34)     88.8966 (5.34)     88.8966 (5.34)     0.0000 (1.0)      88.8966 (5.34)     0.0000 (1.0)           0;0  0.0112 (0.19)          1           1
test_get_url-get-url[3.53.2]     16.7612 (1.01)     16.7612 (1.01)     16.7612 (1.01)     0.0000 (1.0)      16.7612 (1.01)     0.0000 (1.0)           0;0  0.0597 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.8636 (1.01)     16.8636 (1.01)     16.8636 (1.01)     0.0000 (1.0)      16.8636 (1.01)     0.0000 (1.0)           0;0  0.0593 (0.99)          1           1
test_get_url-get-url[main]       16.6433 (1.0)      16.6433 (1.0)      16.6433 (1.0)      0.0000 (1.0)      16.6433 (1.0)      0.0000 (1.0)           0;0  0.0601 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     163.8715 (1.05)     177.0277 (1.08)     165.9149 (1.05)     1.5799 (2.00)     165.5580 (1.05)     1.0010 (1.24)          8;6  6.0272 (0.95)        100           1
test_help---help[3.10.0]     160.5219 (1.03)     164.6482 (1.0)      161.8267 (1.02)     0.7893 (1.0)      161.6866 (1.03)     0.8066 (1.0)          24;7  6.1794 (0.98)        100           1
test_help---help[3.53.2]     163.7603 (1.05)     170.8860 (1.04)     165.3190 (1.05)     0.9883 (1.25)     165.1193 (1.05)     0.9646 (1.20)         20;3  6.0489 (0.96)        100           1
test_help---help[3.60.1]     163.2311 (1.04)     209.0316 (1.27)     166.7959 (1.05)     6.9340 (8.79)     165.4342 (1.05)     1.1796 (1.46)          4;7  5.9954 (0.95)        100           1
test_help---help[main]       156.4264 (1.0)      200.5210 (1.22)     158.1668 (1.0)      4.3391 (5.50)     157.6153 (1.0)      1.0439 (1.29)          1;2  6.3224 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     265.4090 (3.38)     265.4090 (3.38)     265.4090 (3.38)     0.0000 (1.0)      265.4090 (3.38)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[3.10.0]     304.6100 (3.88)     304.6100 (3.88)     304.6100 (3.88)     0.0000 (1.0)      304.6100 (3.88)     0.0000 (1.0)           0;0  0.0033 (0.26)          1           1
test_import-import[3.60.1]      78.5429 (1.0)       78.5429 (1.0)       78.5429 (1.0)      0.0000 (1.0)       78.5429 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
test_import-import[main]        79.6919 (1.01)      79.6919 (1.01)      79.6919 (1.01)     0.0000 (1.0)       79.6919 (1.01)     0.0000 (1.0)           0;0  0.0125 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     193.0019 (4.24)     193.0019 (4.24)     193.0019 (4.24)     0.0000 (1.0)      193.0019 (4.24)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_import_url-import-url[3.10.0]     196.1649 (4.31)     196.1649 (4.31)     196.1649 (4.31)     0.0000 (1.0)      196.1649 (4.31)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_import_url-import-url[3.53.2]     112.1876 (2.47)     112.1876 (2.47)     112.1876 (2.47)     0.0000 (1.0)      112.1876 (2.47)     0.0000 (1.0)           0;0  0.0089 (0.41)          1           1
test_import_url-import-url[3.60.1]      45.4920 (1.0)       45.4920 (1.0)       45.4920 (1.0)      0.0000 (1.0)       45.4920 (1.0)      0.0000 (1.0)           0;0  0.0220 (1.0)           1           1
test_import_url-import-url[main]        46.7914 (1.03)      46.7914 (1.03)      46.7914 (1.03)     0.0000 (1.0)       46.7914 (1.03)     0.0000 (1.0)           0;0  0.0214 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     365.2729 (1.02)     392.4125 (1.01)     376.8908 (1.02)      6.1043 (1.47)     375.5124 (1.01)      8.6001 (1.43)         33;0  2.6533 (0.98)        100           1
test_init-init[3.10.0]     373.2598 (1.05)     394.1804 (1.02)     383.3203 (1.03)      4.4979 (1.08)     383.3660 (1.03)      6.0290 (1.0)          34;0  2.6088 (0.97)        100           1
test_init-init[3.53.2]     356.4690 (1.0)      404.4953 (1.04)     371.0885 (1.0)       6.7619 (1.63)     370.6029 (1.0)       7.1991 (1.19)         23;4  2.6948 (1.0)         100           1
test_init-init[3.60.1]     365.4561 (1.03)     387.4566 (1.0)      373.1785 (1.01)      4.1610 (1.0)      372.6260 (1.01)      6.2155 (1.03)         35;1  2.6797 (0.99)        100           1
test_init-init[main]       402.9582 (1.13)     581.3789 (1.50)     417.7528 (1.13)     19.2419 (4.62)     414.9634 (1.12)     12.9692 (2.15)          2;2  2.3938 (0.89)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     646.2612 (1.01)     646.2612 (1.01)     646.2612 (1.01)     0.0000 (1.0)      646.2612 (1.01)     0.0000 (1.0)           0;0  1.5474 (0.99)          1           1
test_list-list[3.10.0]     937.0215 (1.47)     937.0215 (1.47)     937.0215 (1.47)     0.0000 (1.0)      937.0215 (1.47)     0.0000 (1.0)           0;0  1.0672 (0.68)          1           1
test_list-list[3.53.2]     638.8267 (1.0)      638.8267 (1.0)      638.8267 (1.0)      0.0000 (1.0)      638.8267 (1.0)      0.0000 (1.0)           0;0  1.5654 (1.0)           1           1
test_list-list[3.60.1]     663.4475 (1.04)     663.4475 (1.04)     663.4475 (1.04)     0.0000 (1.0)      663.4475 (1.04)     0.0000 (1.0)           0;0  1.5073 (0.96)          1           1
test_list-list[main]       674.7970 (1.06)     674.7970 (1.06)     674.7970 (1.06)     0.0000 (1.0)      674.7970 (1.06)     0.0000 (1.0)           0;0  1.4819 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     446.0325 (1.07)     446.0325 (1.07)     446.0325 (1.07)     0.0000 (1.0)      446.0325 (1.07)     0.0000 (1.0)           0;0  2.2420 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     441.5962 (1.06)     441.5962 (1.06)     441.5962 (1.06)     0.0000 (1.0)      441.5962 (1.06)     0.0000 (1.0)           0;0  2.2645 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     416.4136 (1.0)      416.4136 (1.0)      416.4136 (1.0)      0.0000 (1.0)      416.4136 (1.0)      0.0000 (1.0)           0;0  2.4015 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     429.7916 (1.03)     429.7916 (1.03)     429.7916 (1.03)     0.0000 (1.0)      429.7916 (1.03)     0.0000 (1.0)           0;0  2.3267 (0.97)          1           1
test_list-list-dvc-only[main]       433.3610 (1.04)     433.3610 (1.04)     433.3610 (1.04)     0.0000 (1.0)      433.3610 (1.04)     0.0000 (1.0)           0;0  2.3075 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4514 (1.01)     2.4514 (1.01)     2.4514 (1.01)     0.0000 (1.0)      2.4514 (1.01)     0.0000 (1.0)           0;0  0.4079 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.4253 (1.0)      2.4253 (1.0)      2.4253 (1.0)      0.0000 (1.0)      2.4253 (1.0)      0.0000 (1.0)           0;0  0.4123 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.6748 (1.10)     2.6748 (1.10)     2.6748 (1.10)     0.0000 (1.0)      2.6748 (1.10)     0.0000 (1.0)           0;0  0.3739 (0.91)          1           1
test_list-list-recursive[3.60.1]     2.6951 (1.11)     2.6951 (1.11)     2.6951 (1.11)     0.0000 (1.0)      2.6951 (1.11)     0.0000 (1.0)           0;0  0.3710 (0.90)          1           1
test_list-list-recursive[main]       2.8145 (1.16)     2.8145 (1.16)     2.8145 (1.16)     0.0000 (1.0)      2.8145 (1.16)     0.0000 (1.0)           0;0  0.3553 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     445.0685 (1.05)     445.0685 (1.05)     445.0685 (1.05)     0.0000 (1.0)      445.0685 (1.05)     0.0000 (1.0)           0;0  2.2468 (0.95)          1           1
test_list-list-shallow[3.10.0]     453.2977 (1.07)     453.2977 (1.07)     453.2977 (1.07)     0.0000 (1.0)      453.2977 (1.07)     0.0000 (1.0)           0;0  2.2061 (0.94)          1           1
test_list-list-shallow[3.53.2]     424.8050 (1.00)     424.8050 (1.00)     424.8050 (1.00)     0.0000 (1.0)      424.8050 (1.00)     0.0000 (1.0)           0;0  2.3540 (1.00)          1           1
test_list-list-shallow[3.60.1]     427.8212 (1.01)     427.8212 (1.01)     427.8212 (1.01)     0.0000 (1.0)      427.8212 (1.01)     0.0000 (1.0)           0;0  2.3374 (0.99)          1           1
test_list-list-shallow[main]       424.5813 (1.0)      424.5813 (1.0)      424.5813 (1.0)      0.0000 (1.0)      424.5813 (1.0)      0.0000 (1.0)           0;0  2.3553 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     67.7619 (3.53)     67.7619 (3.53)     67.7619 (3.53)     0.0000 (1.0)      67.7619 (3.53)     0.0000 (1.0)           0;0  0.0148 (0.28)          1           1
test_partial_add-add[3.10.0]     69.2557 (3.61)     69.2557 (3.61)     69.2557 (3.61)     0.0000 (1.0)      69.2557 (3.61)     0.0000 (1.0)           0;0  0.0144 (0.28)          1           1
test_partial_add-add[3.53.2]     62.0336 (3.23)     62.0336 (3.23)     62.0336 (3.23)     0.0000 (1.0)      62.0336 (3.23)     0.0000 (1.0)           0;0  0.0161 (0.31)          1           1
test_partial_add-add[3.60.1]     19.1761 (1.0)      19.1761 (1.0)      19.1761 (1.0)      0.0000 (1.0)      19.1761 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
test_partial_add-add[main]       20.3516 (1.06)     20.3516 (1.06)     20.3516 (1.06)     0.0000 (1.0)      20.3516 (1.06)     0.0000 (1.0)           0;0  0.0491 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     57.6455 (7.80)     57.6455 (7.80)     57.6455 (7.80)     0.0000 (1.0)      57.6455 (7.80)     0.0000 (1.0)           0;0  0.0173 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     58.2734 (7.88)     58.2734 (7.88)     58.2734 (7.88)     0.0000 (1.0)      58.2734 (7.88)     0.0000 (1.0)           0;0  0.0172 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     52.8227 (7.15)     52.8227 (7.15)     52.8227 (7.15)     0.0000 (1.0)      52.8227 (7.15)     0.0000 (1.0)           0;0  0.0189 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.3907 (1.0)       7.3907 (1.0)       7.3907 (1.0)      0.0000 (1.0)       7.3907 (1.0)      0.0000 (1.0)           0;0  0.1353 (1.0)           1           1
test_partial_add-add-partial[main]        7.5047 (1.02)      7.5047 (1.02)      7.5047 (1.02)     0.0000 (1.0)       7.5047 (1.02)     0.0000 (1.0)           0;0  0.1332 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4557 (1.0)      4.4557 (1.0)      4.4557 (1.0)      0.0000 (1.0)      4.4557 (1.0)      0.0000 (1.0)           0;0  0.2244 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9472 (1.33)     5.9472 (1.33)     5.9472 (1.33)     0.0000 (1.0)      5.9472 (1.33)     0.0000 (1.0)           0;0  0.1681 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7855 (1.52)     6.7855 (1.52)     6.7855 (1.52)     0.0000 (1.0)      6.7855 (1.52)     0.0000 (1.0)           0;0  0.1474 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7188 (1.51)     6.7188 (1.51)     6.7188 (1.51)     0.0000 (1.0)      6.7188 (1.51)     0.0000 (1.0)           0;0  0.1488 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       5.7494 (1.29)     5.7494 (1.29)     5.7494 (1.29)     0.0000 (1.0)      5.7494 (1.29)     0.0000 (1.0)           0;0  0.1739 (0.77)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4962 (1.0)      2.4962 (1.0)      2.4962 (1.0)      0.0000 (1.0)      2.4962 (1.0)      0.0000 (1.0)           0;0  0.4006 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8036 (1.52)     3.8036 (1.52)     3.8036 (1.52)     0.0000 (1.0)      3.8036 (1.52)     0.0000 (1.0)           0;0  0.2629 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.8284 (1.53)     3.8284 (1.53)     3.8284 (1.53)     0.0000 (1.0)      3.8284 (1.53)     0.0000 (1.0)           0;0  0.2612 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.8471 (1.54)     3.8471 (1.54)     3.8471 (1.54)     0.0000 (1.0)      3.8471 (1.54)     0.0000 (1.0)           0;0  0.2599 (0.65)          1           1
test_partial_add-gc-noop[main]       2.7902 (1.12)     2.7902 (1.12)     2.7902 (1.12)     0.0000 (1.0)      2.7902 (1.12)     0.0000 (1.0)           0;0  0.3584 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     80.5959 (4.24)     80.5959 (4.24)     80.5959 (4.24)     0.0000 (1.0)      80.5959 (4.24)     0.0000 (1.0)           0;0  0.0124 (0.24)          1           1
test_partial_add-push[3.10.0]     37.0146 (1.95)     37.0146 (1.95)     37.0146 (1.95)     0.0000 (1.0)      37.0146 (1.95)     0.0000 (1.0)           0;0  0.0270 (0.51)          1           1
test_partial_add-push[3.53.2]     19.4258 (1.02)     19.4258 (1.02)     19.4258 (1.02)     0.0000 (1.0)      19.4258 (1.02)     0.0000 (1.0)           0;0  0.0515 (0.98)          1           1
test_partial_add-push[3.60.1]     19.0037 (1.0)      19.0037 (1.0)      19.0037 (1.0)      0.0000 (1.0)      19.0037 (1.0)      0.0000 (1.0)           0;0  0.0526 (1.0)           1           1
test_partial_add-push[main]       19.0969 (1.00)     19.0969 (1.00)     19.0969 (1.00)     0.0000 (1.0)      19.0969 (1.00)     0.0000 (1.0)           0;0  0.0524 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.3939 (1.72)     17.3939 (1.72)     17.3939 (1.72)     0.0000 (1.0)      17.3939 (1.72)     0.0000 (1.0)           0;0  0.0575 (0.58)          1           1
test_partial_add-push-partial[3.10.0]     10.2094 (1.01)     10.2094 (1.01)     10.2094 (1.01)     0.0000 (1.0)      10.2094 (1.01)     0.0000 (1.0)           0;0  0.0979 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.2888 (1.02)     10.2888 (1.02)     10.2888 (1.02)     0.0000 (1.0)      10.2888 (1.02)     0.0000 (1.0)           0;0  0.0972 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     10.0872 (1.0)      10.0872 (1.0)      10.0872 (1.0)      0.0000 (1.0)      10.0872 (1.0)      0.0000 (1.0)           0;0  0.0991 (1.0)           1           1
test_partial_add-push-partial[main]       10.1421 (1.01)     10.1421 (1.01)     10.1421 (1.01)     0.0000 (1.0)      10.1421 (1.01)     0.0000 (1.0)           0;0  0.0986 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     81.3109 (3.62)     81.3109 (3.62)     81.3109 (3.62)     0.0000 (1.0)      81.3109 (3.62)     0.0000 (1.0)           0;0  0.0123 (0.28)          1           1
test_partial_remove-add[3.10.0]     81.6670 (3.64)     81.6670 (3.64)     81.6670 (3.64)     0.0000 (1.0)      81.6670 (3.64)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_partial_remove-add[3.53.2]     72.7340 (3.24)     72.7340 (3.24)     72.7340 (3.24)     0.0000 (1.0)      72.7340 (3.24)     0.0000 (1.0)           0;0  0.0137 (0.31)          1           1
test_partial_remove-add[3.60.1]     22.4561 (1.0)      22.4561 (1.0)      22.4561 (1.0)      0.0000 (1.0)      22.4561 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_partial_remove-add[main]       23.6474 (1.05)     23.6474 (1.05)     23.6474 (1.05)     0.0000 (1.0)      23.6474 (1.05)     0.0000 (1.0)           0;0  0.0423 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.3341 (7.81)     8.3341 (7.81)     8.3341 (7.81)     0.0000 (1.0)      8.3341 (7.81)     0.0000 (1.0)           0;0  0.1200 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.2967 (7.78)     8.2967 (7.78)     8.2967 (7.78)     0.0000 (1.0)      8.2967 (7.78)     0.0000 (1.0)           0;0  0.1205 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.4006 (6.94)     7.4006 (6.94)     7.4006 (6.94)     0.0000 (1.0)      7.4006 (6.94)     0.0000 (1.0)           0;0  0.1351 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0665 (1.0)      1.0665 (1.0)      1.0665 (1.0)      0.0000 (1.0)      1.0665 (1.0)      0.0000 (1.0)           0;0  0.9376 (1.0)           1           1
test_partial_remove-add-update[main]       1.0954 (1.03)     1.0954 (1.03)     1.0954 (1.03)     0.0000 (1.0)      1.0954 (1.03)     0.0000 (1.0)           0;0  0.9129 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2973 (1.0)      3.2973 (1.0)      3.2973 (1.0)      0.0000 (1.0)      3.2973 (1.0)      0.0000 (1.0)           0;0  0.3033 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7322 (1.13)     3.7322 (1.13)     3.7322 (1.13)     0.0000 (1.0)      3.7322 (1.13)     0.0000 (1.0)           0;0  0.2679 (0.88)          1           1
test_partial_remove-gc[3.53.2]     3.6181 (1.10)     3.6181 (1.10)     3.6181 (1.10)     0.0000 (1.0)      3.6181 (1.10)     0.0000 (1.0)           0;0  0.2764 (0.91)          1           1
test_partial_remove-gc[3.60.1]     3.8451 (1.17)     3.8451 (1.17)     3.8451 (1.17)     0.0000 (1.0)      3.8451 (1.17)     0.0000 (1.0)           0;0  0.2601 (0.86)          1           1
test_partial_remove-gc[main]       3.5937 (1.09)     3.5937 (1.09)     3.5937 (1.09)     0.0000 (1.0)      3.5937 (1.09)     0.0000 (1.0)           0;0  0.2783 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8678 (1.07)     4.8678 (1.07)     4.8678 (1.07)     0.0000 (1.0)      4.8678 (1.07)     0.0000 (1.0)           0;0  0.2054 (0.94)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1767 (1.13)     5.1767 (1.13)     5.1767 (1.13)     0.0000 (1.0)      5.1767 (1.13)     0.0000 (1.0)           0;0  0.1932 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8798 (1.07)     4.8798 (1.07)     4.8798 (1.07)     0.0000 (1.0)      4.8798 (1.07)     0.0000 (1.0)           0;0  0.2049 (0.94)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8352 (1.06)     4.8352 (1.06)     4.8352 (1.06)     0.0000 (1.0)      4.8352 (1.06)     0.0000 (1.0)           0;0  0.2068 (0.95)          1           1
test_partial_remove-gc-cloud[main]       4.5698 (1.0)      4.5698 (1.0)      4.5698 (1.0)      0.0000 (1.0)      4.5698 (1.0)      0.0000 (1.0)           0;0  0.2188 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     95.3320 (4.32)     95.3320 (4.32)     95.3320 (4.32)     0.0000 (1.0)      95.3320 (4.32)     0.0000 (1.0)           0;0  0.0105 (0.23)          1           1
test_partial_remove-push[3.10.0]     43.8532 (1.99)     43.8532 (1.99)     43.8532 (1.99)     0.0000 (1.0)      43.8532 (1.99)     0.0000 (1.0)           0;0  0.0228 (0.50)          1           1
test_partial_remove-push[3.53.2]     22.8017 (1.03)     22.8017 (1.03)     22.8017 (1.03)     0.0000 (1.0)      22.8017 (1.03)     0.0000 (1.0)           0;0  0.0439 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.0715 (1.0)      22.0715 (1.0)      22.0715 (1.0)      0.0000 (1.0)      22.0715 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
test_partial_remove-push[main]       22.8144 (1.03)     22.8144 (1.03)     22.8144 (1.03)     0.0000 (1.0)      22.8144 (1.03)     0.0000 (1.0)           0;0  0.0438 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8682 (1.02)     1.8682 (1.02)     1.8682 (1.02)     0.0000 (1.0)      1.8682 (1.02)     0.0000 (1.0)           0;0  0.5353 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     1.8253 (1.0)      1.8253 (1.0)      1.8253 (1.0)      0.0000 (1.0)      1.8253 (1.0)      0.0000 (1.0)           0;0  0.5478 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5094 (1.37)     2.5094 (1.37)     2.5094 (1.37)     0.0000 (1.0)      2.5094 (1.37)     0.0000 (1.0)           0;0  0.3985 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.6811 (1.47)     2.6811 (1.47)     2.6811 (1.47)     0.0000 (1.0)      2.6811 (1.47)     0.0000 (1.0)           0;0  0.3730 (0.68)          1           1
test_partial_remove-push-update[main]       2.5091 (1.37)     2.5091 (1.37)     2.5091 (1.37)     0.0000 (1.0)      2.5091 (1.37)     0.0000 (1.0)           0;0  0.3986 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     548.5709 (1.0)      553.9570 (1.0)      550.8013 (1.0)       2.1966 (1.0)      550.2858 (1.0)       3.4725 (1.28)          2;0  1.8155 (1.0)           5           3
test_plots-plots-diff[3.10.0]     941.8425 (1.72)     957.5199 (1.73)     949.6874 (1.72)      7.1439 (3.25)     947.5888 (1.72)     13.0814 (4.81)          3;0  1.0530 (0.58)          5           3
test_plots-plots-diff[3.53.2]     886.3571 (1.62)     891.9702 (1.61)     890.0642 (1.62)      2.2629 (1.03)     891.2021 (1.62)      2.7418 (1.01)          1;0  1.1235 (0.62)          5           3
test_plots-plots-diff[3.60.1]     893.6304 (1.63)     980.9219 (1.77)     913.7750 (1.66)     37.6136 (17.12)    899.0844 (1.63)     24.5869 (9.04)          1;1  1.0944 (0.60)          5           3
test_plots-plots-diff[main]       897.2511 (1.64)     903.2272 (1.63)     899.2975 (1.63)      2.3575 (1.07)     898.4363 (1.63)      2.7198 (1.0)           1;0  1.1120 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       562.0961 (1.0)        566.0992 (1.0)        564.5429 (1.0)      1.9681 (1.0)        565.7410 (1.0)      3.5113 (1.0)           1;0  1.7713 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,171.6337 (2.08)     1,182.7829 (2.09)     1,175.3302 (2.08)     4.7370 (2.41)     1,173.2484 (2.07)     6.8698 (1.96)          1;0  0.8508 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]       956.5827 (1.70)       963.9739 (1.70)       959.8799 (1.70)     2.8386 (1.44)       959.1450 (1.70)     3.9843 (1.13)          2;0  1.0418 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       961.0928 (1.71)       967.1348 (1.71)       963.8487 (1.71)     2.7425 (1.39)       963.3785 (1.70)     5.1024 (1.45)          2;0  1.0375 (0.59)          5           3
test_plots-plots-diff-json[main]         970.6165 (1.73)       978.0250 (1.73)       973.8243 (1.72)     2.9738 (1.51)       974.1257 (1.72)     4.5582 (1.30)          2;0  1.0269 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     441.1060 (1.0)      445.2258 (1.0)      443.8094 (1.0)      1.5809 (2.30)     444.1202 (1.0)      1.3798 (1.10)          1;1  2.2532 (1.0)           5           3
test_plots-plots-show[3.10.0]     757.3755 (1.72)     766.9282 (1.72)     761.1965 (1.72)     3.6256 (5.28)     760.0033 (1.71)     4.3575 (3.49)          2;0  1.3137 (0.58)          5           3
test_plots-plots-show[3.53.2]     741.9067 (1.68)     755.0475 (1.70)     747.3876 (1.68)     4.8068 (6.99)     746.5653 (1.68)     4.8261 (3.86)          2;0  1.3380 (0.59)          5           3
test_plots-plots-show[3.60.1]     746.5828 (1.69)     748.1159 (1.68)     747.2384 (1.68)     0.6872 (1.0)      747.0993 (1.68)     1.2493 (1.0)           1;0  1.3383 (0.59)          5           3
test_plots-plots-show[main]       755.5417 (1.71)     759.6481 (1.71)     757.7478 (1.71)     1.6521 (2.40)     757.6077 (1.71)     2.6424 (2.12)          2;0  1.3197 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     459.6388 (1.0)      462.2690 (1.0)      461.3609 (1.0)      1.0745 (1.0)      461.6857 (1.0)       1.4811 (1.02)          1;0  2.1675 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     883.8935 (1.92)     887.8523 (1.92)     885.2831 (1.92)     1.6258 (1.51)     884.3867 (1.92)      2.1504 (1.49)          1;0  1.1296 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     787.3376 (1.71)     792.9537 (1.72)     789.8493 (1.71)     2.3020 (2.14)     789.1886 (1.71)      3.7306 (2.58)          2;0  1.2661 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     792.2100 (1.72)     796.5929 (1.72)     793.7049 (1.72)     1.6851 (1.57)     793.3733 (1.72)      1.4465 (1.0)           1;1  1.2599 (0.58)          5           3
test_plots-plots-show-json[main]       801.2282 (1.74)     816.2541 (1.77)     806.7693 (1.75)     6.5527 (6.10)     804.2506 (1.74)     10.7704 (7.45)          1;0  1.2395 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     94.2155 (4.31)     94.2155 (4.31)     94.2155 (4.31)     0.0000 (1.0)      94.2155 (4.31)     0.0000 (1.0)           0;0  0.0106 (0.23)          1           1
test_push-push[3.10.0]     44.4389 (2.03)     44.4389 (2.03)     44.4389 (2.03)     0.0000 (1.0)      44.4389 (2.03)     0.0000 (1.0)           0;0  0.0225 (0.49)          1           1
test_push-push[3.53.2]     22.5251 (1.03)     22.5251 (1.03)     22.5251 (1.03)     0.0000 (1.0)      22.5251 (1.03)     0.0000 (1.0)           0;0  0.0444 (0.97)          1           1
test_push-push[3.60.1]     21.8788 (1.0)      21.8788 (1.0)      21.8788 (1.0)      0.0000 (1.0)      21.8788 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
test_push-push[main]       22.2665 (1.02)     22.2665 (1.02)     22.2665 (1.02)     0.0000 (1.0)      22.2665 (1.02)     0.0000 (1.0)           0;0  0.0449 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     92.5625 (6.32)     92.5625 (6.32)     92.5625 (6.32)     0.0000 (1.0)      92.5625 (6.32)     0.0000 (1.0)           0;0  0.0108 (0.16)          1           1
test_sharing-fetch[3.10.0]     95.5459 (6.52)     95.5459 (6.52)     95.5459 (6.52)     0.0000 (1.0)      95.5459 (6.52)     0.0000 (1.0)           0;0  0.0105 (0.15)          1           1
test_sharing-fetch[3.53.2]     21.6486 (1.48)     21.6486 (1.48)     21.6486 (1.48)     0.0000 (1.0)      21.6486 (1.48)     0.0000 (1.0)           0;0  0.0462 (0.68)          1           1
test_sharing-fetch[3.60.1]     14.6543 (1.0)      14.6543 (1.0)      14.6543 (1.0)      0.0000 (1.0)      14.6543 (1.0)      0.0000 (1.0)           0;0  0.0682 (1.0)           1           1
test_sharing-fetch[main]       14.8555 (1.01)     14.8555 (1.01)     14.8555 (1.01)     0.0000 (1.0)      14.8555 (1.01)     0.0000 (1.0)           0;0  0.0673 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.1409 (1.0)      1.1409 (1.0)      1.1409 (1.0)      0.0000 (1.0)      1.1409 (1.0)      0.0000 (1.0)           0;0  0.8765 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.1781 (2.79)     3.1781 (2.79)     3.1781 (2.79)     0.0000 (1.0)      3.1781 (2.79)     0.0000 (1.0)           0;0  0.3147 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     5.0948 (4.47)     5.0948 (4.47)     5.0948 (4.47)     0.0000 (1.0)      5.0948 (4.47)     0.0000 (1.0)           0;0  0.1963 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.1581 (4.52)     5.1581 (4.52)     5.1581 (4.52)     0.0000 (1.0)      5.1581 (4.52)     0.0000 (1.0)           0;0  0.1939 (0.22)          1           1
test_sharing-fetch-noop[main]       5.4553 (4.78)     5.4553 (4.78)     5.4553 (4.78)     0.0000 (1.0)      5.4553 (4.78)     0.0000 (1.0)           0;0  0.1833 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     83.4913 (5.73)     83.4913 (5.73)     83.4913 (5.73)     0.0000 (1.0)      83.4913 (5.73)     0.0000 (1.0)           0;0  0.0120 (0.17)          1           1
test_sharing-push[3.10.0]     35.5706 (2.44)     35.5706 (2.44)     35.5706 (2.44)     0.0000 (1.0)      35.5706 (2.44)     0.0000 (1.0)           0;0  0.0281 (0.41)          1           1
test_sharing-push[3.53.2]     15.1789 (1.04)     15.1789 (1.04)     15.1789 (1.04)     0.0000 (1.0)      15.1789 (1.04)     0.0000 (1.0)           0;0  0.0659 (0.96)          1           1
test_sharing-push[3.60.1]     14.6300 (1.00)     14.6300 (1.00)     14.6300 (1.00)     0.0000 (1.0)      14.6300 (1.00)     0.0000 (1.0)           0;0  0.0684 (1.00)          1           1
test_sharing-push[main]       14.5752 (1.0)      14.5752 (1.0)      14.5752 (1.0)      0.0000 (1.0)      14.5752 (1.0)      0.0000 (1.0)           0;0  0.0686 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     1.8724 (1.02)     1.8724 (1.02)     1.8724 (1.02)     0.0000 (1.0)      1.8724 (1.02)     0.0000 (1.0)           0;0  0.5341 (0.98)          1           1
test_sharing-push-noop[3.10.0]     1.8340 (1.0)      1.8340 (1.0)      1.8340 (1.0)      0.0000 (1.0)      1.8340 (1.0)      0.0000 (1.0)           0;0  0.5453 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.0150 (2.73)     5.0150 (2.73)     5.0150 (2.73)     0.0000 (1.0)      5.0150 (2.73)     0.0000 (1.0)           0;0  0.1994 (0.37)          1           1
test_sharing-push-noop[3.60.1]     5.0746 (2.77)     5.0746 (2.77)     5.0746 (2.77)     0.0000 (1.0)      5.0746 (2.77)     0.0000 (1.0)           0;0  0.1971 (0.36)          1           1
test_sharing-push-noop[main]       5.0272 (2.74)     5.0272 (2.74)     5.0272 (2.74)     0.0000 (1.0)      5.0272 (2.74)     0.0000 (1.0)           0;0  0.1989 (0.36)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     293.5067 (1.04)     293.5067 (1.04)     293.5067 (1.04)     0.0000 (1.0)      293.5067 (1.04)     0.0000 (1.0)           0;0  0.0034 (0.96)          1           1
test_sharing_azure-fetch[main]       282.1942 (1.0)      282.1942 (1.0)      282.1942 (1.0)      0.0000 (1.0)      282.1942 (1.0)      0.0000 (1.0)           0;0  0.0035 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     5.5861 (1.0)      5.5861 (1.0)      5.5861 (1.0)      0.0000 (1.0)      5.5861 (1.0)      0.0000 (1.0)           0;0  0.1790 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       5.8156 (1.04)     5.8156 (1.04)     5.8156 (1.04)     0.0000 (1.0)      5.8156 (1.04)     0.0000 (1.0)           0;0  0.1720 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     305.2278 (1.0)      305.2278 (1.0)      305.2278 (1.0)      0.0000 (1.0)      305.2278 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
test_sharing_azure-push[main]       307.2897 (1.01)     307.2897 (1.01)     307.2897 (1.01)     0.0000 (1.0)      307.2897 (1.01)     0.0000 (1.0)           0;0  0.0033 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.4647 (1.0)      6.4647 (1.0)      6.4647 (1.0)      0.0000 (1.0)      6.4647 (1.0)      0.0000 (1.0)           0;0  0.1547 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.6244 (1.02)     6.6244 (1.02)     6.6244 (1.02)     0.0000 (1.0)      6.6244 (1.02)     0.0000 (1.0)           0;0  0.1510 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     376.0522 (1.04)     376.0522 (1.04)     376.0522 (1.04)     0.0000 (1.0)      376.0522 (1.04)     0.0000 (1.0)           0;0  0.0027 (0.97)          1           1
test_sharing_s3-fetch[main]       363.2070 (1.0)      363.2070 (1.0)      363.2070 (1.0)      0.0000 (1.0)      363.2070 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2443 (1.0)      6.2443 (1.0)      6.2443 (1.0)      0.0000 (1.0)      6.2443 (1.0)      0.0000 (1.0)           0;0  0.1601 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3322 (1.01)     6.3322 (1.01)     6.3322 (1.01)     0.0000 (1.0)      6.3322 (1.01)     0.0000 (1.0)           0;0  0.1579 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     327.9942 (1.0)      327.9942 (1.0)      327.9942 (1.0)      0.0000 (1.0)      327.9942 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
test_sharing_s3-push[main]       332.6148 (1.01)     332.6148 (1.01)     332.6148 (1.01)     0.0000 (1.0)      332.6148 (1.01)     0.0000 (1.0)           0;0  0.0030 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.3583 (1.0)      6.3583 (1.0)      6.3583 (1.0)      0.0000 (1.0)      6.3583 (1.0)      0.0000 (1.0)           0;0  0.1573 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.3703 (1.00)     6.3703 (1.00)     6.3703 (1.00)     0.0000 (1.0)      6.3703 (1.00)     0.0000 (1.0)           0;0  0.1570 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.1850 (3.64)     19.1850 (3.64)     19.1850 (3.64)     0.0000 (1.0)      19.1850 (3.64)     0.0000 (1.0)           0;0  0.0521 (0.27)          1           1
test_status-status[3.10.0]     19.7074 (3.74)     19.7074 (3.74)     19.7074 (3.74)     0.0000 (1.0)      19.7074 (3.74)     0.0000 (1.0)           0;0  0.0507 (0.27)          1           1
test_status-status[3.53.2]     17.7113 (3.36)     17.7113 (3.36)     17.7113 (3.36)     0.0000 (1.0)      17.7113 (3.36)     0.0000 (1.0)           0;0  0.0565 (0.30)          1           1
test_status-status[3.60.1]      5.2667 (1.0)       5.2667 (1.0)       5.2667 (1.0)      0.0000 (1.0)       5.2667 (1.0)      0.0000 (1.0)           0;0  0.1899 (1.0)           1           1
test_status-status[main]        5.5825 (1.06)      5.5825 (1.06)      5.5825 (1.06)     0.0000 (1.0)       5.5825 (1.06)     0.0000 (1.0)           0;0  0.1791 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8781 (1.83)     4.8781 (1.83)     4.8781 (1.83)     0.0000 (1.0)      4.8781 (1.83)     0.0000 (1.0)           0;0  0.2050 (0.55)          1           1
test_status-status-changed[3.10.0]     5.1953 (1.95)     5.1953 (1.95)     5.1953 (1.95)     0.0000 (1.0)      5.1953 (1.95)     0.0000 (1.0)           0;0  0.1925 (0.51)          1           1
test_status-status-changed[3.53.2]     5.1471 (1.93)     5.1471 (1.93)     5.1471 (1.93)     0.0000 (1.0)      5.1471 (1.93)     0.0000 (1.0)           0;0  0.1943 (0.52)          1           1
test_status-status-changed[3.60.1]     2.6637 (1.0)      2.6637 (1.0)      2.6637 (1.0)      0.0000 (1.0)      2.6637 (1.0)      0.0000 (1.0)           0;0  0.3754 (1.0)           1           1
test_status-status-changed[main]       2.8528 (1.07)     2.8528 (1.07)     2.8528 (1.07)     0.0000 (1.0)      2.8528 (1.07)     0.0000 (1.0)           0;0  0.3505 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9891 (1.94)     4.9891 (1.94)     4.9891 (1.94)     0.0000 (1.0)      4.9891 (1.94)     0.0000 (1.0)           0;0  0.2004 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.1425 (2.00)     5.1425 (2.00)     5.1425 (2.00)     0.0000 (1.0)      5.1425 (2.00)     0.0000 (1.0)           0;0  0.1945 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     5.0153 (1.95)     5.0153 (1.95)     5.0153 (1.95)     0.0000 (1.0)      5.0153 (1.95)     0.0000 (1.0)           0;0  0.1994 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.5665 (1.0)      2.5665 (1.0)      2.5665 (1.0)      0.0000 (1.0)      2.5665 (1.0)      0.0000 (1.0)           0;0  0.3896 (1.0)           1           1
test_status-status-changed-noop[main]       2.7307 (1.06)     2.7307 (1.06)     2.7307 (1.06)     0.0000 (1.0)      2.7307 (1.06)     0.0000 (1.0)           0;0  0.3662 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8864 (1.93)     4.8864 (1.93)     4.8864 (1.93)     0.0000 (1.0)      4.8864 (1.93)     0.0000 (1.0)           0;0  0.2047 (0.52)          1           1
test_status-status-noop[3.10.0]     5.1639 (2.03)     5.1639 (2.03)     5.1639 (2.03)     0.0000 (1.0)      5.1639 (2.03)     0.0000 (1.0)           0;0  0.1937 (0.49)          1           1
test_status-status-noop[3.53.2]     4.9691 (1.96)     4.9691 (1.96)     4.9691 (1.96)     0.0000 (1.0)      4.9691 (1.96)     0.0000 (1.0)           0;0  0.2012 (0.51)          1           1
test_status-status-noop[3.60.1]     2.5379 (1.0)      2.5379 (1.0)      2.5379 (1.0)      0.0000 (1.0)      2.5379 (1.0)      0.0000 (1.0)           0;0  0.3940 (1.0)           1           1
test_status-status-noop[main]       2.7271 (1.07)     2.7271 (1.07)     2.7271 (1.07)     0.0000 (1.0)      2.7271 (1.07)     0.0000 (1.0)           0;0  0.3667 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     192.0233 (4.13)     192.0233 (4.13)     192.0233 (4.13)     0.0000 (1.0)      192.0233 (4.13)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_update-import-url[3.10.0]     198.0536 (4.26)     198.0536 (4.26)     198.0536 (4.26)     0.0000 (1.0)      198.0536 (4.26)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.53.2]     115.0284 (2.48)     115.0284 (2.48)     115.0284 (2.48)     0.0000 (1.0)      115.0284 (2.48)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_update-import-url[3.60.1]      46.4481 (1.0)       46.4481 (1.0)       46.4481 (1.0)      0.0000 (1.0)       46.4481 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_update-import-url[main]        48.7412 (1.05)      48.7412 (1.05)      48.7412 (1.05)     0.0000 (1.0)       48.7412 (1.05)     0.0000 (1.0)           0;0  0.0205 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     180.8667 (5.05)     180.8667 (5.05)     180.8667 (5.05)     0.0000 (1.0)      180.8667 (5.05)     0.0000 (1.0)           0;0  0.0055 (0.20)          1           1
test_update-update[3.10.0]     182.9419 (5.11)     182.9419 (5.11)     182.9419 (5.11)     0.0000 (1.0)      182.9419 (5.11)     0.0000 (1.0)           0;0  0.0055 (0.20)          1           1
test_update-update[3.53.2]     108.0334 (3.02)     108.0334 (3.02)     108.0334 (3.02)     0.0000 (1.0)      108.0334 (3.02)     0.0000 (1.0)           0;0  0.0093 (0.33)          1           1
test_update-update[3.60.1]      35.8093 (1.0)       35.8093 (1.0)       35.8093 (1.0)      0.0000 (1.0)       35.8093 (1.0)      0.0000 (1.0)           0;0  0.0279 (1.0)           1           1
test_update-update[main]        37.0572 (1.03)      37.0572 (1.03)      37.0572 (1.03)     0.0000 (1.0)       37.0572 (1.03)     0.0000 (1.0)           0;0  0.0270 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.0156 (2.11)     17.0156 (2.11)     17.0156 (2.11)     0.0000 (1.0)      17.0156 (2.11)     0.0000 (1.0)           0;0  0.0588 (0.47)          1           1
test_update-update-noop[3.10.0]     18.1315 (2.25)     18.1315 (2.25)     18.1315 (2.25)     0.0000 (1.0)      18.1315 (2.25)     0.0000 (1.0)           0;0  0.0552 (0.44)          1           1
test_update-update-noop[3.53.2]     17.1664 (2.13)     17.1664 (2.13)     17.1664 (2.13)     0.0000 (1.0)      17.1664 (2.13)     0.0000 (1.0)           0;0  0.0583 (0.47)          1           1
test_update-update-noop[3.60.1]      8.0571 (1.0)       8.0571 (1.0)       8.0571 (1.0)      0.0000 (1.0)       8.0571 (1.0)      0.0000 (1.0)           0;0  0.1241 (1.0)           1           1
test_update-update-noop[main]        8.6383 (1.07)      8.6383 (1.07)      8.6383 (1.07)     0.0000 (1.0)       8.6383 (1.07)     0.0000 (1.0)           0;0  0.1158 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean