Mon Feb 16 01:24:00 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.6178 (3.65)     84.6178 (3.65)     84.6178 (3.65)     0.0000 (1.0)      84.6178 (3.65)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.10.0]     85.1607 (3.67)     85.1607 (3.67)     85.1607 (3.67)     0.0000 (1.0)      85.1607 (3.67)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_add_copy-add[3.53.2]     75.8619 (3.27)     75.8619 (3.27)     75.8619 (3.27)     0.0000 (1.0)      75.8619 (3.27)     0.0000 (1.0)           0;0  0.0132 (0.31)          1           1
test_add_copy-add[3.60.1]     23.1818 (1.0)      23.1818 (1.0)      23.1818 (1.0)      0.0000 (1.0)      23.1818 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
test_add_copy-add[main]       25.0231 (1.08)     25.0231 (1.08)     25.0231 (1.08)     0.0000 (1.0)      25.0231 (1.08)     0.0000 (1.0)           0;0  0.0400 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.8656 (6.50)     27.8656 (6.50)     27.8656 (6.50)     0.0000 (1.0)      27.8656 (6.50)     0.0000 (1.0)           0;0  0.0359 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     28.0181 (6.53)     28.0181 (6.53)     28.0181 (6.53)     0.0000 (1.0)      28.0181 (6.53)     0.0000 (1.0)           0;0  0.0357 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.0650 (6.08)     26.0650 (6.08)     26.0650 (6.08)     0.0000 (1.0)      26.0650 (6.08)     0.0000 (1.0)           0;0  0.0384 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.2903 (1.0)       4.2903 (1.0)       4.2903 (1.0)      0.0000 (1.0)       4.2903 (1.0)      0.0000 (1.0)           0;0  0.2331 (1.0)           1           1
test_add_copy-add-noop[main]        4.5130 (1.05)      4.5130 (1.05)      4.5130 (1.05)     0.0000 (1.0)       4.5130 (1.05)     0.0000 (1.0)           0;0  0.2216 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.7487 (4.16)     67.7487 (4.16)     67.7487 (4.16)     0.0000 (1.0)      67.7487 (4.16)     0.0000 (1.0)           0;0  0.0148 (0.24)          1           1
test_add_hardlink-add[3.10.0]     68.8437 (4.23)     68.8437 (4.23)     68.8437 (4.23)     0.0000 (1.0)      68.8437 (4.23)     0.0000 (1.0)           0;0  0.0145 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.8276 (3.86)     62.8276 (3.86)     62.8276 (3.86)     0.0000 (1.0)      62.8276 (3.86)     0.0000 (1.0)           0;0  0.0159 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.2739 (1.0)      16.2739 (1.0)      16.2739 (1.0)      0.0000 (1.0)      16.2739 (1.0)      0.0000 (1.0)           0;0  0.0614 (1.0)           1           1
test_add_hardlink-add[main]       17.7320 (1.09)     17.7320 (1.09)     17.7320 (1.09)     0.0000 (1.0)      17.7320 (1.09)     0.0000 (1.0)           0;0  0.0564 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.8205 (7.96)     33.8205 (7.96)     33.8205 (7.96)     0.0000 (1.0)      33.8205 (7.96)     0.0000 (1.0)           0;0  0.0296 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     34.4138 (8.10)     34.4138 (8.10)     34.4138 (8.10)     0.0000 (1.0)      34.4138 (8.10)     0.0000 (1.0)           0;0  0.0291 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     32.5443 (7.66)     32.5443 (7.66)     32.5443 (7.66)     0.0000 (1.0)      32.5443 (7.66)     0.0000 (1.0)           0;0  0.0307 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2478 (1.0)       4.2478 (1.0)       4.2478 (1.0)      0.0000 (1.0)       4.2478 (1.0)      0.0000 (1.0)           0;0  0.2354 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.5472 (1.07)      4.5472 (1.07)      4.5472 (1.07)     0.0000 (1.0)       4.5472 (1.07)     0.0000 (1.0)           0;0  0.2199 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     70.9492 (1.92)     70.9492 (1.92)     70.9492 (1.92)     0.0000 (1.0)      70.9492 (1.92)     0.0000 (1.0)           0;0  0.0141 (0.52)          1           1
test_add_symlink-add[3.10.0]     70.9087 (1.92)     70.9087 (1.92)     70.9087 (1.92)     0.0000 (1.0)      70.9087 (1.92)     0.0000 (1.0)           0;0  0.0141 (0.52)          1           1
test_add_symlink-add[3.53.2]     65.0822 (1.76)     65.0822 (1.76)     65.0822 (1.76)     0.0000 (1.0)      65.0822 (1.76)     0.0000 (1.0)           0;0  0.0154 (0.57)          1           1
test_add_symlink-add[3.60.1]     36.9612 (1.00)     36.9612 (1.00)     36.9612 (1.00)     0.0000 (1.0)      36.9612 (1.00)     0.0000 (1.0)           0;0  0.0271 (1.00)          1           1
test_add_symlink-add[main]       36.9522 (1.0)      36.9522 (1.0)      36.9522 (1.0)      0.0000 (1.0)      36.9522 (1.0)      0.0000 (1.0)           0;0  0.0271 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.3661 (8.52)     45.3661 (8.52)     45.3661 (8.52)     0.0000 (1.0)      45.3661 (8.52)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.3936 (8.52)     45.3936 (8.52)     45.3936 (8.52)     0.0000 (1.0)      45.3936 (8.52)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     45.4671 (8.54)     45.4671 (8.54)     45.4671 (8.54)     0.0000 (1.0)      45.4671 (8.54)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.3255 (1.0)       5.3255 (1.0)       5.3255 (1.0)      0.0000 (1.0)       5.3255 (1.0)      0.0000 (1.0)           0;0  0.1878 (1.0)           1           1
test_add_symlink-add-noop[main]        5.4771 (1.03)      5.4771 (1.03)      5.4771 (1.03)     0.0000 (1.0)       5.4771 (1.03)     0.0000 (1.0)           0;0  0.1826 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      41.0932 (1.93)      41.0932 (1.93)      41.0932 (1.93)     0.0000 (1.0)       41.0932 (1.93)     0.0000 (1.0)           0;0  0.0243 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     104.3128 (4.90)     104.3128 (4.90)     104.3128 (4.90)     0.0000 (1.0)      104.3128 (4.90)     0.0000 (1.0)           0;0  0.0096 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      28.7121 (1.35)      28.7121 (1.35)      28.7121 (1.35)     0.0000 (1.0)       28.7121 (1.35)     0.0000 (1.0)           0;0  0.0348 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]      21.2883 (1.0)       21.2883 (1.0)       21.2883 (1.0)      0.0000 (1.0)       21.2883 (1.0)      0.0000 (1.0)           0;0  0.0470 (1.0)           1           1
test_checkout_copy-checkout[main]        22.0358 (1.04)      22.0358 (1.04)      22.0358 (1.04)     0.0000 (1.0)       22.0358 (1.04)     0.0000 (1.0)           0;0  0.0454 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5169 (1.70)     5.5169 (1.70)     5.5169 (1.70)     0.0000 (1.0)      5.5169 (1.70)     0.0000 (1.0)           0;0  0.1813 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7154 (1.76)     5.7154 (1.76)     5.7154 (1.76)     0.0000 (1.0)      5.7154 (1.76)     0.0000 (1.0)           0;0  0.1750 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4601 (1.68)     5.4601 (1.68)     5.4601 (1.68)     0.0000 (1.0)      5.4601 (1.68)     0.0000 (1.0)           0;0  0.1831 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2452 (1.0)      3.2452 (1.0)      3.2452 (1.0)      0.0000 (1.0)      3.2452 (1.0)      0.0000 (1.0)           0;0  0.3081 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3187 (1.02)     3.3187 (1.02)     3.3187 (1.02)     0.0000 (1.0)      3.3187 (1.02)     0.0000 (1.0)           0;0  0.3013 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.5147 (1.98)     7.5147 (1.98)     7.5147 (1.98)     0.0000 (1.0)      7.5147 (1.98)     0.0000 (1.0)           0;0  0.1331 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4945 (1.72)     6.4945 (1.72)     6.4945 (1.72)     0.0000 (1.0)      6.4945 (1.72)     0.0000 (1.0)           0;0  0.1540 (0.58)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3379 (1.67)     6.3379 (1.67)     6.3379 (1.67)     0.0000 (1.0)      6.3379 (1.67)     0.0000 (1.0)           0;0  0.1578 (0.60)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.7861 (1.0)      3.7861 (1.0)      3.7861 (1.0)      0.0000 (1.0)      3.7861 (1.0)      0.0000 (1.0)           0;0  0.2641 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4045 (1.16)     4.4045 (1.16)     4.4045 (1.16)     0.0000 (1.0)      4.4045 (1.16)     0.0000 (1.0)           0;0  0.2270 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.3775 (2.79)     21.3775 (2.79)     21.3775 (2.79)     0.0000 (1.0)      21.3775 (2.79)     0.0000 (1.0)           0;0  0.0468 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.6124 (2.17)     16.6124 (2.17)     16.6124 (2.17)     0.0000 (1.0)      16.6124 (2.17)     0.0000 (1.0)           0;0  0.0602 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.7632 (1.92)     14.7632 (1.92)     14.7632 (1.92)     0.0000 (1.0)      14.7632 (1.92)     0.0000 (1.0)           0;0  0.0677 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6708 (1.0)       7.6708 (1.0)       7.6708 (1.0)      0.0000 (1.0)       7.6708 (1.0)      0.0000 (1.0)           0;0  0.1304 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.4036 (1.10)      8.4036 (1.10)      8.4036 (1.10)     0.0000 (1.0)       8.4036 (1.10)     0.0000 (1.0)           0;0  0.1190 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.7727 (1.74)     5.7727 (1.74)     5.7727 (1.74)     0.0000 (1.0)      5.7727 (1.74)     0.0000 (1.0)           0;0  0.1732 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8333 (1.75)     5.8333 (1.75)     5.8333 (1.75)     0.0000 (1.0)      5.8333 (1.75)     0.0000 (1.0)           0;0  0.1714 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7037 (1.71)     5.7037 (1.71)     5.7037 (1.71)     0.0000 (1.0)      5.7037 (1.71)     0.0000 (1.0)           0;0  0.1753 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3259 (1.0)      3.3259 (1.0)      3.3259 (1.0)      0.0000 (1.0)      3.3259 (1.0)      0.0000 (1.0)           0;0  0.3007 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4672 (1.04)     3.4672 (1.04)     3.4672 (1.04)     0.0000 (1.0)      3.4672 (1.04)     0.0000 (1.0)           0;0  0.2884 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.8520 (1.97)     7.8520 (1.97)     7.8520 (1.97)     0.0000 (1.0)      7.8520 (1.97)     0.0000 (1.0)           0;0  0.1274 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6822 (1.68)     6.6822 (1.68)     6.6822 (1.68)     0.0000 (1.0)      6.6822 (1.68)     0.0000 (1.0)           0;0  0.1497 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.5311 (1.64)     6.5311 (1.64)     6.5311 (1.64)     0.0000 (1.0)      6.5311 (1.64)     0.0000 (1.0)           0;0  0.1531 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9884 (1.0)      3.9884 (1.0)      3.9884 (1.0)      0.0000 (1.0)      3.9884 (1.0)      0.0000 (1.0)           0;0  0.2507 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.2659 (1.07)     4.2659 (1.07)     4.2659 (1.07)     0.0000 (1.0)      4.2659 (1.07)     0.0000 (1.0)           0;0  0.2344 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     18.7353 (2.45)     18.7353 (2.45)     18.7353 (2.45)     0.0000 (1.0)      18.7353 (2.45)     0.0000 (1.0)           0;0  0.0534 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     14.3265 (1.88)     14.3265 (1.88)     14.3265 (1.88)     0.0000 (1.0)      14.3265 (1.88)     0.0000 (1.0)           0;0  0.0698 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     13.0659 (1.71)     13.0659 (1.71)     13.0659 (1.71)     0.0000 (1.0)      13.0659 (1.71)     0.0000 (1.0)           0;0  0.0765 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]      7.6380 (1.0)       7.6380 (1.0)       7.6380 (1.0)      0.0000 (1.0)       7.6380 (1.0)      0.0000 (1.0)           0;0  0.1309 (1.0)           1           1
test_checkout_symlink-checkout[main]        9.2857 (1.22)      9.2857 (1.22)      9.2857 (1.22)     0.0000 (1.0)       9.2857 (1.22)     0.0000 (1.0)           0;0  0.1077 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     4.8721 (1.34)     4.8721 (1.34)     4.8721 (1.34)     0.0000 (1.0)      4.8721 (1.34)     0.0000 (1.0)           0;0  0.2053 (0.75)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.1383 (1.41)     5.1383 (1.41)     5.1383 (1.41)     0.0000 (1.0)      5.1383 (1.41)     0.0000 (1.0)           0;0  0.1946 (0.71)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     5.0483 (1.39)     5.0483 (1.39)     5.0483 (1.39)     0.0000 (1.0)      5.0483 (1.39)     0.0000 (1.0)           0;0  0.1981 (0.72)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     3.6447 (1.0)      3.6447 (1.0)      3.6447 (1.0)      0.0000 (1.0)      3.6447 (1.0)      0.0000 (1.0)           0;0  0.2744 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       3.8407 (1.05)     3.8407 (1.05)     3.8407 (1.05)     0.0000 (1.0)      3.8407 (1.05)     0.0000 (1.0)           0;0  0.2604 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     7.3001 (1.55)     7.3001 (1.55)     7.3001 (1.55)     0.0000 (1.0)      7.3001 (1.55)     0.0000 (1.0)           0;0  0.1370 (0.65)          1           1
test_checkout_symlink-checkout-update[3.10.0]     6.3368 (1.34)     6.3368 (1.34)     6.3368 (1.34)     0.0000 (1.0)      6.3368 (1.34)     0.0000 (1.0)           0;0  0.1578 (0.75)          1           1
test_checkout_symlink-checkout-update[3.53.2]     6.2757 (1.33)     6.2757 (1.33)     6.2757 (1.33)     0.0000 (1.0)      6.2757 (1.33)     0.0000 (1.0)           0;0  0.1593 (0.75)          1           1
test_checkout_symlink-checkout-update[3.60.1]     4.7244 (1.0)      4.7244 (1.0)      4.7244 (1.0)      0.0000 (1.0)      4.7244 (1.0)      0.0000 (1.0)           0;0  0.2117 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       5.2021 (1.10)     5.2021 (1.10)     5.2021 (1.10)     0.0000 (1.0)      5.2021 (1.10)     0.0000 (1.0)           0;0  0.1922 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1310 (1.73)     4.1310 (1.73)     4.1310 (1.73)     0.0000 (1.0)      4.1310 (1.73)     0.0000 (1.0)           0;0  0.2421 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.9923 (2.10)     4.9923 (2.10)     4.9923 (2.10)     0.0000 (1.0)      4.9923 (2.10)     0.0000 (1.0)           0;0  0.2003 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.8936 (2.05)     4.8936 (2.05)     4.8936 (2.05)     0.0000 (1.0)      4.8936 (2.05)     0.0000 (1.0)           0;0  0.2043 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.3821 (1.0)      2.3821 (1.0)      2.3821 (1.0)      0.0000 (1.0)      2.3821 (1.0)      0.0000 (1.0)           0;0  0.4198 (1.0)           1           1
test_data_status-data-changed[main]       2.7666 (1.16)     2.7666 (1.16)     2.7666 (1.16)     0.0000 (1.0)      2.7666 (1.16)     0.0000 (1.0)           0;0  0.3615 (0.86)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1759 (1.78)     4.1759 (1.78)     4.1759 (1.78)     0.0000 (1.0)      4.1759 (1.78)     0.0000 (1.0)           0;0  0.2395 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0424 (2.15)     5.0424 (2.15)     5.0424 (2.15)     0.0000 (1.0)      5.0424 (2.15)     0.0000 (1.0)           0;0  0.1983 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8776 (2.08)     4.8776 (2.08)     4.8776 (2.08)     0.0000 (1.0)      4.8776 (2.08)     0.0000 (1.0)           0;0  0.2050 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3496 (1.0)      2.3496 (1.0)      2.3496 (1.0)      0.0000 (1.0)      2.3496 (1.0)      0.0000 (1.0)           0;0  0.4256 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6001 (1.11)     2.6001 (1.11)     2.6001 (1.11)     0.0000 (1.0)      2.6001 (1.11)     0.0000 (1.0)           0;0  0.3846 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.6223 (3.59)     18.6223 (3.59)     18.6223 (3.59)     0.0000 (1.0)      18.6223 (3.59)     0.0000 (1.0)           0;0  0.0537 (0.28)          1           1
test_data_status-data-new[3.10.0]     20.0518 (3.87)     20.0518 (3.87)     20.0518 (3.87)     0.0000 (1.0)      20.0518 (3.87)     0.0000 (1.0)           0;0  0.0499 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.3816 (3.74)     19.3816 (3.74)     19.3816 (3.74)     0.0000 (1.0)      19.3816 (3.74)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_data_status-data-new[3.60.1]      5.1835 (1.0)       5.1835 (1.0)       5.1835 (1.0)      0.0000 (1.0)       5.1835 (1.0)      0.0000 (1.0)           0;0  0.1929 (1.0)           1           1
test_data_status-data-new[main]        5.6669 (1.09)      5.6669 (1.09)      5.6669 (1.09)     0.0000 (1.0)       5.6669 (1.09)     0.0000 (1.0)           0;0  0.1765 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2702 (1.82)     4.2702 (1.82)     4.2702 (1.82)     0.0000 (1.0)      4.2702 (1.82)     0.0000 (1.0)           0;0  0.2342 (0.55)          1           1
test_data_status-data-noop[3.10.0]     5.1527 (2.20)     5.1527 (2.20)     5.1527 (2.20)     0.0000 (1.0)      5.1527 (2.20)     0.0000 (1.0)           0;0  0.1941 (0.46)          1           1
test_data_status-data-noop[3.53.2]     4.9091 (2.09)     4.9091 (2.09)     4.9091 (2.09)     0.0000 (1.0)      4.9091 (2.09)     0.0000 (1.0)           0;0  0.2037 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3449 (1.0)      2.3449 (1.0)      2.3449 (1.0)      0.0000 (1.0)      2.3449 (1.0)      0.0000 (1.0)           0;0  0.4265 (1.0)           1           1
test_data_status-data-noop[main]       2.8881 (1.23)     2.8881 (1.23)     2.8881 (1.23)     0.0000 (1.0)      2.8881 (1.23)     0.0000 (1.0)           0;0  0.3462 (0.81)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.8893 (1.26)     6.8893 (1.26)     6.8893 (1.26)     0.0000 (1.0)      6.8893 (1.26)     0.0000 (1.0)           0;0  0.1452 (0.79)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7991 (1.43)     7.7991 (1.43)     7.7991 (1.43)     0.0000 (1.0)      7.7991 (1.43)     0.0000 (1.0)           0;0  0.1282 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6551 (1.40)     7.6551 (1.40)     7.6551 (1.40)     0.0000 (1.0)      7.6551 (1.40)     0.0000 (1.0)           0;0  0.1306 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4728 (1.0)      5.4728 (1.0)      5.4728 (1.0)      0.0000 (1.0)      5.4728 (1.0)      0.0000 (1.0)           0;0  0.1827 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.7201 (1.05)     5.7201 (1.05)     5.7201 (1.05)     0.0000 (1.0)      5.7201 (1.05)     0.0000 (1.0)           0;0  0.1748 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.0177 (1.29)     7.0177 (1.29)     7.0177 (1.29)     0.0000 (1.0)      7.0177 (1.29)     0.0000 (1.0)           0;0  0.1425 (0.77)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8435 (1.44)     7.8435 (1.44)     7.8435 (1.44)     0.0000 (1.0)      7.8435 (1.44)     0.0000 (1.0)           0;0  0.1275 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7820 (1.43)     7.7820 (1.43)     7.7820 (1.43)     0.0000 (1.0)      7.7820 (1.43)     0.0000 (1.0)           0;0  0.1285 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.4337 (1.0)      5.4337 (1.0)      5.4337 (1.0)      0.0000 (1.0)      5.4337 (1.0)      0.0000 (1.0)           0;0  0.1840 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.7023 (1.05)     5.7023 (1.05)     5.7023 (1.05)     0.0000 (1.0)      5.7023 (1.05)     0.0000 (1.0)           0;0  0.1754 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     22.2137 (2.74)     22.2137 (2.74)     22.2137 (2.74)     0.0000 (1.0)      22.2137 (2.74)     0.0000 (1.0)           0;0  0.0450 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.9565 (2.95)     23.9565 (2.95)     23.9565 (2.95)     0.0000 (1.0)      23.9565 (2.95)     0.0000 (1.0)           0;0  0.0417 (0.34)          1           1
test_data_status_all_flags-data-new[3.53.2]     23.3088 (2.87)     23.3088 (2.87)     23.3088 (2.87)     0.0000 (1.0)      23.3088 (2.87)     0.0000 (1.0)           0;0  0.0429 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.1136 (1.0)       8.1136 (1.0)       8.1136 (1.0)      0.0000 (1.0)       8.1136 (1.0)      0.0000 (1.0)           0;0  0.1233 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6607 (1.07)      8.6607 (1.07)      8.6607 (1.07)     0.0000 (1.0)       8.6607 (1.07)     0.0000 (1.0)           0;0  0.1155 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.3770 (1.33)     6.3770 (1.33)     6.3770 (1.33)     0.0000 (1.0)      6.3770 (1.33)     0.0000 (1.0)           0;0  0.1568 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.3183 (1.53)     7.3183 (1.53)     7.3183 (1.53)     0.0000 (1.0)      7.3183 (1.53)     0.0000 (1.0)           0;0  0.1366 (0.66)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.5023 (1.56)     7.5023 (1.56)     7.5023 (1.56)     0.0000 (1.0)      7.5023 (1.56)     0.0000 (1.0)           0;0  0.1333 (0.64)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7973 (1.0)      4.7973 (1.0)      4.7973 (1.0)      0.0000 (1.0)      4.7973 (1.0)      0.0000 (1.0)           0;0  0.2084 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2076 (1.09)     5.2076 (1.09)     5.2076 (1.09)     0.0000 (1.0)      5.2076 (1.09)     0.0000 (1.0)           0;0  0.1920 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     13.2278 (2.38)     13.2278 (2.38)     13.2278 (2.38)     0.0000 (1.0)      13.2278 (2.38)     0.0000 (1.0)           0;0  0.0756 (0.42)          1           1
test_diff-diff[3.10.0]     14.2209 (2.56)     14.2209 (2.56)     14.2209 (2.56)     0.0000 (1.0)      14.2209 (2.56)     0.0000 (1.0)           0;0  0.0703 (0.39)          1           1
test_diff-diff[3.53.2]     13.9404 (2.51)     13.9404 (2.51)     13.9404 (2.51)     0.0000 (1.0)      13.9404 (2.51)     0.0000 (1.0)           0;0  0.0717 (0.40)          1           1
test_diff-diff[3.60.1]      5.5482 (1.0)       5.5482 (1.0)       5.5482 (1.0)      0.0000 (1.0)       5.5482 (1.0)      0.0000 (1.0)           0;0  0.1802 (1.0)           1           1
test_diff-diff[main]        6.6006 (1.19)      6.6006 (1.19)      6.6006 (1.19)     0.0000 (1.0)       6.6006 (1.19)     0.0000 (1.0)           0;0  0.1515 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     4.7286 (1.57)     4.7286 (1.57)     4.7286 (1.57)     0.0000 (1.0)      4.7286 (1.57)     0.0000 (1.0)           0;0  0.2115 (0.64)          1           1
test_diff-diff-changed[3.10.0]     5.2459 (1.74)     5.2459 (1.74)     5.2459 (1.74)     0.0000 (1.0)      5.2459 (1.74)     0.0000 (1.0)           0;0  0.1906 (0.58)          1           1
test_diff-diff-changed[3.53.2]     4.3316 (1.44)     4.3316 (1.44)     4.3316 (1.44)     0.0000 (1.0)      4.3316 (1.44)     0.0000 (1.0)           0;0  0.2309 (0.70)          1           1
test_diff-diff-changed[3.60.1]     3.0183 (1.0)      3.0183 (1.0)      3.0183 (1.0)      0.0000 (1.0)      3.0183 (1.0)      0.0000 (1.0)           0;0  0.3313 (1.0)           1           1
test_diff-diff-changed[main]       3.6406 (1.21)     3.6406 (1.21)     3.6406 (1.21)     0.0000 (1.0)      3.6406 (1.21)     0.0000 (1.0)           0;0  0.2747 (0.83)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.0275 (1.35)     4.0275 (1.35)     4.0275 (1.35)     0.0000 (1.0)      4.0275 (1.35)     0.0000 (1.0)           0;0  0.2483 (0.74)          1           1
test_diff-diff-changed-noop[3.10.0]     4.4157 (1.48)     4.4157 (1.48)     4.4157 (1.48)     0.0000 (1.0)      4.4157 (1.48)     0.0000 (1.0)           0;0  0.2265 (0.68)          1           1
test_diff-diff-changed-noop[3.53.2]     4.4321 (1.48)     4.4321 (1.48)     4.4321 (1.48)     0.0000 (1.0)      4.4321 (1.48)     0.0000 (1.0)           0;0  0.2256 (0.67)          1           1
test_diff-diff-changed-noop[3.60.1]     2.9879 (1.0)      2.9879 (1.0)      2.9879 (1.0)      0.0000 (1.0)      2.9879 (1.0)      0.0000 (1.0)           0;0  0.3347 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.6245 (1.21)     3.6245 (1.21)     3.6245 (1.21)     0.0000 (1.0)      3.6245 (1.21)     0.0000 (1.0)           0;0  0.2759 (0.82)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.0338 (1.01)     3.0338 (1.01)     3.0338 (1.01)     0.0000 (1.0)      3.0338 (1.01)     0.0000 (1.0)           0;0  0.3296 (0.99)          1           1
test_diff-diff-noop[3.10.0]     3.4905 (1.16)     3.4905 (1.16)     3.4905 (1.16)     0.0000 (1.0)      3.4905 (1.16)     0.0000 (1.0)           0;0  0.2865 (0.86)          1           1
test_diff-diff-noop[3.53.2]     4.2356 (1.41)     4.2356 (1.41)     4.2356 (1.41)     0.0000 (1.0)      4.2356 (1.41)     0.0000 (1.0)           0;0  0.2361 (0.71)          1           1
test_diff-diff-noop[3.60.1]     3.0006 (1.0)      3.0006 (1.0)      3.0006 (1.0)      0.0000 (1.0)      3.0006 (1.0)      0.0000 (1.0)           0;0  0.3333 (1.0)           1           1
test_diff-diff-noop[main]       3.6436 (1.21)     3.6436 (1.21)     3.6436 (1.21)     0.0000 (1.0)      3.6436 (1.21)     0.0000 (1.0)           0;0  0.2745 (0.82)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.2438 (1.0)      1.2438 (1.0)      1.2438 (1.0)      0.0000 (1.0)      1.2438 (1.0)      0.0000 (1.0)           0;0  0.8040 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.6497 (4.54)     5.6497 (4.54)     5.6497 (4.54)     0.0000 (1.0)      5.6497 (4.54)     0.0000 (1.0)           0;0  0.1770 (0.22)          1           1
test_exp_show-exp[3.53.2]     3.5490 (2.85)     3.5490 (2.85)     3.5490 (2.85)     0.0000 (1.0)      3.5490 (2.85)     0.0000 (1.0)           0;0  0.2818 (0.35)          1           1
test_exp_show-exp[3.60.1]     4.3107 (3.47)     4.3107 (3.47)     4.3107 (3.47)     0.0000 (1.0)      4.3107 (3.47)     0.0000 (1.0)           0;0  0.2320 (0.29)          1           1
test_exp_show-exp[main]       6.6518 (5.35)     6.6518 (5.35)     6.6518 (5.35)     0.0000 (1.0)      6.6518 (5.35)     0.0000 (1.0)           0;0  0.1503 (0.19)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     112.7400 (4.71)     112.7400 (4.71)     112.7400 (4.71)     0.0000 (1.0)      112.7400 (4.71)     0.0000 (1.0)           0;0  0.0089 (0.21)          1           1
test_fetch-fetch[3.10.0]     118.6233 (4.95)     118.6233 (4.95)     118.6233 (4.95)     0.0000 (1.0)      118.6233 (4.95)     0.0000 (1.0)           0;0  0.0084 (0.20)          1           1
test_fetch-fetch[3.53.2]      34.1497 (1.43)      34.1497 (1.43)      34.1497 (1.43)     0.0000 (1.0)       34.1497 (1.43)     0.0000 (1.0)           0;0  0.0293 (0.70)          1           1
test_fetch-fetch[3.60.1]      24.0039 (1.00)      24.0039 (1.00)      24.0039 (1.00)     0.0000 (1.0)       24.0039 (1.00)     0.0000 (1.0)           0;0  0.0417 (1.00)          1           1
test_fetch-fetch[main]        23.9470 (1.0)       23.9470 (1.0)       23.9470 (1.0)      0.0000 (1.0)       23.9470 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8604 (1.0)      2.8604 (1.0)      2.8604 (1.0)      0.0000 (1.0)      2.8604 (1.0)      0.0000 (1.0)           0;0  0.3496 (1.0)           1           1
test_gc-gc[3.10.0]     3.1773 (1.11)     3.1773 (1.11)     3.1773 (1.11)     0.0000 (1.0)      3.1773 (1.11)     0.0000 (1.0)           0;0  0.3147 (0.90)          1           1
test_gc-gc[3.53.2]     2.9039 (1.02)     2.9039 (1.02)     2.9039 (1.02)     0.0000 (1.0)      2.9039 (1.02)     0.0000 (1.0)           0;0  0.3444 (0.99)          1           1
test_gc-gc[3.60.1]     2.9178 (1.02)     2.9178 (1.02)     2.9178 (1.02)     0.0000 (1.0)      2.9178 (1.02)     0.0000 (1.0)           0;0  0.3427 (0.98)          1           1
test_gc-gc[main]       3.1276 (1.09)     3.1276 (1.09)     3.1276 (1.09)     0.0000 (1.0)      3.1276 (1.09)     0.0000 (1.0)           0;0  0.3197 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     200.7963 (3.54)     200.7963 (3.54)     200.7963 (3.54)     0.0000 (1.0)      200.7963 (3.54)     0.0000 (1.0)           0;0  0.0050 (0.28)          1           1
test_get-get[3.10.0]     244.8559 (4.32)     244.8559 (4.32)     244.8559 (4.32)     0.0000 (1.0)      244.8559 (4.32)     0.0000 (1.0)           0;0  0.0041 (0.23)          1           1
test_get-get[3.53.2]     182.0776 (3.21)     182.0776 (3.21)     182.0776 (3.21)     0.0000 (1.0)      182.0776 (3.21)     0.0000 (1.0)           0;0  0.0055 (0.31)          1           1
test_get-get[3.60.1]      57.2599 (1.01)      57.2599 (1.01)      57.2599 (1.01)     0.0000 (1.0)       57.2599 (1.01)     0.0000 (1.0)           0;0  0.0175 (0.99)          1           1
test_get-get[main]        56.7097 (1.0)       56.7097 (1.0)       56.7097 (1.0)      0.0000 (1.0)       56.7097 (1.0)      0.0000 (1.0)           0;0  0.0176 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     93.6133 (5.45)     93.6133 (5.45)     93.6133 (5.45)     0.0000 (1.0)      93.6133 (5.45)     0.0000 (1.0)           0;0  0.0107 (0.18)          1           1
test_get_url-get-url[3.10.0]     95.7912 (5.57)     95.7912 (5.57)     95.7912 (5.57)     0.0000 (1.0)      95.7912 (5.57)     0.0000 (1.0)           0;0  0.0104 (0.18)          1           1
test_get_url-get-url[3.53.2]     17.5299 (1.02)     17.5299 (1.02)     17.5299 (1.02)     0.0000 (1.0)      17.5299 (1.02)     0.0000 (1.0)           0;0  0.0570 (0.98)          1           1
test_get_url-get-url[3.60.1]     17.1896 (1.0)      17.1896 (1.0)      17.1896 (1.0)      0.0000 (1.0)      17.1896 (1.0)      0.0000 (1.0)           0;0  0.0582 (1.0)           1           1
test_get_url-get-url[main]       17.5256 (1.02)     17.5256 (1.02)     17.5256 (1.02)     0.0000 (1.0)      17.5256 (1.02)     0.0000 (1.0)           0;0  0.0571 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     131.0306 (1.05)     144.6630 (1.02)     133.3139 (1.05)     1.6711 (1.0)      132.9401 (1.05)     1.3886 (1.0)          14;7  7.5011 (0.95)        100           1
test_help---help[3.10.0]     130.3901 (1.05)     145.5879 (1.03)     132.6925 (1.05)     1.9996 (1.20)     132.3842 (1.05)     1.9681 (1.42)         16;4  7.5362 (0.95)        100           1
test_help---help[3.53.2]     132.4455 (1.07)     146.9715 (1.04)     134.8635 (1.07)     2.0059 (1.20)     134.4852 (1.06)     1.8377 (1.32)         13;6  7.4149 (0.94)        100           1
test_help---help[3.60.1]     131.5734 (1.06)     163.5601 (1.16)     135.4961 (1.07)     6.2015 (3.71)     133.7910 (1.06)     1.9354 (1.39)          8;8  7.3803 (0.93)        100           1
test_help---help[main]       124.2206 (1.0)      141.2771 (1.0)      126.5648 (1.0)      1.9625 (1.17)     126.3031 (1.0)      1.4672 (1.06)          8;7  7.9011 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     269.7729 (3.42)     269.7729 (3.42)     269.7729 (3.42)     0.0000 (1.0)      269.7729 (3.42)     0.0000 (1.0)           0;0  0.0037 (0.29)          1           1
test_import-import[3.10.0]     305.0080 (3.86)     305.0080 (3.86)     305.0080 (3.86)     0.0000 (1.0)      305.0080 (3.86)     0.0000 (1.0)           0;0  0.0033 (0.26)          1           1
test_import-import[3.60.1]      78.9809 (1.0)       78.9809 (1.0)       78.9809 (1.0)      0.0000 (1.0)       78.9809 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
test_import-import[main]        79.6728 (1.01)      79.6728 (1.01)      79.6728 (1.01)     0.0000 (1.0)       79.6728 (1.01)     0.0000 (1.0)           0;0  0.0126 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     203.3976 (4.32)     203.3976 (4.32)     203.3976 (4.32)     0.0000 (1.0)      203.3976 (4.32)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.10.0]     206.9782 (4.39)     206.9782 (4.39)     206.9782 (4.39)     0.0000 (1.0)      206.9782 (4.39)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_import_url-import-url[3.53.2]     116.3080 (2.47)     116.3080 (2.47)     116.3080 (2.47)     0.0000 (1.0)      116.3080 (2.47)     0.0000 (1.0)           0;0  0.0086 (0.41)          1           1
test_import_url-import-url[3.60.1]      47.1110 (1.0)       47.1110 (1.0)       47.1110 (1.0)      0.0000 (1.0)       47.1110 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
test_import_url-import-url[main]        48.4682 (1.03)      48.4682 (1.03)      48.4682 (1.03)     0.0000 (1.0)       48.4682 (1.03)     0.0000 (1.0)           0;0  0.0206 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     362.4204 (1.01)     401.6455 (1.01)     376.7132 (1.00)      8.4500 (1.25)     375.7142 (1.00)     13.7735 (1.74)         39;0  2.6545 (1.00)        100           1
test_init-init[3.10.0]     369.3239 (1.03)     415.5430 (1.05)     384.9535 (1.02)      6.7605 (1.0)      385.8215 (1.03)      8.0988 (1.02)         24;1  2.5977 (0.98)        100           1
test_init-init[3.53.2]     362.2229 (1.01)     403.2279 (1.02)     375.6100 (1.0)       7.9024 (1.17)     374.5323 (1.0)       8.4765 (1.07)         25;6  2.6623 (1.0)         100           1
test_init-init[3.60.1]     359.8957 (1.0)      396.1268 (1.0)      377.6783 (1.01)      7.1953 (1.06)     377.2562 (1.01)      9.8127 (1.24)         34;0  2.6478 (0.99)        100           1
test_init-init[main]       399.8092 (1.11)     532.5737 (1.34)     418.9654 (1.12)     19.4121 (2.87)     415.5419 (1.11)      7.9220 (1.0)           5;6  2.3868 (0.90)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     721.4461 (1.07)     721.4461 (1.07)     721.4461 (1.07)     0.0000 (1.0)      721.4461 (1.07)     0.0000 (1.0)           0;0  1.3861 (0.93)          1           1
test_list-list[3.10.0]     998.4471 (1.48)     998.4471 (1.48)     998.4471 (1.48)     0.0000 (1.0)      998.4471 (1.48)     0.0000 (1.0)           0;0  1.0016 (0.67)          1           1
test_list-list[3.53.2]     672.3560 (1.0)      672.3560 (1.0)      672.3560 (1.0)      0.0000 (1.0)      672.3560 (1.0)      0.0000 (1.0)           0;0  1.4873 (1.0)           1           1
test_list-list[3.60.1]     717.9740 (1.07)     717.9740 (1.07)     717.9740 (1.07)     0.0000 (1.0)      717.9740 (1.07)     0.0000 (1.0)           0;0  1.3928 (0.94)          1           1
test_list-list[main]       683.1112 (1.02)     683.1112 (1.02)     683.1112 (1.02)     0.0000 (1.0)      683.1112 (1.02)     0.0000 (1.0)           0;0  1.4639 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     536.5768 (1.18)     536.5768 (1.18)     536.5768 (1.18)     0.0000 (1.0)      536.5768 (1.18)     0.0000 (1.0)           0;0  1.8637 (0.85)          1           1
test_list-list-dvc-only[3.10.0]     489.7095 (1.07)     489.7095 (1.07)     489.7095 (1.07)     0.0000 (1.0)      489.7095 (1.07)     0.0000 (1.0)           0;0  2.0420 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     458.0589 (1.01)     458.0589 (1.01)     458.0589 (1.01)     0.0000 (1.0)      458.0589 (1.01)     0.0000 (1.0)           0;0  2.1831 (0.99)          1           1
test_list-list-dvc-only[3.60.1]     455.7155 (1.0)      455.7155 (1.0)      455.7155 (1.0)      0.0000 (1.0)      455.7155 (1.0)      0.0000 (1.0)           0;0  2.1944 (1.0)           1           1
test_list-list-dvc-only[main]       469.9326 (1.03)     469.9326 (1.03)     469.9326 (1.03)     0.0000 (1.0)      469.9326 (1.03)     0.0000 (1.0)           0;0  2.1280 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8069 (1.01)     2.8069 (1.01)     2.8069 (1.01)     0.0000 (1.0)      2.8069 (1.01)     0.0000 (1.0)           0;0  0.3563 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.7872 (1.0)      2.7872 (1.0)      2.7872 (1.0)      0.0000 (1.0)      2.7872 (1.0)      0.0000 (1.0)           0;0  0.3588 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.8141 (1.01)     2.8141 (1.01)     2.8141 (1.01)     0.0000 (1.0)      2.8141 (1.01)     0.0000 (1.0)           0;0  0.3554 (0.99)          1           1
test_list-list-recursive[3.60.1]     2.8948 (1.04)     2.8948 (1.04)     2.8948 (1.04)     0.0000 (1.0)      2.8948 (1.04)     0.0000 (1.0)           0;0  0.3455 (0.96)          1           1
test_list-list-recursive[main]       2.9061 (1.04)     2.9061 (1.04)     2.9061 (1.04)     0.0000 (1.0)      2.9061 (1.04)     0.0000 (1.0)           0;0  0.3441 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     504.3022 (1.17)     504.3022 (1.17)     504.3022 (1.17)     0.0000 (1.0)      504.3022 (1.17)     0.0000 (1.0)           0;0  1.9829 (0.85)          1           1
test_list-list-shallow[3.10.0]     509.7386 (1.18)     509.7386 (1.18)     509.7386 (1.18)     0.0000 (1.0)      509.7386 (1.18)     0.0000 (1.0)           0;0  1.9618 (0.84)          1           1
test_list-list-shallow[3.53.2]     437.7604 (1.02)     437.7604 (1.02)     437.7604 (1.02)     0.0000 (1.0)      437.7604 (1.02)     0.0000 (1.0)           0;0  2.2844 (0.98)          1           1
test_list-list-shallow[3.60.1]     459.0912 (1.07)     459.0912 (1.07)     459.0912 (1.07)     0.0000 (1.0)      459.0912 (1.07)     0.0000 (1.0)           0;0  2.1782 (0.94)          1           1
test_list-list-shallow[main]       430.3604 (1.0)      430.3604 (1.0)      430.3604 (1.0)      0.0000 (1.0)      430.3604 (1.0)      0.0000 (1.0)           0;0  2.3236 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.1253 (2.96)     12.1253 (2.96)     12.1253 (2.96)     0.0000 (1.0)      12.1253 (2.96)     0.0000 (1.0)           0;0  0.0825 (0.34)          1           1
test_partial_add-add[3.10.0]     12.6188 (3.08)     12.6188 (3.08)     12.6188 (3.08)     0.0000 (1.0)      12.6188 (3.08)     0.0000 (1.0)           0;0  0.0792 (0.33)          1           1
test_partial_add-add[3.53.2]     11.0345 (2.69)     11.0345 (2.69)     11.0345 (2.69)     0.0000 (1.0)      11.0345 (2.69)     0.0000 (1.0)           0;0  0.0906 (0.37)          1           1
test_partial_add-add[3.60.1]      4.1024 (1.0)       4.1024 (1.0)       4.1024 (1.0)      0.0000 (1.0)       4.1024 (1.0)      0.0000 (1.0)           0;0  0.2438 (1.0)           1           1
test_partial_add-add[main]        5.1636 (1.26)      5.1636 (1.26)      5.1636 (1.26)     0.0000 (1.0)       5.1636 (1.26)     0.0000 (1.0)           0;0  0.1937 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     78.9859 (3.86)     78.9859 (3.86)     78.9859 (3.86)     0.0000 (1.0)      78.9859 (3.86)     0.0000 (1.0)           0;0  0.0127 (0.26)          1           1
test_partial_add-add-partial[3.10.0]     79.5584 (3.89)     79.5584 (3.89)     79.5584 (3.89)     0.0000 (1.0)      79.5584 (3.89)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add-partial[3.53.2]     71.2635 (3.49)     71.2635 (3.49)     71.2635 (3.49)     0.0000 (1.0)      71.2635 (3.49)     0.0000 (1.0)           0;0  0.0140 (0.29)          1           1
test_partial_add-add-partial[3.60.1]     20.4417 (1.0)      20.4417 (1.0)      20.4417 (1.0)      0.0000 (1.0)      20.4417 (1.0)      0.0000 (1.0)           0;0  0.0489 (1.0)           1           1
test_partial_add-add-partial[main]       21.1473 (1.03)     21.1473 (1.03)     21.1473 (1.03)     0.0000 (1.0)      21.1473 (1.03)     0.0000 (1.0)           0;0  0.0473 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6300 (1.0)      4.6300 (1.0)      4.6300 (1.0)      0.0000 (1.0)      4.6300 (1.0)      0.0000 (1.0)           0;0  0.2160 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1251 (1.32)     6.1251 (1.32)     6.1251 (1.32)     0.0000 (1.0)      6.1251 (1.32)     0.0000 (1.0)           0;0  0.1633 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9197 (1.49)     6.9197 (1.49)     6.9197 (1.49)     0.0000 (1.0)      6.9197 (1.49)     0.0000 (1.0)           0;0  0.1445 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.9566 (1.50)     6.9566 (1.50)     6.9566 (1.50)     0.0000 (1.0)      6.9566 (1.50)     0.0000 (1.0)           0;0  0.1437 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.2938 (1.36)     6.2938 (1.36)     6.2938 (1.36)     0.0000 (1.0)      6.2938 (1.36)     0.0000 (1.0)           0;0  0.1589 (0.74)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6862 (1.0)      2.6862 (1.0)      2.6862 (1.0)      0.0000 (1.0)      2.6862 (1.0)      0.0000 (1.0)           0;0  0.3723 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8914 (1.45)     3.8914 (1.45)     3.8914 (1.45)     0.0000 (1.0)      3.8914 (1.45)     0.0000 (1.0)           0;0  0.2570 (0.69)          1           1
test_partial_add-gc-noop[3.53.2]     3.8965 (1.45)     3.8965 (1.45)     3.8965 (1.45)     0.0000 (1.0)      3.8965 (1.45)     0.0000 (1.0)           0;0  0.2566 (0.69)          1           1
test_partial_add-gc-noop[3.60.1]     3.9634 (1.48)     3.9634 (1.48)     3.9634 (1.48)     0.0000 (1.0)      3.9634 (1.48)     0.0000 (1.0)           0;0  0.2523 (0.68)          1           1
test_partial_add-gc-noop[main]       3.0489 (1.13)     3.0489 (1.13)     3.0489 (1.13)     0.0000 (1.0)      3.0489 (1.13)     0.0000 (1.0)           0;0  0.3280 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.7460 (4.00)     14.7460 (4.00)     14.7460 (4.00)     0.0000 (1.0)      14.7460 (4.00)     0.0000 (1.0)           0;0  0.0678 (0.25)          1           1
test_partial_add-push[3.10.0]      7.2282 (1.96)      7.2282 (1.96)      7.2282 (1.96)     0.0000 (1.0)       7.2282 (1.96)     0.0000 (1.0)           0;0  0.1383 (0.51)          1           1
test_partial_add-push[3.53.2]      3.7510 (1.02)      3.7510 (1.02)      3.7510 (1.02)     0.0000 (1.0)       3.7510 (1.02)     0.0000 (1.0)           0;0  0.2666 (0.98)          1           1
test_partial_add-push[3.60.1]      3.6836 (1.0)       3.6836 (1.0)       3.6836 (1.0)      0.0000 (1.0)       3.6836 (1.0)      0.0000 (1.0)           0;0  0.2715 (1.0)           1           1
test_partial_add-push[main]        3.7978 (1.03)      3.7978 (1.03)      3.7978 (1.03)     0.0000 (1.0)       3.7978 (1.03)     0.0000 (1.0)           0;0  0.2633 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     86.7407 (4.03)     86.7407 (4.03)     86.7407 (4.03)     0.0000 (1.0)      86.7407 (4.03)     0.0000 (1.0)           0;0  0.0115 (0.25)          1           1
test_partial_add-push-partial[3.10.0]     42.1774 (1.96)     42.1774 (1.96)     42.1774 (1.96)     0.0000 (1.0)      42.1774 (1.96)     0.0000 (1.0)           0;0  0.0237 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     22.1642 (1.03)     22.1642 (1.03)     22.1642 (1.03)     0.0000 (1.0)      22.1642 (1.03)     0.0000 (1.0)           0;0  0.0451 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     21.5361 (1.0)      21.5361 (1.0)      21.5361 (1.0)      0.0000 (1.0)      21.5361 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_partial_add-push-partial[main]       21.7005 (1.01)     21.7005 (1.01)     21.7005 (1.01)     0.0000 (1.0)      21.7005 (1.01)     0.0000 (1.0)           0;0  0.0461 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.3865 (3.63)     85.3865 (3.63)     85.3865 (3.63)     0.0000 (1.0)      85.3865 (3.63)     0.0000 (1.0)           0;0  0.0117 (0.28)          1           1
test_partial_remove-add[3.10.0]     85.2031 (3.62)     85.2031 (3.62)     85.2031 (3.62)     0.0000 (1.0)      85.2031 (3.62)     0.0000 (1.0)           0;0  0.0117 (0.28)          1           1
test_partial_remove-add[3.53.2]     76.9940 (3.27)     76.9940 (3.27)     76.9940 (3.27)     0.0000 (1.0)      76.9940 (3.27)     0.0000 (1.0)           0;0  0.0130 (0.31)          1           1
test_partial_remove-add[3.60.1]     23.5427 (1.0)      23.5427 (1.0)      23.5427 (1.0)      0.0000 (1.0)      23.5427 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
test_partial_remove-add[main]       24.7004 (1.05)     24.7004 (1.05)     24.7004 (1.05)     0.0000 (1.0)      24.7004 (1.05)     0.0000 (1.0)           0;0  0.0405 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     46.9629 (12.63)    46.9629 (12.63)    46.9629 (12.63)    0.0000 (1.0)      46.9629 (12.63)    0.0000 (1.0)           0;0  0.0213 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     47.7237 (12.83)    47.7237 (12.83)    47.7237 (12.83)    0.0000 (1.0)      47.7237 (12.83)    0.0000 (1.0)           0;0  0.0210 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.6047 (11.72)    43.6047 (11.72)    43.6047 (11.72)    0.0000 (1.0)      43.6047 (11.72)    0.0000 (1.0)           0;0  0.0229 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.7191 (1.0)       3.7191 (1.0)       3.7191 (1.0)      0.0000 (1.0)       3.7191 (1.0)      0.0000 (1.0)           0;0  0.2689 (1.0)           1           1
test_partial_remove-add-update[main]        4.0235 (1.08)      4.0235 (1.08)      4.0235 (1.08)     0.0000 (1.0)       4.0235 (1.08)     0.0000 (1.0)           0;0  0.2485 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6674 (1.0)      2.6674 (1.0)      2.6674 (1.0)      0.0000 (1.0)      2.6674 (1.0)      0.0000 (1.0)           0;0  0.3749 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7753 (1.42)     3.7753 (1.42)     3.7753 (1.42)     0.0000 (1.0)      3.7753 (1.42)     0.0000 (1.0)           0;0  0.2649 (0.71)          1           1
test_partial_remove-gc[3.53.2]     3.8979 (1.46)     3.8979 (1.46)     3.8979 (1.46)     0.0000 (1.0)      3.8979 (1.46)     0.0000 (1.0)           0;0  0.2565 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.9062 (1.46)     3.9062 (1.46)     3.9062 (1.46)     0.0000 (1.0)      3.9062 (1.46)     0.0000 (1.0)           0;0  0.2560 (0.68)          1           1
test_partial_remove-gc[main]       3.0071 (1.13)     3.0071 (1.13)     3.0071 (1.13)     0.0000 (1.0)      3.0071 (1.13)     0.0000 (1.0)           0;0  0.3325 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8987 (1.0)      4.8987 (1.0)      4.8987 (1.0)      0.0000 (1.0)      4.8987 (1.0)      0.0000 (1.0)           0;0  0.2041 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.2603 (1.28)     6.2603 (1.28)     6.2603 (1.28)     0.0000 (1.0)      6.2603 (1.28)     0.0000 (1.0)           0;0  0.1597 (0.78)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.1441 (1.46)     7.1441 (1.46)     7.1441 (1.46)     0.0000 (1.0)      7.1441 (1.46)     0.0000 (1.0)           0;0  0.1400 (0.69)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.5894 (1.35)     6.5894 (1.35)     6.5894 (1.35)     0.0000 (1.0)      6.5894 (1.35)     0.0000 (1.0)           0;0  0.1518 (0.74)          1           1
test_partial_remove-gc-cloud[main]       5.9923 (1.22)     5.9923 (1.22)     5.9923 (1.22)     0.0000 (1.0)      5.9923 (1.22)     0.0000 (1.0)           0;0  0.1669 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     100.4538 (4.29)     100.4538 (4.29)     100.4538 (4.29)     0.0000 (1.0)      100.4538 (4.29)     0.0000 (1.0)           0;0  0.0100 (0.23)          1           1
test_partial_remove-push[3.10.0]      47.2082 (2.02)      47.2082 (2.02)      47.2082 (2.02)     0.0000 (1.0)       47.2082 (2.02)     0.0000 (1.0)           0;0  0.0212 (0.50)          1           1
test_partial_remove-push[3.53.2]      24.2723 (1.04)      24.2723 (1.04)      24.2723 (1.04)     0.0000 (1.0)       24.2723 (1.04)     0.0000 (1.0)           0;0  0.0412 (0.96)          1           1
test_partial_remove-push[3.60.1]      23.8160 (1.02)      23.8160 (1.02)      23.8160 (1.02)     0.0000 (1.0)       23.8160 (1.02)     0.0000 (1.0)           0;0  0.0420 (0.98)          1           1
test_partial_remove-push[main]        23.4000 (1.0)       23.4000 (1.0)       23.4000 (1.0)      0.0000 (1.0)       23.4000 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.1399 (1.0)      4.1399 (1.0)      4.1399 (1.0)      0.0000 (1.0)      4.1399 (1.0)      0.0000 (1.0)           0;0  0.2416 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.2066 (1.02)     4.2066 (1.02)     4.2066 (1.02)     0.0000 (1.0)      4.2066 (1.02)     0.0000 (1.0)           0;0  0.2377 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     7.8310 (1.89)     7.8310 (1.89)     7.8310 (1.89)     0.0000 (1.0)      7.8310 (1.89)     0.0000 (1.0)           0;0  0.1277 (0.53)          1           1
test_partial_remove-push-update[3.60.1]     7.3595 (1.78)     7.3595 (1.78)     7.3595 (1.78)     0.0000 (1.0)      7.3595 (1.78)     0.0000 (1.0)           0;0  0.1359 (0.56)          1           1
test_partial_remove-push-update[main]       7.8248 (1.89)     7.8248 (1.89)     7.8248 (1.89)     0.0000 (1.0)      7.8248 (1.89)     0.0000 (1.0)           0;0  0.1278 (0.53)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     546.3904 (1.0)      554.7771 (1.0)      550.1337 (1.0)      3.0366 (1.85)     549.8058 (1.0)      3.1780 (1.47)          2;0  1.8177 (1.0)           5           3
test_plots-plots-diff[3.10.0]     957.2653 (1.75)     966.1842 (1.74)     961.6723 (1.75)     3.7649 (2.29)     962.3837 (1.75)     6.4830 (3.00)          2;0  1.0399 (0.57)          5           3
test_plots-plots-diff[3.53.2]     896.5373 (1.64)     904.2148 (1.63)     899.6869 (1.64)     3.1762 (1.93)     899.2025 (1.64)     5.1534 (2.39)          1;0  1.1115 (0.61)          5           3
test_plots-plots-diff[3.60.1]     898.3797 (1.64)     906.7035 (1.63)     903.6088 (1.64)     3.1608 (1.93)     903.9478 (1.64)     3.2967 (1.53)          1;0  1.1067 (0.61)          5           3
test_plots-plots-diff[main]       912.1375 (1.67)     916.5122 (1.65)     914.5651 (1.66)     1.6416 (1.0)      914.6627 (1.66)     2.1607 (1.0)           2;0  1.0934 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       563.8053 (1.0)        567.5839 (1.0)        565.8040 (1.0)      1.8435 (1.0)        566.7022 (1.0)      3.4081 (1.0)           2;0  1.7674 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,185.6542 (2.10)     1,194.6570 (2.10)     1,189.5154 (2.10)     3.3639 (1.82)     1,189.4563 (2.10)     4.1388 (1.21)          2;0  0.8407 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]       967.3823 (1.72)       978.0774 (1.72)       975.3320 (1.72)     4.4935 (2.44)       976.9839 (1.72)     3.7300 (1.09)          1;1  1.0253 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]       975.3432 (1.73)       981.9960 (1.73)       979.3437 (1.73)     2.7026 (1.47)       978.8314 (1.73)     3.8329 (1.12)          1;0  1.0211 (0.58)          5           3
test_plots-plots-diff-json[main]         984.2452 (1.75)       991.2110 (1.75)       987.3586 (1.75)     3.1224 (1.69)       985.7758 (1.74)     5.3544 (1.57)          1;0  1.0128 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     439.9771 (1.0)      444.1273 (1.0)      441.9730 (1.0)       1.9607 (1.0)      441.0867 (1.0)       3.5705 (1.22)          3;0  2.2626 (1.0)           5           3
test_plots-plots-show[3.10.0]     770.3203 (1.75)     787.4503 (1.77)     778.6205 (1.76)      6.8294 (3.48)     776.1270 (1.76)     10.2408 (3.50)          2;0  1.2843 (0.57)          5           3
test_plots-plots-show[3.53.2]     750.5267 (1.71)     756.4839 (1.70)     753.3996 (1.70)      2.2455 (1.15)     752.7225 (1.71)      2.9264 (1.0)           2;0  1.3273 (0.59)          5           3
test_plots-plots-show[3.60.1]     754.0395 (1.71)     774.7215 (1.74)     758.7855 (1.72)      8.9542 (4.57)     754.6010 (1.71)      6.7390 (2.30)          1;1  1.3179 (0.58)          5           3
test_plots-plots-show[main]       763.6487 (1.74)     801.8250 (1.81)     774.7247 (1.75)     15.5668 (7.94)     771.2778 (1.75)     14.4307 (4.93)          1;1  1.2908 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     459.7386 (1.0)      464.7446 (1.0)      461.9582 (1.0)      2.1899 (1.0)      461.3862 (1.0)      3.8849 (1.60)          2;0  2.1647 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     895.6440 (1.95)     907.7422 (1.95)     901.6463 (1.95)     4.8399 (2.21)     901.4752 (1.95)     7.8244 (3.23)          2;0  1.1091 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     797.9705 (1.74)     804.7105 (1.73)     799.8733 (1.73)     2.7583 (1.26)     799.0945 (1.73)     2.4235 (1.0)           1;1  1.2502 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     801.0214 (1.74)     811.4989 (1.75)     806.3742 (1.75)     3.8992 (1.78)     806.0750 (1.75)     5.1452 (2.12)          2;0  1.2401 (0.57)          5           3
test_plots-plots-show-json[main]       808.0251 (1.76)     818.6834 (1.76)     814.6681 (1.76)     4.1101 (1.88)     814.7883 (1.77)     4.8286 (1.99)          1;0  1.2275 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     100.6261 (4.44)     100.6261 (4.44)     100.6261 (4.44)     0.0000 (1.0)      100.6261 (4.44)     0.0000 (1.0)           0;0  0.0099 (0.23)          1           1
test_push-push[3.10.0]      48.4646 (2.14)      48.4646 (2.14)      48.4646 (2.14)     0.0000 (1.0)       48.4646 (2.14)     0.0000 (1.0)           0;0  0.0206 (0.47)          1           1
test_push-push[3.53.2]      23.3859 (1.03)      23.3859 (1.03)      23.3859 (1.03)     0.0000 (1.0)       23.3859 (1.03)     0.0000 (1.0)           0;0  0.0428 (0.97)          1           1
test_push-push[3.60.1]      22.6753 (1.0)       22.6753 (1.0)       22.6753 (1.0)      0.0000 (1.0)       22.6753 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
test_push-push[main]        23.3458 (1.03)      23.3458 (1.03)      23.3458 (1.03)     0.0000 (1.0)       23.3458 (1.03)     0.0000 (1.0)           0;0  0.0428 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     115.8346 (4.86)     115.8346 (4.86)     115.8346 (4.86)     0.0000 (1.0)      115.8346 (4.86)     0.0000 (1.0)           0;0  0.0086 (0.21)          1           1
test_sharing-fetch[3.10.0]     120.7373 (5.07)     120.7373 (5.07)     120.7373 (5.07)     0.0000 (1.0)      120.7373 (5.07)     0.0000 (1.0)           0;0  0.0083 (0.20)          1           1
test_sharing-fetch[3.53.2]      33.9484 (1.43)      33.9484 (1.43)      33.9484 (1.43)     0.0000 (1.0)       33.9484 (1.43)     0.0000 (1.0)           0;0  0.0295 (0.70)          1           1
test_sharing-fetch[3.60.1]      23.8151 (1.0)       23.8151 (1.0)       23.8151 (1.0)      0.0000 (1.0)       23.8151 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
test_sharing-fetch[main]        23.9785 (1.01)      23.9785 (1.01)      23.9785 (1.01)     0.0000 (1.0)       23.9785 (1.01)     0.0000 (1.0)           0;0  0.0417 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3326 (1.0)      1.3326 (1.0)      1.3326 (1.0)      0.0000 (1.0)      1.3326 (1.0)      0.0000 (1.0)           0;0  0.7504 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.9205 (2.94)     3.9205 (2.94)     3.9205 (2.94)     0.0000 (1.0)      3.9205 (2.94)     0.0000 (1.0)           0;0  0.2551 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     6.2141 (4.66)     6.2141 (4.66)     6.2141 (4.66)     0.0000 (1.0)      6.2141 (4.66)     0.0000 (1.0)           0;0  0.1609 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     6.2886 (4.72)     6.2886 (4.72)     6.2886 (4.72)     0.0000 (1.0)      6.2886 (4.72)     0.0000 (1.0)           0;0  0.1590 (0.21)          1           1
test_sharing-fetch-noop[main]       6.4463 (4.84)     6.4463 (4.84)     6.4463 (4.84)     0.0000 (1.0)      6.4463 (4.84)     0.0000 (1.0)           0;0  0.1551 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     103.0371 (4.45)     103.0371 (4.45)     103.0371 (4.45)     0.0000 (1.0)      103.0371 (4.45)     0.0000 (1.0)           0;0  0.0097 (0.22)          1           1
test_sharing-push[3.10.0]      50.1597 (2.17)      50.1597 (2.17)      50.1597 (2.17)     0.0000 (1.0)       50.1597 (2.17)     0.0000 (1.0)           0;0  0.0199 (0.46)          1           1
test_sharing-push[3.53.2]      24.6548 (1.06)      24.6548 (1.06)      24.6548 (1.06)     0.0000 (1.0)       24.6548 (1.06)     0.0000 (1.0)           0;0  0.0406 (0.94)          1           1
test_sharing-push[3.60.1]      23.1559 (1.0)       23.1559 (1.0)       23.1559 (1.0)      0.0000 (1.0)       23.1559 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
test_sharing-push[main]        23.8155 (1.03)      23.8155 (1.03)      23.8155 (1.03)     0.0000 (1.0)       23.8155 (1.03)     0.0000 (1.0)           0;0  0.0420 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1791 (1.0)      2.1791 (1.0)      2.1791 (1.0)      0.0000 (1.0)      2.1791 (1.0)      0.0000 (1.0)           0;0  0.4589 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2435 (1.03)     2.2435 (1.03)     2.2435 (1.03)     0.0000 (1.0)      2.2435 (1.03)     0.0000 (1.0)           0;0  0.4457 (0.97)          1           1
test_sharing-push-noop[3.53.2]     6.6412 (3.05)     6.6412 (3.05)     6.6412 (3.05)     0.0000 (1.0)      6.6412 (3.05)     0.0000 (1.0)           0;0  0.1506 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.5291 (3.00)     6.5291 (3.00)     6.5291 (3.00)     0.0000 (1.0)      6.5291 (3.00)     0.0000 (1.0)           0;0  0.1532 (0.33)          1           1
test_sharing-push-noop[main]       6.4685 (2.97)     6.4685 (2.97)     6.4685 (2.97)     0.0000 (1.0)      6.4685 (2.97)     0.0000 (1.0)           0;0  0.1546 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     197.8817 (1.08)     197.8817 (1.08)     197.8817 (1.08)     0.0000 (1.0)      197.8817 (1.08)     0.0000 (1.0)           0;0  0.0051 (0.93)          1           1
test_sharing_azure-fetch[main]       183.7553 (1.0)      183.7553 (1.0)      183.7553 (1.0)      0.0000 (1.0)      183.7553 (1.0)      0.0000 (1.0)           0;0  0.0054 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4378 (1.0)      6.4378 (1.0)      6.4378 (1.0)      0.0000 (1.0)      6.4378 (1.0)      0.0000 (1.0)           0;0  0.1553 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6120 (1.03)     6.6120 (1.03)     6.6120 (1.03)     0.0000 (1.0)      6.6120 (1.03)     0.0000 (1.0)           0;0  0.1512 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     188.8209 (1.0)      188.8209 (1.0)      188.8209 (1.0)      0.0000 (1.0)      188.8209 (1.0)      0.0000 (1.0)           0;0  0.0053 (1.0)           1           1
test_sharing_azure-push[main]       192.5809 (1.02)     192.5809 (1.02)     192.5809 (1.02)     0.0000 (1.0)      192.5809 (1.02)     0.0000 (1.0)           0;0  0.0052 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.9543 (1.03)     6.9543 (1.03)     6.9543 (1.03)     0.0000 (1.0)      6.9543 (1.03)     0.0000 (1.0)           0;0  0.1438 (0.97)          1           1
test_sharing_azure-push-noop[main]       6.7775 (1.0)      6.7775 (1.0)      6.7775 (1.0)      0.0000 (1.0)      6.7775 (1.0)      0.0000 (1.0)           0;0  0.1475 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     667.8988 (1.01)     667.8988 (1.01)     667.8988 (1.01)     0.0000 (1.0)      667.8988 (1.01)     0.0000 (1.0)           0;0  0.0015 (0.99)          1           1
test_sharing_s3-fetch[main]       660.4979 (1.0)      660.4979 (1.0)      660.4979 (1.0)      0.0000 (1.0)      660.4979 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5875 (1.0)      6.5875 (1.0)      6.5875 (1.0)      0.0000 (1.0)      6.5875 (1.0)      0.0000 (1.0)           0;0  0.1518 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7488 (1.02)     6.7488 (1.02)     6.7488 (1.02)     0.0000 (1.0)      6.7488 (1.02)     0.0000 (1.0)           0;0  0.1482 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     935.6754 (1.00)     935.6754 (1.00)     935.6754 (1.00)     0.0000 (1.0)      935.6754 (1.00)     0.0000 (1.0)           0;0  0.0011 (1.00)          1           1
test_sharing_s3-push[main]       935.5874 (1.0)      935.5874 (1.0)      935.5874 (1.0)      0.0000 (1.0)      935.5874 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.0349 (1.0)      7.0349 (1.0)      7.0349 (1.0)      0.0000 (1.0)      7.0349 (1.0)      0.0000 (1.0)           0;0  0.1421 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.1304 (1.01)     7.1304 (1.01)     7.1304 (1.01)     0.0000 (1.0)      7.1304 (1.01)     0.0000 (1.0)           0;0  0.1402 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.7734 (3.70)     20.7734 (3.70)     20.7734 (3.70)     0.0000 (1.0)      20.7734 (3.70)     0.0000 (1.0)           0;0  0.0481 (0.27)          1           1
test_status-status[3.10.0]     21.8284 (3.89)     21.8284 (3.89)     21.8284 (3.89)     0.0000 (1.0)      21.8284 (3.89)     0.0000 (1.0)           0;0  0.0458 (0.26)          1           1
test_status-status[3.53.2]     19.5640 (3.48)     19.5640 (3.48)     19.5640 (3.48)     0.0000 (1.0)      19.5640 (3.48)     0.0000 (1.0)           0;0  0.0511 (0.29)          1           1
test_status-status[3.60.1]      5.6178 (1.0)       5.6178 (1.0)       5.6178 (1.0)      0.0000 (1.0)       5.6178 (1.0)      0.0000 (1.0)           0;0  0.1780 (1.0)           1           1
test_status-status[main]        6.0120 (1.07)      6.0120 (1.07)      6.0120 (1.07)     0.0000 (1.0)       6.0120 (1.07)     0.0000 (1.0)           0;0  0.1663 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.2142 (1.83)     5.2142 (1.83)     5.2142 (1.83)     0.0000 (1.0)      5.2142 (1.83)     0.0000 (1.0)           0;0  0.1918 (0.55)          1           1
test_status-status-changed[3.10.0]     5.3773 (1.89)     5.3773 (1.89)     5.3773 (1.89)     0.0000 (1.0)      5.3773 (1.89)     0.0000 (1.0)           0;0  0.1860 (0.53)          1           1
test_status-status-changed[3.53.2]     5.3933 (1.90)     5.3933 (1.90)     5.3933 (1.90)     0.0000 (1.0)      5.3933 (1.90)     0.0000 (1.0)           0;0  0.1854 (0.53)          1           1
test_status-status-changed[3.60.1]     2.8439 (1.0)      2.8439 (1.0)      2.8439 (1.0)      0.0000 (1.0)      2.8439 (1.0)      0.0000 (1.0)           0;0  0.3516 (1.0)           1           1
test_status-status-changed[main]       3.0389 (1.07)     3.0389 (1.07)     3.0389 (1.07)     0.0000 (1.0)      3.0389 (1.07)     0.0000 (1.0)           0;0  0.3291 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.1014 (1.90)     5.1014 (1.90)     5.1014 (1.90)     0.0000 (1.0)      5.1014 (1.90)     0.0000 (1.0)           0;0  0.1960 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     5.3136 (1.98)     5.3136 (1.98)     5.3136 (1.98)     0.0000 (1.0)      5.3136 (1.98)     0.0000 (1.0)           0;0  0.1882 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     5.1101 (1.90)     5.1101 (1.90)     5.1101 (1.90)     0.0000 (1.0)      5.1101 (1.90)     0.0000 (1.0)           0;0  0.1957 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.6892 (1.0)      2.6892 (1.0)      2.6892 (1.0)      0.0000 (1.0)      2.6892 (1.0)      0.0000 (1.0)           0;0  0.3719 (1.0)           1           1
test_status-status-changed-noop[main]       2.8526 (1.06)     2.8526 (1.06)     2.8526 (1.06)     0.0000 (1.0)      2.8526 (1.06)     0.0000 (1.0)           0;0  0.3506 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1679 (1.92)     5.1679 (1.92)     5.1679 (1.92)     0.0000 (1.0)      5.1679 (1.92)     0.0000 (1.0)           0;0  0.1935 (0.52)          1           1
test_status-status-noop[3.10.0]     5.4211 (2.01)     5.4211 (2.01)     5.4211 (2.01)     0.0000 (1.0)      5.4211 (2.01)     0.0000 (1.0)           0;0  0.1845 (0.50)          1           1
test_status-status-noop[3.53.2]     5.1856 (1.92)     5.1856 (1.92)     5.1856 (1.92)     0.0000 (1.0)      5.1856 (1.92)     0.0000 (1.0)           0;0  0.1928 (0.52)          1           1
test_status-status-noop[3.60.1]     2.6986 (1.0)      2.6986 (1.0)      2.6986 (1.0)      0.0000 (1.0)      2.6986 (1.0)      0.0000 (1.0)           0;0  0.3706 (1.0)           1           1
test_status-status-noop[main]       2.8445 (1.05)     2.8445 (1.05)     2.8445 (1.05)     0.0000 (1.0)      2.8445 (1.05)     0.0000 (1.0)           0;0  0.3516 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     200.1113 (4.27)     200.1113 (4.27)     200.1113 (4.27)     0.0000 (1.0)      200.1113 (4.27)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.10.0]     205.7040 (4.39)     205.7040 (4.39)     205.7040 (4.39)     0.0000 (1.0)      205.7040 (4.39)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.53.2]     120.8649 (2.58)     120.8649 (2.58)     120.8649 (2.58)     0.0000 (1.0)      120.8649 (2.58)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_update-import-url[3.60.1]      46.8565 (1.0)       46.8565 (1.0)       46.8565 (1.0)      0.0000 (1.0)       46.8565 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_update-import-url[main]        48.3356 (1.03)      48.3356 (1.03)      48.3356 (1.03)     0.0000 (1.0)       48.3356 (1.03)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     187.0639 (5.27)     187.0639 (5.27)     187.0639 (5.27)     0.0000 (1.0)      187.0639 (5.27)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.10.0]     187.8280 (5.29)     187.8280 (5.29)     187.8280 (5.29)     0.0000 (1.0)      187.8280 (5.29)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.53.2]     111.3582 (3.14)     111.3582 (3.14)     111.3582 (3.14)     0.0000 (1.0)      111.3582 (3.14)     0.0000 (1.0)           0;0  0.0090 (0.32)          1           1
test_update-update[3.60.1]      35.5083 (1.0)       35.5083 (1.0)       35.5083 (1.0)      0.0000 (1.0)       35.5083 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        36.0898 (1.02)      36.0898 (1.02)      36.0898 (1.02)     0.0000 (1.0)       36.0898 (1.02)     0.0000 (1.0)           0;0  0.0277 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.2080 (2.25)     17.2080 (2.25)     17.2080 (2.25)     0.0000 (1.0)      17.2080 (2.25)     0.0000 (1.0)           0;0  0.0581 (0.44)          1           1
test_update-update-noop[3.10.0]     17.7002 (2.32)     17.7002 (2.32)     17.7002 (2.32)     0.0000 (1.0)      17.7002 (2.32)     0.0000 (1.0)           0;0  0.0565 (0.43)          1           1
test_update-update-noop[3.53.2]     17.1572 (2.24)     17.1572 (2.24)     17.1572 (2.24)     0.0000 (1.0)      17.1572 (2.24)     0.0000 (1.0)           0;0  0.0583 (0.45)          1           1
test_update-update-noop[3.60.1]      7.6428 (1.0)       7.6428 (1.0)       7.6428 (1.0)      0.0000 (1.0)       7.6428 (1.0)      0.0000 (1.0)           0;0  0.1308 (1.0)           1           1
test_update-update-noop[main]        8.1545 (1.07)      8.1545 (1.07)      8.1545 (1.07)     0.0000 (1.0)       8.1545 (1.07)     0.0000 (1.0)           0;0  0.1226 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean