Tue Mar 31 01:45:32 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     80.6594 (3.63)     80.6594 (3.63)     80.6594 (3.63)     0.0000 (1.0)      80.6594 (3.63)     0.0000 (1.0)           0;0  0.0124 (0.28)          1           1
test_add_copy-add[3.10.0]     81.1821 (3.66)     81.1821 (3.66)     81.1821 (3.66)     0.0000 (1.0)      81.1821 (3.66)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_add_copy-add[3.53.2]     73.7571 (3.32)     73.7571 (3.32)     73.7571 (3.32)     0.0000 (1.0)      73.7571 (3.32)     0.0000 (1.0)           0;0  0.0136 (0.30)          1           1
test_add_copy-add[3.60.1]     22.1945 (1.0)      22.1945 (1.0)      22.1945 (1.0)      0.0000 (1.0)      22.1945 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
test_add_copy-add[main]       23.4710 (1.06)     23.4710 (1.06)     23.4710 (1.06)     0.0000 (1.0)      23.4710 (1.06)     0.0000 (1.0)           0;0  0.0426 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     25.9299 (6.51)     25.9299 (6.51)     25.9299 (6.51)     0.0000 (1.0)      25.9299 (6.51)     0.0000 (1.0)           0;0  0.0386 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     26.1367 (6.57)     26.1367 (6.57)     26.1367 (6.57)     0.0000 (1.0)      26.1367 (6.57)     0.0000 (1.0)           0;0  0.0383 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     24.9486 (6.27)     24.9486 (6.27)     24.9486 (6.27)     0.0000 (1.0)      24.9486 (6.27)     0.0000 (1.0)           0;0  0.0401 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      3.9810 (1.0)       3.9810 (1.0)       3.9810 (1.0)      0.0000 (1.0)       3.9810 (1.0)      0.0000 (1.0)           0;0  0.2512 (1.0)           1           1
test_add_copy-add-noop[main]        4.2220 (1.06)      4.2220 (1.06)      4.2220 (1.06)     0.0000 (1.0)       4.2220 (1.06)     0.0000 (1.0)           0;0  0.2369 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     65.5551 (4.08)     65.5551 (4.08)     65.5551 (4.08)     0.0000 (1.0)      65.5551 (4.08)     0.0000 (1.0)           0;0  0.0153 (0.25)          1           1
test_add_hardlink-add[3.10.0]     67.0154 (4.17)     67.0154 (4.17)     67.0154 (4.17)     0.0000 (1.0)      67.0154 (4.17)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.53.2]     61.0296 (3.79)     61.0296 (3.79)     61.0296 (3.79)     0.0000 (1.0)      61.0296 (3.79)     0.0000 (1.0)           0;0  0.0164 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.0854 (1.0)      16.0854 (1.0)      16.0854 (1.0)      0.0000 (1.0)      16.0854 (1.0)      0.0000 (1.0)           0;0  0.0622 (1.0)           1           1
test_add_hardlink-add[main]       17.8408 (1.11)     17.8408 (1.11)     17.8408 (1.11)     0.0000 (1.0)      17.8408 (1.11)     0.0000 (1.0)           0;0  0.0561 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.2746 (7.60)     33.2746 (7.60)     33.2746 (7.60)     0.0000 (1.0)      33.2746 (7.60)     0.0000 (1.0)           0;0  0.0301 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     33.7339 (7.71)     33.7339 (7.71)     33.7339 (7.71)     0.0000 (1.0)      33.7339 (7.71)     0.0000 (1.0)           0;0  0.0296 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.8448 (7.28)     31.8448 (7.28)     31.8448 (7.28)     0.0000 (1.0)      31.8448 (7.28)     0.0000 (1.0)           0;0  0.0314 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3757 (1.0)       4.3757 (1.0)       4.3757 (1.0)      0.0000 (1.0)       4.3757 (1.0)      0.0000 (1.0)           0;0  0.2285 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4482 (1.02)      4.4482 (1.02)      4.4482 (1.02)     0.0000 (1.0)       4.4482 (1.02)     0.0000 (1.0)           0;0  0.2248 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     51.9216 (2.21)     51.9216 (2.21)     51.9216 (2.21)     0.0000 (1.0)      51.9216 (2.21)     0.0000 (1.0)           0;0  0.0193 (0.45)          1           1
test_add_symlink-add[3.10.0]     52.8247 (2.25)     52.8247 (2.25)     52.8247 (2.25)     0.0000 (1.0)      52.8247 (2.25)     0.0000 (1.0)           0;0  0.0189 (0.44)          1           1
test_add_symlink-add[3.53.2]     48.1495 (2.05)     48.1495 (2.05)     48.1495 (2.05)     0.0000 (1.0)      48.1495 (2.05)     0.0000 (1.0)           0;0  0.0208 (0.49)          1           1
test_add_symlink-add[3.60.1]     23.4834 (1.0)      23.4834 (1.0)      23.4834 (1.0)      0.0000 (1.0)      23.4834 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
test_add_symlink-add[main]       25.6234 (1.09)     25.6234 (1.09)     25.6234 (1.09)     0.0000 (1.0)      25.6234 (1.09)     0.0000 (1.0)           0;0  0.0390 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     35.4149 (8.25)     35.4149 (8.25)     35.4149 (8.25)     0.0000 (1.0)      35.4149 (8.25)     0.0000 (1.0)           0;0  0.0282 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     35.7863 (8.33)     35.7863 (8.33)     35.7863 (8.33)     0.0000 (1.0)      35.7863 (8.33)     0.0000 (1.0)           0;0  0.0279 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     32.5062 (7.57)     32.5062 (7.57)     32.5062 (7.57)     0.0000 (1.0)      32.5062 (7.57)     0.0000 (1.0)           0;0  0.0308 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      4.2938 (1.0)       4.2938 (1.0)       4.2938 (1.0)      0.0000 (1.0)       4.2938 (1.0)      0.0000 (1.0)           0;0  0.2329 (1.0)           1           1
test_add_symlink-add-noop[main]        4.6275 (1.08)      4.6275 (1.08)      4.6275 (1.08)     0.0000 (1.0)       4.6275 (1.08)     0.0000 (1.0)           0;0  0.2161 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      39.0803 (1.89)      39.0803 (1.89)      39.0803 (1.89)     0.0000 (1.0)       39.0803 (1.89)     0.0000 (1.0)           0;0  0.0256 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     103.9941 (5.03)     103.9941 (5.03)     103.9941 (5.03)     0.0000 (1.0)      103.9941 (5.03)     0.0000 (1.0)           0;0  0.0096 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      27.6784 (1.34)      27.6784 (1.34)      27.6784 (1.34)     0.0000 (1.0)       27.6784 (1.34)     0.0000 (1.0)           0;0  0.0361 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]      20.6671 (1.0)       20.6671 (1.0)       20.6671 (1.0)      0.0000 (1.0)       20.6671 (1.0)      0.0000 (1.0)           0;0  0.0484 (1.0)           1           1
test_checkout_copy-checkout[main]        22.0387 (1.07)      22.0387 (1.07)      22.0387 (1.07)     0.0000 (1.0)       22.0387 (1.07)     0.0000 (1.0)           0;0  0.0454 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4711 (1.77)     5.4711 (1.77)     5.4711 (1.77)     0.0000 (1.0)      5.4711 (1.77)     0.0000 (1.0)           0;0  0.1828 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6008 (1.81)     5.6008 (1.81)     5.6008 (1.81)     0.0000 (1.0)      5.6008 (1.81)     0.0000 (1.0)           0;0  0.1785 (0.55)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5575 (1.79)     5.5575 (1.79)     5.5575 (1.79)     0.0000 (1.0)      5.5575 (1.79)     0.0000 (1.0)           0;0  0.1799 (0.56)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.0996 (1.0)      3.0996 (1.0)      3.0996 (1.0)      0.0000 (1.0)      3.0996 (1.0)      0.0000 (1.0)           0;0  0.3226 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3316 (1.07)     3.3316 (1.07)     3.3316 (1.07)     0.0000 (1.0)      3.3316 (1.07)     0.0000 (1.0)           0;0  0.3002 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.4757 (1.91)     7.4757 (1.91)     7.4757 (1.91)     0.0000 (1.0)      7.4757 (1.91)     0.0000 (1.0)           0;0  0.1338 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3819 (1.63)     6.3819 (1.63)     6.3819 (1.63)     0.0000 (1.0)      6.3819 (1.63)     0.0000 (1.0)           0;0  0.1567 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2337 (1.60)     6.2337 (1.60)     6.2337 (1.60)     0.0000 (1.0)      6.2337 (1.60)     0.0000 (1.0)           0;0  0.1604 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9071 (1.0)      3.9071 (1.0)      3.9071 (1.0)      0.0000 (1.0)      3.9071 (1.0)      0.0000 (1.0)           0;0  0.2559 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3843 (1.12)     4.3843 (1.12)     4.3843 (1.12)     0.0000 (1.0)      4.3843 (1.12)     0.0000 (1.0)           0;0  0.2281 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.0700 (2.89)     21.0700 (2.89)     21.0700 (2.89)     0.0000 (1.0)      21.0700 (2.89)     0.0000 (1.0)           0;0  0.0475 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7844 (2.16)     15.7844 (2.16)     15.7844 (2.16)     0.0000 (1.0)      15.7844 (2.16)     0.0000 (1.0)           0;0  0.0634 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.1301 (1.94)     14.1301 (1.94)     14.1301 (1.94)     0.0000 (1.0)      14.1301 (1.94)     0.0000 (1.0)           0;0  0.0708 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2919 (1.0)       7.2919 (1.0)       7.2919 (1.0)      0.0000 (1.0)       7.2919 (1.0)      0.0000 (1.0)           0;0  0.1371 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1592 (1.12)      8.1592 (1.12)      8.1592 (1.12)     0.0000 (1.0)       8.1592 (1.12)     0.0000 (1.0)           0;0  0.1226 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3750 (1.73)     5.3750 (1.73)     5.3750 (1.73)     0.0000 (1.0)      5.3750 (1.73)     0.0000 (1.0)           0;0  0.1860 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5815 (1.79)     5.5815 (1.79)     5.5815 (1.79)     0.0000 (1.0)      5.5815 (1.79)     0.0000 (1.0)           0;0  0.1792 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3548 (1.72)     5.3548 (1.72)     5.3548 (1.72)     0.0000 (1.0)      5.3548 (1.72)     0.0000 (1.0)           0;0  0.1867 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.1137 (1.0)      3.1137 (1.0)      3.1137 (1.0)      0.0000 (1.0)      3.1137 (1.0)      0.0000 (1.0)           0;0  0.3212 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.3612 (1.08)     3.3612 (1.08)     3.3612 (1.08)     0.0000 (1.0)      3.3612 (1.08)     0.0000 (1.0)           0;0  0.2975 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.5057 (2.01)     7.5057 (2.01)     7.5057 (2.01)     0.0000 (1.0)      7.5057 (2.01)     0.0000 (1.0)           0;0  0.1332 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3149 (1.69)     6.3149 (1.69)     6.3149 (1.69)     0.0000 (1.0)      6.3149 (1.69)     0.0000 (1.0)           0;0  0.1584 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1806 (1.66)     6.1806 (1.66)     6.1806 (1.66)     0.0000 (1.0)      6.1806 (1.66)     0.0000 (1.0)           0;0  0.1618 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.7259 (1.0)      3.7259 (1.0)      3.7259 (1.0)      0.0000 (1.0)      3.7259 (1.0)      0.0000 (1.0)           0;0  0.2684 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3132 (1.16)     4.3132 (1.16)     4.3132 (1.16)     0.0000 (1.0)      4.3132 (1.16)     0.0000 (1.0)           0;0  0.2318 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9804 (2.46)     24.9804 (2.46)     24.9804 (2.46)     0.0000 (1.0)      24.9804 (2.46)     0.0000 (1.0)           0;0  0.0400 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     19.9708 (1.96)     19.9708 (1.96)     19.9708 (1.96)     0.0000 (1.0)      19.9708 (1.96)     0.0000 (1.0)           0;0  0.0501 (0.51)          1           1
test_checkout_symlink-checkout[3.53.2]     17.7975 (1.75)     17.7975 (1.75)     17.7975 (1.75)     0.0000 (1.0)      17.7975 (1.75)     0.0000 (1.0)           0;0  0.0562 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1676 (1.0)      10.1676 (1.0)      10.1676 (1.0)      0.0000 (1.0)      10.1676 (1.0)      0.0000 (1.0)           0;0  0.0984 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.8786 (1.07)     10.8786 (1.07)     10.8786 (1.07)     0.0000 (1.0)      10.8786 (1.07)     0.0000 (1.0)           0;0  0.0919 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.9183 (1.65)     6.9183 (1.65)     6.9183 (1.65)     0.0000 (1.0)      6.9183 (1.65)     0.0000 (1.0)           0;0  0.1445 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8718 (1.64)     6.8718 (1.64)     6.8718 (1.64)     0.0000 (1.0)      6.8718 (1.64)     0.0000 (1.0)           0;0  0.1455 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7511 (1.61)     6.7511 (1.61)     6.7511 (1.61)     0.0000 (1.0)      6.7511 (1.61)     0.0000 (1.0)           0;0  0.1481 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1867 (1.0)      4.1867 (1.0)      4.1867 (1.0)      0.0000 (1.0)      4.1867 (1.0)      0.0000 (1.0)           0;0  0.2389 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4513 (1.06)     4.4513 (1.06)     4.4513 (1.06)     0.0000 (1.0)      4.4513 (1.06)     0.0000 (1.0)           0;0  0.2247 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.7606 (1.71)     9.7606 (1.71)     9.7606 (1.71)     0.0000 (1.0)      9.7606 (1.71)     0.0000 (1.0)           0;0  0.1025 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.7087 (1.53)     8.7087 (1.53)     8.7087 (1.53)     0.0000 (1.0)      8.7087 (1.53)     0.0000 (1.0)           0;0  0.1148 (0.65)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.5300 (1.50)     8.5300 (1.50)     8.5300 (1.50)     0.0000 (1.0)      8.5300 (1.50)     0.0000 (1.0)           0;0  0.1172 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.6967 (1.0)      5.6967 (1.0)      5.6967 (1.0)      0.0000 (1.0)      5.6967 (1.0)      0.0000 (1.0)           0;0  0.1755 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.2279 (1.09)     6.2279 (1.09)     6.2279 (1.09)     0.0000 (1.0)      6.2279 (1.09)     0.0000 (1.0)           0;0  0.1606 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9645 (1.68)     3.9645 (1.68)     3.9645 (1.68)     0.0000 (1.0)      3.9645 (1.68)     0.0000 (1.0)           0;0  0.2522 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.8675 (2.07)     4.8675 (2.07)     4.8675 (2.07)     0.0000 (1.0)      4.8675 (2.07)     0.0000 (1.0)           0;0  0.2054 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.6964 (1.99)     4.6964 (1.99)     4.6964 (1.99)     0.0000 (1.0)      4.6964 (1.99)     0.0000 (1.0)           0;0  0.2129 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3566 (1.0)      2.3566 (1.0)      2.3566 (1.0)      0.0000 (1.0)      2.3566 (1.0)      0.0000 (1.0)           0;0  0.4243 (1.0)           1           1
test_data_status-data-changed[main]       2.5785 (1.09)     2.5785 (1.09)     2.5785 (1.09)     0.0000 (1.0)      2.5785 (1.09)     0.0000 (1.0)           0;0  0.3878 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2498 (1.78)     4.2498 (1.78)     4.2498 (1.78)     0.0000 (1.0)      4.2498 (1.78)     0.0000 (1.0)           0;0  0.2353 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8590 (2.04)     4.8590 (2.04)     4.8590 (2.04)     0.0000 (1.0)      4.8590 (2.04)     0.0000 (1.0)           0;0  0.2058 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8914 (2.05)     4.8914 (2.05)     4.8914 (2.05)     0.0000 (1.0)      4.8914 (2.05)     0.0000 (1.0)           0;0  0.2044 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3829 (1.0)      2.3829 (1.0)      2.3829 (1.0)      0.0000 (1.0)      2.3829 (1.0)      0.0000 (1.0)           0;0  0.4197 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5474 (1.07)     2.5474 (1.07)     2.5474 (1.07)     0.0000 (1.0)      2.5474 (1.07)     0.0000 (1.0)           0;0  0.3926 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.1900 (3.59)     18.1900 (3.59)     18.1900 (3.59)     0.0000 (1.0)      18.1900 (3.59)     0.0000 (1.0)           0;0  0.0550 (0.28)          1           1
test_data_status-data-new[3.10.0]     19.6358 (3.87)     19.6358 (3.87)     19.6358 (3.87)     0.0000 (1.0)      19.6358 (3.87)     0.0000 (1.0)           0;0  0.0509 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.8428 (3.72)     18.8428 (3.72)     18.8428 (3.72)     0.0000 (1.0)      18.8428 (3.72)     0.0000 (1.0)           0;0  0.0531 (0.27)          1           1
test_data_status-data-new[3.60.1]      5.0720 (1.0)       5.0720 (1.0)       5.0720 (1.0)      0.0000 (1.0)       5.0720 (1.0)      0.0000 (1.0)           0;0  0.1972 (1.0)           1           1
test_data_status-data-new[main]        5.3797 (1.06)      5.3797 (1.06)      5.3797 (1.06)     0.0000 (1.0)       5.3797 (1.06)     0.0000 (1.0)           0;0  0.1859 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2552 (1.81)     4.2552 (1.81)     4.2552 (1.81)     0.0000 (1.0)      4.2552 (1.81)     0.0000 (1.0)           0;0  0.2350 (0.55)          1           1
test_data_status-data-noop[3.10.0]     5.1762 (2.20)     5.1762 (2.20)     5.1762 (2.20)     0.0000 (1.0)      5.1762 (2.20)     0.0000 (1.0)           0;0  0.1932 (0.46)          1           1
test_data_status-data-noop[3.53.2]     4.8658 (2.07)     4.8658 (2.07)     4.8658 (2.07)     0.0000 (1.0)      4.8658 (2.07)     0.0000 (1.0)           0;0  0.2055 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.3557 (1.0)      2.3557 (1.0)      2.3557 (1.0)      0.0000 (1.0)      2.3557 (1.0)      0.0000 (1.0)           0;0  0.4245 (1.0)           1           1
test_data_status-data-noop[main]       2.5442 (1.08)     2.5442 (1.08)     2.5442 (1.08)     0.0000 (1.0)      2.5442 (1.08)     0.0000 (1.0)           0;0  0.3931 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2115 (1.28)     7.2115 (1.28)     7.2115 (1.28)     0.0000 (1.0)      7.2115 (1.28)     0.0000 (1.0)           0;0  0.1387 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.9464 (1.41)     7.9464 (1.41)     7.9464 (1.41)     0.0000 (1.0)      7.9464 (1.41)     0.0000 (1.0)           0;0  0.1258 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.9862 (1.42)     7.9862 (1.42)     7.9862 (1.42)     0.0000 (1.0)      7.9862 (1.42)     0.0000 (1.0)           0;0  0.1252 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6388 (1.0)      5.6388 (1.0)      5.6388 (1.0)      0.0000 (1.0)      5.6388 (1.0)      0.0000 (1.0)           0;0  0.1773 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.0443 (1.07)     6.0443 (1.07)     6.0443 (1.07)     0.0000 (1.0)      6.0443 (1.07)     0.0000 (1.0)           0;0  0.1654 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1600 (1.25)     7.1600 (1.25)     7.1600 (1.25)     0.0000 (1.0)      7.1600 (1.25)     0.0000 (1.0)           0;0  0.1397 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     8.1501 (1.43)     8.1501 (1.43)     8.1501 (1.43)     0.0000 (1.0)      8.1501 (1.43)     0.0000 (1.0)           0;0  0.1227 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.9320 (1.39)     7.9320 (1.39)     7.9320 (1.39)     0.0000 (1.0)      7.9320 (1.39)     0.0000 (1.0)           0;0  0.1261 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7058 (1.0)      5.7058 (1.0)      5.7058 (1.0)      0.0000 (1.0)      5.7058 (1.0)      0.0000 (1.0)           0;0  0.1753 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.0846 (1.07)     6.0846 (1.07)     6.0846 (1.07)     0.0000 (1.0)      6.0846 (1.07)     0.0000 (1.0)           0;0  0.1643 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.9177 (2.64)     21.9177 (2.64)     21.9177 (2.64)     0.0000 (1.0)      21.9177 (2.64)     0.0000 (1.0)           0;0  0.0456 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.5029 (2.83)     23.5029 (2.83)     23.5029 (2.83)     0.0000 (1.0)      23.5029 (2.83)     0.0000 (1.0)           0;0  0.0425 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.6893 (2.73)     22.6893 (2.73)     22.6893 (2.73)     0.0000 (1.0)      22.6893 (2.73)     0.0000 (1.0)           0;0  0.0441 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.2984 (1.0)       8.2984 (1.0)       8.2984 (1.0)      0.0000 (1.0)       8.2984 (1.0)      0.0000 (1.0)           0;0  0.1205 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.9433 (1.08)      8.9433 (1.08)      8.9433 (1.08)     0.0000 (1.0)       8.9433 (1.08)     0.0000 (1.0)           0;0  0.1118 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5603 (1.33)     6.5603 (1.33)     6.5603 (1.33)     0.0000 (1.0)      6.5603 (1.33)     0.0000 (1.0)           0;0  0.1524 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.4415 (1.51)     7.4415 (1.51)     7.4415 (1.51)     0.0000 (1.0)      7.4415 (1.51)     0.0000 (1.0)           0;0  0.1344 (0.66)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.3890 (1.50)     7.3890 (1.50)     7.3890 (1.50)     0.0000 (1.0)      7.3890 (1.50)     0.0000 (1.0)           0;0  0.1353 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.9290 (1.0)      4.9290 (1.0)      4.9290 (1.0)      0.0000 (1.0)      4.9290 (1.0)      0.0000 (1.0)           0;0  0.2029 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.3852 (1.09)     5.3852 (1.09)     5.3852 (1.09)     0.0000 (1.0)      5.3852 (1.09)     0.0000 (1.0)           0;0  0.1857 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.6525 (2.70)     17.6525 (2.70)     17.6525 (2.70)     0.0000 (1.0)      17.6525 (2.70)     0.0000 (1.0)           0;0  0.0566 (0.37)          1           1
test_diff-diff[3.10.0]     18.8203 (2.88)     18.8203 (2.88)     18.8203 (2.88)     0.0000 (1.0)      18.8203 (2.88)     0.0000 (1.0)           0;0  0.0531 (0.35)          1           1
test_diff-diff[3.53.2]     18.6888 (2.86)     18.6888 (2.86)     18.6888 (2.86)     0.0000 (1.0)      18.6888 (2.86)     0.0000 (1.0)           0;0  0.0535 (0.35)          1           1
test_diff-diff[3.60.1]      6.5407 (1.0)       6.5407 (1.0)       6.5407 (1.0)      0.0000 (1.0)       6.5407 (1.0)      0.0000 (1.0)           0;0  0.1529 (1.0)           1           1
test_diff-diff[main]        7.9570 (1.22)      7.9570 (1.22)      7.9570 (1.22)     0.0000 (1.0)       7.9570 (1.22)     0.0000 (1.0)           0;0  0.1257 (0.82)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.7204 (1.79)     5.7204 (1.79)     5.7204 (1.79)     0.0000 (1.0)      5.7204 (1.79)     0.0000 (1.0)           0;0  0.1748 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.6431 (2.08)     6.6431 (2.08)     6.6431 (2.08)     0.0000 (1.0)      6.6431 (2.08)     0.0000 (1.0)           0;0  0.1505 (0.48)          1           1
test_diff-diff-changed[3.53.2]     5.6330 (1.77)     5.6330 (1.77)     5.6330 (1.77)     0.0000 (1.0)      5.6330 (1.77)     0.0000 (1.0)           0;0  0.1775 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.1912 (1.0)      3.1912 (1.0)      3.1912 (1.0)      0.0000 (1.0)      3.1912 (1.0)      0.0000 (1.0)           0;0  0.3134 (1.0)           1           1
test_diff-diff-changed[main]       4.1904 (1.31)     4.1904 (1.31)     4.1904 (1.31)     0.0000 (1.0)      4.1904 (1.31)     0.0000 (1.0)           0;0  0.2386 (0.76)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.9131 (1.54)     4.9131 (1.54)     4.9131 (1.54)     0.0000 (1.0)      4.9131 (1.54)     0.0000 (1.0)           0;0  0.2035 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.5248 (1.73)     5.5248 (1.73)     5.5248 (1.73)     0.0000 (1.0)      5.5248 (1.73)     0.0000 (1.0)           0;0  0.1810 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4182 (1.70)     5.4182 (1.70)     5.4182 (1.70)     0.0000 (1.0)      5.4182 (1.70)     0.0000 (1.0)           0;0  0.1846 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.1914 (1.0)      3.1914 (1.0)      3.1914 (1.0)      0.0000 (1.0)      3.1914 (1.0)      0.0000 (1.0)           0;0  0.3133 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1764 (1.31)     4.1764 (1.31)     4.1764 (1.31)     0.0000 (1.0)      4.1764 (1.31)     0.0000 (1.0)           0;0  0.2394 (0.76)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0877 (1.26)     4.0877 (1.26)     4.0877 (1.26)     0.0000 (1.0)      4.0877 (1.26)     0.0000 (1.0)           0;0  0.2446 (0.79)          1           1
test_diff-diff-noop[3.10.0]     4.5915 (1.42)     4.5915 (1.42)     4.5915 (1.42)     0.0000 (1.0)      4.5915 (1.42)     0.0000 (1.0)           0;0  0.2178 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.4732 (1.69)     5.4732 (1.69)     5.4732 (1.69)     0.0000 (1.0)      5.4732 (1.69)     0.0000 (1.0)           0;0  0.1827 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.2399 (1.0)      3.2399 (1.0)      3.2399 (1.0)      0.0000 (1.0)      3.2399 (1.0)      0.0000 (1.0)           0;0  0.3087 (1.0)           1           1
test_diff-diff-noop[main]       4.0840 (1.26)     4.0840 (1.26)     4.0840 (1.26)     0.0000 (1.0)      4.0840 (1.26)     0.0000 (1.0)           0;0  0.2449 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.2148 (1.0)      1.2148 (1.0)      1.2148 (1.0)      0.0000 (1.0)      1.2148 (1.0)      0.0000 (1.0)           0;0  0.8232 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.2642 (4.33)     5.2642 (4.33)     5.2642 (4.33)     0.0000 (1.0)      5.2642 (4.33)     0.0000 (1.0)           0;0  0.1900 (0.23)          1           1
test_exp_show-exp[3.53.2]     3.3601 (2.77)     3.3601 (2.77)     3.3601 (2.77)     0.0000 (1.0)      3.3601 (2.77)     0.0000 (1.0)           0;0  0.2976 (0.36)          1           1
test_exp_show-exp[3.60.1]     3.4854 (2.87)     3.4854 (2.87)     3.4854 (2.87)     0.0000 (1.0)      3.4854 (2.87)     0.0000 (1.0)           0;0  0.2869 (0.35)          1           1
test_exp_show-exp[main]       7.4361 (6.12)     7.4361 (6.12)     7.4361 (6.12)     0.0000 (1.0)      7.4361 (6.12)     0.0000 (1.0)           0;0  0.1345 (0.16)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     106.2582 (4.61)     106.2582 (4.61)     106.2582 (4.61)     0.0000 (1.0)      106.2582 (4.61)     0.0000 (1.0)           0;0  0.0094 (0.22)          1           1
test_fetch-fetch[3.10.0]     111.7085 (4.85)     111.7085 (4.85)     111.7085 (4.85)     0.0000 (1.0)      111.7085 (4.85)     0.0000 (1.0)           0;0  0.0090 (0.21)          1           1
test_fetch-fetch[3.53.2]      33.4656 (1.45)      33.4656 (1.45)      33.4656 (1.45)     0.0000 (1.0)       33.4656 (1.45)     0.0000 (1.0)           0;0  0.0299 (0.69)          1           1
test_fetch-fetch[3.60.1]      23.0422 (1.0)       23.0422 (1.0)       23.0422 (1.0)      0.0000 (1.0)       23.0422 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
test_fetch-fetch[main]        23.0850 (1.00)      23.0850 (1.00)      23.0850 (1.00)     0.0000 (1.0)       23.0850 (1.00)     0.0000 (1.0)           0;0  0.0433 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8209 (1.0)      2.8209 (1.0)      2.8209 (1.0)      0.0000 (1.0)      2.8209 (1.0)      0.0000 (1.0)           0;0  0.3545 (1.0)           1           1
test_gc-gc[3.10.0]     3.1490 (1.12)     3.1490 (1.12)     3.1490 (1.12)     0.0000 (1.0)      3.1490 (1.12)     0.0000 (1.0)           0;0  0.3176 (0.90)          1           1
test_gc-gc[3.53.2]     2.8660 (1.02)     2.8660 (1.02)     2.8660 (1.02)     0.0000 (1.0)      2.8660 (1.02)     0.0000 (1.0)           0;0  0.3489 (0.98)          1           1
test_gc-gc[3.60.1]     2.9065 (1.03)     2.9065 (1.03)     2.9065 (1.03)     0.0000 (1.0)      2.9065 (1.03)     0.0000 (1.0)           0;0  0.3441 (0.97)          1           1
test_gc-gc[main]       3.0599 (1.08)     3.0599 (1.08)     3.0599 (1.08)     0.0000 (1.0)      3.0599 (1.08)     0.0000 (1.0)           0;0  0.3268 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     189.0008 (3.53)     189.0008 (3.53)     189.0008 (3.53)     0.0000 (1.0)      189.0008 (3.53)     0.0000 (1.0)           0;0  0.0053 (0.28)          1           1
test_get-get[3.10.0]     225.2383 (4.21)     225.2383 (4.21)     225.2383 (4.21)     0.0000 (1.0)      225.2383 (4.21)     0.0000 (1.0)           0;0  0.0044 (0.24)          1           1
test_get-get[3.53.2]     174.8206 (3.27)     174.8206 (3.27)     174.8206 (3.27)     0.0000 (1.0)      174.8206 (3.27)     0.0000 (1.0)           0;0  0.0057 (0.31)          1           1
test_get-get[3.60.1]      53.8203 (1.01)      53.8203 (1.01)      53.8203 (1.01)     0.0000 (1.0)       53.8203 (1.01)     0.0000 (1.0)           0;0  0.0186 (0.99)          1           1
test_get-get[main]        53.5396 (1.0)       53.5396 (1.0)       53.5396 (1.0)      0.0000 (1.0)       53.5396 (1.0)      0.0000 (1.0)           0;0  0.0187 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     91.2651 (5.47)     91.2651 (5.47)     91.2651 (5.47)     0.0000 (1.0)      91.2651 (5.47)     0.0000 (1.0)           0;0  0.0110 (0.18)          1           1
test_get_url-get-url[3.10.0]     93.6793 (5.62)     93.6793 (5.62)     93.6793 (5.62)     0.0000 (1.0)      93.6793 (5.62)     0.0000 (1.0)           0;0  0.0107 (0.18)          1           1
test_get_url-get-url[3.53.2]     16.8913 (1.01)     16.8913 (1.01)     16.8913 (1.01)     0.0000 (1.0)      16.8913 (1.01)     0.0000 (1.0)           0;0  0.0592 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.6809 (1.0)      16.6809 (1.0)      16.6809 (1.0)      0.0000 (1.0)      16.6809 (1.0)      0.0000 (1.0)           0;0  0.0599 (1.0)           1           1
test_get_url-get-url[main]       17.0357 (1.02)     17.0357 (1.02)     17.0357 (1.02)     0.0000 (1.0)      17.0357 (1.02)     0.0000 (1.0)           0;0  0.0587 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     139.2922 (1.04)     149.9187 (1.0)      143.2018 (1.04)     2.2645 (1.27)     143.1873 (1.04)     3.2627 (1.44)         32;1  6.9832 (0.96)        100           1
test_help---help[3.10.0]     137.4333 (1.03)     155.4902 (1.04)     142.6087 (1.03)     2.8339 (1.59)     142.5834 (1.03)     3.0607 (1.35)         24;3  7.0122 (0.97)        100           1
test_help---help[3.53.2]     141.5249 (1.06)     150.1278 (1.00)     144.8308 (1.05)     1.7793 (1.0)      144.4966 (1.05)     2.2701 (1.0)          33;2  6.9046 (0.95)        100           1
test_help---help[3.60.1]     139.1040 (1.04)     160.0830 (1.07)     144.8702 (1.05)     2.9854 (1.68)     144.7846 (1.05)     3.9898 (1.76)         27;1  6.9027 (0.95)        100           1
test_help---help[main]       133.6392 (1.0)      156.2523 (1.04)     138.1250 (1.0)      3.2275 (1.81)     137.8872 (1.0)      3.0176 (1.33)         16;3  7.2398 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     276.8369 (3.56)     276.8369 (3.56)     276.8369 (3.56)     0.0000 (1.0)      276.8369 (3.56)     0.0000 (1.0)           0;0  0.0036 (0.28)          1           1
test_import-import[3.10.0]     307.5223 (3.96)     307.5223 (3.96)     307.5223 (3.96)     0.0000 (1.0)      307.5223 (3.96)     0.0000 (1.0)           0;0  0.0033 (0.25)          1           1
test_import-import[3.60.1]      77.6847 (1.0)       77.6847 (1.0)       77.6847 (1.0)      0.0000 (1.0)       77.6847 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
test_import-import[main]        78.7333 (1.01)      78.7333 (1.01)      78.7333 (1.01)     0.0000 (1.0)       78.7333 (1.01)     0.0000 (1.0)           0;0  0.0127 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     151.7302 (5.27)     151.7302 (5.27)     151.7302 (5.27)     0.0000 (1.0)      151.7302 (5.27)     0.0000 (1.0)           0;0  0.0066 (0.19)          1           1
test_import_url-import-url[3.10.0]     156.2081 (5.42)     156.2081 (5.42)     156.2081 (5.42)     0.0000 (1.0)      156.2081 (5.42)     0.0000 (1.0)           0;0  0.0064 (0.18)          1           1
test_import_url-import-url[3.53.2]      77.2879 (2.68)      77.2879 (2.68)      77.2879 (2.68)     0.0000 (1.0)       77.2879 (2.68)     0.0000 (1.0)           0;0  0.0129 (0.37)          1           1
test_import_url-import-url[3.60.1]      28.8161 (1.0)       28.8161 (1.0)       28.8161 (1.0)      0.0000 (1.0)       28.8161 (1.0)      0.0000 (1.0)           0;0  0.0347 (1.0)           1           1
test_import_url-import-url[main]        30.2427 (1.05)      30.2427 (1.05)      30.2427 (1.05)     0.0000 (1.0)       30.2427 (1.05)     0.0000 (1.0)           0;0  0.0331 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     393.9520 (1.02)     433.4697 (1.09)     409.9694 (1.05)      8.4735 (3.36)     409.4222 (1.04)     13.6022 (4.37)         37;0  2.4392 (0.96)        100           1
test_init-init[3.10.0]     399.8195 (1.04)     534.2666 (1.34)     409.4128 (1.04)     14.0574 (5.58)     406.8965 (1.04)      3.9947 (1.28)          4;9  2.4425 (0.96)        100           1
test_init-init[3.53.2]     386.2701 (1.0)      399.0777 (1.0)      392.0549 (1.0)       2.5207 (1.0)      391.8089 (1.0)       3.1132 (1.0)          35;1  2.5507 (1.0)         100           1
test_init-init[3.60.1]     386.9367 (1.00)     415.1260 (1.04)     395.3674 (1.01)      4.4040 (1.75)     394.8216 (1.01)      4.9450 (1.59)         26;4  2.5293 (0.99)        100           1
test_init-init[main]       428.9664 (1.11)     474.6289 (1.19)     439.7030 (1.12)      8.4879 (3.37)     437.1952 (1.12)     10.6385 (3.42)         25;1  2.2743 (0.89)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     626.0530 (1.05)     626.0530 (1.05)     626.0530 (1.05)     0.0000 (1.0)      626.0530 (1.05)     0.0000 (1.0)           0;0  1.5973 (0.95)          1           1
test_list-list[3.10.0]     912.1006 (1.53)     912.1006 (1.53)     912.1006 (1.53)     0.0000 (1.0)      912.1006 (1.53)     0.0000 (1.0)           0;0  1.0964 (0.65)          1           1
test_list-list[3.53.2]     617.1992 (1.04)     617.1992 (1.04)     617.1992 (1.04)     0.0000 (1.0)      617.1992 (1.04)     0.0000 (1.0)           0;0  1.6202 (0.97)          1           1
test_list-list[3.60.1]     648.5565 (1.09)     648.5565 (1.09)     648.5565 (1.09)     0.0000 (1.0)      648.5565 (1.09)     0.0000 (1.0)           0;0  1.5419 (0.92)          1           1
test_list-list[main]       596.1198 (1.0)      596.1198 (1.0)      596.1198 (1.0)      0.0000 (1.0)      596.1198 (1.0)      0.0000 (1.0)           0;0  1.6775 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     429.9221 (1.05)     429.9221 (1.05)     429.9221 (1.05)     0.0000 (1.0)      429.9221 (1.05)     0.0000 (1.0)           0;0  2.3260 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     426.6634 (1.04)     426.6634 (1.04)     426.6634 (1.04)     0.0000 (1.0)      426.6634 (1.04)     0.0000 (1.0)           0;0  2.3438 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     410.5361 (1.0)      410.5361 (1.0)      410.5361 (1.0)      0.0000 (1.0)      410.5361 (1.0)      0.0000 (1.0)           0;0  2.4358 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     420.3989 (1.02)     420.3989 (1.02)     420.3989 (1.02)     0.0000 (1.0)      420.3989 (1.02)     0.0000 (1.0)           0;0  2.3787 (0.98)          1           1
test_list-list-dvc-only[main]       412.4336 (1.00)     412.4336 (1.00)     412.4336 (1.00)     0.0000 (1.0)      412.4336 (1.00)     0.0000 (1.0)           0;0  2.4246 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4900 (1.0)      2.4900 (1.0)      2.4900 (1.0)      0.0000 (1.0)      2.4900 (1.0)      0.0000 (1.0)           0;0  0.4016 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5456 (1.02)     2.5456 (1.02)     2.5456 (1.02)     0.0000 (1.0)      2.5456 (1.02)     0.0000 (1.0)           0;0  0.3928 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.5980 (1.04)     2.5980 (1.04)     2.5980 (1.04)     0.0000 (1.0)      2.5980 (1.04)     0.0000 (1.0)           0;0  0.3849 (0.96)          1           1
test_list-list-recursive[3.60.1]     2.6406 (1.06)     2.6406 (1.06)     2.6406 (1.06)     0.0000 (1.0)      2.6406 (1.06)     0.0000 (1.0)           0;0  0.3787 (0.94)          1           1
test_list-list-recursive[main]       2.5946 (1.04)     2.5946 (1.04)     2.5946 (1.04)     0.0000 (1.0)      2.5946 (1.04)     0.0000 (1.0)           0;0  0.3854 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     434.6748 (1.07)     434.6748 (1.07)     434.6748 (1.07)     0.0000 (1.0)      434.6748 (1.07)     0.0000 (1.0)           0;0  2.3006 (0.94)          1           1
test_list-list-shallow[3.10.0]     420.5493 (1.03)     420.5493 (1.03)     420.5493 (1.03)     0.0000 (1.0)      420.5493 (1.03)     0.0000 (1.0)           0;0  2.3778 (0.97)          1           1
test_list-list-shallow[3.53.2]     406.7650 (1.0)      406.7650 (1.0)      406.7650 (1.0)      0.0000 (1.0)      406.7650 (1.0)      0.0000 (1.0)           0;0  2.4584 (1.0)           1           1
test_list-list-shallow[3.60.1]     415.8472 (1.02)     415.8472 (1.02)     415.8472 (1.02)     0.0000 (1.0)      415.8472 (1.02)     0.0000 (1.0)           0;0  2.4047 (0.98)          1           1
test_list-list-shallow[main]       426.5594 (1.05)     426.5594 (1.05)     426.5594 (1.05)     0.0000 (1.0)      426.5594 (1.05)     0.0000 (1.0)           0;0  2.3443 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     11.7726 (2.98)     11.7726 (2.98)     11.7726 (2.98)     0.0000 (1.0)      11.7726 (2.98)     0.0000 (1.0)           0;0  0.0849 (0.34)          1           1
test_partial_add-add[3.10.0]     12.3370 (3.12)     12.3370 (3.12)     12.3370 (3.12)     0.0000 (1.0)      12.3370 (3.12)     0.0000 (1.0)           0;0  0.0811 (0.32)          1           1
test_partial_add-add[3.53.2]     10.7171 (2.71)     10.7171 (2.71)     10.7171 (2.71)     0.0000 (1.0)      10.7171 (2.71)     0.0000 (1.0)           0;0  0.0933 (0.37)          1           1
test_partial_add-add[3.60.1]      3.9514 (1.0)       3.9514 (1.0)       3.9514 (1.0)      0.0000 (1.0)       3.9514 (1.0)      0.0000 (1.0)           0;0  0.2531 (1.0)           1           1
test_partial_add-add[main]        4.8360 (1.22)      4.8360 (1.22)      4.8360 (1.22)     0.0000 (1.0)       4.8360 (1.22)     0.0000 (1.0)           0;0  0.2068 (0.82)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     77.8996 (3.92)     77.8996 (3.92)     77.8996 (3.92)     0.0000 (1.0)      77.8996 (3.92)     0.0000 (1.0)           0;0  0.0128 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     80.2601 (4.04)     80.2601 (4.04)     80.2601 (4.04)     0.0000 (1.0)      80.2601 (4.04)     0.0000 (1.0)           0;0  0.0125 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     70.2266 (3.54)     70.2266 (3.54)     70.2266 (3.54)     0.0000 (1.0)      70.2266 (3.54)     0.0000 (1.0)           0;0  0.0142 (0.28)          1           1
test_partial_add-add-partial[3.60.1]     19.8638 (1.0)      19.8638 (1.0)      19.8638 (1.0)      0.0000 (1.0)      19.8638 (1.0)      0.0000 (1.0)           0;0  0.0503 (1.0)           1           1
test_partial_add-add-partial[main]       20.4394 (1.03)     20.4394 (1.03)     20.4394 (1.03)     0.0000 (1.0)      20.4394 (1.03)     0.0000 (1.0)           0;0  0.0489 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6963 (1.0)      4.6963 (1.0)      4.6963 (1.0)      0.0000 (1.0)      4.6963 (1.0)      0.0000 (1.0)           0;0  0.2129 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1947 (1.32)     6.1947 (1.32)     6.1947 (1.32)     0.0000 (1.0)      6.1947 (1.32)     0.0000 (1.0)           0;0  0.1614 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.2220 (1.54)     7.2220 (1.54)     7.2220 (1.54)     0.0000 (1.0)      7.2220 (1.54)     0.0000 (1.0)           0;0  0.1385 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.0512 (1.50)     7.0512 (1.50)     7.0512 (1.50)     0.0000 (1.0)      7.0512 (1.50)     0.0000 (1.0)           0;0  0.1418 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       5.9913 (1.28)     5.9913 (1.28)     5.9913 (1.28)     0.0000 (1.0)      5.9913 (1.28)     0.0000 (1.0)           0;0  0.1669 (0.78)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7560 (1.0)      2.7560 (1.0)      2.7560 (1.0)      0.0000 (1.0)      2.7560 (1.0)      0.0000 (1.0)           0;0  0.3628 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.0730 (1.48)     4.0730 (1.48)     4.0730 (1.48)     0.0000 (1.0)      4.0730 (1.48)     0.0000 (1.0)           0;0  0.2455 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     4.0146 (1.46)     4.0146 (1.46)     4.0146 (1.46)     0.0000 (1.0)      4.0146 (1.46)     0.0000 (1.0)           0;0  0.2491 (0.69)          1           1
test_partial_add-gc-noop[3.60.1]     4.0808 (1.48)     4.0808 (1.48)     4.0808 (1.48)     0.0000 (1.0)      4.0808 (1.48)     0.0000 (1.0)           0;0  0.2451 (0.68)          1           1
test_partial_add-gc-noop[main]       3.0509 (1.11)     3.0509 (1.11)     3.0509 (1.11)     0.0000 (1.0)      3.0509 (1.11)     0.0000 (1.0)           0;0  0.3278 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.0600 (3.96)     14.0600 (3.96)     14.0600 (3.96)     0.0000 (1.0)      14.0600 (3.96)     0.0000 (1.0)           0;0  0.0711 (0.25)          1           1
test_partial_add-push[3.10.0]      6.7351 (1.90)      6.7351 (1.90)      6.7351 (1.90)     0.0000 (1.0)       6.7351 (1.90)     0.0000 (1.0)           0;0  0.1485 (0.53)          1           1
test_partial_add-push[3.53.2]      3.6729 (1.03)      3.6729 (1.03)      3.6729 (1.03)     0.0000 (1.0)       3.6729 (1.03)     0.0000 (1.0)           0;0  0.2723 (0.97)          1           1
test_partial_add-push[3.60.1]      3.5527 (1.0)       3.5527 (1.0)       3.5527 (1.0)      0.0000 (1.0)       3.5527 (1.0)      0.0000 (1.0)           0;0  0.2815 (1.0)           1           1
test_partial_add-push[main]        3.7342 (1.05)      3.7342 (1.05)      3.7342 (1.05)     0.0000 (1.0)       3.7342 (1.05)     0.0000 (1.0)           0;0  0.2678 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     83.1600 (4.10)     83.1600 (4.10)     83.1600 (4.10)     0.0000 (1.0)      83.1600 (4.10)     0.0000 (1.0)           0;0  0.0120 (0.24)          1           1
test_partial_add-push-partial[3.10.0]     39.4717 (1.95)     39.4717 (1.95)     39.4717 (1.95)     0.0000 (1.0)      39.4717 (1.95)     0.0000 (1.0)           0;0  0.0253 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.7922 (1.08)     21.7922 (1.08)     21.7922 (1.08)     0.0000 (1.0)      21.7922 (1.08)     0.0000 (1.0)           0;0  0.0459 (0.93)          1           1
test_partial_add-push-partial[3.60.1]     20.2622 (1.0)      20.2622 (1.0)      20.2622 (1.0)      0.0000 (1.0)      20.2622 (1.0)      0.0000 (1.0)           0;0  0.0494 (1.0)           1           1
test_partial_add-push-partial[main]       20.4318 (1.01)     20.4318 (1.01)     20.4318 (1.01)     0.0000 (1.0)      20.4318 (1.01)     0.0000 (1.0)           0;0  0.0489 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     80.6902 (3.59)     80.6902 (3.59)     80.6902 (3.59)     0.0000 (1.0)      80.6902 (3.59)     0.0000 (1.0)           0;0  0.0124 (0.28)          1           1
test_partial_remove-add[3.10.0]     81.1248 (3.61)     81.1248 (3.61)     81.1248 (3.61)     0.0000 (1.0)      81.1248 (3.61)     0.0000 (1.0)           0;0  0.0123 (0.28)          1           1
test_partial_remove-add[3.53.2]     72.7986 (3.24)     72.7986 (3.24)     72.7986 (3.24)     0.0000 (1.0)      72.7986 (3.24)     0.0000 (1.0)           0;0  0.0137 (0.31)          1           1
test_partial_remove-add[3.60.1]     22.5023 (1.0)      22.5023 (1.0)      22.5023 (1.0)      0.0000 (1.0)      22.5023 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_partial_remove-add[main]       23.6004 (1.05)     23.6004 (1.05)     23.6004 (1.05)     0.0000 (1.0)      23.6004 (1.05)     0.0000 (1.0)           0;0  0.0424 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     45.1572 (12.24)    45.1572 (12.24)    45.1572 (12.24)    0.0000 (1.0)      45.1572 (12.24)    0.0000 (1.0)           0;0  0.0221 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     46.4816 (12.60)    46.4816 (12.60)    46.4816 (12.60)    0.0000 (1.0)      46.4816 (12.60)    0.0000 (1.0)           0;0  0.0215 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     41.3541 (11.21)    41.3541 (11.21)    41.3541 (11.21)    0.0000 (1.0)      41.3541 (11.21)    0.0000 (1.0)           0;0  0.0242 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.6882 (1.0)       3.6882 (1.0)       3.6882 (1.0)      0.0000 (1.0)       3.6882 (1.0)      0.0000 (1.0)           0;0  0.2711 (1.0)           1           1
test_partial_remove-add-update[main]        3.7081 (1.01)      3.7081 (1.01)      3.7081 (1.01)     0.0000 (1.0)       3.7081 (1.01)     0.0000 (1.0)           0;0  0.2697 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5957 (1.0)      2.5957 (1.0)      2.5957 (1.0)      0.0000 (1.0)      2.5957 (1.0)      0.0000 (1.0)           0;0  0.3853 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7365 (1.44)     3.7365 (1.44)     3.7365 (1.44)     0.0000 (1.0)      3.7365 (1.44)     0.0000 (1.0)           0;0  0.2676 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.7775 (1.46)     3.7775 (1.46)     3.7775 (1.46)     0.0000 (1.0)      3.7775 (1.46)     0.0000 (1.0)           0;0  0.2647 (0.69)          1           1
test_partial_remove-gc[3.60.1]     3.8427 (1.48)     3.8427 (1.48)     3.8427 (1.48)     0.0000 (1.0)      3.8427 (1.48)     0.0000 (1.0)           0;0  0.2602 (0.68)          1           1
test_partial_remove-gc[main]       2.8751 (1.11)     2.8751 (1.11)     2.8751 (1.11)     0.0000 (1.0)      2.8751 (1.11)     0.0000 (1.0)           0;0  0.3478 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.0116 (1.0)      5.0116 (1.0)      5.0116 (1.0)      0.0000 (1.0)      5.0116 (1.0)      0.0000 (1.0)           0;0  0.1995 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.9171 (1.18)     5.9171 (1.18)     5.9171 (1.18)     0.0000 (1.0)      5.9171 (1.18)     0.0000 (1.0)           0;0  0.1690 (0.85)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.6124 (1.32)     6.6124 (1.32)     6.6124 (1.32)     0.0000 (1.0)      6.6124 (1.32)     0.0000 (1.0)           0;0  0.1512 (0.76)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.7470 (1.35)     6.7470 (1.35)     6.7470 (1.35)     0.0000 (1.0)      6.7470 (1.35)     0.0000 (1.0)           0;0  0.1482 (0.74)          1           1
test_partial_remove-gc-cloud[main]       5.7873 (1.15)     5.7873 (1.15)     5.7873 (1.15)     0.0000 (1.0)      5.7873 (1.15)     0.0000 (1.0)           0;0  0.1728 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     94.7323 (4.31)     94.7323 (4.31)     94.7323 (4.31)     0.0000 (1.0)      94.7323 (4.31)     0.0000 (1.0)           0;0  0.0106 (0.23)          1           1
test_partial_remove-push[3.10.0]     44.3177 (2.01)     44.3177 (2.01)     44.3177 (2.01)     0.0000 (1.0)      44.3177 (2.01)     0.0000 (1.0)           0;0  0.0226 (0.50)          1           1
test_partial_remove-push[3.53.2]     22.8772 (1.04)     22.8772 (1.04)     22.8772 (1.04)     0.0000 (1.0)      22.8772 (1.04)     0.0000 (1.0)           0;0  0.0437 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.0040 (1.0)      22.0040 (1.0)      22.0040 (1.0)      0.0000 (1.0)      22.0040 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
test_partial_remove-push[main]       22.5364 (1.02)     22.5364 (1.02)     22.5364 (1.02)     0.0000 (1.0)      22.5364 (1.02)     0.0000 (1.0)           0;0  0.0444 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8412 (1.00)     3.8412 (1.00)     3.8412 (1.00)     0.0000 (1.0)      3.8412 (1.00)     0.0000 (1.0)           0;0  0.2603 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     3.8392 (1.0)      3.8392 (1.0)      3.8392 (1.0)      0.0000 (1.0)      3.8392 (1.0)      0.0000 (1.0)           0;0  0.2605 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.0716 (1.84)     7.0716 (1.84)     7.0716 (1.84)     0.0000 (1.0)      7.0716 (1.84)     0.0000 (1.0)           0;0  0.1414 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     7.0804 (1.84)     7.0804 (1.84)     7.0804 (1.84)     0.0000 (1.0)      7.0804 (1.84)     0.0000 (1.0)           0;0  0.1412 (0.54)          1           1
test_partial_remove-push-update[main]       6.9666 (1.81)     6.9666 (1.81)     6.9666 (1.81)     0.0000 (1.0)      6.9666 (1.81)     0.0000 (1.0)           0;0  0.1435 (0.55)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     527.5644 (1.0)        529.9586 (1.0)      528.9125 (1.0)       0.9463 (1.0)      529.2647 (1.0)       1.3812 (1.0)           2;0  1.8907 (1.0)           5           3
test_plots-plots-diff[3.10.0]     967.4489 (1.83)     1,108.1574 (2.09)     997.5840 (1.89)     61.8532 (65.37)    969.8705 (1.83)     38.6442 (27.98)         1;1  1.0024 (0.53)          5           3
test_plots-plots-diff[3.53.2]     927.9605 (1.76)       933.7474 (1.76)     931.0280 (1.76)      2.5508 (2.70)     931.8201 (1.76)      4.5383 (3.29)          2;0  1.0741 (0.57)          5           3
test_plots-plots-diff[3.60.1]     935.2287 (1.77)       951.7274 (1.80)     944.9486 (1.79)      6.0431 (6.39)     946.3598 (1.79)      5.7979 (4.20)          2;0  1.0583 (0.56)          5           3
test_plots-plots-diff[main]       945.6732 (1.79)       971.6822 (1.83)     955.3746 (1.81)     10.4790 (11.07)    952.8057 (1.80)     15.0160 (10.87)         1;0  1.0467 (0.55)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       544.1121 (1.0)        545.1168 (1.0)        544.6791 (1.0)      0.4269 (1.0)        544.8127 (1.0)       0.7232 (1.0)           2;0  1.8359 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,194.7131 (2.20)     1,207.8043 (2.22)     1,199.8514 (2.20)     5.3977 (12.64)    1,199.3074 (2.20)      8.4707 (11.71)         1;0  0.8334 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]     1,004.1408 (1.85)     1,017.0081 (1.87)     1,011.2095 (1.86)     5.9973 (14.05)    1,013.3562 (1.86)     11.1035 (15.35)         1;0  0.9889 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]     1,008.4248 (1.85)     1,018.7710 (1.87)     1,015.6578 (1.86)     4.2814 (10.03)    1,017.9704 (1.87)      4.7944 (6.63)          1;0  0.9846 (0.54)          5           3
test_plots-plots-diff-json[main]       1,019.4904 (1.87)     1,033.4253 (1.90)     1,024.9891 (1.88)     6.0174 (14.10)    1,023.1311 (1.88)     10.1410 (14.02)         1;0  0.9756 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     424.0977 (1.0)      426.9930 (1.0)      425.6357 (1.0)      1.0635 (1.0)      425.8792 (1.0)      1.2598 (1.0)           2;0  2.3494 (1.0)           5           3
test_plots-plots-show[3.10.0]     785.3619 (1.85)     789.1432 (1.85)     786.8517 (1.85)     1.6293 (1.53)     786.2663 (1.85)     2.7142 (2.15)          1;0  1.2709 (0.54)          5           3
test_plots-plots-show[3.53.2]     772.6178 (1.82)     776.0223 (1.82)     773.7451 (1.82)     1.3986 (1.32)     773.3902 (1.82)     1.8721 (1.49)          1;0  1.2924 (0.55)          5           3
test_plots-plots-show[3.60.1]     776.4209 (1.83)     782.5858 (1.83)     779.8394 (1.83)     2.8582 (2.69)     780.7004 (1.83)     5.3196 (4.22)          1;0  1.2823 (0.55)          5           3
test_plots-plots-show[main]       814.3001 (1.92)     836.4679 (1.96)     829.7658 (1.95)     8.9439 (8.41)     832.5371 (1.95)     8.9360 (7.09)          1;0  1.2052 (0.51)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     439.1601 (1.0)      445.1054 (1.0)      441.5228 (1.0)      2.2518 (1.46)     440.8023 (1.0)      2.6582 (1.40)          2;0  2.2649 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     909.1882 (2.07)     925.3937 (2.08)     914.8026 (2.07)     6.1703 (4.01)     912.9150 (2.07)     4.5964 (2.42)          1;1  1.0931 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     817.3921 (1.86)     821.4494 (1.85)     819.6441 (1.86)     1.5379 (1.0)      819.5404 (1.86)     2.0575 (1.08)          2;0  1.2200 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     821.4551 (1.87)     825.3178 (1.85)     822.6041 (1.86)     1.6028 (1.04)     822.0598 (1.86)     1.8995 (1.0)           1;0  1.2157 (0.54)          5           3
test_plots-plots-show-json[main]       834.2590 (1.90)     857.5887 (1.93)     839.8989 (1.90)     9.9152 (6.45)     835.8245 (1.90)     6.1742 (3.25)          1;1  1.1906 (0.53)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     92.9314 (4.20)     92.9314 (4.20)     92.9314 (4.20)     0.0000 (1.0)      92.9314 (4.20)     0.0000 (1.0)           0;0  0.0108 (0.24)          1           1
test_push-push[3.10.0]     43.5367 (1.97)     43.5367 (1.97)     43.5367 (1.97)     0.0000 (1.0)      43.5367 (1.97)     0.0000 (1.0)           0;0  0.0230 (0.51)          1           1
test_push-push[3.53.2]     23.1518 (1.05)     23.1518 (1.05)     23.1518 (1.05)     0.0000 (1.0)      23.1518 (1.05)     0.0000 (1.0)           0;0  0.0432 (0.95)          1           1
test_push-push[3.60.1]     22.1080 (1.0)      22.1080 (1.0)      22.1080 (1.0)      0.0000 (1.0)      22.1080 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_push-push[main]       22.3141 (1.01)     22.3141 (1.01)     22.3141 (1.01)     0.0000 (1.0)      22.3141 (1.01)     0.0000 (1.0)           0;0  0.0448 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.4333 (4.96)     110.4333 (4.96)     110.4333 (4.96)     0.0000 (1.0)      110.4333 (4.96)     0.0000 (1.0)           0;0  0.0091 (0.20)          1           1
test_sharing-fetch[3.10.0]     115.6717 (5.19)     115.6717 (5.19)     115.6717 (5.19)     0.0000 (1.0)      115.6717 (5.19)     0.0000 (1.0)           0;0  0.0086 (0.19)          1           1
test_sharing-fetch[3.53.2]      32.3100 (1.45)      32.3100 (1.45)      32.3100 (1.45)     0.0000 (1.0)       32.3100 (1.45)     0.0000 (1.0)           0;0  0.0310 (0.69)          1           1
test_sharing-fetch[3.60.1]      22.3616 (1.00)      22.3616 (1.00)      22.3616 (1.00)     0.0000 (1.0)       22.3616 (1.00)     0.0000 (1.0)           0;0  0.0447 (1.00)          1           1
test_sharing-fetch[main]        22.2685 (1.0)       22.2685 (1.0)       22.2685 (1.0)      0.0000 (1.0)       22.2685 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2665 (1.0)      1.2665 (1.0)      1.2665 (1.0)      0.0000 (1.0)      1.2665 (1.0)      0.0000 (1.0)           0;0  0.7896 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6104 (2.85)     3.6104 (2.85)     3.6104 (2.85)     0.0000 (1.0)      3.6104 (2.85)     0.0000 (1.0)           0;0  0.2770 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.7247 (4.52)     5.7247 (4.52)     5.7247 (4.52)     0.0000 (1.0)      5.7247 (4.52)     0.0000 (1.0)           0;0  0.1747 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.7866 (4.57)     5.7866 (4.57)     5.7866 (4.57)     0.0000 (1.0)      5.7866 (4.57)     0.0000 (1.0)           0;0  0.1728 (0.22)          1           1
test_sharing-fetch-noop[main]       5.8213 (4.60)     5.8213 (4.60)     5.8213 (4.60)     0.0000 (1.0)      5.8213 (4.60)     0.0000 (1.0)           0;0  0.1718 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     99.5224 (4.47)     99.5224 (4.47)     99.5224 (4.47)     0.0000 (1.0)      99.5224 (4.47)     0.0000 (1.0)           0;0  0.0100 (0.22)          1           1
test_sharing-push[3.10.0]     47.0689 (2.11)     47.0689 (2.11)     47.0689 (2.11)     0.0000 (1.0)      47.0689 (2.11)     0.0000 (1.0)           0;0  0.0212 (0.47)          1           1
test_sharing-push[3.53.2]     22.9578 (1.03)     22.9578 (1.03)     22.9578 (1.03)     0.0000 (1.0)      22.9578 (1.03)     0.0000 (1.0)           0;0  0.0436 (0.97)          1           1
test_sharing-push[3.60.1]     22.2594 (1.0)      22.2594 (1.0)      22.2594 (1.0)      0.0000 (1.0)      22.2594 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
test_sharing-push[main]       22.6019 (1.02)     22.6019 (1.02)     22.6019 (1.02)     0.0000 (1.0)      22.6019 (1.02)     0.0000 (1.0)           0;0  0.0442 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0785 (1.00)     2.0785 (1.00)     2.0785 (1.00)     0.0000 (1.0)      2.0785 (1.00)     0.0000 (1.0)           0;0  0.4811 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.0719 (1.0)      2.0719 (1.0)      2.0719 (1.0)      0.0000 (1.0)      2.0719 (1.0)      0.0000 (1.0)           0;0  0.4826 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.0056 (2.90)     6.0056 (2.90)     6.0056 (2.90)     0.0000 (1.0)      6.0056 (2.90)     0.0000 (1.0)           0;0  0.1665 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.8870 (2.84)     5.8870 (2.84)     5.8870 (2.84)     0.0000 (1.0)      5.8870 (2.84)     0.0000 (1.0)           0;0  0.1699 (0.35)          1           1
test_sharing-push-noop[main]       6.3236 (3.05)     6.3236 (3.05)     6.3236 (3.05)     0.0000 (1.0)      6.3236 (3.05)     0.0000 (1.0)           0;0  0.1581 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     161.4452 (1.04)     161.4452 (1.04)     161.4452 (1.04)     0.0000 (1.0)      161.4452 (1.04)     0.0000 (1.0)           0;0  0.0062 (0.96)          1           1
test_sharing_azure-fetch[main]       154.5823 (1.0)      154.5823 (1.0)      154.5823 (1.0)      0.0000 (1.0)      154.5823 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4821 (1.0)      6.4821 (1.0)      6.4821 (1.0)      0.0000 (1.0)      6.4821 (1.0)      0.0000 (1.0)           0;0  0.1543 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7277 (1.04)     6.7277 (1.04)     6.7277 (1.04)     0.0000 (1.0)      6.7277 (1.04)     0.0000 (1.0)           0;0  0.1486 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     134.3877 (1.0)      134.3877 (1.0)      134.3877 (1.0)      0.0000 (1.0)      134.3877 (1.0)      0.0000 (1.0)           0;0  0.0074 (1.0)           1           1
test_sharing_azure-push[main]       135.3232 (1.01)     135.3232 (1.01)     135.3232 (1.01)     0.0000 (1.0)      135.3232 (1.01)     0.0000 (1.0)           0;0  0.0074 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6231 (1.0)      6.6231 (1.0)      6.6231 (1.0)      0.0000 (1.0)      6.6231 (1.0)      0.0000 (1.0)           0;0  0.1510 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.7408 (1.02)     6.7408 (1.02)     6.7408 (1.02)     0.0000 (1.0)      6.7408 (1.02)     0.0000 (1.0)           0;0  0.1484 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     17.1908 (3.59)     17.1908 (3.59)     17.1908 (3.59)     0.0000 (1.0)      17.1908 (3.59)     0.0000 (1.0)           0;0  0.0582 (0.28)          1           1
test_status-status[3.10.0]     17.9976 (3.76)     17.9976 (3.76)     17.9976 (3.76)     0.0000 (1.0)      17.9976 (3.76)     0.0000 (1.0)           0;0  0.0556 (0.27)          1           1
test_status-status[3.53.2]     15.6830 (3.28)     15.6830 (3.28)     15.6830 (3.28)     0.0000 (1.0)      15.6830 (3.28)     0.0000 (1.0)           0;0  0.0638 (0.31)          1           1
test_status-status[3.60.1]      4.7844 (1.0)       4.7844 (1.0)       4.7844 (1.0)      0.0000 (1.0)       4.7844 (1.0)      0.0000 (1.0)           0;0  0.2090 (1.0)           1           1
test_status-status[main]        5.1221 (1.07)      5.1221 (1.07)      5.1221 (1.07)     0.0000 (1.0)       5.1221 (1.07)     0.0000 (1.0)           0;0  0.1952 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     3.7071 (1.40)     3.7071 (1.40)     3.7071 (1.40)     0.0000 (1.0)      3.7071 (1.40)     0.0000 (1.0)           0;0  0.2698 (0.71)          1           1
test_status-status-changed[3.10.0]     3.9659 (1.50)     3.9659 (1.50)     3.9659 (1.50)     0.0000 (1.0)      3.9659 (1.50)     0.0000 (1.0)           0;0  0.2521 (0.67)          1           1
test_status-status-changed[3.53.2]     3.8532 (1.46)     3.8532 (1.46)     3.8532 (1.46)     0.0000 (1.0)      3.8532 (1.46)     0.0000 (1.0)           0;0  0.2595 (0.69)          1           1
test_status-status-changed[3.60.1]     2.6424 (1.0)      2.6424 (1.0)      2.6424 (1.0)      0.0000 (1.0)      2.6424 (1.0)      0.0000 (1.0)           0;0  0.3784 (1.0)           1           1
test_status-status-changed[main]       2.8549 (1.08)     2.8549 (1.08)     2.8549 (1.08)     0.0000 (1.0)      2.8549 (1.08)     0.0000 (1.0)           0;0  0.3503 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     3.8858 (1.53)     3.8858 (1.53)     3.8858 (1.53)     0.0000 (1.0)      3.8858 (1.53)     0.0000 (1.0)           0;0  0.2574 (0.65)          1           1
test_status-status-changed-noop[3.10.0]     4.0093 (1.58)     4.0093 (1.58)     4.0093 (1.58)     0.0000 (1.0)      4.0093 (1.58)     0.0000 (1.0)           0;0  0.2494 (0.63)          1           1
test_status-status-changed-noop[3.53.2]     3.7832 (1.49)     3.7832 (1.49)     3.7832 (1.49)     0.0000 (1.0)      3.7832 (1.49)     0.0000 (1.0)           0;0  0.2643 (0.67)          1           1
test_status-status-changed-noop[3.60.1]     2.5435 (1.0)      2.5435 (1.0)      2.5435 (1.0)      0.0000 (1.0)      2.5435 (1.0)      0.0000 (1.0)           0;0  0.3932 (1.0)           1           1
test_status-status-changed-noop[main]       2.7507 (1.08)     2.7507 (1.08)     2.7507 (1.08)     0.0000 (1.0)      2.7507 (1.08)     0.0000 (1.0)           0;0  0.3636 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     3.7422 (1.46)     3.7422 (1.46)     3.7422 (1.46)     0.0000 (1.0)      3.7422 (1.46)     0.0000 (1.0)           0;0  0.2672 (0.69)          1           1
test_status-status-noop[3.10.0]     3.8706 (1.51)     3.8706 (1.51)     3.8706 (1.51)     0.0000 (1.0)      3.8706 (1.51)     0.0000 (1.0)           0;0  0.2584 (0.66)          1           1
test_status-status-noop[3.53.2]     3.7213 (1.45)     3.7213 (1.45)     3.7213 (1.45)     0.0000 (1.0)      3.7213 (1.45)     0.0000 (1.0)           0;0  0.2687 (0.69)          1           1
test_status-status-noop[3.60.1]     2.5708 (1.0)      2.5708 (1.0)      2.5708 (1.0)      0.0000 (1.0)      2.5708 (1.0)      0.0000 (1.0)           0;0  0.3890 (1.0)           1           1
test_status-status-noop[main]       2.7348 (1.06)     2.7348 (1.06)     2.7348 (1.06)     0.0000 (1.0)      2.7348 (1.06)     0.0000 (1.0)           0;0  0.3657 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     194.1012 (4.12)     194.1012 (4.12)     194.1012 (4.12)     0.0000 (1.0)      194.1012 (4.12)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_update-import-url[3.10.0]     199.7439 (4.24)     199.7439 (4.24)     199.7439 (4.24)     0.0000 (1.0)      199.7439 (4.24)     0.0000 (1.0)           0;0  0.0050 (0.24)          1           1
test_update-import-url[3.53.2]     116.7057 (2.48)     116.7057 (2.48)     116.7057 (2.48)     0.0000 (1.0)      116.7057 (2.48)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      47.1517 (1.0)       47.1517 (1.0)       47.1517 (1.0)      0.0000 (1.0)       47.1517 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
test_update-import-url[main]        47.4109 (1.01)      47.4109 (1.01)      47.4109 (1.01)     0.0000 (1.0)       47.4109 (1.01)     0.0000 (1.0)           0;0  0.0211 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     181.4073 (5.05)     181.4073 (5.05)     181.4073 (5.05)     0.0000 (1.0)      181.4073 (5.05)     0.0000 (1.0)           0;0  0.0055 (0.20)          1           1
test_update-update[3.10.0]     185.6035 (5.17)     185.6035 (5.17)     185.6035 (5.17)     0.0000 (1.0)      185.6035 (5.17)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.53.2]     110.8255 (3.08)     110.8255 (3.08)     110.8255 (3.08)     0.0000 (1.0)      110.8255 (3.08)     0.0000 (1.0)           0;0  0.0090 (0.32)          1           1
test_update-update[3.60.1]      35.9327 (1.0)       35.9327 (1.0)       35.9327 (1.0)      0.0000 (1.0)       35.9327 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
test_update-update[main]        36.6581 (1.02)      36.6581 (1.02)      36.6581 (1.02)     0.0000 (1.0)       36.6581 (1.02)     0.0000 (1.0)           0;0  0.0273 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.7369 (2.19)     16.7369 (2.19)     16.7369 (2.19)     0.0000 (1.0)      16.7369 (2.19)     0.0000 (1.0)           0;0  0.0597 (0.46)          1           1
test_update-update-noop[3.10.0]     17.9489 (2.35)     17.9489 (2.35)     17.9489 (2.35)     0.0000 (1.0)      17.9489 (2.35)     0.0000 (1.0)           0;0  0.0557 (0.43)          1           1
test_update-update-noop[3.53.2]     17.1836 (2.25)     17.1836 (2.25)     17.1836 (2.25)     0.0000 (1.0)      17.1836 (2.25)     0.0000 (1.0)           0;0  0.0582 (0.45)          1           1
test_update-update-noop[3.60.1]      7.6535 (1.0)       7.6535 (1.0)       7.6535 (1.0)      0.0000 (1.0)       7.6535 (1.0)      0.0000 (1.0)           0;0  0.1307 (1.0)           1           1
test_update-update-noop[main]        8.3688 (1.09)      8.3688 (1.09)      8.3688 (1.09)     0.0000 (1.0)       8.3688 (1.09)     0.0000 (1.0)           0;0  0.1195 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean