Sun Oct  5 01:27:59 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     87.1846 (3.77)     87.1846 (3.77)     87.1846 (3.77)     0.0000 (1.0)      87.1846 (3.77)     0.0000 (1.0)           0;0  0.0115 (0.27)          1           1
test_add_copy-add[3.10.0]     88.0401 (3.80)     88.0401 (3.80)     88.0401 (3.80)     0.0000 (1.0)      88.0401 (3.80)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_add_copy-add[3.53.2]     78.9921 (3.41)     78.9921 (3.41)     78.9921 (3.41)     0.0000 (1.0)      78.9921 (3.41)     0.0000 (1.0)           0;0  0.0127 (0.29)          1           1
test_add_copy-add[3.60.1]     23.1549 (1.0)      23.1549 (1.0)      23.1549 (1.0)      0.0000 (1.0)      23.1549 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
test_add_copy-add[main]       24.0786 (1.04)     24.0786 (1.04)     24.0786 (1.04)     0.0000 (1.0)      24.0786 (1.04)     0.0000 (1.0)           0;0  0.0415 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.9537 (6.56)     29.9537 (6.56)     29.9537 (6.56)     0.0000 (1.0)      29.9537 (6.56)     0.0000 (1.0)           0;0  0.0334 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     30.1052 (6.60)     30.1052 (6.60)     30.1052 (6.60)     0.0000 (1.0)      30.1052 (6.60)     0.0000 (1.0)           0;0  0.0332 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.9966 (6.35)     28.9966 (6.35)     28.9966 (6.35)     0.0000 (1.0)      28.9966 (6.35)     0.0000 (1.0)           0;0  0.0345 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.5639 (1.0)       4.5639 (1.0)       4.5639 (1.0)      0.0000 (1.0)       4.5639 (1.0)      0.0000 (1.0)           0;0  0.2191 (1.0)           1           1
test_add_copy-add-noop[main]        4.9618 (1.09)      4.9618 (1.09)      4.9618 (1.09)     0.0000 (1.0)       4.9618 (1.09)     0.0000 (1.0)           0;0  0.2015 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.0862 (4.11)     67.0862 (4.11)     67.0862 (4.11)     0.0000 (1.0)      67.0862 (4.11)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.10.0]     67.9818 (4.16)     67.9818 (4.16)     67.9818 (4.16)     0.0000 (1.0)      67.9818 (4.16)     0.0000 (1.0)           0;0  0.0147 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.9804 (3.86)     62.9804 (3.86)     62.9804 (3.86)     0.0000 (1.0)      62.9804 (3.86)     0.0000 (1.0)           0;0  0.0159 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.3348 (1.0)      16.3348 (1.0)      16.3348 (1.0)      0.0000 (1.0)      16.3348 (1.0)      0.0000 (1.0)           0;0  0.0612 (1.0)           1           1
test_add_hardlink-add[main]       17.2526 (1.06)     17.2526 (1.06)     17.2526 (1.06)     0.0000 (1.0)      17.2526 (1.06)     0.0000 (1.0)           0;0  0.0580 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.8307 (7.49)     34.8307 (7.49)     34.8307 (7.49)     0.0000 (1.0)      34.8307 (7.49)     0.0000 (1.0)           0;0  0.0287 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.5418 (7.64)     35.5418 (7.64)     35.5418 (7.64)     0.0000 (1.0)      35.5418 (7.64)     0.0000 (1.0)           0;0  0.0281 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     32.9517 (7.09)     32.9517 (7.09)     32.9517 (7.09)     0.0000 (1.0)      32.9517 (7.09)     0.0000 (1.0)           0;0  0.0303 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.6504 (1.0)       4.6504 (1.0)       4.6504 (1.0)      0.0000 (1.0)       4.6504 (1.0)      0.0000 (1.0)           0;0  0.2150 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8473 (1.04)      4.8473 (1.04)      4.8473 (1.04)     0.0000 (1.0)       4.8473 (1.04)     0.0000 (1.0)           0;0  0.2063 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     70.8593 (2.03)     70.8593 (2.03)     70.8593 (2.03)     0.0000 (1.0)      70.8593 (2.03)     0.0000 (1.0)           0;0  0.0141 (0.49)          1           1
test_add_symlink-add[3.10.0]     72.0653 (2.07)     72.0653 (2.07)     72.0653 (2.07)     0.0000 (1.0)      72.0653 (2.07)     0.0000 (1.0)           0;0  0.0139 (0.48)          1           1
test_add_symlink-add[3.53.2]     66.5777 (1.91)     66.5777 (1.91)     66.5777 (1.91)     0.0000 (1.0)      66.5777 (1.91)     0.0000 (1.0)           0;0  0.0150 (0.52)          1           1
test_add_symlink-add[3.60.1]     34.8846 (1.0)      34.8846 (1.0)      34.8846 (1.0)      0.0000 (1.0)      34.8846 (1.0)      0.0000 (1.0)           0;0  0.0287 (1.0)           1           1
test_add_symlink-add[main]       36.0948 (1.03)     36.0948 (1.03)     36.0948 (1.03)     0.0000 (1.0)      36.0948 (1.03)     0.0000 (1.0)           0;0  0.0277 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.6816 (8.14)     47.6816 (8.14)     47.6816 (8.14)     0.0000 (1.0)      47.6816 (8.14)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.2732 (8.41)     49.2732 (8.41)     49.2732 (8.41)     0.0000 (1.0)      49.2732 (8.41)     0.0000 (1.0)           0;0  0.0203 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.3971 (8.09)     47.3971 (8.09)     47.3971 (8.09)     0.0000 (1.0)      47.3971 (8.09)     0.0000 (1.0)           0;0  0.0211 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.8583 (1.0)       5.8583 (1.0)       5.8583 (1.0)      0.0000 (1.0)       5.8583 (1.0)      0.0000 (1.0)           0;0  0.1707 (1.0)           1           1
test_add_symlink-add-noop[main]        6.2854 (1.07)      6.2854 (1.07)      6.2854 (1.07)     0.0000 (1.0)       6.2854 (1.07)     0.0000 (1.0)           0;0  0.1591 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.9358 (1.94)     39.9358 (1.94)     39.9358 (1.94)     0.0000 (1.0)      39.9358 (1.94)     0.0000 (1.0)           0;0  0.0250 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     60.3264 (2.93)     60.3264 (2.93)     60.3264 (2.93)     0.0000 (1.0)      60.3264 (2.93)     0.0000 (1.0)           0;0  0.0166 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     27.7484 (1.35)     27.7484 (1.35)     27.7484 (1.35)     0.0000 (1.0)      27.7484 (1.35)     0.0000 (1.0)           0;0  0.0360 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     20.5869 (1.0)      20.5869 (1.0)      20.5869 (1.0)      0.0000 (1.0)      20.5869 (1.0)      0.0000 (1.0)           0;0  0.0486 (1.0)           1           1
test_checkout_copy-checkout[main]       21.6952 (1.05)     21.6952 (1.05)     21.6952 (1.05)     0.0000 (1.0)      21.6952 (1.05)     0.0000 (1.0)           0;0  0.0461 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3630 (1.63)     5.3630 (1.63)     5.3630 (1.63)     0.0000 (1.0)      5.3630 (1.63)     0.0000 (1.0)           0;0  0.1865 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.5581 (1.69)     5.5581 (1.69)     5.5581 (1.69)     0.0000 (1.0)      5.5581 (1.69)     0.0000 (1.0)           0;0  0.1799 (0.59)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4486 (1.66)     5.4486 (1.66)     5.4486 (1.66)     0.0000 (1.0)      5.4486 (1.66)     0.0000 (1.0)           0;0  0.1835 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2816 (1.0)      3.2816 (1.0)      3.2816 (1.0)      0.0000 (1.0)      3.2816 (1.0)      0.0000 (1.0)           0;0  0.3047 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5807 (1.09)     3.5807 (1.09)     3.5807 (1.09)     0.0000 (1.0)      3.5807 (1.09)     0.0000 (1.0)           0;0  0.2793 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5634 (2.17)     8.5634 (2.17)     8.5634 (2.17)     0.0000 (1.0)      8.5634 (2.17)     0.0000 (1.0)           0;0  0.1168 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3018 (1.59)     6.3018 (1.59)     6.3018 (1.59)     0.0000 (1.0)      6.3018 (1.59)     0.0000 (1.0)           0;0  0.1587 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1722 (1.56)     6.1722 (1.56)     6.1722 (1.56)     0.0000 (1.0)      6.1722 (1.56)     0.0000 (1.0)           0;0  0.1620 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9539 (1.0)      3.9539 (1.0)      3.9539 (1.0)      0.0000 (1.0)      3.9539 (1.0)      0.0000 (1.0)           0;0  0.2529 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4175 (1.12)     4.4175 (1.12)     4.4175 (1.12)     0.0000 (1.0)      4.4175 (1.12)     0.0000 (1.0)           0;0  0.2264 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.7694 (3.04)     22.7694 (3.04)     22.7694 (3.04)     0.0000 (1.0)      22.7694 (3.04)     0.0000 (1.0)           0;0  0.0439 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.7887 (2.24)     16.7887 (2.24)     16.7887 (2.24)     0.0000 (1.0)      16.7887 (2.24)     0.0000 (1.0)           0;0  0.0596 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.2509 (2.04)     15.2509 (2.04)     15.2509 (2.04)     0.0000 (1.0)      15.2509 (2.04)     0.0000 (1.0)           0;0  0.0656 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4844 (1.0)       7.4844 (1.0)       7.4844 (1.0)      0.0000 (1.0)       7.4844 (1.0)      0.0000 (1.0)           0;0  0.1336 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.5816 (1.15)      8.5816 (1.15)      8.5816 (1.15)     0.0000 (1.0)       8.5816 (1.15)     0.0000 (1.0)           0;0  0.1165 (0.87)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.8381 (1.65)     5.8381 (1.65)     5.8381 (1.65)     0.0000 (1.0)      5.8381 (1.65)     0.0000 (1.0)           0;0  0.1713 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.9647 (1.68)     5.9647 (1.68)     5.9647 (1.68)     0.0000 (1.0)      5.9647 (1.68)     0.0000 (1.0)           0;0  0.1677 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7590 (1.62)     5.7590 (1.62)     5.7590 (1.62)     0.0000 (1.0)      5.7590 (1.62)     0.0000 (1.0)           0;0  0.1736 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.5468 (1.0)      3.5468 (1.0)      3.5468 (1.0)      0.0000 (1.0)      3.5468 (1.0)      0.0000 (1.0)           0;0  0.2819 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.8517 (1.09)     3.8517 (1.09)     3.8517 (1.09)     0.0000 (1.0)      3.8517 (1.09)     0.0000 (1.0)           0;0  0.2596 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.9949 (2.16)     8.9949 (2.16)     8.9949 (2.16)     0.0000 (1.0)      8.9949 (2.16)     0.0000 (1.0)           0;0  0.1112 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.8526 (1.65)     6.8526 (1.65)     6.8526 (1.65)     0.0000 (1.0)      6.8526 (1.65)     0.0000 (1.0)           0;0  0.1459 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6225 (1.59)     6.6225 (1.59)     6.6225 (1.59)     0.0000 (1.0)      6.6225 (1.59)     0.0000 (1.0)           0;0  0.1510 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.1621 (1.0)      4.1621 (1.0)      4.1621 (1.0)      0.0000 (1.0)      4.1621 (1.0)      0.0000 (1.0)           0;0  0.2403 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.8012 (1.15)     4.8012 (1.15)     4.8012 (1.15)     0.0000 (1.0)      4.8012 (1.15)     0.0000 (1.0)           0;0  0.2083 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9145 (2.45)     24.9145 (2.45)     24.9145 (2.45)     0.0000 (1.0)      24.9145 (2.45)     0.0000 (1.0)           0;0  0.0401 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     18.9694 (1.86)     18.9694 (1.86)     18.9694 (1.86)     0.0000 (1.0)      18.9694 (1.86)     0.0000 (1.0)           0;0  0.0527 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     17.4901 (1.72)     17.4901 (1.72)     17.4901 (1.72)     0.0000 (1.0)      17.4901 (1.72)     0.0000 (1.0)           0;0  0.0572 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1870 (1.0)      10.1870 (1.0)      10.1870 (1.0)      0.0000 (1.0)      10.1870 (1.0)      0.0000 (1.0)           0;0  0.0982 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.1032 (1.09)     11.1032 (1.09)     11.1032 (1.09)     0.0000 (1.0)      11.1032 (1.09)     0.0000 (1.0)           0;0  0.0901 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7513 (1.54)     6.7513 (1.54)     6.7513 (1.54)     0.0000 (1.0)      6.7513 (1.54)     0.0000 (1.0)           0;0  0.1481 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9215 (1.58)     6.9215 (1.58)     6.9215 (1.58)     0.0000 (1.0)      6.9215 (1.58)     0.0000 (1.0)           0;0  0.1445 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7629 (1.55)     6.7629 (1.55)     6.7629 (1.55)     0.0000 (1.0)      6.7629 (1.55)     0.0000 (1.0)           0;0  0.1479 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3702 (1.0)      4.3702 (1.0)      4.3702 (1.0)      0.0000 (1.0)      4.3702 (1.0)      0.0000 (1.0)           0;0  0.2288 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.6391 (1.06)     4.6391 (1.06)     4.6391 (1.06)     0.0000 (1.0)      4.6391 (1.06)     0.0000 (1.0)           0;0  0.2156 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.0369 (1.88)     11.0369 (1.88)     11.0369 (1.88)     0.0000 (1.0)      11.0369 (1.88)     0.0000 (1.0)           0;0  0.0906 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7077 (1.49)      8.7077 (1.49)      8.7077 (1.49)     0.0000 (1.0)       8.7077 (1.49)     0.0000 (1.0)           0;0  0.1148 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.5697 (1.46)      8.5697 (1.46)      8.5697 (1.46)     0.0000 (1.0)       8.5697 (1.46)     0.0000 (1.0)           0;0  0.1167 (0.68)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.8578 (1.0)       5.8578 (1.0)       5.8578 (1.0)      0.0000 (1.0)       5.8578 (1.0)      0.0000 (1.0)           0;0  0.1707 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.4862 (1.11)      6.4862 (1.11)      6.4862 (1.11)     0.0000 (1.0)       6.4862 (1.11)     0.0000 (1.0)           0;0  0.1542 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9575 (1.71)     3.9575 (1.71)     3.9575 (1.71)     0.0000 (1.0)      3.9575 (1.71)     0.0000 (1.0)           0;0  0.2527 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.6395 (2.00)     4.6395 (2.00)     4.6395 (2.00)     0.0000 (1.0)      4.6395 (2.00)     0.0000 (1.0)           0;0  0.2155 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.4272 (1.91)     4.4272 (1.91)     4.4272 (1.91)     0.0000 (1.0)      4.4272 (1.91)     0.0000 (1.0)           0;0  0.2259 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.3165 (1.0)      2.3165 (1.0)      2.3165 (1.0)      0.0000 (1.0)      2.3165 (1.0)      0.0000 (1.0)           0;0  0.4317 (1.0)           1           1
test_data_status-data-changed[main]       2.5376 (1.10)     2.5376 (1.10)     2.5376 (1.10)     0.0000 (1.0)      2.5376 (1.10)     0.0000 (1.0)           0;0  0.3941 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0653 (1.76)     4.0653 (1.76)     4.0653 (1.76)     0.0000 (1.0)      4.0653 (1.76)     0.0000 (1.0)           0;0  0.2460 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.6894 (2.03)     4.6894 (2.03)     4.6894 (2.03)     0.0000 (1.0)      4.6894 (2.03)     0.0000 (1.0)           0;0  0.2132 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.4359 (1.92)     4.4359 (1.92)     4.4359 (1.92)     0.0000 (1.0)      4.4359 (1.92)     0.0000 (1.0)           0;0  0.2254 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3073 (1.0)      2.3073 (1.0)      2.3073 (1.0)      0.0000 (1.0)      2.3073 (1.0)      0.0000 (1.0)           0;0  0.4334 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5673 (1.11)     2.5673 (1.11)     2.5673 (1.11)     0.0000 (1.0)      2.5673 (1.11)     0.0000 (1.0)           0;0  0.3895 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.3442 (3.79)     18.3442 (3.79)     18.3442 (3.79)     0.0000 (1.0)      18.3442 (3.79)     0.0000 (1.0)           0;0  0.0545 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.3482 (4.00)     19.3482 (4.00)     19.3482 (4.00)     0.0000 (1.0)      19.3482 (4.00)     0.0000 (1.0)           0;0  0.0517 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.1609 (3.96)     19.1609 (3.96)     19.1609 (3.96)     0.0000 (1.0)      19.1609 (3.96)     0.0000 (1.0)           0;0  0.0522 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.8383 (1.0)       4.8383 (1.0)       4.8383 (1.0)      0.0000 (1.0)       4.8383 (1.0)      0.0000 (1.0)           0;0  0.2067 (1.0)           1           1
test_data_status-data-new[main]        5.2135 (1.08)      5.2135 (1.08)      5.2135 (1.08)     0.0000 (1.0)       5.2135 (1.08)     0.0000 (1.0)           0;0  0.1918 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9756 (1.74)     3.9756 (1.74)     3.9756 (1.74)     0.0000 (1.0)      3.9756 (1.74)     0.0000 (1.0)           0;0  0.2515 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.6785 (2.04)     4.6785 (2.04)     4.6785 (2.04)     0.0000 (1.0)      4.6785 (2.04)     0.0000 (1.0)           0;0  0.2137 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.6092 (2.01)     4.6092 (2.01)     4.6092 (2.01)     0.0000 (1.0)      4.6092 (2.01)     0.0000 (1.0)           0;0  0.2170 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.2881 (1.0)      2.2881 (1.0)      2.2881 (1.0)      0.0000 (1.0)      2.2881 (1.0)      0.0000 (1.0)           0;0  0.4370 (1.0)           1           1
test_data_status-data-noop[main]       2.5092 (1.10)     2.5092 (1.10)     2.5092 (1.10)     0.0000 (1.0)      2.5092 (1.10)     0.0000 (1.0)           0;0  0.3985 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2682 (1.30)     7.2682 (1.30)     7.2682 (1.30)     0.0000 (1.0)      7.2682 (1.30)     0.0000 (1.0)           0;0  0.1376 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7667 (1.39)     7.7667 (1.39)     7.7667 (1.39)     0.0000 (1.0)      7.7667 (1.39)     0.0000 (1.0)           0;0  0.1288 (0.72)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7748 (1.39)     7.7748 (1.39)     7.7748 (1.39)     0.0000 (1.0)      7.7748 (1.39)     0.0000 (1.0)           0;0  0.1286 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5935 (1.0)      5.5935 (1.0)      5.5935 (1.0)      0.0000 (1.0)      5.5935 (1.0)      0.0000 (1.0)           0;0  0.1788 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.0130 (1.07)     6.0130 (1.07)     6.0130 (1.07)     0.0000 (1.0)      6.0130 (1.07)     0.0000 (1.0)           0;0  0.1663 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2023 (1.26)     7.2023 (1.26)     7.2023 (1.26)     0.0000 (1.0)      7.2023 (1.26)     0.0000 (1.0)           0;0  0.1388 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7677 (1.36)     7.7677 (1.36)     7.7677 (1.36)     0.0000 (1.0)      7.7677 (1.36)     0.0000 (1.0)           0;0  0.1287 (0.74)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7067 (1.35)     7.7067 (1.35)     7.7067 (1.35)     0.0000 (1.0)      7.7067 (1.35)     0.0000 (1.0)           0;0  0.1298 (0.74)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7157 (1.0)      5.7157 (1.0)      5.7157 (1.0)      0.0000 (1.0)      5.7157 (1.0)      0.0000 (1.0)           0;0  0.1750 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.0390 (1.06)     6.0390 (1.06)     6.0390 (1.06)     0.0000 (1.0)      6.0390 (1.06)     0.0000 (1.0)           0;0  0.1656 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.3164 (2.68)     21.3164 (2.68)     21.3164 (2.68)     0.0000 (1.0)      21.3164 (2.68)     0.0000 (1.0)           0;0  0.0469 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.9188 (2.76)     21.9188 (2.76)     21.9188 (2.76)     0.0000 (1.0)      21.9188 (2.76)     0.0000 (1.0)           0;0  0.0456 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.1572 (2.79)     22.1572 (2.79)     22.1572 (2.79)     0.0000 (1.0)      22.1572 (2.79)     0.0000 (1.0)           0;0  0.0451 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9531 (1.0)       7.9531 (1.0)       7.9531 (1.0)      0.0000 (1.0)       7.9531 (1.0)      0.0000 (1.0)           0;0  0.1257 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3826 (1.05)      8.3826 (1.05)      8.3826 (1.05)     0.0000 (1.0)       8.3826 (1.05)     0.0000 (1.0)           0;0  0.1193 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5362 (1.35)     6.5362 (1.35)     6.5362 (1.35)     0.0000 (1.0)      6.5362 (1.35)     0.0000 (1.0)           0;0  0.1530 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0892 (1.46)     7.0892 (1.46)     7.0892 (1.46)     0.0000 (1.0)      7.0892 (1.46)     0.0000 (1.0)           0;0  0.1411 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9903 (1.44)     6.9903 (1.44)     6.9903 (1.44)     0.0000 (1.0)      6.9903 (1.44)     0.0000 (1.0)           0;0  0.1431 (0.69)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8441 (1.0)      4.8441 (1.0)      4.8441 (1.0)      0.0000 (1.0)      4.8441 (1.0)      0.0000 (1.0)           0;0  0.2064 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2462 (1.08)     5.2462 (1.08)     5.2462 (1.08)     0.0000 (1.0)      5.2462 (1.08)     0.0000 (1.0)           0;0  0.1906 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.4178 (2.66)     18.4178 (2.66)     18.4178 (2.66)     0.0000 (1.0)      18.4178 (2.66)     0.0000 (1.0)           0;0  0.0543 (0.38)          1           1
test_diff-diff[3.10.0]     18.9865 (2.74)     18.9865 (2.74)     18.9865 (2.74)     0.0000 (1.0)      18.9865 (2.74)     0.0000 (1.0)           0;0  0.0527 (0.37)          1           1
test_diff-diff[3.53.2]     19.0710 (2.75)     19.0710 (2.75)     19.0710 (2.75)     0.0000 (1.0)      19.0710 (2.75)     0.0000 (1.0)           0;0  0.0524 (0.36)          1           1
test_diff-diff[3.60.1]      6.9334 (1.0)       6.9334 (1.0)       6.9334 (1.0)      0.0000 (1.0)       6.9334 (1.0)      0.0000 (1.0)           0;0  0.1442 (1.0)           1           1
test_diff-diff[main]        7.8548 (1.13)      7.8548 (1.13)      7.8548 (1.13)     0.0000 (1.0)       7.8548 (1.13)     0.0000 (1.0)           0;0  0.1273 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0297 (1.74)     6.0297 (1.74)     6.0297 (1.74)     0.0000 (1.0)      6.0297 (1.74)     0.0000 (1.0)           0;0  0.1658 (0.58)          1           1
test_diff-diff-changed[3.10.0]     6.7133 (1.93)     6.7133 (1.93)     6.7133 (1.93)     0.0000 (1.0)      6.7133 (1.93)     0.0000 (1.0)           0;0  0.1490 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.6512 (1.63)     5.6512 (1.63)     5.6512 (1.63)     0.0000 (1.0)      5.6512 (1.63)     0.0000 (1.0)           0;0  0.1770 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4738 (1.0)      3.4738 (1.0)      3.4738 (1.0)      0.0000 (1.0)      3.4738 (1.0)      0.0000 (1.0)           0;0  0.2879 (1.0)           1           1
test_diff-diff-changed[main]       4.2990 (1.24)     4.2990 (1.24)     4.2990 (1.24)     0.0000 (1.0)      4.2990 (1.24)     0.0000 (1.0)           0;0  0.2326 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1310 (1.49)     5.1310 (1.49)     5.1310 (1.49)     0.0000 (1.0)      5.1310 (1.49)     0.0000 (1.0)           0;0  0.1949 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8506 (1.70)     5.8506 (1.70)     5.8506 (1.70)     0.0000 (1.0)      5.8506 (1.70)     0.0000 (1.0)           0;0  0.1709 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6317 (1.64)     5.6317 (1.64)     5.6317 (1.64)     0.0000 (1.0)      5.6317 (1.64)     0.0000 (1.0)           0;0  0.1776 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4353 (1.0)      3.4353 (1.0)      3.4353 (1.0)      0.0000 (1.0)      3.4353 (1.0)      0.0000 (1.0)           0;0  0.2911 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2645 (1.24)     4.2645 (1.24)     4.2645 (1.24)     0.0000 (1.0)      4.2645 (1.24)     0.0000 (1.0)           0;0  0.2345 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0760 (1.18)     4.0760 (1.18)     4.0760 (1.18)     0.0000 (1.0)      4.0760 (1.18)     0.0000 (1.0)           0;0  0.2453 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.8488 (1.40)     4.8488 (1.40)     4.8488 (1.40)     0.0000 (1.0)      4.8488 (1.40)     0.0000 (1.0)           0;0  0.2062 (0.72)          1           1
test_diff-diff-noop[3.53.2]     5.6577 (1.63)     5.6577 (1.63)     5.6577 (1.63)     0.0000 (1.0)      5.6577 (1.63)     0.0000 (1.0)           0;0  0.1768 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.4680 (1.0)      3.4680 (1.0)      3.4680 (1.0)      0.0000 (1.0)      3.4680 (1.0)      0.0000 (1.0)           0;0  0.2884 (1.0)           1           1
test_diff-diff-noop[main]       4.2524 (1.23)     4.2524 (1.23)     4.2524 (1.23)     0.0000 (1.0)      4.2524 (1.23)     0.0000 (1.0)           0;0  0.2352 (0.82)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        968.7318 (1.0)         968.7318 (1.0)         968.7318 (1.0)      0.0000 (1.0)         968.7318 (1.0)      0.0000 (1.0)           0;0  1.0323 (1.0)           1           1
test_exp_show-exp[3.10.0]     11,895.9792 (12.28)    11,895.9792 (12.28)    11,895.9792 (12.28)    0.0000 (1.0)      11,895.9792 (12.28)    0.0000 (1.0)           0;0  0.0841 (0.08)          1           1
test_exp_show-exp[3.53.2]      6,332.8562 (6.54)      6,332.8562 (6.54)      6,332.8562 (6.54)     0.0000 (1.0)       6,332.8562 (6.54)     0.0000 (1.0)           0;0  0.1579 (0.15)          1           1
test_exp_show-exp[3.60.1]      6,689.2168 (6.91)      6,689.2168 (6.91)      6,689.2168 (6.91)     0.0000 (1.0)       6,689.2168 (6.91)     0.0000 (1.0)           0;0  0.1495 (0.14)          1           1
test_exp_show-exp[main]       13,599.6090 (14.04)    13,599.6090 (14.04)    13,599.6090 (14.04)    0.0000 (1.0)      13,599.6090 (14.04)    0.0000 (1.0)           0;0  0.0735 (0.07)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.7360 (2.91)     66.7360 (2.91)     66.7360 (2.91)     0.0000 (1.0)      66.7360 (2.91)     0.0000 (1.0)           0;0  0.0150 (0.34)          1           1
test_fetch-fetch[3.10.0]     70.6248 (3.08)     70.6248 (3.08)     70.6248 (3.08)     0.0000 (1.0)      70.6248 (3.08)     0.0000 (1.0)           0;0  0.0142 (0.32)          1           1
test_fetch-fetch[3.53.2]     32.6452 (1.42)     32.6452 (1.42)     32.6452 (1.42)     0.0000 (1.0)      32.6452 (1.42)     0.0000 (1.0)           0;0  0.0306 (0.70)          1           1
test_fetch-fetch[3.60.1]     22.9203 (1.0)      22.9203 (1.0)      22.9203 (1.0)      0.0000 (1.0)      22.9203 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
test_fetch-fetch[main]       23.0419 (1.01)     23.0419 (1.01)     23.0419 (1.01)     0.0000 (1.0)      23.0419 (1.01)     0.0000 (1.0)           0;0  0.0434 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8144 (1.0)      2.8144 (1.0)      2.8144 (1.0)      0.0000 (1.0)      2.8144 (1.0)      0.0000 (1.0)           0;0  0.3553 (1.0)           1           1
test_gc-gc[3.10.0]     2.9292 (1.04)     2.9292 (1.04)     2.9292 (1.04)     0.0000 (1.0)      2.9292 (1.04)     0.0000 (1.0)           0;0  0.3414 (0.96)          1           1
test_gc-gc[3.53.2]     2.8302 (1.01)     2.8302 (1.01)     2.8302 (1.01)     0.0000 (1.0)      2.8302 (1.01)     0.0000 (1.0)           0;0  0.3533 (0.99)          1           1
test_gc-gc[3.60.1]     2.8701 (1.02)     2.8701 (1.02)     2.8701 (1.02)     0.0000 (1.0)      2.8701 (1.02)     0.0000 (1.0)           0;0  0.3484 (0.98)          1           1
test_gc-gc[main]       2.9794 (1.06)     2.9794 (1.06)     2.9794 (1.06)     0.0000 (1.0)      2.9794 (1.06)     0.0000 (1.0)           0;0  0.3356 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     133.7201 (2.72)     133.7201 (2.72)     133.7201 (2.72)     0.0000 (1.0)      133.7201 (2.72)     0.0000 (1.0)           0;0  0.0075 (0.37)          1           1
test_get-get[3.10.0]     162.8618 (3.31)     162.8618 (3.31)     162.8618 (3.31)     0.0000 (1.0)      162.8618 (3.31)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.6117 (2.92)     143.6117 (2.92)     143.6117 (2.92)     0.0000 (1.0)      143.6117 (2.92)     0.0000 (1.0)           0;0  0.0070 (0.34)          1           1
test_get-get[3.60.1]      49.2130 (1.0)       49.2130 (1.0)       49.2130 (1.0)      0.0000 (1.0)       49.2130 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
test_get-get[main]        49.4499 (1.00)      49.4499 (1.00)      49.4499 (1.00)     0.0000 (1.0)       49.4499 (1.00)     0.0000 (1.0)           0;0  0.0202 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.1363 (2.70)     45.1363 (2.70)     45.1363 (2.70)     0.0000 (1.0)      45.1363 (2.70)     0.0000 (1.0)           0;0  0.0222 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.1816 (2.89)     48.1816 (2.89)     48.1816 (2.89)     0.0000 (1.0)      48.1816 (2.89)     0.0000 (1.0)           0;0  0.0208 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.7505 (1.00)     16.7505 (1.00)     16.7505 (1.00)     0.0000 (1.0)      16.7505 (1.00)     0.0000 (1.0)           0;0  0.0597 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.6986 (1.0)      16.6986 (1.0)      16.6986 (1.0)      0.0000 (1.0)      16.6986 (1.0)      0.0000 (1.0)           0;0  0.0599 (1.0)           1           1
test_get_url-get-url[main]       16.8564 (1.01)     16.8564 (1.01)     16.8564 (1.01)     0.0000 (1.0)      16.8564 (1.01)     0.0000 (1.0)           0;0  0.0593 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.1958 (1.00)     133.8154 (1.01)     127.8975 (1.02)     2.3925 (1.30)     127.7371 (1.02)     3.3159 (1.36)         36;0  7.8188 (0.98)        100           1
test_help---help[3.10.0]     122.7048 (1.0)      133.5446 (1.00)     125.9465 (1.0)      2.0872 (1.14)     125.6084 (1.0)      2.5585 (1.05)         32;2  7.9399 (1.0)         100           1
test_help---help[3.53.2]     125.2298 (1.02)     132.9972 (1.0)      127.9559 (1.02)     1.8365 (1.0)      127.9268 (1.02)     2.4360 (1.0)          33;3  7.8152 (0.98)        100           1
test_help---help[3.60.1]     126.4582 (1.03)     162.8728 (1.22)     131.7012 (1.05)     5.8362 (3.18)     130.0767 (1.04)     3.9800 (1.63)          7;7  7.5929 (0.96)        100           1
test_help---help[main]       126.3836 (1.03)     147.2866 (1.11)     131.4282 (1.04)     2.8859 (1.57)     130.9142 (1.04)     2.6489 (1.09)         21;4  7.6087 (0.96)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     223.7294 (2.98)     223.7294 (2.98)     223.7294 (2.98)     0.0000 (1.0)      223.7294 (2.98)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     256.0504 (3.41)     256.0504 (3.41)     256.0504 (3.41)     0.0000 (1.0)      256.0504 (3.41)     0.0000 (1.0)           0;0  0.0039 (0.29)          1           1
test_import-import[3.60.1]      75.1346 (1.0)       75.1346 (1.0)       75.1346 (1.0)      0.0000 (1.0)       75.1346 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        76.6738 (1.02)      76.6738 (1.02)      76.6738 (1.02)     0.0000 (1.0)       76.6738 (1.02)     0.0000 (1.0)           0;0  0.0130 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     161.1060 (3.38)     161.1060 (3.38)     161.1060 (3.38)     0.0000 (1.0)      161.1060 (3.38)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_import_url-import-url[3.10.0]     163.7823 (3.44)     163.7823 (3.44)     163.7823 (3.44)     0.0000 (1.0)      163.7823 (3.44)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.53.2]     121.8663 (2.56)     121.8663 (2.56)     121.8663 (2.56)     0.0000 (1.0)      121.8663 (2.56)     0.0000 (1.0)           0;0  0.0082 (0.39)          1           1
test_import_url-import-url[3.60.1]      47.6777 (1.0)       47.6777 (1.0)       47.6777 (1.0)      0.0000 (1.0)       47.6777 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
test_import_url-import-url[main]        48.9879 (1.03)      48.9879 (1.03)      48.9879 (1.03)     0.0000 (1.0)       48.9879 (1.03)     0.0000 (1.0)           0;0  0.0204 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     384.7059 (1.01)     413.6758 (1.04)     392.2670 (1.01)      4.1066 (1.16)     391.8443 (1.02)     4.8883 (1.08)         24;1  2.5493 (0.99)        100           1
test_init-init[3.10.0]     394.5563 (1.04)     427.2208 (1.08)     402.6095 (1.04)      5.3637 (1.52)     401.5099 (1.04)     5.0360 (1.11)         15;4  2.4838 (0.96)        100           1
test_init-init[3.53.2]     380.3516 (1.0)      397.1163 (1.0)      386.7057 (1.0)       3.9423 (1.11)     385.9815 (1.0)      4.7404 (1.05)         35;3  2.5859 (1.0)         100           1
test_init-init[3.60.1]     382.2284 (1.00)     400.1302 (1.01)     388.6594 (1.01)      3.5393 (1.0)      388.0244 (1.01)     4.5311 (1.0)          28;3  2.5729 (0.99)        100           1
test_init-init[main]       416.7378 (1.10)     552.4122 (1.39)     425.4366 (1.10)     15.5709 (4.40)     422.7370 (1.10)     4.7425 (1.05)          2;5  2.3505 (0.91)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     643.3816 (1.13)     643.3816 (1.13)     643.3816 (1.13)     0.0000 (1.0)      643.3816 (1.13)     0.0000 (1.0)           0;0  1.5543 (0.88)          1           1
test_list-list[3.10.0]     705.9433 (1.24)     705.9433 (1.24)     705.9433 (1.24)     0.0000 (1.0)      705.9433 (1.24)     0.0000 (1.0)           0;0  1.4165 (0.80)          1           1
test_list-list[3.53.2]     599.4135 (1.06)     599.4135 (1.06)     599.4135 (1.06)     0.0000 (1.0)      599.4135 (1.06)     0.0000 (1.0)           0;0  1.6683 (0.95)          1           1
test_list-list[3.60.1]     567.3421 (1.0)      567.3421 (1.0)      567.3421 (1.0)      0.0000 (1.0)      567.3421 (1.0)      0.0000 (1.0)           0;0  1.7626 (1.0)           1           1
test_list-list[main]       596.9316 (1.05)     596.9316 (1.05)     596.9316 (1.05)     0.0000 (1.0)      596.9316 (1.05)     0.0000 (1.0)           0;0  1.6752 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     439.6094 (1.08)     439.6094 (1.08)     439.6094 (1.08)     0.0000 (1.0)      439.6094 (1.08)     0.0000 (1.0)           0;0  2.2747 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     448.3190 (1.10)     448.3190 (1.10)     448.3190 (1.10)     0.0000 (1.0)      448.3190 (1.10)     0.0000 (1.0)           0;0  2.2306 (0.91)          1           1
test_list-list-dvc-only[3.53.2]     408.7097 (1.0)      408.7097 (1.0)      408.7097 (1.0)      0.0000 (1.0)      408.7097 (1.0)      0.0000 (1.0)           0;0  2.4467 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     418.4334 (1.02)     418.4334 (1.02)     418.4334 (1.02)     0.0000 (1.0)      418.4334 (1.02)     0.0000 (1.0)           0;0  2.3899 (0.98)          1           1
test_list-list-dvc-only[main]       415.2451 (1.02)     415.2451 (1.02)     415.2451 (1.02)     0.0000 (1.0)      415.2451 (1.02)     0.0000 (1.0)           0;0  2.4082 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8460 (1.0)      2.8460 (1.0)      2.8460 (1.0)      0.0000 (1.0)      2.8460 (1.0)      0.0000 (1.0)           0;0  0.3514 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.9467 (1.04)     2.9467 (1.04)     2.9467 (1.04)     0.0000 (1.0)      2.9467 (1.04)     0.0000 (1.0)           0;0  0.3394 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.8813 (1.01)     2.8813 (1.01)     2.8813 (1.01)     0.0000 (1.0)      2.8813 (1.01)     0.0000 (1.0)           0;0  0.3471 (0.99)          1           1
test_list-list-recursive[3.60.1]     2.9110 (1.02)     2.9110 (1.02)     2.9110 (1.02)     0.0000 (1.0)      2.9110 (1.02)     0.0000 (1.0)           0;0  0.3435 (0.98)          1           1
test_list-list-recursive[main]       3.0387 (1.07)     3.0387 (1.07)     3.0387 (1.07)     0.0000 (1.0)      3.0387 (1.07)     0.0000 (1.0)           0;0  0.3291 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     437.2276 (1.05)     437.2276 (1.05)     437.2276 (1.05)     0.0000 (1.0)      437.2276 (1.05)     0.0000 (1.0)           0;0  2.2871 (0.95)          1           1
test_list-list-shallow[3.10.0]     438.5514 (1.06)     438.5514 (1.06)     438.5514 (1.06)     0.0000 (1.0)      438.5514 (1.06)     0.0000 (1.0)           0;0  2.2802 (0.95)          1           1
test_list-list-shallow[3.53.2]     414.9573 (1.0)      414.9573 (1.0)      414.9573 (1.0)      0.0000 (1.0)      414.9573 (1.0)      0.0000 (1.0)           0;0  2.4099 (1.0)           1           1
test_list-list-shallow[3.60.1]     416.2439 (1.00)     416.2439 (1.00)     416.2439 (1.00)     0.0000 (1.0)      416.2439 (1.00)     0.0000 (1.0)           0;0  2.4024 (1.00)          1           1
test_list-list-shallow[main]       429.9685 (1.04)     429.9685 (1.04)     429.9685 (1.04)     0.0000 (1.0)      429.9685 (1.04)     0.0000 (1.0)           0;0  2.3258 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     75.5654 (3.79)     75.5654 (3.79)     75.5654 (3.79)     0.0000 (1.0)      75.5654 (3.79)     0.0000 (1.0)           0;0  0.0132 (0.26)          1           1
test_partial_add-add[3.10.0]     75.5481 (3.79)     75.5481 (3.79)     75.5481 (3.79)     0.0000 (1.0)      75.5481 (3.79)     0.0000 (1.0)           0;0  0.0132 (0.26)          1           1
test_partial_add-add[3.53.2]     68.1866 (3.42)     68.1866 (3.42)     68.1866 (3.42)     0.0000 (1.0)      68.1866 (3.42)     0.0000 (1.0)           0;0  0.0147 (0.29)          1           1
test_partial_add-add[3.60.1]     19.9188 (1.0)      19.9188 (1.0)      19.9188 (1.0)      0.0000 (1.0)      19.9188 (1.0)      0.0000 (1.0)           0;0  0.0502 (1.0)           1           1
test_partial_add-add[main]       20.9221 (1.05)     20.9221 (1.05)     20.9221 (1.05)     0.0000 (1.0)      20.9221 (1.05)     0.0000 (1.0)           0;0  0.0478 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     64.0492 (7.83)     64.0492 (7.83)     64.0492 (7.83)     0.0000 (1.0)      64.0492 (7.83)     0.0000 (1.0)           0;0  0.0156 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     64.5414 (7.89)     64.5414 (7.89)     64.5414 (7.89)     0.0000 (1.0)      64.5414 (7.89)     0.0000 (1.0)           0;0  0.0155 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     58.2119 (7.11)     58.2119 (7.11)     58.2119 (7.11)     0.0000 (1.0)      58.2119 (7.11)     0.0000 (1.0)           0;0  0.0172 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      8.1849 (1.0)       8.1849 (1.0)       8.1849 (1.0)      0.0000 (1.0)       8.1849 (1.0)      0.0000 (1.0)           0;0  0.1222 (1.0)           1           1
test_partial_add-add-partial[main]        8.4820 (1.04)      8.4820 (1.04)      8.4820 (1.04)     0.0000 (1.0)       8.4820 (1.04)     0.0000 (1.0)           0;0  0.1179 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5982 (1.0)      4.5982 (1.0)      4.5982 (1.0)      0.0000 (1.0)      4.5982 (1.0)      0.0000 (1.0)           0;0  0.2175 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9562 (1.30)     5.9562 (1.30)     5.9562 (1.30)     0.0000 (1.0)      5.9562 (1.30)     0.0000 (1.0)           0;0  0.1679 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7402 (1.47)     6.7402 (1.47)     6.7402 (1.47)     0.0000 (1.0)      6.7402 (1.47)     0.0000 (1.0)           0;0  0.1484 (0.68)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6793 (1.45)     6.6793 (1.45)     6.6793 (1.45)     0.0000 (1.0)      6.6793 (1.45)     0.0000 (1.0)           0;0  0.1497 (0.69)          1           1
test_partial_add-gc-cloud-noop[main]       6.6598 (1.45)     6.6598 (1.45)     6.6598 (1.45)     0.0000 (1.0)      6.6598 (1.45)     0.0000 (1.0)           0;0  0.1502 (0.69)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4842 (1.0)      2.4842 (1.0)      2.4842 (1.0)      0.0000 (1.0)      2.4842 (1.0)      0.0000 (1.0)           0;0  0.4025 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6876 (1.48)     3.6876 (1.48)     3.6876 (1.48)     0.0000 (1.0)      3.6876 (1.48)     0.0000 (1.0)           0;0  0.2712 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.7005 (1.49)     3.7005 (1.49)     3.7005 (1.49)     0.0000 (1.0)      3.7005 (1.49)     0.0000 (1.0)           0;0  0.2702 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.8223 (1.54)     3.8223 (1.54)     3.8223 (1.54)     0.0000 (1.0)      3.8223 (1.54)     0.0000 (1.0)           0;0  0.2616 (0.65)          1           1
test_partial_add-gc-noop[main]       3.7548 (1.51)     3.7548 (1.51)     3.7548 (1.51)     0.0000 (1.0)      3.7548 (1.51)     0.0000 (1.0)           0;0  0.2663 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.0988 (2.34)     45.0988 (2.34)     45.0988 (2.34)     0.0000 (1.0)      45.0988 (2.34)     0.0000 (1.0)           0;0  0.0222 (0.43)          1           1
test_partial_add-push[3.10.0]     39.8730 (2.07)     39.8730 (2.07)     39.8730 (2.07)     0.0000 (1.0)      39.8730 (2.07)     0.0000 (1.0)           0;0  0.0251 (0.48)          1           1
test_partial_add-push[3.53.2]     20.1756 (1.05)     20.1756 (1.05)     20.1756 (1.05)     0.0000 (1.0)      20.1756 (1.05)     0.0000 (1.0)           0;0  0.0496 (0.96)          1           1
test_partial_add-push[3.60.1]     19.2954 (1.0)      19.2954 (1.0)      19.2954 (1.0)      0.0000 (1.0)      19.2954 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
test_partial_add-push[main]       19.7883 (1.03)     19.7883 (1.03)     19.7883 (1.03)     0.0000 (1.0)      19.7883 (1.03)     0.0000 (1.0)           0;0  0.0505 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.4671 (1.10)     11.4671 (1.10)     11.4671 (1.10)     0.0000 (1.0)      11.4671 (1.10)     0.0000 (1.0)           0;0  0.0872 (0.91)          1           1
test_partial_add-push-partial[3.10.0]     10.7762 (1.03)     10.7762 (1.03)     10.7762 (1.03)     0.0000 (1.0)      10.7762 (1.03)     0.0000 (1.0)           0;0  0.0928 (0.97)          1           1
test_partial_add-push-partial[3.53.2]     10.8583 (1.04)     10.8583 (1.04)     10.8583 (1.04)     0.0000 (1.0)      10.8583 (1.04)     0.0000 (1.0)           0;0  0.0921 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     10.4904 (1.00)     10.4904 (1.00)     10.4904 (1.00)     0.0000 (1.0)      10.4904 (1.00)     0.0000 (1.0)           0;0  0.0953 (1.00)          1           1
test_partial_add-push-partial[main]       10.4495 (1.0)      10.4495 (1.0)      10.4495 (1.0)      0.0000 (1.0)      10.4495 (1.0)      0.0000 (1.0)           0;0  0.0957 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     84.7516 (3.69)     84.7516 (3.69)     84.7516 (3.69)     0.0000 (1.0)      84.7516 (3.69)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.9861 (3.70)     84.9861 (3.70)     84.9861 (3.70)     0.0000 (1.0)      84.9861 (3.70)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.4309 (3.28)     75.4309 (3.28)     75.4309 (3.28)     0.0000 (1.0)      75.4309 (3.28)     0.0000 (1.0)           0;0  0.0133 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.9898 (1.0)      22.9898 (1.0)      22.9898 (1.0)      0.0000 (1.0)      22.9898 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_partial_remove-add[main]       24.3327 (1.06)     24.3327 (1.06)     24.3327 (1.06)     0.0000 (1.0)      24.3327 (1.06)     0.0000 (1.0)           0;0  0.0411 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.6979 (8.16)     8.6979 (8.16)     8.6979 (8.16)     0.0000 (1.0)      8.6979 (8.16)     0.0000 (1.0)           0;0  0.1150 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.6835 (8.14)     8.6835 (8.14)     8.6835 (8.14)     0.0000 (1.0)      8.6835 (8.14)     0.0000 (1.0)           0;0  0.1152 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.6318 (7.16)     7.6318 (7.16)     7.6318 (7.16)     0.0000 (1.0)      7.6318 (7.16)     0.0000 (1.0)           0;0  0.1310 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0665 (1.0)      1.0665 (1.0)      1.0665 (1.0)      0.0000 (1.0)      1.0665 (1.0)      0.0000 (1.0)           0;0  0.9377 (1.0)           1           1
test_partial_remove-add-update[main]       1.0879 (1.02)     1.0879 (1.02)     1.0879 (1.02)     0.0000 (1.0)      1.0879 (1.02)     0.0000 (1.0)           0;0  0.9192 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2808 (1.0)      3.2808 (1.0)      3.2808 (1.0)      0.0000 (1.0)      3.2808 (1.0)      0.0000 (1.0)           0;0  0.3048 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7126 (1.13)     3.7126 (1.13)     3.7126 (1.13)     0.0000 (1.0)      3.7126 (1.13)     0.0000 (1.0)           0;0  0.2694 (0.88)          1           1
test_partial_remove-gc[3.53.2]     3.5125 (1.07)     3.5125 (1.07)     3.5125 (1.07)     0.0000 (1.0)      3.5125 (1.07)     0.0000 (1.0)           0;0  0.2847 (0.93)          1           1
test_partial_remove-gc[3.60.1]     3.9291 (1.20)     3.9291 (1.20)     3.9291 (1.20)     0.0000 (1.0)      3.9291 (1.20)     0.0000 (1.0)           0;0  0.2545 (0.84)          1           1
test_partial_remove-gc[main]       3.6134 (1.10)     3.6134 (1.10)     3.6134 (1.10)     0.0000 (1.0)      3.6134 (1.10)     0.0000 (1.0)           0;0  0.2767 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.9666 (1.09)     4.9666 (1.09)     4.9666 (1.09)     0.0000 (1.0)      4.9666 (1.09)     0.0000 (1.0)           0;0  0.2013 (0.92)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.4025 (1.19)     5.4025 (1.19)     5.4025 (1.19)     0.0000 (1.0)      5.4025 (1.19)     0.0000 (1.0)           0;0  0.1851 (0.84)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.9848 (1.10)     4.9848 (1.10)     4.9848 (1.10)     0.0000 (1.0)      4.9848 (1.10)     0.0000 (1.0)           0;0  0.2006 (0.91)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.7325 (1.04)     4.7325 (1.04)     4.7325 (1.04)     0.0000 (1.0)      4.7325 (1.04)     0.0000 (1.0)           0;0  0.2113 (0.96)          1           1
test_partial_remove-gc-cloud[main]       4.5495 (1.0)      4.5495 (1.0)      4.5495 (1.0)      0.0000 (1.0)      4.5495 (1.0)      0.0000 (1.0)           0;0  0.2198 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     54.0723 (2.38)     54.0723 (2.38)     54.0723 (2.38)     0.0000 (1.0)      54.0723 (2.38)     0.0000 (1.0)           0;0  0.0185 (0.42)          1           1
test_partial_remove-push[3.10.0]     47.9213 (2.11)     47.9213 (2.11)     47.9213 (2.11)     0.0000 (1.0)      47.9213 (2.11)     0.0000 (1.0)           0;0  0.0209 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.2375 (1.02)     23.2375 (1.02)     23.2375 (1.02)     0.0000 (1.0)      23.2375 (1.02)     0.0000 (1.0)           0;0  0.0430 (0.98)          1           1
test_partial_remove-push[3.60.1]     22.7525 (1.0)      22.7525 (1.0)      22.7525 (1.0)      0.0000 (1.0)      22.7525 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_partial_remove-push[main]       22.9766 (1.01)     22.9766 (1.01)     22.9766 (1.01)     0.0000 (1.0)      22.9766 (1.01)     0.0000 (1.0)           0;0  0.0435 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8209 (1.0)      1.8209 (1.0)      1.8209 (1.0)      0.0000 (1.0)      1.8209 (1.0)      0.0000 (1.0)           0;0  0.5492 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8372 (1.01)     1.8372 (1.01)     1.8372 (1.01)     0.0000 (1.0)      1.8372 (1.01)     0.0000 (1.0)           0;0  0.5443 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.4832 (1.36)     2.4832 (1.36)     2.4832 (1.36)     0.0000 (1.0)      2.4832 (1.36)     0.0000 (1.0)           0;0  0.4027 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.4795 (1.36)     2.4795 (1.36)     2.4795 (1.36)     0.0000 (1.0)      2.4795 (1.36)     0.0000 (1.0)           0;0  0.4033 (0.73)          1           1
test_partial_remove-push-update[main]       2.4966 (1.37)     2.4966 (1.37)     2.4966 (1.37)     0.0000 (1.0)      2.4966 (1.37)     0.0000 (1.0)           0;0  0.4005 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     513.4022 (1.0)      544.1128 (1.0)      529.2451 (1.0)      11.7135 (1.96)     531.7214 (1.0)      16.5213 (1.60)          2;0  1.8895 (1.0)           5           3
test_plots-plots-diff[3.10.0]     900.1706 (1.75)     995.4738 (1.83)     935.7219 (1.77)     38.8023 (6.49)     920.1635 (1.73)     55.8021 (5.39)          1;0  1.0687 (0.57)          5           3
test_plots-plots-diff[3.53.2]     922.5475 (1.80)     940.4142 (1.73)     933.2183 (1.76)      7.3917 (1.24)     933.1494 (1.75)     11.7083 (1.13)          1;0  1.0716 (0.57)          5           3
test_plots-plots-diff[3.60.1]     890.2228 (1.73)     910.9047 (1.67)     899.4721 (1.70)      8.0470 (1.35)     897.1098 (1.69)     11.6369 (1.12)          2;0  1.1118 (0.59)          5           3
test_plots-plots-diff[main]       812.3603 (1.58)     825.2016 (1.52)     820.0840 (1.55)      5.9816 (1.0)      823.4911 (1.55)     10.3527 (1.0)           1;0  1.2194 (0.65)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       536.4663 (1.0)        553.8863 (1.0)        543.7299 (1.0)       6.8376 (1.0)        541.9054 (1.0)       9.8870 (1.18)          2;0  1.8391 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,171.6225 (2.18)     1,286.2490 (2.32)     1,199.5825 (2.21)     48.6712 (7.12)     1,181.0463 (2.18)     34.6832 (4.13)          1;1  0.8336 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       970.2354 (1.81)       998.0530 (1.80)       987.5753 (1.82)     10.3491 (1.51)       990.3866 (1.83)      8.3969 (1.0)           2;1  1.0126 (0.55)          5           3
test_plots-plots-diff-json[3.60.1]       975.4950 (1.82)     1,019.3537 (1.84)       999.2492 (1.84)     19.2714 (2.82)     1,001.9522 (1.85)     34.9023 (4.16)          2;0  1.0008 (0.54)          5           3
test_plots-plots-diff-json[main]         906.0034 (1.69)       994.6297 (1.80)       954.9781 (1.76)     38.7878 (5.67)       946.1436 (1.75)     67.2104 (8.00)          3;0  1.0471 (0.57)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     437.3488 (1.0)      449.7908 (1.0)      442.2728 (1.0)       4.7856 (1.57)     442.1130 (1.0)       6.0828 (1.99)          2;0  2.2610 (1.0)           5           3
test_plots-plots-show[3.10.0]     789.0207 (1.80)     820.4540 (1.82)     805.3704 (1.82)     15.1833 (4.98)     809.0117 (1.83)     29.3672 (9.61)          2;0  1.2417 (0.55)          5           3
test_plots-plots-show[3.53.2]     766.8857 (1.75)     815.8741 (1.81)     795.3189 (1.80)     19.9018 (6.53)     796.6809 (1.80)     31.5233 (10.31)         2;0  1.2574 (0.56)          5           3
test_plots-plots-show[3.60.1]     750.5883 (1.72)     793.9981 (1.77)     774.2176 (1.75)     21.1103 (6.92)     786.6661 (1.78)     37.7067 (12.34)         2;0  1.2916 (0.57)          5           3
test_plots-plots-show[main]       697.4971 (1.59)     705.7445 (1.57)     700.8108 (1.58)      3.0485 (1.0)      700.0158 (1.58)      3.0567 (1.0)           2;0  1.4269 (0.63)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     455.5701 (1.0)      461.0179 (1.0)      457.5283 (1.0)       2.3782 (1.0)      456.3986 (1.0)       3.7933 (1.0)           1;0  2.1857 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     902.7744 (1.98)     968.3972 (2.10)     947.5186 (2.07)     25.7361 (10.82)    955.5642 (2.09)     21.3312 (5.62)          1;1  1.0554 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     837.0010 (1.84)     873.7635 (1.90)     854.4845 (1.87)     15.9273 (6.70)     854.2893 (1.87)     28.6340 (7.55)          2;0  1.1703 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     811.8569 (1.78)     842.4546 (1.83)     828.6235 (1.81)     10.9399 (4.60)     829.7616 (1.82)      9.6026 (2.53)          2;0  1.2068 (0.55)          5           3
test_plots-plots-show-json[main]       752.3874 (1.65)     767.8402 (1.67)     758.9076 (1.66)      7.1160 (2.99)     756.1485 (1.66)     12.8988 (3.40)          1;0  1.3177 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.1727 (2.41)     53.1727 (2.41)     53.1727 (2.41)     0.0000 (1.0)      53.1727 (2.41)     0.0000 (1.0)           0;0  0.0188 (0.41)          1           1
test_push-push[3.10.0]     47.6863 (2.16)     47.6863 (2.16)     47.6863 (2.16)     0.0000 (1.0)      47.6863 (2.16)     0.0000 (1.0)           0;0  0.0210 (0.46)          1           1
test_push-push[3.53.2]     23.2796 (1.06)     23.2796 (1.06)     23.2796 (1.06)     0.0000 (1.0)      23.2796 (1.06)     0.0000 (1.0)           0;0  0.0430 (0.95)          1           1
test_push-push[3.60.1]     22.0850 (1.00)     22.0850 (1.00)     22.0850 (1.00)     0.0000 (1.0)      22.0850 (1.00)     0.0000 (1.0)           0;0  0.0453 (1.00)          1           1
test_push-push[main]       22.0590 (1.0)      22.0590 (1.0)      22.0590 (1.0)      0.0000 (1.0)      22.0590 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.2805 (2.80)     64.2805 (2.80)     64.2805 (2.80)     0.0000 (1.0)      64.2805 (2.80)     0.0000 (1.0)           0;0  0.0156 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.2612 (3.02)     69.2612 (3.02)     69.2612 (3.02)     0.0000 (1.0)      69.2612 (3.02)     0.0000 (1.0)           0;0  0.0144 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.0410 (1.44)     33.0410 (1.44)     33.0410 (1.44)     0.0000 (1.0)      33.0410 (1.44)     0.0000 (1.0)           0;0  0.0303 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.0459 (1.01)     23.0459 (1.01)     23.0459 (1.01)     0.0000 (1.0)      23.0459 (1.01)     0.0000 (1.0)           0;0  0.0434 (0.99)          1           1
test_sharing-fetch[main]       22.9211 (1.0)      22.9211 (1.0)      22.9211 (1.0)      0.0000 (1.0)      22.9211 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2117 (1.0)      1.2117 (1.0)      1.2117 (1.0)      0.0000 (1.0)      1.2117 (1.0)      0.0000 (1.0)           0;0  0.8253 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5306 (2.91)     3.5306 (2.91)     3.5306 (2.91)     0.0000 (1.0)      3.5306 (2.91)     0.0000 (1.0)           0;0  0.2832 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6744 (4.68)     5.6744 (4.68)     5.6744 (4.68)     0.0000 (1.0)      5.6744 (4.68)     0.0000 (1.0)           0;0  0.1762 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.8029 (4.79)     5.8029 (4.79)     5.8029 (4.79)     0.0000 (1.0)      5.8029 (4.79)     0.0000 (1.0)           0;0  0.1723 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7603 (4.75)     5.7603 (4.75)     5.7603 (4.75)     0.0000 (1.0)      5.7603 (4.75)     0.0000 (1.0)           0;0  0.1736 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.4015 (2.43)     52.4015 (2.43)     52.4015 (2.43)     0.0000 (1.0)      52.4015 (2.43)     0.0000 (1.0)           0;0  0.0191 (0.41)          1           1
test_sharing-push[3.10.0]     46.1535 (2.14)     46.1535 (2.14)     46.1535 (2.14)     0.0000 (1.0)      46.1535 (2.14)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_sharing-push[3.53.2]     22.4191 (1.04)     22.4191 (1.04)     22.4191 (1.04)     0.0000 (1.0)      22.4191 (1.04)     0.0000 (1.0)           0;0  0.0446 (0.96)          1           1
test_sharing-push[3.60.1]     21.5332 (1.0)      21.5332 (1.0)      21.5332 (1.0)      0.0000 (1.0)      21.5332 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_sharing-push[main]       22.3848 (1.04)     22.3848 (1.04)     22.3848 (1.04)     0.0000 (1.0)      22.3848 (1.04)     0.0000 (1.0)           0;0  0.0447 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0595 (1.0)      2.0595 (1.0)      2.0595 (1.0)      0.0000 (1.0)      2.0595 (1.0)      0.0000 (1.0)           0;0  0.4855 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0619 (1.00)     2.0619 (1.00)     2.0619 (1.00)     0.0000 (1.0)      2.0619 (1.00)     0.0000 (1.0)           0;0  0.4850 (1.00)          1           1
test_sharing-push-noop[3.53.2]     5.8902 (2.86)     5.8902 (2.86)     5.8902 (2.86)     0.0000 (1.0)      5.8902 (2.86)     0.0000 (1.0)           0;0  0.1698 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.9255 (2.88)     5.9255 (2.88)     5.9255 (2.88)     0.0000 (1.0)      5.9255 (2.88)     0.0000 (1.0)           0;0  0.1688 (0.35)          1           1
test_sharing-push-noop[main]       5.9490 (2.89)     5.9490 (2.89)     5.9490 (2.89)     0.0000 (1.0)      5.9490 (2.89)     0.0000 (1.0)           0;0  0.1681 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     158.5018 (1.06)     158.5018 (1.06)     158.5018 (1.06)     0.0000 (1.0)      158.5018 (1.06)     0.0000 (1.0)           0;0  0.0063 (0.94)          1           1
test_sharing_azure-fetch[main]       148.9826 (1.0)      148.9826 (1.0)      148.9826 (1.0)      0.0000 (1.0)      148.9826 (1.0)      0.0000 (1.0)           0;0  0.0067 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.2885 (1.0)      6.2885 (1.0)      6.2885 (1.0)      0.0000 (1.0)      6.2885 (1.0)      0.0000 (1.0)           0;0  0.1590 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4952 (1.03)     6.4952 (1.03)     6.4952 (1.03)     0.0000 (1.0)      6.4952 (1.03)     0.0000 (1.0)           0;0  0.1540 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     159.6198 (1.0)      159.6198 (1.0)      159.6198 (1.0)      0.0000 (1.0)      159.6198 (1.0)      0.0000 (1.0)           0;0  0.0063 (1.0)           1           1
test_sharing_azure-push[main]       160.6802 (1.01)     160.6802 (1.01)     160.6802 (1.01)     0.0000 (1.0)      160.6802 (1.01)     0.0000 (1.0)           0;0  0.0062 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6706 (1.0)      6.6706 (1.0)      6.6706 (1.0)      0.0000 (1.0)      6.6706 (1.0)      0.0000 (1.0)           0;0  0.1499 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.8794 (1.03)     6.8794 (1.03)     6.8794 (1.03)     0.0000 (1.0)      6.8794 (1.03)     0.0000 (1.0)           0;0  0.1454 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     350.6910 (1.01)     350.6910 (1.01)     350.6910 (1.01)     0.0000 (1.0)      350.6910 (1.01)     0.0000 (1.0)           0;0  0.0029 (0.99)          1           1
test_sharing_gs-fetch[main]       346.7728 (1.0)      346.7728 (1.0)      346.7728 (1.0)      0.0000 (1.0)      346.7728 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     17.8917 (1.0)      17.8917 (1.0)      17.8917 (1.0)      0.0000 (1.0)      17.8917 (1.0)      0.0000 (1.0)           0;0  0.0559 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       19.6314 (1.10)     19.6314 (1.10)     19.6314 (1.10)     0.0000 (1.0)      19.6314 (1.10)     0.0000 (1.0)           0;0  0.0509 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     532.8176 (1.0)      532.8176 (1.0)      532.8176 (1.0)      0.0000 (1.0)      532.8176 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
test_sharing_gs-push[main]       550.0679 (1.03)     550.0679 (1.03)     550.0679 (1.03)     0.0000 (1.0)      550.0679 (1.03)     0.0000 (1.0)           0;0  0.0018 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.0763 (1.01)     7.0763 (1.01)     7.0763 (1.01)     0.0000 (1.0)      7.0763 (1.01)     0.0000 (1.0)           0;0  0.1413 (0.99)          1           1
test_sharing_gs-push-noop[main]       7.0386 (1.0)      7.0386 (1.0)      7.0386 (1.0)      0.0000 (1.0)      7.0386 (1.0)      0.0000 (1.0)           0;0  0.1421 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     758.9664 (1.02)     758.9664 (1.02)     758.9664 (1.02)     0.0000 (1.0)      758.9664 (1.02)     0.0000 (1.0)           0;0  0.0013 (0.98)          1           1
test_sharing_s3-fetch[main]       743.9338 (1.0)      743.9338 (1.0)      743.9338 (1.0)      0.0000 (1.0)      743.9338 (1.0)      0.0000 (1.0)           0;0  0.0013 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5249 (1.0)      6.5249 (1.0)      6.5249 (1.0)      0.0000 (1.0)      6.5249 (1.0)      0.0000 (1.0)           0;0  0.1533 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.6077 (1.01)     6.6077 (1.01)     6.6077 (1.01)     0.0000 (1.0)      6.6077 (1.01)     0.0000 (1.0)           0;0  0.1513 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,182.2427 (1.0)      1,182.2427 (1.0)      1,182.2427 (1.0)      0.0000 (1.0)      1,182.2427 (1.0)      0.0000 (1.0)           0;0  0.0008 (1.0)           1           1
test_sharing_s3-push[main]       1,190.4380 (1.01)     1,190.4380 (1.01)     1,190.4380 (1.01)     0.0000 (1.0)      1,190.4380 (1.01)     0.0000 (1.0)           0;0  0.0008 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.2217 (1.02)     7.2217 (1.02)     7.2217 (1.02)     0.0000 (1.0)      7.2217 (1.02)     0.0000 (1.0)           0;0  0.1385 (0.98)          1           1
test_sharing_s3-push-noop[main]       7.0632 (1.0)      7.0632 (1.0)      7.0632 (1.0)      0.0000 (1.0)      7.0632 (1.0)      0.0000 (1.0)           0;0  0.1416 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     18.9210 (3.64)     18.9210 (3.64)     18.9210 (3.64)     0.0000 (1.0)      18.9210 (3.64)     0.0000 (1.0)           0;0  0.0529 (0.27)          1           1
test_status-status[3.10.0]     19.2876 (3.71)     19.2876 (3.71)     19.2876 (3.71)     0.0000 (1.0)      19.2876 (3.71)     0.0000 (1.0)           0;0  0.0518 (0.27)          1           1
test_status-status[3.53.2]     17.4786 (3.36)     17.4786 (3.36)     17.4786 (3.36)     0.0000 (1.0)      17.4786 (3.36)     0.0000 (1.0)           0;0  0.0572 (0.30)          1           1
test_status-status[3.60.1]      5.2026 (1.0)       5.2026 (1.0)       5.2026 (1.0)      0.0000 (1.0)       5.2026 (1.0)      0.0000 (1.0)           0;0  0.1922 (1.0)           1           1
test_status-status[main]        5.4544 (1.05)      5.4544 (1.05)      5.4544 (1.05)     0.0000 (1.0)       5.4544 (1.05)     0.0000 (1.0)           0;0  0.1833 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7391 (1.74)     4.7391 (1.74)     4.7391 (1.74)     0.0000 (1.0)      4.7391 (1.74)     0.0000 (1.0)           0;0  0.2110 (0.58)          1           1
test_status-status-changed[3.10.0]     5.0239 (1.84)     5.0239 (1.84)     5.0239 (1.84)     0.0000 (1.0)      5.0239 (1.84)     0.0000 (1.0)           0;0  0.1990 (0.54)          1           1
test_status-status-changed[3.53.2]     4.8297 (1.77)     4.8297 (1.77)     4.8297 (1.77)     0.0000 (1.0)      4.8297 (1.77)     0.0000 (1.0)           0;0  0.2071 (0.56)          1           1
test_status-status-changed[3.60.1]     2.7273 (1.0)      2.7273 (1.0)      2.7273 (1.0)      0.0000 (1.0)      2.7273 (1.0)      0.0000 (1.0)           0;0  0.3667 (1.0)           1           1
test_status-status-changed[main]       2.9457 (1.08)     2.9457 (1.08)     2.9457 (1.08)     0.0000 (1.0)      2.9457 (1.08)     0.0000 (1.0)           0;0  0.3395 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8545 (1.88)     4.8545 (1.88)     4.8545 (1.88)     0.0000 (1.0)      4.8545 (1.88)     0.0000 (1.0)           0;0  0.2060 (0.53)          1           1
test_status-status-changed-noop[3.10.0]     4.8758 (1.89)     4.8758 (1.89)     4.8758 (1.89)     0.0000 (1.0)      4.8758 (1.89)     0.0000 (1.0)           0;0  0.2051 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.8762 (1.89)     4.8762 (1.89)     4.8762 (1.89)     0.0000 (1.0)      4.8762 (1.89)     0.0000 (1.0)           0;0  0.2051 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.5774 (1.0)      2.5774 (1.0)      2.5774 (1.0)      0.0000 (1.0)      2.5774 (1.0)      0.0000 (1.0)           0;0  0.3880 (1.0)           1           1
test_status-status-changed-noop[main]       2.7952 (1.08)     2.7952 (1.08)     2.7952 (1.08)     0.0000 (1.0)      2.7952 (1.08)     0.0000 (1.0)           0;0  0.3578 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8322 (1.85)     4.8322 (1.85)     4.8322 (1.85)     0.0000 (1.0)      4.8322 (1.85)     0.0000 (1.0)           0;0  0.2069 (0.54)          1           1
test_status-status-noop[3.10.0]     4.8813 (1.87)     4.8813 (1.87)     4.8813 (1.87)     0.0000 (1.0)      4.8813 (1.87)     0.0000 (1.0)           0;0  0.2049 (0.53)          1           1
test_status-status-noop[3.53.2]     4.8684 (1.87)     4.8684 (1.87)     4.8684 (1.87)     0.0000 (1.0)      4.8684 (1.87)     0.0000 (1.0)           0;0  0.2054 (0.54)          1           1
test_status-status-noop[3.60.1]     2.6081 (1.0)      2.6081 (1.0)      2.6081 (1.0)      0.0000 (1.0)      2.6081 (1.0)      0.0000 (1.0)           0;0  0.3834 (1.0)           1           1
test_status-status-noop[main]       2.8044 (1.08)     2.8044 (1.08)     2.8044 (1.08)     0.0000 (1.0)      2.8044 (1.08)     0.0000 (1.0)           0;0  0.3566 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     156.7892 (3.38)     156.7892 (3.38)     156.7892 (3.38)     0.0000 (1.0)      156.7892 (3.38)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     161.1600 (3.47)     161.1600 (3.47)     161.1600 (3.47)     0.0000 (1.0)      161.1600 (3.47)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.53.2]     118.6891 (2.56)     118.6891 (2.56)     118.6891 (2.56)     0.0000 (1.0)      118.6891 (2.56)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_update-import-url[3.60.1]      46.4299 (1.0)       46.4299 (1.0)       46.4299 (1.0)      0.0000 (1.0)       46.4299 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_update-import-url[main]        48.2270 (1.04)      48.2270 (1.04)      48.2270 (1.04)     0.0000 (1.0)       48.2270 (1.04)     0.0000 (1.0)           0;0  0.0207 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     140.5906 (3.89)     140.5906 (3.89)     140.5906 (3.89)     0.0000 (1.0)      140.5906 (3.89)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.10.0]     145.4186 (4.02)     145.4186 (4.02)     145.4186 (4.02)     0.0000 (1.0)      145.4186 (4.02)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.53.2]     111.2504 (3.08)     111.2504 (3.08)     111.2504 (3.08)     0.0000 (1.0)      111.2504 (3.08)     0.0000 (1.0)           0;0  0.0090 (0.33)          1           1
test_update-update[3.60.1]      36.1653 (1.0)       36.1653 (1.0)       36.1653 (1.0)      0.0000 (1.0)       36.1653 (1.0)      0.0000 (1.0)           0;0  0.0277 (1.0)           1           1
test_update-update[main]        37.1611 (1.03)      37.1611 (1.03)      37.1611 (1.03)     0.0000 (1.0)       37.1611 (1.03)     0.0000 (1.0)           0;0  0.0269 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.2797 (2.07)     16.2797 (2.07)     16.2797 (2.07)     0.0000 (1.0)      16.2797 (2.07)     0.0000 (1.0)           0;0  0.0614 (0.48)          1           1
test_update-update-noop[3.10.0]     16.5669 (2.11)     16.5669 (2.11)     16.5669 (2.11)     0.0000 (1.0)      16.5669 (2.11)     0.0000 (1.0)           0;0  0.0604 (0.47)          1           1
test_update-update-noop[3.53.2]     16.3164 (2.08)     16.3164 (2.08)     16.3164 (2.08)     0.0000 (1.0)      16.3164 (2.08)     0.0000 (1.0)           0;0  0.0613 (0.48)          1           1
test_update-update-noop[3.60.1]      7.8550 (1.0)       7.8550 (1.0)       7.8550 (1.0)      0.0000 (1.0)       7.8550 (1.0)      0.0000 (1.0)           0;0  0.1273 (1.0)           1           1
test_update-update-noop[main]        8.7240 (1.11)      8.7240 (1.11)      8.7240 (1.11)     0.0000 (1.0)       8.7240 (1.11)     0.0000 (1.0)           0;0  0.1146 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean