Fri Oct  3 01:03:49 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     84.5464 (3.77)     84.5464 (3.77)     84.5464 (3.77)     0.0000 (1.0)      84.5464 (3.77)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.10.0]     85.9365 (3.83)     85.9365 (3.83)     85.9365 (3.83)     0.0000 (1.0)      85.9365 (3.83)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.53.2]     75.4978 (3.37)     75.4978 (3.37)     75.4978 (3.37)     0.0000 (1.0)      75.4978 (3.37)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_add_copy-add[3.60.1]     22.4222 (1.0)      22.4222 (1.0)      22.4222 (1.0)      0.0000 (1.0)      22.4222 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_add_copy-add[main]       23.5782 (1.05)     23.5782 (1.05)     23.5782 (1.05)     0.0000 (1.0)      23.5782 (1.05)     0.0000 (1.0)           0;0  0.0424 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.5572 (6.77)     29.5572 (6.77)     29.5572 (6.77)     0.0000 (1.0)      29.5572 (6.77)     0.0000 (1.0)           0;0  0.0338 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.5471 (6.77)     29.5471 (6.77)     29.5471 (6.77)     0.0000 (1.0)      29.5471 (6.77)     0.0000 (1.0)           0;0  0.0338 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.2114 (6.46)     28.2114 (6.46)     28.2114 (6.46)     0.0000 (1.0)      28.2114 (6.46)     0.0000 (1.0)           0;0  0.0354 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.3656 (1.0)       4.3656 (1.0)       4.3656 (1.0)      0.0000 (1.0)       4.3656 (1.0)      0.0000 (1.0)           0;0  0.2291 (1.0)           1           1
test_add_copy-add-noop[main]        4.7934 (1.10)      4.7934 (1.10)      4.7934 (1.10)     0.0000 (1.0)       4.7934 (1.10)     0.0000 (1.0)           0;0  0.2086 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     71.2289 (4.24)     71.2289 (4.24)     71.2289 (4.24)     0.0000 (1.0)      71.2289 (4.24)     0.0000 (1.0)           0;0  0.0140 (0.24)          1           1
test_add_hardlink-add[3.10.0]     72.2961 (4.30)     72.2961 (4.30)     72.2961 (4.30)     0.0000 (1.0)      72.2961 (4.30)     0.0000 (1.0)           0;0  0.0138 (0.23)          1           1
test_add_hardlink-add[3.53.2]     64.8066 (3.85)     64.8066 (3.85)     64.8066 (3.85)     0.0000 (1.0)      64.8066 (3.85)     0.0000 (1.0)           0;0  0.0154 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.8171 (1.0)      16.8171 (1.0)      16.8171 (1.0)      0.0000 (1.0)      16.8171 (1.0)      0.0000 (1.0)           0;0  0.0595 (1.0)           1           1
test_add_hardlink-add[main]       17.7489 (1.06)     17.7489 (1.06)     17.7489 (1.06)     0.0000 (1.0)      17.7489 (1.06)     0.0000 (1.0)           0;0  0.0563 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     37.0575 (7.69)     37.0575 (7.69)     37.0575 (7.69)     0.0000 (1.0)      37.0575 (7.69)     0.0000 (1.0)           0;0  0.0270 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.3095 (7.75)     37.3095 (7.75)     37.3095 (7.75)     0.0000 (1.0)      37.3095 (7.75)     0.0000 (1.0)           0;0  0.0268 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.6905 (7.20)     34.6905 (7.20)     34.6905 (7.20)     0.0000 (1.0)      34.6905 (7.20)     0.0000 (1.0)           0;0  0.0288 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.8161 (1.0)       4.8161 (1.0)       4.8161 (1.0)      0.0000 (1.0)       4.8161 (1.0)      0.0000 (1.0)           0;0  0.2076 (1.0)           1           1
test_add_hardlink-add-noop[main]        5.1529 (1.07)      5.1529 (1.07)      5.1529 (1.07)     0.0000 (1.0)       5.1529 (1.07)     0.0000 (1.0)           0;0  0.1941 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.3387 (2.05)     71.3387 (2.05)     71.3387 (2.05)     0.0000 (1.0)      71.3387 (2.05)     0.0000 (1.0)           0;0  0.0140 (0.49)          1           1
test_add_symlink-add[3.10.0]     71.0153 (2.04)     71.0153 (2.04)     71.0153 (2.04)     0.0000 (1.0)      71.0153 (2.04)     0.0000 (1.0)           0;0  0.0141 (0.49)          1           1
test_add_symlink-add[3.53.2]     67.2113 (1.93)     67.2113 (1.93)     67.2113 (1.93)     0.0000 (1.0)      67.2113 (1.93)     0.0000 (1.0)           0;0  0.0149 (0.52)          1           1
test_add_symlink-add[3.60.1]     34.8336 (1.0)      34.8336 (1.0)      34.8336 (1.0)      0.0000 (1.0)      34.8336 (1.0)      0.0000 (1.0)           0;0  0.0287 (1.0)           1           1
test_add_symlink-add[main]       36.2144 (1.04)     36.2144 (1.04)     36.2144 (1.04)     0.0000 (1.0)      36.2144 (1.04)     0.0000 (1.0)           0;0  0.0276 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.9586 (8.27)     47.9586 (8.27)     47.9586 (8.27)     0.0000 (1.0)      47.9586 (8.27)     0.0000 (1.0)           0;0  0.0209 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.6687 (8.22)     47.6687 (8.22)     47.6687 (8.22)     0.0000 (1.0)      47.6687 (8.22)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.0587 (8.11)     47.0587 (8.11)     47.0587 (8.11)     0.0000 (1.0)      47.0587 (8.11)     0.0000 (1.0)           0;0  0.0213 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.7999 (1.0)       5.7999 (1.0)       5.7999 (1.0)      0.0000 (1.0)       5.7999 (1.0)      0.0000 (1.0)           0;0  0.1724 (1.0)           1           1
test_add_symlink-add-noop[main]        6.1408 (1.06)      6.1408 (1.06)      6.1408 (1.06)     0.0000 (1.0)       6.1408 (1.06)     0.0000 (1.0)           0;0  0.1628 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.5906 (1.97)     40.5906 (1.97)     40.5906 (1.97)     0.0000 (1.0)      40.5906 (1.97)     0.0000 (1.0)           0;0  0.0246 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     59.6021 (2.89)     59.6021 (2.89)     59.6021 (2.89)     0.0000 (1.0)      59.6021 (2.89)     0.0000 (1.0)           0;0  0.0168 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     27.7338 (1.35)     27.7338 (1.35)     27.7338 (1.35)     0.0000 (1.0)      27.7338 (1.35)     0.0000 (1.0)           0;0  0.0361 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     20.5991 (1.0)      20.5991 (1.0)      20.5991 (1.0)      0.0000 (1.0)      20.5991 (1.0)      0.0000 (1.0)           0;0  0.0485 (1.0)           1           1
test_checkout_copy-checkout[main]       21.4904 (1.04)     21.4904 (1.04)     21.4904 (1.04)     0.0000 (1.0)      21.4904 (1.04)     0.0000 (1.0)           0;0  0.0465 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.2859 (1.63)     5.2859 (1.63)     5.2859 (1.63)     0.0000 (1.0)      5.2859 (1.63)     0.0000 (1.0)           0;0  0.1892 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6162 (1.73)     5.6162 (1.73)     5.6162 (1.73)     0.0000 (1.0)      5.6162 (1.73)     0.0000 (1.0)           0;0  0.1781 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4206 (1.67)     5.4206 (1.67)     5.4206 (1.67)     0.0000 (1.0)      5.4206 (1.67)     0.0000 (1.0)           0;0  0.1845 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2525 (1.0)      3.2525 (1.0)      3.2525 (1.0)      0.0000 (1.0)      3.2525 (1.0)      0.0000 (1.0)           0;0  0.3075 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5686 (1.10)     3.5686 (1.10)     3.5686 (1.10)     0.0000 (1.0)      3.5686 (1.10)     0.0000 (1.0)           0;0  0.2802 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5627 (2.21)     8.5627 (2.21)     8.5627 (2.21)     0.0000 (1.0)      8.5627 (2.21)     0.0000 (1.0)           0;0  0.1168 (0.45)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.2762 (1.62)     6.2762 (1.62)     6.2762 (1.62)     0.0000 (1.0)      6.2762 (1.62)     0.0000 (1.0)           0;0  0.1593 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1041 (1.58)     6.1041 (1.58)     6.1041 (1.58)     0.0000 (1.0)      6.1041 (1.58)     0.0000 (1.0)           0;0  0.1638 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8667 (1.0)      3.8667 (1.0)      3.8667 (1.0)      0.0000 (1.0)      3.8667 (1.0)      0.0000 (1.0)           0;0  0.2586 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4704 (1.16)     4.4704 (1.16)     4.4704 (1.16)     0.0000 (1.0)      4.4704 (1.16)     0.0000 (1.0)           0;0  0.2237 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.7442 (3.03)     22.7442 (3.03)     22.7442 (3.03)     0.0000 (1.0)      22.7442 (3.03)     0.0000 (1.0)           0;0  0.0440 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.3387 (2.18)     16.3387 (2.18)     16.3387 (2.18)     0.0000 (1.0)      16.3387 (2.18)     0.0000 (1.0)           0;0  0.0612 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.8469 (1.98)     14.8469 (1.98)     14.8469 (1.98)     0.0000 (1.0)      14.8469 (1.98)     0.0000 (1.0)           0;0  0.0674 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5101 (1.0)       7.5101 (1.0)       7.5101 (1.0)      0.0000 (1.0)       7.5101 (1.0)      0.0000 (1.0)           0;0  0.1332 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.5186 (1.13)      8.5186 (1.13)      8.5186 (1.13)     0.0000 (1.0)       8.5186 (1.13)     0.0000 (1.0)           0;0  0.1174 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6527 (1.61)     5.6527 (1.61)     5.6527 (1.61)     0.0000 (1.0)      5.6527 (1.61)     0.0000 (1.0)           0;0  0.1769 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.9070 (1.68)     5.9070 (1.68)     5.9070 (1.68)     0.0000 (1.0)      5.9070 (1.68)     0.0000 (1.0)           0;0  0.1693 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6677 (1.61)     5.6677 (1.61)     5.6677 (1.61)     0.0000 (1.0)      5.6677 (1.61)     0.0000 (1.0)           0;0  0.1764 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.5165 (1.0)      3.5165 (1.0)      3.5165 (1.0)      0.0000 (1.0)      3.5165 (1.0)      0.0000 (1.0)           0;0  0.2844 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.8109 (1.08)     3.8109 (1.08)     3.8109 (1.08)     0.0000 (1.0)      3.8109 (1.08)     0.0000 (1.0)           0;0  0.2624 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     9.0412 (2.18)     9.0412 (2.18)     9.0412 (2.18)     0.0000 (1.0)      9.0412 (2.18)     0.0000 (1.0)           0;0  0.1106 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6985 (1.61)     6.6985 (1.61)     6.6985 (1.61)     0.0000 (1.0)      6.6985 (1.61)     0.0000 (1.0)           0;0  0.1493 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4839 (1.56)     6.4839 (1.56)     6.4839 (1.56)     0.0000 (1.0)      6.4839 (1.56)     0.0000 (1.0)           0;0  0.1542 (0.64)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.1513 (1.0)      4.1513 (1.0)      4.1513 (1.0)      0.0000 (1.0)      4.1513 (1.0)      0.0000 (1.0)           0;0  0.2409 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.8025 (1.16)     4.8025 (1.16)     4.8025 (1.16)     0.0000 (1.0)      4.8025 (1.16)     0.0000 (1.0)           0;0  0.2082 (0.86)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.4004 (2.49)     25.4004 (2.49)     25.4004 (2.49)     0.0000 (1.0)      25.4004 (2.49)     0.0000 (1.0)           0;0  0.0394 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     18.9412 (1.86)     18.9412 (1.86)     18.9412 (1.86)     0.0000 (1.0)      18.9412 (1.86)     0.0000 (1.0)           0;0  0.0528 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     17.4503 (1.71)     17.4503 (1.71)     17.4503 (1.71)     0.0000 (1.0)      17.4503 (1.71)     0.0000 (1.0)           0;0  0.0573 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1979 (1.0)      10.1979 (1.0)      10.1979 (1.0)      0.0000 (1.0)      10.1979 (1.0)      0.0000 (1.0)           0;0  0.0981 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.9766 (1.08)     10.9766 (1.08)     10.9766 (1.08)     0.0000 (1.0)      10.9766 (1.08)     0.0000 (1.0)           0;0  0.0911 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7385 (1.56)     6.7385 (1.56)     6.7385 (1.56)     0.0000 (1.0)      6.7385 (1.56)     0.0000 (1.0)           0;0  0.1484 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9019 (1.60)     6.9019 (1.60)     6.9019 (1.60)     0.0000 (1.0)      6.9019 (1.60)     0.0000 (1.0)           0;0  0.1449 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6966 (1.55)     6.6966 (1.55)     6.6966 (1.55)     0.0000 (1.0)      6.6966 (1.55)     0.0000 (1.0)           0;0  0.1493 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3182 (1.0)      4.3182 (1.0)      4.3182 (1.0)      0.0000 (1.0)      4.3182 (1.0)      0.0000 (1.0)           0;0  0.2316 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.7371 (1.10)     4.7371 (1.10)     4.7371 (1.10)     0.0000 (1.0)      4.7371 (1.10)     0.0000 (1.0)           0;0  0.2111 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.9269 (1.85)     10.9269 (1.85)     10.9269 (1.85)     0.0000 (1.0)      10.9269 (1.85)     0.0000 (1.0)           0;0  0.0915 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.5016 (1.44)      8.5016 (1.44)      8.5016 (1.44)     0.0000 (1.0)       8.5016 (1.44)     0.0000 (1.0)           0;0  0.1176 (0.70)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3548 (1.41)      8.3548 (1.41)      8.3548 (1.41)     0.0000 (1.0)       8.3548 (1.41)     0.0000 (1.0)           0;0  0.1197 (0.71)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9150 (1.0)       5.9150 (1.0)       5.9150 (1.0)      0.0000 (1.0)       5.9150 (1.0)      0.0000 (1.0)           0;0  0.1691 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.4928 (1.10)      6.4928 (1.10)      6.4928 (1.10)     0.0000 (1.0)       6.4928 (1.10)     0.0000 (1.0)           0;0  0.1540 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9737 (1.79)     3.9737 (1.79)     3.9737 (1.79)     0.0000 (1.0)      3.9737 (1.79)     0.0000 (1.0)           0;0  0.2517 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.6513 (2.09)     4.6513 (2.09)     4.6513 (2.09)     0.0000 (1.0)      4.6513 (2.09)     0.0000 (1.0)           0;0  0.2150 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.4855 (2.02)     4.4855 (2.02)     4.4855 (2.02)     0.0000 (1.0)      4.4855 (2.02)     0.0000 (1.0)           0;0  0.2229 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.2239 (1.0)      2.2239 (1.0)      2.2239 (1.0)      0.0000 (1.0)      2.2239 (1.0)      0.0000 (1.0)           0;0  0.4497 (1.0)           1           1
test_data_status-data-changed[main]       2.4882 (1.12)     2.4882 (1.12)     2.4882 (1.12)     0.0000 (1.0)      2.4882 (1.12)     0.0000 (1.0)           0;0  0.4019 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9617 (1.76)     3.9617 (1.76)     3.9617 (1.76)     0.0000 (1.0)      3.9617 (1.76)     0.0000 (1.0)           0;0  0.2524 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.6451 (2.07)     4.6451 (2.07)     4.6451 (2.07)     0.0000 (1.0)      4.6451 (2.07)     0.0000 (1.0)           0;0  0.2153 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5426 (2.02)     4.5426 (2.02)     4.5426 (2.02)     0.0000 (1.0)      4.5426 (2.02)     0.0000 (1.0)           0;0  0.2201 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2447 (1.0)      2.2447 (1.0)      2.2447 (1.0)      0.0000 (1.0)      2.2447 (1.0)      0.0000 (1.0)           0;0  0.4455 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5352 (1.13)     2.5352 (1.13)     2.5352 (1.13)     0.0000 (1.0)      2.5352 (1.13)     0.0000 (1.0)           0;0  0.3945 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     17.9610 (3.80)     17.9610 (3.80)     17.9610 (3.80)     0.0000 (1.0)      17.9610 (3.80)     0.0000 (1.0)           0;0  0.0557 (0.26)          1           1
test_data_status-data-new[3.10.0]     18.3824 (3.89)     18.3824 (3.89)     18.3824 (3.89)     0.0000 (1.0)      18.3824 (3.89)     0.0000 (1.0)           0;0  0.0544 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.1488 (3.84)     18.1488 (3.84)     18.1488 (3.84)     0.0000 (1.0)      18.1488 (3.84)     0.0000 (1.0)           0;0  0.0551 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.7307 (1.0)       4.7307 (1.0)       4.7307 (1.0)      0.0000 (1.0)       4.7307 (1.0)      0.0000 (1.0)           0;0  0.2114 (1.0)           1           1
test_data_status-data-new[main]        4.9406 (1.04)      4.9406 (1.04)      4.9406 (1.04)     0.0000 (1.0)       4.9406 (1.04)     0.0000 (1.0)           0;0  0.2024 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9779 (1.78)     3.9779 (1.78)     3.9779 (1.78)     0.0000 (1.0)      3.9779 (1.78)     0.0000 (1.0)           0;0  0.2514 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.6102 (2.06)     4.6102 (2.06)     4.6102 (2.06)     0.0000 (1.0)      4.6102 (2.06)     0.0000 (1.0)           0;0  0.2169 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.3670 (1.95)     4.3670 (1.95)     4.3670 (1.95)     0.0000 (1.0)      4.3670 (1.95)     0.0000 (1.0)           0;0  0.2290 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.2342 (1.0)      2.2342 (1.0)      2.2342 (1.0)      0.0000 (1.0)      2.2342 (1.0)      0.0000 (1.0)           0;0  0.4476 (1.0)           1           1
test_data_status-data-noop[main]       2.5255 (1.13)     2.5255 (1.13)     2.5255 (1.13)     0.0000 (1.0)      2.5255 (1.13)     0.0000 (1.0)           0;0  0.3960 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1123 (1.30)     7.1123 (1.30)     7.1123 (1.30)     0.0000 (1.0)      7.1123 (1.30)     0.0000 (1.0)           0;0  0.1406 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8433 (1.43)     7.8433 (1.43)     7.8433 (1.43)     0.0000 (1.0)      7.8433 (1.43)     0.0000 (1.0)           0;0  0.1275 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7230 (1.41)     7.7230 (1.41)     7.7230 (1.41)     0.0000 (1.0)      7.7230 (1.41)     0.0000 (1.0)           0;0  0.1295 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4758 (1.0)      5.4758 (1.0)      5.4758 (1.0)      0.0000 (1.0)      5.4758 (1.0)      0.0000 (1.0)           0;0  0.1826 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9416 (1.09)     5.9416 (1.09)     5.9416 (1.09)     0.0000 (1.0)      5.9416 (1.09)     0.0000 (1.0)           0;0  0.1683 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1451 (1.29)     7.1451 (1.29)     7.1451 (1.29)     0.0000 (1.0)      7.1451 (1.29)     0.0000 (1.0)           0;0  0.1400 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7368 (1.40)     7.7368 (1.40)     7.7368 (1.40)     0.0000 (1.0)      7.7368 (1.40)     0.0000 (1.0)           0;0  0.1293 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6269 (1.38)     7.6269 (1.38)     7.6269 (1.38)     0.0000 (1.0)      7.6269 (1.38)     0.0000 (1.0)           0;0  0.1311 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5396 (1.0)      5.5396 (1.0)      5.5396 (1.0)      0.0000 (1.0)      5.5396 (1.0)      0.0000 (1.0)           0;0  0.1805 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.9785 (1.08)     5.9785 (1.08)     5.9785 (1.08)     0.0000 (1.0)      5.9785 (1.08)     0.0000 (1.0)           0;0  0.1673 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.0978 (2.67)     21.0978 (2.67)     21.0978 (2.67)     0.0000 (1.0)      21.0978 (2.67)     0.0000 (1.0)           0;0  0.0474 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.9218 (2.78)     21.9218 (2.78)     21.9218 (2.78)     0.0000 (1.0)      21.9218 (2.78)     0.0000 (1.0)           0;0  0.0456 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.5409 (2.73)     21.5409 (2.73)     21.5409 (2.73)     0.0000 (1.0)      21.5409 (2.73)     0.0000 (1.0)           0;0  0.0464 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.8982 (1.0)       7.8982 (1.0)       7.8982 (1.0)      0.0000 (1.0)       7.8982 (1.0)      0.0000 (1.0)           0;0  0.1266 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4331 (1.07)      8.4331 (1.07)      8.4331 (1.07)     0.0000 (1.0)       8.4331 (1.07)     0.0000 (1.0)           0;0  0.1186 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5640 (1.38)     6.5640 (1.38)     6.5640 (1.38)     0.0000 (1.0)      6.5640 (1.38)     0.0000 (1.0)           0;0  0.1523 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0069 (1.47)     7.0069 (1.47)     7.0069 (1.47)     0.0000 (1.0)      7.0069 (1.47)     0.0000 (1.0)           0;0  0.1427 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9668 (1.46)     6.9668 (1.46)     6.9668 (1.46)     0.0000 (1.0)      6.9668 (1.46)     0.0000 (1.0)           0;0  0.1435 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7673 (1.0)      4.7673 (1.0)      4.7673 (1.0)      0.0000 (1.0)      4.7673 (1.0)      0.0000 (1.0)           0;0  0.2098 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2365 (1.10)     5.2365 (1.10)     5.2365 (1.10)     0.0000 (1.0)      5.2365 (1.10)     0.0000 (1.0)           0;0  0.1910 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.9472 (2.57)     17.9472 (2.57)     17.9472 (2.57)     0.0000 (1.0)      17.9472 (2.57)     0.0000 (1.0)           0;0  0.0557 (0.39)          1           1
test_diff-diff[3.10.0]     19.2946 (2.76)     19.2946 (2.76)     19.2946 (2.76)     0.0000 (1.0)      19.2946 (2.76)     0.0000 (1.0)           0;0  0.0518 (0.36)          1           1
test_diff-diff[3.53.2]     19.1449 (2.74)     19.1449 (2.74)     19.1449 (2.74)     0.0000 (1.0)      19.1449 (2.74)     0.0000 (1.0)           0;0  0.0522 (0.37)          1           1
test_diff-diff[3.60.1]      6.9933 (1.0)       6.9933 (1.0)       6.9933 (1.0)      0.0000 (1.0)       6.9933 (1.0)      0.0000 (1.0)           0;0  0.1430 (1.0)           1           1
test_diff-diff[main]        7.8338 (1.12)      7.8338 (1.12)      7.8338 (1.12)     0.0000 (1.0)       7.8338 (1.12)     0.0000 (1.0)           0;0  0.1277 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2561 (1.78)     6.2561 (1.78)     6.2561 (1.78)     0.0000 (1.0)      6.2561 (1.78)     0.0000 (1.0)           0;0  0.1598 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.7982 (1.94)     6.7982 (1.94)     6.7982 (1.94)     0.0000 (1.0)      6.7982 (1.94)     0.0000 (1.0)           0;0  0.1471 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.7057 (1.63)     5.7057 (1.63)     5.7057 (1.63)     0.0000 (1.0)      5.7057 (1.63)     0.0000 (1.0)           0;0  0.1753 (0.62)          1           1
test_diff-diff-changed[3.60.1]     3.5104 (1.0)      3.5104 (1.0)      3.5104 (1.0)      0.0000 (1.0)      3.5104 (1.0)      0.0000 (1.0)           0;0  0.2849 (1.0)           1           1
test_diff-diff-changed[main]       4.2960 (1.22)     4.2960 (1.22)     4.2960 (1.22)     0.0000 (1.0)      4.2960 (1.22)     0.0000 (1.0)           0;0  0.2328 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3845 (1.53)     5.3845 (1.53)     5.3845 (1.53)     0.0000 (1.0)      5.3845 (1.53)     0.0000 (1.0)           0;0  0.1857 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9077 (1.68)     5.9077 (1.68)     5.9077 (1.68)     0.0000 (1.0)      5.9077 (1.68)     0.0000 (1.0)           0;0  0.1693 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6299 (1.60)     5.6299 (1.60)     5.6299 (1.60)     0.0000 (1.0)      5.6299 (1.60)     0.0000 (1.0)           0;0  0.1776 (0.62)          1           1
test_diff-diff-changed-noop[3.60.1]     3.5104 (1.0)      3.5104 (1.0)      3.5104 (1.0)      0.0000 (1.0)      3.5104 (1.0)      0.0000 (1.0)           0;0  0.2849 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2281 (1.20)     4.2281 (1.20)     4.2281 (1.20)     0.0000 (1.0)      4.2281 (1.20)     0.0000 (1.0)           0;0  0.2365 (0.83)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1378 (1.19)     4.1378 (1.19)     4.1378 (1.19)     0.0000 (1.0)      4.1378 (1.19)     0.0000 (1.0)           0;0  0.2417 (0.84)          1           1
test_diff-diff-noop[3.10.0]     4.7755 (1.38)     4.7755 (1.38)     4.7755 (1.38)     0.0000 (1.0)      4.7755 (1.38)     0.0000 (1.0)           0;0  0.2094 (0.73)          1           1
test_diff-diff-noop[3.53.2]     5.7169 (1.65)     5.7169 (1.65)     5.7169 (1.65)     0.0000 (1.0)      5.7169 (1.65)     0.0000 (1.0)           0;0  0.1749 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.4720 (1.0)      3.4720 (1.0)      3.4720 (1.0)      0.0000 (1.0)      3.4720 (1.0)      0.0000 (1.0)           0;0  0.2880 (1.0)           1           1
test_diff-diff-noop[main]       4.2794 (1.23)     4.2794 (1.23)     4.2794 (1.23)     0.0000 (1.0)      4.2794 (1.23)     0.0000 (1.0)           0;0  0.2337 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0301 (1.0)      1.0301 (1.0)      1.0301 (1.0)      0.0000 (1.0)      1.0301 (1.0)      0.0000 (1.0)           0;0  0.9708 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.6545 (5.49)     5.6545 (5.49)     5.6545 (5.49)     0.0000 (1.0)      5.6545 (5.49)     0.0000 (1.0)           0;0  0.1769 (0.18)          1           1
test_exp_show-exp[3.53.2]     3.2143 (3.12)     3.2143 (3.12)     3.2143 (3.12)     0.0000 (1.0)      3.2143 (3.12)     0.0000 (1.0)           0;0  0.3111 (0.32)          1           1
test_exp_show-exp[3.60.1]     4.3236 (4.20)     4.3236 (4.20)     4.3236 (4.20)     0.0000 (1.0)      4.3236 (4.20)     0.0000 (1.0)           0;0  0.2313 (0.24)          1           1
test_exp_show-exp[main]       7.2631 (7.05)     7.2631 (7.05)     7.2631 (7.05)     0.0000 (1.0)      7.2631 (7.05)     0.0000 (1.0)           0;0  0.1377 (0.14)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.1941 (2.77)     66.1941 (2.77)     66.1941 (2.77)     0.0000 (1.0)      66.1941 (2.77)     0.0000 (1.0)           0;0  0.0151 (0.36)          1           1
test_fetch-fetch[3.10.0]     71.8163 (3.00)     71.8163 (3.00)     71.8163 (3.00)     0.0000 (1.0)      71.8163 (3.00)     0.0000 (1.0)           0;0  0.0139 (0.33)          1           1
test_fetch-fetch[3.53.2]     35.1951 (1.47)     35.1951 (1.47)     35.1951 (1.47)     0.0000 (1.0)      35.1951 (1.47)     0.0000 (1.0)           0;0  0.0284 (0.68)          1           1
test_fetch-fetch[3.60.1]     23.9172 (1.0)      23.9172 (1.0)      23.9172 (1.0)      0.0000 (1.0)      23.9172 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
test_fetch-fetch[main]       23.9937 (1.00)     23.9937 (1.00)     23.9937 (1.00)     0.0000 (1.0)      23.9937 (1.00)     0.0000 (1.0)           0;0  0.0417 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7902 (1.0)      2.7902 (1.0)      2.7902 (1.0)      0.0000 (1.0)      2.7902 (1.0)      0.0000 (1.0)           0;0  0.3584 (1.0)           1           1
test_gc-gc[3.10.0]     2.9055 (1.04)     2.9055 (1.04)     2.9055 (1.04)     0.0000 (1.0)      2.9055 (1.04)     0.0000 (1.0)           0;0  0.3442 (0.96)          1           1
test_gc-gc[3.53.2]     2.8279 (1.01)     2.8279 (1.01)     2.8279 (1.01)     0.0000 (1.0)      2.8279 (1.01)     0.0000 (1.0)           0;0  0.3536 (0.99)          1           1
test_gc-gc[3.60.1]     2.8187 (1.01)     2.8187 (1.01)     2.8187 (1.01)     0.0000 (1.0)      2.8187 (1.01)     0.0000 (1.0)           0;0  0.3548 (0.99)          1           1
test_gc-gc[main]       3.0315 (1.09)     3.0315 (1.09)     3.0315 (1.09)     0.0000 (1.0)      3.0315 (1.09)     0.0000 (1.0)           0;0  0.3299 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.4872 (2.71)     134.4872 (2.71)     134.4872 (2.71)     0.0000 (1.0)      134.4872 (2.71)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     164.6858 (3.32)     164.6858 (3.32)     164.6858 (3.32)     0.0000 (1.0)      164.6858 (3.32)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.5625 (2.89)     143.5625 (2.89)     143.5625 (2.89)     0.0000 (1.0)      143.5625 (2.89)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      49.6302 (1.0)       49.6302 (1.0)       49.6302 (1.0)      0.0000 (1.0)       49.6302 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
test_get-get[main]        49.8554 (1.00)      49.8554 (1.00)      49.8554 (1.00)     0.0000 (1.0)       49.8554 (1.00)     0.0000 (1.0)           0;0  0.0201 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.5406 (2.67)     44.5406 (2.67)     44.5406 (2.67)     0.0000 (1.0)      44.5406 (2.67)     0.0000 (1.0)           0;0  0.0225 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.4897 (2.85)     47.4897 (2.85)     47.4897 (2.85)     0.0000 (1.0)      47.4897 (2.85)     0.0000 (1.0)           0;0  0.0211 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.7129 (1.00)     16.7129 (1.00)     16.7129 (1.00)     0.0000 (1.0)      16.7129 (1.00)     0.0000 (1.0)           0;0  0.0598 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.6908 (1.0)      16.6908 (1.0)      16.6908 (1.0)      0.0000 (1.0)      16.6908 (1.0)      0.0000 (1.0)           0;0  0.0599 (1.0)           1           1
test_get_url-get-url[main]       16.9563 (1.02)     16.9563 (1.02)     16.9563 (1.02)     0.0000 (1.0)      16.9563 (1.02)     0.0000 (1.0)           0;0  0.0590 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.1590 (1.02)     136.6962 (1.05)     127.4454 (1.02)     2.5094 (1.63)     126.9799 (1.02)     3.2391 (1.49)         31;2  7.8465 (0.98)        100           1
test_help---help[3.10.0]     122.2094 (1.0)      129.8277 (1.0)      124.9995 (1.0)      1.8221 (1.18)     124.8458 (1.0)      2.3848 (1.10)         34;3  8.0000 (1.0)         100           1
test_help---help[3.53.2]     123.6845 (1.01)     131.6542 (1.01)     126.3478 (1.01)     1.5401 (1.0)      126.0183 (1.01)     2.1727 (1.0)          29;2  7.9147 (0.99)        100           1
test_help---help[3.60.1]     124.4638 (1.02)     134.8061 (1.04)     128.3521 (1.03)     2.4425 (1.59)     127.7575 (1.02)     2.8929 (1.33)         29;3  7.7911 (0.97)        100           1
test_help---help[main]       125.1502 (1.02)     159.1990 (1.23)     129.3397 (1.03)     6.0398 (3.92)     127.5126 (1.02)     2.3616 (1.09)         9;11  7.7316 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     224.4081 (2.99)     224.4081 (2.99)     224.4081 (2.99)     0.0000 (1.0)      224.4081 (2.99)     0.0000 (1.0)           0;0  0.0045 (0.33)          1           1
test_import-import[3.10.0]     255.7715 (3.40)     255.7715 (3.40)     255.7715 (3.40)     0.0000 (1.0)      255.7715 (3.40)     0.0000 (1.0)           0;0  0.0039 (0.29)          1           1
test_import-import[3.60.1]      75.1460 (1.0)       75.1460 (1.0)       75.1460 (1.0)      0.0000 (1.0)       75.1460 (1.0)      0.0000 (1.0)           0;0  0.0133 (1.0)           1           1
test_import-import[main]        76.5130 (1.02)      76.5130 (1.02)      76.5130 (1.02)     0.0000 (1.0)       76.5130 (1.02)     0.0000 (1.0)           0;0  0.0131 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     158.3651 (3.36)     158.3651 (3.36)     158.3651 (3.36)     0.0000 (1.0)      158.3651 (3.36)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     159.4002 (3.38)     159.4002 (3.38)     159.4002 (3.38)     0.0000 (1.0)      159.4002 (3.38)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.53.2]     118.9132 (2.52)     118.9132 (2.52)     118.9132 (2.52)     0.0000 (1.0)      118.9132 (2.52)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_import_url-import-url[3.60.1]      47.1034 (1.0)       47.1034 (1.0)       47.1034 (1.0)      0.0000 (1.0)       47.1034 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
test_import_url-import-url[main]        48.6280 (1.03)      48.6280 (1.03)      48.6280 (1.03)     0.0000 (1.0)       48.6280 (1.03)     0.0000 (1.0)           0;0  0.0206 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     391.6675 (1.02)     436.3258 (1.03)     399.4155 (1.01)      5.8987 (1.09)     398.4528 (1.01)      4.9508 (1.0)          16;7  2.5037 (0.99)        100           1
test_init-init[3.10.0]     399.7491 (1.04)     425.2862 (1.0)      409.2841 (1.03)      5.3975 (1.0)      408.1273 (1.03)      7.6918 (1.55)         30;1  2.4433 (0.97)        100           1
test_init-init[3.53.2]     384.3127 (1.0)      560.8581 (1.32)     400.6555 (1.01)     18.2735 (3.39)     397.5428 (1.00)      9.4670 (1.91)          4;5  2.4959 (0.99)        100           1
test_init-init[3.60.1]     384.5431 (1.00)     435.7358 (1.02)     397.0654 (1.0)       9.1146 (1.69)     395.6362 (1.0)       8.4519 (1.71)         24;7  2.5185 (1.0)         100           1
test_init-init[main]       420.0394 (1.09)     643.3890 (1.51)     437.9592 (1.10)     27.8570 (5.16)     429.9506 (1.09)     17.7882 (3.59)          5;5  2.2833 (0.91)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     600.4271 (1.12)     600.4271 (1.12)     600.4271 (1.12)     0.0000 (1.0)      600.4271 (1.12)     0.0000 (1.0)           0;0  1.6655 (0.89)          1           1
test_list-list[3.10.0]     662.4570 (1.24)     662.4570 (1.24)     662.4570 (1.24)     0.0000 (1.0)      662.4570 (1.24)     0.0000 (1.0)           0;0  1.5095 (0.81)          1           1
test_list-list[3.53.2]     596.1966 (1.11)     596.1966 (1.11)     596.1966 (1.11)     0.0000 (1.0)      596.1966 (1.11)     0.0000 (1.0)           0;0  1.6773 (0.90)          1           1
test_list-list[3.60.1]     555.2444 (1.04)     555.2444 (1.04)     555.2444 (1.04)     0.0000 (1.0)      555.2444 (1.04)     0.0000 (1.0)           0;0  1.8010 (0.96)          1           1
test_list-list[main]       535.2323 (1.0)      535.2323 (1.0)      535.2323 (1.0)      0.0000 (1.0)      535.2323 (1.0)      0.0000 (1.0)           0;0  1.8683 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     428.1461 (1.08)     428.1461 (1.08)     428.1461 (1.08)     0.0000 (1.0)      428.1461 (1.08)     0.0000 (1.0)           0;0  2.3357 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     424.1057 (1.07)     424.1057 (1.07)     424.1057 (1.07)     0.0000 (1.0)      424.1057 (1.07)     0.0000 (1.0)           0;0  2.3579 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     410.2713 (1.04)     410.2713 (1.04)     410.2713 (1.04)     0.0000 (1.0)      410.2713 (1.04)     0.0000 (1.0)           0;0  2.4374 (0.96)          1           1
test_list-list-dvc-only[3.60.1]     405.3285 (1.03)     405.3285 (1.03)     405.3285 (1.03)     0.0000 (1.0)      405.3285 (1.03)     0.0000 (1.0)           0;0  2.4671 (0.97)          1           1
test_list-list-dvc-only[main]       394.9095 (1.0)      394.9095 (1.0)      394.9095 (1.0)      0.0000 (1.0)      394.9095 (1.0)      0.0000 (1.0)           0;0  2.5322 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7810 (1.00)     2.7810 (1.00)     2.7810 (1.00)     0.0000 (1.0)      2.7810 (1.00)     0.0000 (1.0)           0;0  0.3596 (1.00)          1           1
test_list-list-recursive[3.10.0]     2.7950 (1.01)     2.7950 (1.01)     2.7950 (1.01)     0.0000 (1.0)      2.7950 (1.01)     0.0000 (1.0)           0;0  0.3578 (0.99)          1           1
test_list-list-recursive[3.53.2]     2.9262 (1.05)     2.9262 (1.05)     2.9262 (1.05)     0.0000 (1.0)      2.9262 (1.05)     0.0000 (1.0)           0;0  0.3417 (0.95)          1           1
test_list-list-recursive[3.60.1]     2.8012 (1.01)     2.8012 (1.01)     2.8012 (1.01)     0.0000 (1.0)      2.8012 (1.01)     0.0000 (1.0)           0;0  0.3570 (0.99)          1           1
test_list-list-recursive[main]       2.7748 (1.0)      2.7748 (1.0)      2.7748 (1.0)      0.0000 (1.0)      2.7748 (1.0)      0.0000 (1.0)           0;0  0.3604 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     434.6460 (1.09)     434.6460 (1.09)     434.6460 (1.09)     0.0000 (1.0)      434.6460 (1.09)     0.0000 (1.0)           0;0  2.3007 (0.92)          1           1
test_list-list-shallow[3.10.0]     425.0907 (1.06)     425.0907 (1.06)     425.0907 (1.06)     0.0000 (1.0)      425.0907 (1.06)     0.0000 (1.0)           0;0  2.3524 (0.94)          1           1
test_list-list-shallow[3.53.2]     422.6436 (1.06)     422.6436 (1.06)     422.6436 (1.06)     0.0000 (1.0)      422.6436 (1.06)     0.0000 (1.0)           0;0  2.3661 (0.94)          1           1
test_list-list-shallow[3.60.1]     401.2037 (1.01)     401.2037 (1.01)     401.2037 (1.01)     0.0000 (1.0)      401.2037 (1.01)     0.0000 (1.0)           0;0  2.4925 (0.99)          1           1
test_list-list-shallow[main]       399.1570 (1.0)      399.1570 (1.0)      399.1570 (1.0)      0.0000 (1.0)      399.1570 (1.0)      0.0000 (1.0)           0;0  2.5053 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.5790 (3.72)     72.5790 (3.72)     72.5790 (3.72)     0.0000 (1.0)      72.5790 (3.72)     0.0000 (1.0)           0;0  0.0138 (0.27)          1           1
test_partial_add-add[3.10.0]     73.9531 (3.79)     73.9531 (3.79)     73.9531 (3.79)     0.0000 (1.0)      73.9531 (3.79)     0.0000 (1.0)           0;0  0.0135 (0.26)          1           1
test_partial_add-add[3.53.2]     66.1208 (3.39)     66.1208 (3.39)     66.1208 (3.39)     0.0000 (1.0)      66.1208 (3.39)     0.0000 (1.0)           0;0  0.0151 (0.30)          1           1
test_partial_add-add[3.60.1]     19.5140 (1.0)      19.5140 (1.0)      19.5140 (1.0)      0.0000 (1.0)      19.5140 (1.0)      0.0000 (1.0)           0;0  0.0512 (1.0)           1           1
test_partial_add-add[main]       20.4648 (1.05)     20.4648 (1.05)     20.4648 (1.05)     0.0000 (1.0)      20.4648 (1.05)     0.0000 (1.0)           0;0  0.0489 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     62.7835 (8.26)     62.7835 (8.26)     62.7835 (8.26)     0.0000 (1.0)      62.7835 (8.26)     0.0000 (1.0)           0;0  0.0159 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     62.8378 (8.27)     62.8378 (8.27)     62.8378 (8.27)     0.0000 (1.0)      62.8378 (8.27)     0.0000 (1.0)           0;0  0.0159 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     56.3177 (7.41)     56.3177 (7.41)     56.3177 (7.41)     0.0000 (1.0)      56.3177 (7.41)     0.0000 (1.0)           0;0  0.0178 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.6004 (1.0)       7.6004 (1.0)       7.6004 (1.0)      0.0000 (1.0)       7.6004 (1.0)      0.0000 (1.0)           0;0  0.1316 (1.0)           1           1
test_partial_add-add-partial[main]        8.0245 (1.06)      8.0245 (1.06)      8.0245 (1.06)     0.0000 (1.0)       8.0245 (1.06)     0.0000 (1.0)           0;0  0.1246 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4420 (1.0)      4.4420 (1.0)      4.4420 (1.0)      0.0000 (1.0)      4.4420 (1.0)      0.0000 (1.0)           0;0  0.2251 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.7570 (1.30)     5.7570 (1.30)     5.7570 (1.30)     0.0000 (1.0)      5.7570 (1.30)     0.0000 (1.0)           0;0  0.1737 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7177 (1.51)     6.7177 (1.51)     6.7177 (1.51)     0.0000 (1.0)      6.7177 (1.51)     0.0000 (1.0)           0;0  0.1489 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5973 (1.49)     6.5973 (1.49)     6.5973 (1.49)     0.0000 (1.0)      6.5973 (1.49)     0.0000 (1.0)           0;0  0.1516 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.6313 (1.49)     6.6313 (1.49)     6.6313 (1.49)     0.0000 (1.0)      6.6313 (1.49)     0.0000 (1.0)           0;0  0.1508 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3742 (1.0)      2.3742 (1.0)      2.3742 (1.0)      0.0000 (1.0)      2.3742 (1.0)      0.0000 (1.0)           0;0  0.4212 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.5894 (1.51)     3.5894 (1.51)     3.5894 (1.51)     0.0000 (1.0)      3.5894 (1.51)     0.0000 (1.0)           0;0  0.2786 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.6648 (1.54)     3.6648 (1.54)     3.6648 (1.54)     0.0000 (1.0)      3.6648 (1.54)     0.0000 (1.0)           0;0  0.2729 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.7061 (1.56)     3.7061 (1.56)     3.7061 (1.56)     0.0000 (1.0)      3.7061 (1.56)     0.0000 (1.0)           0;0  0.2698 (0.64)          1           1
test_partial_add-gc-noop[main]       3.7450 (1.58)     3.7450 (1.58)     3.7450 (1.58)     0.0000 (1.0)      3.7450 (1.58)     0.0000 (1.0)           0;0  0.2670 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.6918 (2.39)     44.6918 (2.39)     44.6918 (2.39)     0.0000 (1.0)      44.6918 (2.39)     0.0000 (1.0)           0;0  0.0224 (0.42)          1           1
test_partial_add-push[3.10.0]     39.4474 (2.11)     39.4474 (2.11)     39.4474 (2.11)     0.0000 (1.0)      39.4474 (2.11)     0.0000 (1.0)           0;0  0.0254 (0.47)          1           1
test_partial_add-push[3.53.2]     19.8118 (1.06)     19.8118 (1.06)     19.8118 (1.06)     0.0000 (1.0)      19.8118 (1.06)     0.0000 (1.0)           0;0  0.0505 (0.95)          1           1
test_partial_add-push[3.60.1]     19.0872 (1.02)     19.0872 (1.02)     19.0872 (1.02)     0.0000 (1.0)      19.0872 (1.02)     0.0000 (1.0)           0;0  0.0524 (0.98)          1           1
test_partial_add-push[main]       18.7300 (1.0)      18.7300 (1.0)      18.7300 (1.0)      0.0000 (1.0)      18.7300 (1.0)      0.0000 (1.0)           0;0  0.0534 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.2562 (1.12)     11.2562 (1.12)     11.2562 (1.12)     0.0000 (1.0)      11.2562 (1.12)     0.0000 (1.0)           0;0  0.0888 (0.89)          1           1
test_partial_add-push-partial[3.10.0]     10.4956 (1.04)     10.4956 (1.04)     10.4956 (1.04)     0.0000 (1.0)      10.4956 (1.04)     0.0000 (1.0)           0;0  0.0953 (0.96)          1           1
test_partial_add-push-partial[3.53.2]     10.3609 (1.03)     10.3609 (1.03)     10.3609 (1.03)     0.0000 (1.0)      10.3609 (1.03)     0.0000 (1.0)           0;0  0.0965 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.0470 (1.0)      10.0470 (1.0)      10.0470 (1.0)      0.0000 (1.0)      10.0470 (1.0)      0.0000 (1.0)           0;0  0.0995 (1.0)           1           1
test_partial_add-push-partial[main]       10.0755 (1.00)     10.0755 (1.00)     10.0755 (1.00)     0.0000 (1.0)      10.0755 (1.00)     0.0000 (1.0)           0;0  0.0993 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     82.6188 (3.58)     82.6188 (3.58)     82.6188 (3.58)     0.0000 (1.0)      82.6188 (3.58)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_partial_remove-add[3.10.0]     85.6105 (3.71)     85.6105 (3.71)     85.6105 (3.71)     0.0000 (1.0)      85.6105 (3.71)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.53.2]     76.3778 (3.31)     76.3778 (3.31)     76.3778 (3.31)     0.0000 (1.0)      76.3778 (3.31)     0.0000 (1.0)           0;0  0.0131 (0.30)          1           1
test_partial_remove-add[3.60.1]     23.0505 (1.0)      23.0505 (1.0)      23.0505 (1.0)      0.0000 (1.0)      23.0505 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
test_partial_remove-add[main]       24.4725 (1.06)     24.4725 (1.06)     24.4725 (1.06)     0.0000 (1.0)      24.4725 (1.06)     0.0000 (1.0)           0;0  0.0409 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.4506 (7.62)     8.4506 (7.62)     8.4506 (7.62)     0.0000 (1.0)      8.4506 (7.62)     0.0000 (1.0)           0;0  0.1183 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.5416 (7.70)     8.5416 (7.70)     8.5416 (7.70)     0.0000 (1.0)      8.5416 (7.70)     0.0000 (1.0)           0;0  0.1171 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.9118 (7.13)     7.9118 (7.13)     7.9118 (7.13)     0.0000 (1.0)      7.9118 (7.13)     0.0000 (1.0)           0;0  0.1264 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.1094 (1.0)      1.1094 (1.0)      1.1094 (1.0)      0.0000 (1.0)      1.1094 (1.0)      0.0000 (1.0)           0;0  0.9014 (1.0)           1           1
test_partial_remove-add-update[main]       1.1445 (1.03)     1.1445 (1.03)     1.1445 (1.03)     0.0000 (1.0)      1.1445 (1.03)     0.0000 (1.0)           0;0  0.8738 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2251 (1.0)      3.2251 (1.0)      3.2251 (1.0)      0.0000 (1.0)      3.2251 (1.0)      0.0000 (1.0)           0;0  0.3101 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5164 (1.09)     3.5164 (1.09)     3.5164 (1.09)     0.0000 (1.0)      3.5164 (1.09)     0.0000 (1.0)           0;0  0.2844 (0.92)          1           1
test_partial_remove-gc[3.53.2]     3.7184 (1.15)     3.7184 (1.15)     3.7184 (1.15)     0.0000 (1.0)      3.7184 (1.15)     0.0000 (1.0)           0;0  0.2689 (0.87)          1           1
test_partial_remove-gc[3.60.1]     3.9714 (1.23)     3.9714 (1.23)     3.9714 (1.23)     0.0000 (1.0)      3.9714 (1.23)     0.0000 (1.0)           0;0  0.2518 (0.81)          1           1
test_partial_remove-gc[main]       3.6640 (1.14)     3.6640 (1.14)     3.6640 (1.14)     0.0000 (1.0)      3.6640 (1.14)     0.0000 (1.0)           0;0  0.2729 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.6198 (1.0)      4.6198 (1.0)      4.6198 (1.0)      0.0000 (1.0)      4.6198 (1.0)      0.0000 (1.0)           0;0  0.2165 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     4.8569 (1.05)     4.8569 (1.05)     4.8569 (1.05)     0.0000 (1.0)      4.8569 (1.05)     0.0000 (1.0)           0;0  0.2059 (0.95)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.9730 (1.08)     4.9730 (1.08)     4.9730 (1.08)     0.0000 (1.0)      4.9730 (1.08)     0.0000 (1.0)           0;0  0.2011 (0.93)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.7829 (1.04)     4.7829 (1.04)     4.7829 (1.04)     0.0000 (1.0)      4.7829 (1.04)     0.0000 (1.0)           0;0  0.2091 (0.97)          1           1
test_partial_remove-gc-cloud[main]       4.6904 (1.02)     4.6904 (1.02)     4.6904 (1.02)     0.0000 (1.0)      4.6904 (1.02)     0.0000 (1.0)           0;0  0.2132 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.6756 (2.38)     53.6756 (2.38)     53.6756 (2.38)     0.0000 (1.0)      53.6756 (2.38)     0.0000 (1.0)           0;0  0.0186 (0.42)          1           1
test_partial_remove-push[3.10.0]     47.6093 (2.11)     47.6093 (2.11)     47.6093 (2.11)     0.0000 (1.0)      47.6093 (2.11)     0.0000 (1.0)           0;0  0.0210 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.1959 (1.03)     23.1959 (1.03)     23.1959 (1.03)     0.0000 (1.0)      23.1959 (1.03)     0.0000 (1.0)           0;0  0.0431 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.8107 (1.01)     22.8107 (1.01)     22.8107 (1.01)     0.0000 (1.0)      22.8107 (1.01)     0.0000 (1.0)           0;0  0.0438 (0.99)          1           1
test_partial_remove-push[main]       22.5624 (1.0)      22.5624 (1.0)      22.5624 (1.0)      0.0000 (1.0)      22.5624 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7762 (1.0)      1.7762 (1.0)      1.7762 (1.0)      0.0000 (1.0)      1.7762 (1.0)      0.0000 (1.0)           0;0  0.5630 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.7932 (1.01)     1.7932 (1.01)     1.7932 (1.01)     0.0000 (1.0)      1.7932 (1.01)     0.0000 (1.0)           0;0  0.5577 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.5359 (1.43)     2.5359 (1.43)     2.5359 (1.43)     0.0000 (1.0)      2.5359 (1.43)     0.0000 (1.0)           0;0  0.3943 (0.70)          1           1
test_partial_remove-push-update[3.60.1]     2.6200 (1.48)     2.6200 (1.48)     2.6200 (1.48)     0.0000 (1.0)      2.6200 (1.48)     0.0000 (1.0)           0;0  0.3817 (0.68)          1           1
test_partial_remove-push-update[main]       2.5285 (1.42)     2.5285 (1.42)     2.5285 (1.42)     0.0000 (1.0)      2.5285 (1.42)     0.0000 (1.0)           0;0  0.3955 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     491.8943 (1.0)      500.8556 (1.0)      496.2600 (1.0)      3.6535 (1.70)     496.4382 (1.0)      6.0792 (2.90)          2;0  2.0151 (1.0)           5           3
test_plots-plots-diff[3.10.0]     893.1063 (1.82)     903.4987 (1.80)     899.5399 (1.81)     4.1209 (1.92)     900.4822 (1.81)     5.7447 (2.74)          1;0  1.1117 (0.55)          5           3
test_plots-plots-diff[3.53.2]     804.1191 (1.63)     811.9701 (1.62)     808.1663 (1.63)     3.6261 (1.69)     809.8731 (1.63)     6.4327 (3.07)          3;0  1.2374 (0.61)          5           3
test_plots-plots-diff[3.60.1]     803.7112 (1.63)     809.1741 (1.62)     807.3155 (1.63)     2.1458 (1.0)      808.1909 (1.63)     2.3303 (1.11)          1;0  1.2387 (0.61)          5           3
test_plots-plots-diff[main]       807.1397 (1.64)     813.4423 (1.62)     811.3978 (1.64)     2.4619 (1.15)     812.3313 (1.64)     2.0978 (1.0)           1;1  1.2324 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       509.4923 (1.0)        518.0205 (1.0)        515.2436 (1.0)       3.4670 (1.0)        516.4589 (1.0)      4.3229 (1.54)          1;0  1.9408 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,128.8848 (2.22)     1,158.4412 (2.24)     1,137.5632 (2.21)     11.8978 (3.43)     1,133.6108 (2.19)     9.8518 (3.51)          1;1  0.8791 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       893.6908 (1.75)       906.0903 (1.75)       899.3047 (1.75)      4.5897 (1.32)       898.7042 (1.74)     5.7366 (2.05)          2;0  1.1120 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       884.3820 (1.74)       893.6781 (1.73)       886.9951 (1.72)      3.7838 (1.09)       885.8251 (1.72)     2.8039 (1.0)           1;1  1.1274 (0.58)          5           3
test_plots-plots-diff-json[main]         889.9552 (1.75)       904.9092 (1.75)       895.5520 (1.74)      6.1624 (1.78)       892.8632 (1.73)     9.0644 (3.23)          1;0  1.1166 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     412.8717 (1.0)      414.9522 (1.0)      413.7784 (1.0)       0.7508 (1.0)      413.7470 (1.0)       0.6912 (1.0)           2;0  2.4168 (1.0)           5           3
test_plots-plots-show[3.10.0]     722.0325 (1.75)     727.1391 (1.75)     723.7755 (1.75)      2.2032 (2.93)     722.6116 (1.75)      3.2907 (4.76)          1;0  1.3816 (0.57)          5           3
test_plots-plots-show[3.53.2]     684.8646 (1.66)     691.0327 (1.67)     687.7370 (1.66)      2.2691 (3.02)     687.3833 (1.66)      2.7768 (4.02)          2;0  1.4540 (0.60)          5           3
test_plots-plots-show[3.60.1]     689.2632 (1.67)     694.3409 (1.67)     690.6576 (1.67)      2.1278 (2.83)     689.7886 (1.67)      2.2390 (3.24)          1;0  1.4479 (0.60)          5           3
test_plots-plots-show[main]       690.7857 (1.67)     717.5702 (1.73)     704.5097 (1.70)     12.7216 (16.94)    703.0179 (1.70)     24.5670 (35.54)         3;0  1.4194 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     427.6318 (1.0)      436.7183 (1.0)      433.5430 (1.0)      3.9087 (1.71)     435.6159 (1.0)      5.8793 (2.30)          1;0  2.3066 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     851.4560 (1.99)     869.8829 (1.99)     857.9768 (1.98)     7.2110 (3.15)     856.5788 (1.97)     8.5488 (3.35)          1;0  1.1655 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     732.9147 (1.71)     743.0525 (1.70)     737.5652 (1.70)     4.5294 (1.98)     738.3189 (1.69)     8.1959 (3.21)          3;0  1.3558 (0.59)          5           3
test_plots-plots-show-json[3.60.1]     735.3115 (1.72)     741.0593 (1.70)     737.1911 (1.70)     2.2889 (1.0)      736.3791 (1.69)     2.5536 (1.0)           1;0  1.3565 (0.59)          5           3
test_plots-plots-show-json[main]       740.1122 (1.73)     751.8569 (1.72)     744.6923 (1.72)     5.0472 (2.21)     741.7367 (1.70)     7.7715 (3.04)          1;0  1.3428 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.0516 (2.35)     52.0516 (2.35)     52.0516 (2.35)     0.0000 (1.0)      52.0516 (2.35)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_push-push[3.10.0]     46.3757 (2.10)     46.3757 (2.10)     46.3757 (2.10)     0.0000 (1.0)      46.3757 (2.10)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_push-push[3.53.2]     22.7467 (1.03)     22.7467 (1.03)     22.7467 (1.03)     0.0000 (1.0)      22.7467 (1.03)     0.0000 (1.0)           0;0  0.0440 (0.97)          1           1
test_push-push[3.60.1]     22.1321 (1.0)      22.1321 (1.0)      22.1321 (1.0)      0.0000 (1.0)      22.1321 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_push-push[main]       22.4709 (1.02)     22.4709 (1.02)     22.4709 (1.02)     0.0000 (1.0)      22.4709 (1.02)     0.0000 (1.0)           0;0  0.0445 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.2669 (2.77)     64.2669 (2.77)     64.2669 (2.77)     0.0000 (1.0)      64.2669 (2.77)     0.0000 (1.0)           0;0  0.0156 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.6919 (3.01)     69.6919 (3.01)     69.6919 (3.01)     0.0000 (1.0)      69.6919 (3.01)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.0598 (1.43)     33.0598 (1.43)     33.0598 (1.43)     0.0000 (1.0)      33.0598 (1.43)     0.0000 (1.0)           0;0  0.0302 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.2304 (1.00)     23.2304 (1.00)     23.2304 (1.00)     0.0000 (1.0)      23.2304 (1.00)     0.0000 (1.0)           0;0  0.0430 (1.00)          1           1
test_sharing-fetch[main]       23.1870 (1.0)      23.1870 (1.0)      23.1870 (1.0)      0.0000 (1.0)      23.1870 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2298 (1.0)      1.2298 (1.0)      1.2298 (1.0)      0.0000 (1.0)      1.2298 (1.0)      0.0000 (1.0)           0;0  0.8131 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5190 (2.86)     3.5190 (2.86)     3.5190 (2.86)     0.0000 (1.0)      3.5190 (2.86)     0.0000 (1.0)           0;0  0.2842 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.6938 (4.63)     5.6938 (4.63)     5.6938 (4.63)     0.0000 (1.0)      5.6938 (4.63)     0.0000 (1.0)           0;0  0.1756 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.7623 (4.69)     5.7623 (4.69)     5.7623 (4.69)     0.0000 (1.0)      5.7623 (4.69)     0.0000 (1.0)           0;0  0.1735 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7904 (4.71)     5.7904 (4.71)     5.7904 (4.71)     0.0000 (1.0)      5.7904 (4.71)     0.0000 (1.0)           0;0  0.1727 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.2425 (2.41)     52.2425 (2.41)     52.2425 (2.41)     0.0000 (1.0)      52.2425 (2.41)     0.0000 (1.0)           0;0  0.0191 (0.42)          1           1
test_sharing-push[3.10.0]     46.7662 (2.15)     46.7662 (2.15)     46.7662 (2.15)     0.0000 (1.0)      46.7662 (2.15)     0.0000 (1.0)           0;0  0.0214 (0.46)          1           1
test_sharing-push[3.53.2]     22.6331 (1.04)     22.6331 (1.04)     22.6331 (1.04)     0.0000 (1.0)      22.6331 (1.04)     0.0000 (1.0)           0;0  0.0442 (0.96)          1           1
test_sharing-push[3.60.1]     21.7174 (1.0)      21.7174 (1.0)      21.7174 (1.0)      0.0000 (1.0)      21.7174 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
test_sharing-push[main]       21.8552 (1.01)     21.8552 (1.01)     21.8552 (1.01)     0.0000 (1.0)      21.8552 (1.01)     0.0000 (1.0)           0;0  0.0458 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0934 (1.01)     2.0934 (1.01)     2.0934 (1.01)     0.0000 (1.0)      2.0934 (1.01)     0.0000 (1.0)           0;0  0.4777 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.0710 (1.0)      2.0710 (1.0)      2.0710 (1.0)      0.0000 (1.0)      2.0710 (1.0)      0.0000 (1.0)           0;0  0.4829 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.8161 (2.81)     5.8161 (2.81)     5.8161 (2.81)     0.0000 (1.0)      5.8161 (2.81)     0.0000 (1.0)           0;0  0.1719 (0.36)          1           1
test_sharing-push-noop[3.60.1]     5.9086 (2.85)     5.9086 (2.85)     5.9086 (2.85)     0.0000 (1.0)      5.9086 (2.85)     0.0000 (1.0)           0;0  0.1692 (0.35)          1           1
test_sharing-push-noop[main]       6.1687 (2.98)     6.1687 (2.98)     6.1687 (2.98)     0.0000 (1.0)      6.1687 (2.98)     0.0000 (1.0)           0;0  0.1621 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     356.8810 (1.02)     356.8810 (1.02)     356.8810 (1.02)     0.0000 (1.0)      356.8810 (1.02)     0.0000 (1.0)           0;0  0.0028 (0.98)          1           1
test_sharing_azure-fetch[main]       351.0397 (1.0)      351.0397 (1.0)      351.0397 (1.0)      0.0000 (1.0)      351.0397 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.5658 (1.0)      6.5658 (1.0)      6.5658 (1.0)      0.0000 (1.0)      6.5658 (1.0)      0.0000 (1.0)           0;0  0.1523 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7359 (1.03)     6.7359 (1.03)     6.7359 (1.03)     0.0000 (1.0)      6.7359 (1.03)     0.0000 (1.0)           0;0  0.1485 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     357.0034 (1.0)      357.0034 (1.0)      357.0034 (1.0)      0.0000 (1.0)      357.0034 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
test_sharing_azure-push[main]       364.0872 (1.02)     364.0872 (1.02)     364.0872 (1.02)     0.0000 (1.0)      364.0872 (1.02)     0.0000 (1.0)           0;0  0.0027 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.7216 (1.03)     7.7216 (1.03)     7.7216 (1.03)     0.0000 (1.0)      7.7216 (1.03)     0.0000 (1.0)           0;0  0.1295 (0.97)          1           1
test_sharing_azure-push-noop[main]       7.5008 (1.0)      7.5008 (1.0)      7.5008 (1.0)      0.0000 (1.0)      7.5008 (1.0)      0.0000 (1.0)           0;0  0.1333 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     392.8491 (1.02)     392.8491 (1.02)     392.8491 (1.02)     0.0000 (1.0)      392.8491 (1.02)     0.0000 (1.0)           0;0  0.0025 (0.98)          1           1
test_sharing_gs-fetch[main]       385.4575 (1.0)      385.4575 (1.0)      385.4575 (1.0)      0.0000 (1.0)      385.4575 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     21.3041 (1.0)      21.3041 (1.0)      21.3041 (1.0)      0.0000 (1.0)      21.3041 (1.0)      0.0000 (1.0)           0;0  0.0469 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       21.9814 (1.03)     21.9814 (1.03)     21.9814 (1.03)     0.0000 (1.0)      21.9814 (1.03)     0.0000 (1.0)           0;0  0.0455 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     877.5898 (1.0)      877.5898 (1.0)      877.5898 (1.0)      0.0000 (1.0)      877.5898 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
test_sharing_gs-push[main]       889.3525 (1.01)     889.3525 (1.01)     889.3525 (1.01)     0.0000 (1.0)      889.3525 (1.01)     0.0000 (1.0)           0;0  0.0011 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.1134 (1.0)      7.1134 (1.0)      7.1134 (1.0)      0.0000 (1.0)      7.1134 (1.0)      0.0000 (1.0)           0;0  0.1406 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.1831 (1.01)     7.1831 (1.01)     7.1831 (1.01)     0.0000 (1.0)      7.1831 (1.01)     0.0000 (1.0)           0;0  0.1392 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     481.2993 (1.0)      481.2993 (1.0)      481.2993 (1.0)      0.0000 (1.0)      481.2993 (1.0)      0.0000 (1.0)           0;0  0.0021 (1.0)           1           1
test_sharing_s3-fetch[main]       481.5855 (1.00)     481.5855 (1.00)     481.5855 (1.00)     0.0000 (1.0)      481.5855 (1.00)     0.0000 (1.0)           0;0  0.0021 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2897 (1.0)      6.2897 (1.0)      6.2897 (1.0)      0.0000 (1.0)      6.2897 (1.0)      0.0000 (1.0)           0;0  0.1590 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.4363 (1.02)     6.4363 (1.02)     6.4363 (1.02)     0.0000 (1.0)      6.4363 (1.02)     0.0000 (1.0)           0;0  0.1554 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     642.8634 (1.0)      642.8634 (1.0)      642.8634 (1.0)      0.0000 (1.0)      642.8634 (1.0)      0.0000 (1.0)           0;0  0.0016 (1.0)           1           1
test_sharing_s3-push[main]       648.8715 (1.01)     648.8715 (1.01)     648.8715 (1.01)     0.0000 (1.0)      648.8715 (1.01)     0.0000 (1.0)           0;0  0.0015 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.6148 (1.0)      6.6148 (1.0)      6.6148 (1.0)      0.0000 (1.0)      6.6148 (1.0)      0.0000 (1.0)           0;0  0.1512 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.6957 (1.01)     6.6957 (1.01)     6.6957 (1.01)     0.0000 (1.0)      6.6957 (1.01)     0.0000 (1.0)           0;0  0.1493 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     13.7143 (3.18)     13.7143 (3.18)     13.7143 (3.18)     0.0000 (1.0)      13.7143 (3.18)     0.0000 (1.0)           0;0  0.0729 (0.31)          1           1
test_status-status[3.10.0]     14.1908 (3.29)     14.1908 (3.29)     14.1908 (3.29)     0.0000 (1.0)      14.1908 (3.29)     0.0000 (1.0)           0;0  0.0705 (0.30)          1           1
test_status-status[3.53.2]     13.2880 (3.08)     13.2880 (3.08)     13.2880 (3.08)     0.0000 (1.0)      13.2880 (3.08)     0.0000 (1.0)           0;0  0.0753 (0.32)          1           1
test_status-status[3.60.1]      4.3075 (1.0)       4.3075 (1.0)       4.3075 (1.0)      0.0000 (1.0)       4.3075 (1.0)      0.0000 (1.0)           0;0  0.2322 (1.0)           1           1
test_status-status[main]        4.8080 (1.12)      4.8080 (1.12)      4.8080 (1.12)     0.0000 (1.0)       4.8080 (1.12)     0.0000 (1.0)           0;0  0.2080 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     3.4426 (1.31)     3.4426 (1.31)     3.4426 (1.31)     0.0000 (1.0)      3.4426 (1.31)     0.0000 (1.0)           0;0  0.2905 (0.76)          1           1
test_status-status-changed[3.10.0]     3.7093 (1.41)     3.7093 (1.41)     3.7093 (1.41)     0.0000 (1.0)      3.7093 (1.41)     0.0000 (1.0)           0;0  0.2696 (0.71)          1           1
test_status-status-changed[3.53.2]     3.9007 (1.48)     3.9007 (1.48)     3.9007 (1.48)     0.0000 (1.0)      3.9007 (1.48)     0.0000 (1.0)           0;0  0.2564 (0.67)          1           1
test_status-status-changed[3.60.1]     2.6269 (1.0)      2.6269 (1.0)      2.6269 (1.0)      0.0000 (1.0)      2.6269 (1.0)      0.0000 (1.0)           0;0  0.3807 (1.0)           1           1
test_status-status-changed[main]       2.9787 (1.13)     2.9787 (1.13)     2.9787 (1.13)     0.0000 (1.0)      2.9787 (1.13)     0.0000 (1.0)           0;0  0.3357 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     3.5102 (1.41)     3.5102 (1.41)     3.5102 (1.41)     0.0000 (1.0)      3.5102 (1.41)     0.0000 (1.0)           0;0  0.2849 (0.71)          1           1
test_status-status-changed-noop[3.10.0]     3.7738 (1.52)     3.7738 (1.52)     3.7738 (1.52)     0.0000 (1.0)      3.7738 (1.52)     0.0000 (1.0)           0;0  0.2650 (0.66)          1           1
test_status-status-changed-noop[3.53.2]     3.7515 (1.51)     3.7515 (1.51)     3.7515 (1.51)     0.0000 (1.0)      3.7515 (1.51)     0.0000 (1.0)           0;0  0.2666 (0.66)          1           1
test_status-status-changed-noop[3.60.1]     2.4872 (1.0)      2.4872 (1.0)      2.4872 (1.0)      0.0000 (1.0)      2.4872 (1.0)      0.0000 (1.0)           0;0  0.4021 (1.0)           1           1
test_status-status-changed-noop[main]       2.8593 (1.15)     2.8593 (1.15)     2.8593 (1.15)     0.0000 (1.0)      2.8593 (1.15)     0.0000 (1.0)           0;0  0.3497 (0.87)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     3.4751 (1.37)     3.4751 (1.37)     3.4751 (1.37)     0.0000 (1.0)      3.4751 (1.37)     0.0000 (1.0)           0;0  0.2878 (0.73)          1           1
test_status-status-noop[3.10.0]     3.6801 (1.45)     3.6801 (1.45)     3.6801 (1.45)     0.0000 (1.0)      3.6801 (1.45)     0.0000 (1.0)           0;0  0.2717 (0.69)          1           1
test_status-status-noop[3.53.2]     3.7615 (1.48)     3.7615 (1.48)     3.7615 (1.48)     0.0000 (1.0)      3.7615 (1.48)     0.0000 (1.0)           0;0  0.2659 (0.67)          1           1
test_status-status-noop[3.60.1]     2.5347 (1.0)      2.5347 (1.0)      2.5347 (1.0)      0.0000 (1.0)      2.5347 (1.0)      0.0000 (1.0)           0;0  0.3945 (1.0)           1           1
test_status-status-noop[main]       2.8587 (1.13)     2.8587 (1.13)     2.8587 (1.13)     0.0000 (1.0)      2.8587 (1.13)     0.0000 (1.0)           0;0  0.3498 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     156.2922 (3.34)     156.2922 (3.34)     156.2922 (3.34)     0.0000 (1.0)      156.2922 (3.34)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     160.5870 (3.43)     160.5870 (3.43)     160.5870 (3.43)     0.0000 (1.0)      160.5870 (3.43)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.53.2]     118.5867 (2.53)     118.5867 (2.53)     118.5867 (2.53)     0.0000 (1.0)      118.5867 (2.53)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_update-import-url[3.60.1]      46.8344 (1.0)       46.8344 (1.0)       46.8344 (1.0)      0.0000 (1.0)       46.8344 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_update-import-url[main]        48.2107 (1.03)      48.2107 (1.03)      48.2107 (1.03)     0.0000 (1.0)       48.2107 (1.03)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     140.0569 (3.90)     140.0569 (3.90)     140.0569 (3.90)     0.0000 (1.0)      140.0569 (3.90)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.10.0]     145.1547 (4.04)     145.1547 (4.04)     145.1547 (4.04)     0.0000 (1.0)      145.1547 (4.04)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.53.2]     109.5476 (3.05)     109.5476 (3.05)     109.5476 (3.05)     0.0000 (1.0)      109.5476 (3.05)     0.0000 (1.0)           0;0  0.0091 (0.33)          1           1
test_update-update[3.60.1]      35.9095 (1.0)       35.9095 (1.0)       35.9095 (1.0)      0.0000 (1.0)       35.9095 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
test_update-update[main]        37.3390 (1.04)      37.3390 (1.04)      37.3390 (1.04)     0.0000 (1.0)       37.3390 (1.04)     0.0000 (1.0)           0;0  0.0268 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0983 (2.05)     16.0983 (2.05)     16.0983 (2.05)     0.0000 (1.0)      16.0983 (2.05)     0.0000 (1.0)           0;0  0.0621 (0.49)          1           1
test_update-update-noop[3.10.0]     17.1158 (2.18)     17.1158 (2.18)     17.1158 (2.18)     0.0000 (1.0)      17.1158 (2.18)     0.0000 (1.0)           0;0  0.0584 (0.46)          1           1
test_update-update-noop[3.53.2]     16.8858 (2.15)     16.8858 (2.15)     16.8858 (2.15)     0.0000 (1.0)      16.8858 (2.15)     0.0000 (1.0)           0;0  0.0592 (0.46)          1           1
test_update-update-noop[3.60.1]      7.8432 (1.0)       7.8432 (1.0)       7.8432 (1.0)      0.0000 (1.0)       7.8432 (1.0)      0.0000 (1.0)           0;0  0.1275 (1.0)           1           1
test_update-update-noop[main]        8.6797 (1.11)      8.6797 (1.11)      8.6797 (1.11)     0.0000 (1.0)       8.6797 (1.11)     0.0000 (1.0)           0;0  0.1152 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean