Sun Nov 16 00:52:54 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     79.3476 (3.60)     79.3476 (3.60)     79.3476 (3.60)     0.0000 (1.0)      79.3476 (3.60)     0.0000 (1.0)           0;0  0.0126 (0.28)          1           1
test_add_copy-add[3.10.0]     79.9057 (3.63)     79.9057 (3.63)     79.9057 (3.63)     0.0000 (1.0)      79.9057 (3.63)     0.0000 (1.0)           0;0  0.0125 (0.28)          1           1
test_add_copy-add[3.53.2]     71.6045 (3.25)     71.6045 (3.25)     71.6045 (3.25)     0.0000 (1.0)      71.6045 (3.25)     0.0000 (1.0)           0;0  0.0140 (0.31)          1           1
test_add_copy-add[3.60.1]     22.0314 (1.0)      22.0314 (1.0)      22.0314 (1.0)      0.0000 (1.0)      22.0314 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
test_add_copy-add[main]       23.3153 (1.06)     23.3153 (1.06)     23.3153 (1.06)     0.0000 (1.0)      23.3153 (1.06)     0.0000 (1.0)           0;0  0.0429 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     26.7366 (6.46)     26.7366 (6.46)     26.7366 (6.46)     0.0000 (1.0)      26.7366 (6.46)     0.0000 (1.0)           0;0  0.0374 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     26.9507 (6.52)     26.9507 (6.52)     26.9507 (6.52)     0.0000 (1.0)      26.9507 (6.52)     0.0000 (1.0)           0;0  0.0371 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     25.4773 (6.16)     25.4773 (6.16)     25.4773 (6.16)     0.0000 (1.0)      25.4773 (6.16)     0.0000 (1.0)           0;0  0.0393 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.1364 (1.0)       4.1364 (1.0)       4.1364 (1.0)      0.0000 (1.0)       4.1364 (1.0)      0.0000 (1.0)           0;0  0.2418 (1.0)           1           1
test_add_copy-add-noop[main]        4.2491 (1.03)      4.2491 (1.03)      4.2491 (1.03)     0.0000 (1.0)       4.2491 (1.03)     0.0000 (1.0)           0;0  0.2353 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     63.2005 (3.97)     63.2005 (3.97)     63.2005 (3.97)     0.0000 (1.0)      63.2005 (3.97)     0.0000 (1.0)           0;0  0.0158 (0.25)          1           1
test_add_hardlink-add[3.10.0]     63.5641 (4.00)     63.5641 (4.00)     63.5641 (4.00)     0.0000 (1.0)      63.5641 (4.00)     0.0000 (1.0)           0;0  0.0157 (0.25)          1           1
test_add_hardlink-add[3.53.2]     57.6722 (3.62)     57.6722 (3.62)     57.6722 (3.62)     0.0000 (1.0)      57.6722 (3.62)     0.0000 (1.0)           0;0  0.0173 (0.28)          1           1
test_add_hardlink-add[3.60.1]     15.9103 (1.0)      15.9103 (1.0)      15.9103 (1.0)      0.0000 (1.0)      15.9103 (1.0)      0.0000 (1.0)           0;0  0.0629 (1.0)           1           1
test_add_hardlink-add[main]       17.1576 (1.08)     17.1576 (1.08)     17.1576 (1.08)     0.0000 (1.0)      17.1576 (1.08)     0.0000 (1.0)           0;0  0.0583 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     31.9686 (7.55)     31.9686 (7.55)     31.9686 (7.55)     0.0000 (1.0)      31.9686 (7.55)     0.0000 (1.0)           0;0  0.0313 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     32.8778 (7.77)     32.8778 (7.77)     32.8778 (7.77)     0.0000 (1.0)      32.8778 (7.77)     0.0000 (1.0)           0;0  0.0304 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     30.2635 (7.15)     30.2635 (7.15)     30.2635 (7.15)     0.0000 (1.0)      30.2635 (7.15)     0.0000 (1.0)           0;0  0.0330 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2325 (1.0)       4.2325 (1.0)       4.2325 (1.0)      0.0000 (1.0)       4.2325 (1.0)      0.0000 (1.0)           0;0  0.2363 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4556 (1.05)      4.4556 (1.05)      4.4556 (1.05)     0.0000 (1.0)       4.4556 (1.05)     0.0000 (1.0)           0;0  0.2244 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     66.3872 (1.93)     66.3872 (1.93)     66.3872 (1.93)     0.0000 (1.0)      66.3872 (1.93)     0.0000 (1.0)           0;0  0.0151 (0.52)          1           1
test_add_symlink-add[3.10.0]     67.5166 (1.96)     67.5166 (1.96)     67.5166 (1.96)     0.0000 (1.0)      67.5166 (1.96)     0.0000 (1.0)           0;0  0.0148 (0.51)          1           1
test_add_symlink-add[3.53.2]     62.0314 (1.80)     62.0314 (1.80)     62.0314 (1.80)     0.0000 (1.0)      62.0314 (1.80)     0.0000 (1.0)           0;0  0.0161 (0.55)          1           1
test_add_symlink-add[3.60.1]     34.3864 (1.0)      34.3864 (1.0)      34.3864 (1.0)      0.0000 (1.0)      34.3864 (1.0)      0.0000 (1.0)           0;0  0.0291 (1.0)           1           1
test_add_symlink-add[main]       36.3267 (1.06)     36.3267 (1.06)     36.3267 (1.06)     0.0000 (1.0)      36.3267 (1.06)     0.0000 (1.0)           0;0  0.0275 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.8012 (8.37)     45.8012 (8.37)     45.8012 (8.37)     0.0000 (1.0)      45.8012 (8.37)     0.0000 (1.0)           0;0  0.0218 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     46.1396 (8.43)     46.1396 (8.43)     46.1396 (8.43)     0.0000 (1.0)      46.1396 (8.43)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.2003 (8.44)     46.2003 (8.44)     46.2003 (8.44)     0.0000 (1.0)      46.2003 (8.44)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.4747 (1.0)       5.4747 (1.0)       5.4747 (1.0)      0.0000 (1.0)       5.4747 (1.0)      0.0000 (1.0)           0;0  0.1827 (1.0)           1           1
test_add_symlink-add-noop[main]        5.6886 (1.04)      5.6886 (1.04)      5.6886 (1.04)     0.0000 (1.0)       5.6886 (1.04)     0.0000 (1.0)           0;0  0.1758 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.8512 (1.88)     39.8512 (1.88)     39.8512 (1.88)     0.0000 (1.0)      39.8512 (1.88)     0.0000 (1.0)           0;0  0.0251 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     57.2958 (2.71)     57.2958 (2.71)     57.2958 (2.71)     0.0000 (1.0)      57.2958 (2.71)     0.0000 (1.0)           0;0  0.0175 (0.37)          1           1
test_checkout_copy-checkout[3.53.2]     28.3927 (1.34)     28.3927 (1.34)     28.3927 (1.34)     0.0000 (1.0)      28.3927 (1.34)     0.0000 (1.0)           0;0  0.0352 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     21.1723 (1.0)      21.1723 (1.0)      21.1723 (1.0)      0.0000 (1.0)      21.1723 (1.0)      0.0000 (1.0)           0;0  0.0472 (1.0)           1           1
test_checkout_copy-checkout[main]       22.1850 (1.05)     22.1850 (1.05)     22.1850 (1.05)     0.0000 (1.0)      22.1850 (1.05)     0.0000 (1.0)           0;0  0.0451 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6981 (1.76)     5.6981 (1.76)     5.6981 (1.76)     0.0000 (1.0)      5.6981 (1.76)     0.0000 (1.0)           0;0  0.1755 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9026 (1.82)     5.9026 (1.82)     5.9026 (1.82)     0.0000 (1.0)      5.9026 (1.82)     0.0000 (1.0)           0;0  0.1694 (0.55)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7076 (1.76)     5.7076 (1.76)     5.7076 (1.76)     0.0000 (1.0)      5.7076 (1.76)     0.0000 (1.0)           0;0  0.1752 (0.57)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2351 (1.0)      3.2351 (1.0)      3.2351 (1.0)      0.0000 (1.0)      3.2351 (1.0)      0.0000 (1.0)           0;0  0.3091 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5081 (1.08)     3.5081 (1.08)     3.5081 (1.08)     0.0000 (1.0)      3.5081 (1.08)     0.0000 (1.0)           0;0  0.2851 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9721 (2.05)     7.9721 (2.05)     7.9721 (2.05)     0.0000 (1.0)      7.9721 (2.05)     0.0000 (1.0)           0;0  0.1254 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6746 (1.72)     6.6746 (1.72)     6.6746 (1.72)     0.0000 (1.0)      6.6746 (1.72)     0.0000 (1.0)           0;0  0.1498 (0.58)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4490 (1.66)     6.4490 (1.66)     6.4490 (1.66)     0.0000 (1.0)      6.4490 (1.66)     0.0000 (1.0)           0;0  0.1551 (0.60)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8798 (1.0)      3.8798 (1.0)      3.8798 (1.0)      0.0000 (1.0)      3.8798 (1.0)      0.0000 (1.0)           0;0  0.2577 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.2861 (1.10)     4.2861 (1.10)     4.2861 (1.10)     0.0000 (1.0)      4.2861 (1.10)     0.0000 (1.0)           0;0  0.2333 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.3530 (2.89)     21.3530 (2.89)     21.3530 (2.89)     0.0000 (1.0)      21.3530 (2.89)     0.0000 (1.0)           0;0  0.0468 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.6041 (2.24)     16.6041 (2.24)     16.6041 (2.24)     0.0000 (1.0)      16.6041 (2.24)     0.0000 (1.0)           0;0  0.0602 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.0241 (2.03)     15.0241 (2.03)     15.0241 (2.03)     0.0000 (1.0)      15.0241 (2.03)     0.0000 (1.0)           0;0  0.0666 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3988 (1.0)       7.3988 (1.0)       7.3988 (1.0)      0.0000 (1.0)       7.3988 (1.0)      0.0000 (1.0)           0;0  0.1352 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.3313 (1.13)      8.3313 (1.13)      8.3313 (1.13)     0.0000 (1.0)       8.3313 (1.13)     0.0000 (1.0)           0;0  0.1200 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4813 (1.64)     5.4813 (1.64)     5.4813 (1.64)     0.0000 (1.0)      5.4813 (1.64)     0.0000 (1.0)           0;0  0.1824 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6436 (1.69)     5.6436 (1.69)     5.6436 (1.69)     0.0000 (1.0)      5.6436 (1.69)     0.0000 (1.0)           0;0  0.1772 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4890 (1.64)     5.4890 (1.64)     5.4890 (1.64)     0.0000 (1.0)      5.4890 (1.64)     0.0000 (1.0)           0;0  0.1822 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3428 (1.0)      3.3428 (1.0)      3.3428 (1.0)      0.0000 (1.0)      3.3428 (1.0)      0.0000 (1.0)           0;0  0.2992 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4453 (1.03)     3.4453 (1.03)     3.4453 (1.03)     0.0000 (1.0)      3.4453 (1.03)     0.0000 (1.0)           0;0  0.2902 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.9151 (2.07)     7.9151 (2.07)     7.9151 (2.07)     0.0000 (1.0)      7.9151 (2.07)     0.0000 (1.0)           0;0  0.1263 (0.48)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5365 (1.71)     6.5365 (1.71)     6.5365 (1.71)     0.0000 (1.0)      6.5365 (1.71)     0.0000 (1.0)           0;0  0.1530 (0.58)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2716 (1.64)     6.2716 (1.64)     6.2716 (1.64)     0.0000 (1.0)      6.2716 (1.64)     0.0000 (1.0)           0;0  0.1594 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8225 (1.0)      3.8225 (1.0)      3.8225 (1.0)      0.0000 (1.0)      3.8225 (1.0)      0.0000 (1.0)           0;0  0.2616 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3033 (1.13)     4.3033 (1.13)     4.3033 (1.13)     0.0000 (1.0)      4.3033 (1.13)     0.0000 (1.0)           0;0  0.2324 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9721 (2.42)     24.9721 (2.42)     24.9721 (2.42)     0.0000 (1.0)      24.9721 (2.42)     0.0000 (1.0)           0;0  0.0400 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     19.6708 (1.91)     19.6708 (1.91)     19.6708 (1.91)     0.0000 (1.0)      19.6708 (1.91)     0.0000 (1.0)           0;0  0.0508 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.9553 (1.74)     17.9553 (1.74)     17.9553 (1.74)     0.0000 (1.0)      17.9553 (1.74)     0.0000 (1.0)           0;0  0.0557 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.3019 (1.0)      10.3019 (1.0)      10.3019 (1.0)      0.0000 (1.0)      10.3019 (1.0)      0.0000 (1.0)           0;0  0.0971 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.5982 (1.13)     11.5982 (1.13)     11.5982 (1.13)     0.0000 (1.0)      11.5982 (1.13)     0.0000 (1.0)           0;0  0.0862 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8608 (1.65)     6.8608 (1.65)     6.8608 (1.65)     0.0000 (1.0)      6.8608 (1.65)     0.0000 (1.0)           0;0  0.1458 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.0335 (1.69)     7.0335 (1.69)     7.0335 (1.69)     0.0000 (1.0)      7.0335 (1.69)     0.0000 (1.0)           0;0  0.1422 (0.59)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7618 (1.62)     6.7618 (1.62)     6.7618 (1.62)     0.0000 (1.0)      6.7618 (1.62)     0.0000 (1.0)           0;0  0.1479 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1635 (1.0)      4.1635 (1.0)      4.1635 (1.0)      0.0000 (1.0)      4.1635 (1.0)      0.0000 (1.0)           0;0  0.2402 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3952 (1.06)     4.3952 (1.06)     4.3952 (1.06)     0.0000 (1.0)      4.3952 (1.06)     0.0000 (1.0)           0;0  0.2275 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.0608 (1.76)     10.0608 (1.76)     10.0608 (1.76)     0.0000 (1.0)      10.0608 (1.76)     0.0000 (1.0)           0;0  0.0994 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7089 (1.53)      8.7089 (1.53)      8.7089 (1.53)     0.0000 (1.0)       8.7089 (1.53)     0.0000 (1.0)           0;0  0.1148 (0.66)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.5609 (1.50)      8.5609 (1.50)      8.5609 (1.50)     0.0000 (1.0)       8.5609 (1.50)     0.0000 (1.0)           0;0  0.1168 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7085 (1.0)       5.7085 (1.0)       5.7085 (1.0)      0.0000 (1.0)       5.7085 (1.0)      0.0000 (1.0)           0;0  0.1752 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.2146 (1.09)      6.2146 (1.09)      6.2146 (1.09)     0.0000 (1.0)       6.2146 (1.09)     0.0000 (1.0)           0;0  0.1609 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9192 (1.66)     3.9192 (1.66)     3.9192 (1.66)     0.0000 (1.0)      3.9192 (1.66)     0.0000 (1.0)           0;0  0.2552 (0.60)          1           1
test_data_status-data-changed[3.10.0]     4.8035 (2.04)     4.8035 (2.04)     4.8035 (2.04)     0.0000 (1.0)      4.8035 (2.04)     0.0000 (1.0)           0;0  0.2082 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.6450 (1.97)     4.6450 (1.97)     4.6450 (1.97)     0.0000 (1.0)      4.6450 (1.97)     0.0000 (1.0)           0;0  0.2153 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3555 (1.0)      2.3555 (1.0)      2.3555 (1.0)      0.0000 (1.0)      2.3555 (1.0)      0.0000 (1.0)           0;0  0.4245 (1.0)           1           1
test_data_status-data-changed[main]       2.5358 (1.08)     2.5358 (1.08)     2.5358 (1.08)     0.0000 (1.0)      2.5358 (1.08)     0.0000 (1.0)           0;0  0.3943 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1298 (1.76)     4.1298 (1.76)     4.1298 (1.76)     0.0000 (1.0)      4.1298 (1.76)     0.0000 (1.0)           0;0  0.2421 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8624 (2.07)     4.8624 (2.07)     4.8624 (2.07)     0.0000 (1.0)      4.8624 (2.07)     0.0000 (1.0)           0;0  0.2057 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7631 (2.03)     4.7631 (2.03)     4.7631 (2.03)     0.0000 (1.0)      4.7631 (2.03)     0.0000 (1.0)           0;0  0.2099 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3506 (1.0)      2.3506 (1.0)      2.3506 (1.0)      0.0000 (1.0)      2.3506 (1.0)      0.0000 (1.0)           0;0  0.4254 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6141 (1.11)     2.6141 (1.11)     2.6141 (1.11)     0.0000 (1.0)      2.6141 (1.11)     0.0000 (1.0)           0;0  0.3825 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5731 (3.85)     18.5731 (3.85)     18.5731 (3.85)     0.0000 (1.0)      18.5731 (3.85)     0.0000 (1.0)           0;0  0.0538 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.5542 (4.05)     19.5542 (4.05)     19.5542 (4.05)     0.0000 (1.0)      19.5542 (4.05)     0.0000 (1.0)           0;0  0.0511 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.2012 (3.98)     19.2012 (3.98)     19.2012 (3.98)     0.0000 (1.0)      19.2012 (3.98)     0.0000 (1.0)           0;0  0.0521 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.8230 (1.0)       4.8230 (1.0)       4.8230 (1.0)      0.0000 (1.0)       4.8230 (1.0)      0.0000 (1.0)           0;0  0.2073 (1.0)           1           1
test_data_status-data-new[main]        5.1001 (1.06)      5.1001 (1.06)      5.1001 (1.06)     0.0000 (1.0)       5.1001 (1.06)     0.0000 (1.0)           0;0  0.1961 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0724 (1.72)     4.0724 (1.72)     4.0724 (1.72)     0.0000 (1.0)      4.0724 (1.72)     0.0000 (1.0)           0;0  0.2456 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.8758 (2.05)     4.8758 (2.05)     4.8758 (2.05)     0.0000 (1.0)      4.8758 (2.05)     0.0000 (1.0)           0;0  0.2051 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.7661 (2.01)     4.7661 (2.01)     4.7661 (2.01)     0.0000 (1.0)      4.7661 (2.01)     0.0000 (1.0)           0;0  0.2098 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.3728 (1.0)      2.3728 (1.0)      2.3728 (1.0)      0.0000 (1.0)      2.3728 (1.0)      0.0000 (1.0)           0;0  0.4214 (1.0)           1           1
test_data_status-data-noop[main]       2.5179 (1.06)     2.5179 (1.06)     2.5179 (1.06)     0.0000 (1.0)      2.5179 (1.06)     0.0000 (1.0)           0;0  0.3972 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.0523 (1.34)     7.0523 (1.34)     7.0523 (1.34)     0.0000 (1.0)      7.0523 (1.34)     0.0000 (1.0)           0;0  0.1418 (0.74)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6077 (1.45)     7.6077 (1.45)     7.6077 (1.45)     0.0000 (1.0)      7.6077 (1.45)     0.0000 (1.0)           0;0  0.1314 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5197 (1.43)     7.5197 (1.43)     7.5197 (1.43)     0.0000 (1.0)      7.5197 (1.43)     0.0000 (1.0)           0;0  0.1330 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.2470 (1.0)      5.2470 (1.0)      5.2470 (1.0)      0.0000 (1.0)      5.2470 (1.0)      0.0000 (1.0)           0;0  0.1906 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.5069 (1.05)     5.5069 (1.05)     5.5069 (1.05)     0.0000 (1.0)      5.5069 (1.05)     0.0000 (1.0)           0;0  0.1816 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.9868 (1.32)     6.9868 (1.32)     6.9868 (1.32)     0.0000 (1.0)      6.9868 (1.32)     0.0000 (1.0)           0;0  0.1431 (0.76)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.5640 (1.43)     7.5640 (1.43)     7.5640 (1.43)     0.0000 (1.0)      7.5640 (1.43)     0.0000 (1.0)           0;0  0.1322 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.5598 (1.43)     7.5598 (1.43)     7.5598 (1.43)     0.0000 (1.0)      7.5598 (1.43)     0.0000 (1.0)           0;0  0.1323 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.2762 (1.0)      5.2762 (1.0)      5.2762 (1.0)      0.0000 (1.0)      5.2762 (1.0)      0.0000 (1.0)           0;0  0.1895 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.4765 (1.04)     5.4765 (1.04)     5.4765 (1.04)     0.0000 (1.0)      5.4765 (1.04)     0.0000 (1.0)           0;0  0.1826 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.1231 (2.75)     21.1231 (2.75)     21.1231 (2.75)     0.0000 (1.0)      21.1231 (2.75)     0.0000 (1.0)           0;0  0.0473 (0.36)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.8652 (2.84)     21.8652 (2.84)     21.8652 (2.84)     0.0000 (1.0)      21.8652 (2.84)     0.0000 (1.0)           0;0  0.0457 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.2701 (2.77)     21.2701 (2.77)     21.2701 (2.77)     0.0000 (1.0)      21.2701 (2.77)     0.0000 (1.0)           0;0  0.0470 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.6866 (1.0)       7.6866 (1.0)       7.6866 (1.0)      0.0000 (1.0)       7.6866 (1.0)      0.0000 (1.0)           0;0  0.1301 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1880 (1.07)      8.1880 (1.07)      8.1880 (1.07)     0.0000 (1.0)       8.1880 (1.07)     0.0000 (1.0)           0;0  0.1221 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.3018 (1.37)     6.3018 (1.37)     6.3018 (1.37)     0.0000 (1.0)      6.3018 (1.37)     0.0000 (1.0)           0;0  0.1587 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     6.9962 (1.52)     6.9962 (1.52)     6.9962 (1.52)     0.0000 (1.0)      6.9962 (1.52)     0.0000 (1.0)           0;0  0.1429 (0.66)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0874 (1.54)     7.0874 (1.54)     7.0874 (1.54)     0.0000 (1.0)      7.0874 (1.54)     0.0000 (1.0)           0;0  0.1411 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.6133 (1.0)      4.6133 (1.0)      4.6133 (1.0)      0.0000 (1.0)      4.6133 (1.0)      0.0000 (1.0)           0;0  0.2168 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0234 (1.09)     5.0234 (1.09)     5.0234 (1.09)     0.0000 (1.0)      5.0234 (1.09)     0.0000 (1.0)           0;0  0.1991 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.0180 (2.75)     19.0180 (2.75)     19.0180 (2.75)     0.0000 (1.0)      19.0180 (2.75)     0.0000 (1.0)           0;0  0.0526 (0.36)          1           1
test_diff-diff[3.10.0]     20.1509 (2.92)     20.1509 (2.92)     20.1509 (2.92)     0.0000 (1.0)      20.1509 (2.92)     0.0000 (1.0)           0;0  0.0496 (0.34)          1           1
test_diff-diff[3.53.2]     20.1391 (2.92)     20.1391 (2.92)     20.1391 (2.92)     0.0000 (1.0)      20.1391 (2.92)     0.0000 (1.0)           0;0  0.0497 (0.34)          1           1
test_diff-diff[3.60.1]      6.9032 (1.0)       6.9032 (1.0)       6.9032 (1.0)      0.0000 (1.0)       6.9032 (1.0)      0.0000 (1.0)           0;0  0.1449 (1.0)           1           1
test_diff-diff[main]        7.9560 (1.15)      7.9560 (1.15)      7.9560 (1.15)     0.0000 (1.0)       7.9560 (1.15)     0.0000 (1.0)           0;0  0.1257 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2196 (1.83)     6.2196 (1.83)     6.2196 (1.83)     0.0000 (1.0)      6.2196 (1.83)     0.0000 (1.0)           0;0  0.1608 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.9406 (2.04)     6.9406 (2.04)     6.9406 (2.04)     0.0000 (1.0)      6.9406 (2.04)     0.0000 (1.0)           0;0  0.1441 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.8336 (1.71)     5.8336 (1.71)     5.8336 (1.71)     0.0000 (1.0)      5.8336 (1.71)     0.0000 (1.0)           0;0  0.1714 (0.58)          1           1
test_diff-diff-changed[3.60.1]     3.4058 (1.0)      3.4058 (1.0)      3.4058 (1.0)      0.0000 (1.0)      3.4058 (1.0)      0.0000 (1.0)           0;0  0.2936 (1.0)           1           1
test_diff-diff-changed[main]       4.1829 (1.23)     4.1829 (1.23)     4.1829 (1.23)     0.0000 (1.0)      4.1829 (1.23)     0.0000 (1.0)           0;0  0.2391 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.3864 (1.59)     5.3864 (1.59)     5.3864 (1.59)     0.0000 (1.0)      5.3864 (1.59)     0.0000 (1.0)           0;0  0.1857 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.9494 (1.76)     5.9494 (1.76)     5.9494 (1.76)     0.0000 (1.0)      5.9494 (1.76)     0.0000 (1.0)           0;0  0.1681 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6903 (1.68)     5.6903 (1.68)     5.6903 (1.68)     0.0000 (1.0)      5.6903 (1.68)     0.0000 (1.0)           0;0  0.1757 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3880 (1.0)      3.3880 (1.0)      3.3880 (1.0)      0.0000 (1.0)      3.3880 (1.0)      0.0000 (1.0)           0;0  0.2952 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2676 (1.26)     4.2676 (1.26)     4.2676 (1.26)     0.0000 (1.0)      4.2676 (1.26)     0.0000 (1.0)           0;0  0.2343 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2623 (1.26)     4.2623 (1.26)     4.2623 (1.26)     0.0000 (1.0)      4.2623 (1.26)     0.0000 (1.0)           0;0  0.2346 (0.80)          1           1
test_diff-diff-noop[3.10.0]     5.0753 (1.50)     5.0753 (1.50)     5.0753 (1.50)     0.0000 (1.0)      5.0753 (1.50)     0.0000 (1.0)           0;0  0.1970 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.7975 (1.71)     5.7975 (1.71)     5.7975 (1.71)     0.0000 (1.0)      5.7975 (1.71)     0.0000 (1.0)           0;0  0.1725 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.3916 (1.0)      3.3916 (1.0)      3.3916 (1.0)      0.0000 (1.0)      3.3916 (1.0)      0.0000 (1.0)           0;0  0.2948 (1.0)           1           1
test_diff-diff-noop[main]       4.2456 (1.25)     4.2456 (1.25)     4.2456 (1.25)     0.0000 (1.0)      4.2456 (1.25)     0.0000 (1.0)           0;0  0.2355 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2072 (1.0)       1.2072 (1.0)       1.2072 (1.0)      0.0000 (1.0)       1.2072 (1.0)      0.0000 (1.0)           0;0  0.8283 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.4244 (8.63)     10.4244 (8.63)     10.4244 (8.63)     0.0000 (1.0)      10.4244 (8.63)     0.0000 (1.0)           0;0  0.0959 (0.12)          1           1
test_exp_show-exp[3.53.2]      5.5342 (4.58)      5.5342 (4.58)      5.5342 (4.58)     0.0000 (1.0)       5.5342 (4.58)     0.0000 (1.0)           0;0  0.1807 (0.22)          1           1
test_exp_show-exp[3.60.1]      5.9596 (4.94)      5.9596 (4.94)      5.9596 (4.94)     0.0000 (1.0)       5.9596 (4.94)     0.0000 (1.0)           0;0  0.1678 (0.20)          1           1
test_exp_show-exp[main]       12.8244 (10.62)    12.8244 (10.62)    12.8244 (10.62)    0.0000 (1.0)      12.8244 (10.62)    0.0000 (1.0)           0;0  0.0780 (0.09)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     61.1689 (2.62)     61.1689 (2.62)     61.1689 (2.62)     0.0000 (1.0)      61.1689 (2.62)     0.0000 (1.0)           0;0  0.0163 (0.38)          1           1
test_fetch-fetch[3.10.0]     66.7044 (2.86)     66.7044 (2.86)     66.7044 (2.86)     0.0000 (1.0)      66.7044 (2.86)     0.0000 (1.0)           0;0  0.0150 (0.35)          1           1
test_fetch-fetch[3.53.2]     33.7648 (1.45)     33.7648 (1.45)     33.7648 (1.45)     0.0000 (1.0)      33.7648 (1.45)     0.0000 (1.0)           0;0  0.0296 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.4159 (1.00)     23.4159 (1.00)     23.4159 (1.00)     0.0000 (1.0)      23.4159 (1.00)     0.0000 (1.0)           0;0  0.0427 (1.00)          1           1
test_fetch-fetch[main]       23.3521 (1.0)      23.3521 (1.0)      23.3521 (1.0)      0.0000 (1.0)      23.3521 (1.0)      0.0000 (1.0)           0;0  0.0428 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9204 (1.00)     2.9204 (1.00)     2.9204 (1.00)     0.0000 (1.0)      2.9204 (1.00)     0.0000 (1.0)           0;0  0.3424 (1.00)          1           1
test_gc-gc[3.10.0]     3.0292 (1.04)     3.0292 (1.04)     3.0292 (1.04)     0.0000 (1.0)      3.0292 (1.04)     0.0000 (1.0)           0;0  0.3301 (0.96)          1           1
test_gc-gc[3.53.2]     2.9884 (1.03)     2.9884 (1.03)     2.9884 (1.03)     0.0000 (1.0)      2.9884 (1.03)     0.0000 (1.0)           0;0  0.3346 (0.97)          1           1
test_gc-gc[3.60.1]     2.9094 (1.0)      2.9094 (1.0)      2.9094 (1.0)      0.0000 (1.0)      2.9094 (1.0)      0.0000 (1.0)           0;0  0.3437 (1.0)           1           1
test_gc-gc[main]       3.0971 (1.06)     3.0971 (1.06)     3.0971 (1.06)     0.0000 (1.0)      3.0971 (1.06)     0.0000 (1.0)           0;0  0.3229 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     129.6637 (2.70)     129.6637 (2.70)     129.6637 (2.70)     0.0000 (1.0)      129.6637 (2.70)     0.0000 (1.0)           0;0  0.0077 (0.37)          1           1
test_get-get[3.10.0]     157.9518 (3.29)     157.9518 (3.29)     157.9518 (3.29)     0.0000 (1.0)      157.9518 (3.29)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_get-get[3.53.2]     139.9877 (2.92)     139.9877 (2.92)     139.9877 (2.92)     0.0000 (1.0)      139.9877 (2.92)     0.0000 (1.0)           0;0  0.0071 (0.34)          1           1
test_get-get[3.60.1]      48.1359 (1.00)      48.1359 (1.00)      48.1359 (1.00)     0.0000 (1.0)       48.1359 (1.00)     0.0000 (1.0)           0;0  0.0208 (1.00)          1           1
test_get-get[main]        47.9431 (1.0)       47.9431 (1.0)       47.9431 (1.0)      0.0000 (1.0)       47.9431 (1.0)      0.0000 (1.0)           0;0  0.0209 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     33.2821 (3.71)     33.2821 (3.71)     33.2821 (3.71)     0.0000 (1.0)      33.2821 (3.71)     0.0000 (1.0)           0;0  0.0300 (0.27)          1           1
test_get_url-get-url[3.10.0]     38.0171 (4.24)     38.0171 (4.24)     38.0171 (4.24)     0.0000 (1.0)      38.0171 (4.24)     0.0000 (1.0)           0;0  0.0263 (0.24)          1           1
test_get_url-get-url[3.53.2]      9.5667 (1.07)      9.5667 (1.07)      9.5667 (1.07)     0.0000 (1.0)       9.5667 (1.07)     0.0000 (1.0)           0;0  0.1045 (0.94)          1           1
test_get_url-get-url[3.60.1]      8.9734 (1.0)       8.9734 (1.0)       8.9734 (1.0)      0.0000 (1.0)       8.9734 (1.0)      0.0000 (1.0)           0;0  0.1114 (1.0)           1           1
test_get_url-get-url[main]        9.4732 (1.06)      9.4732 (1.06)      9.4732 (1.06)     0.0000 (1.0)       9.4732 (1.06)     0.0000 (1.0)           0;0  0.1056 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     149.8428 (1.06)     166.6342 (1.08)     153.5338 (1.05)     2.0027 (1.26)     153.5962 (1.06)     1.9741 (1.12)         20;2  6.5132 (0.95)        100           1
test_help---help[3.10.0]     144.6628 (1.02)     154.1786 (1.0)      148.6684 (1.02)     1.6182 (1.02)     148.6003 (1.03)     2.1283 (1.21)         34;2  6.7264 (0.98)        100           1
test_help---help[3.53.2]     149.2723 (1.05)     156.5913 (1.02)     152.4352 (1.04)     1.6475 (1.04)     152.1210 (1.05)     2.3347 (1.32)         31;0  6.5602 (0.96)        100           1
test_help---help[3.60.1]     150.1054 (1.06)     158.3955 (1.03)     153.3158 (1.05)     1.5846 (1.0)      153.1707 (1.06)     1.7634 (1.0)          30;5  6.5225 (0.95)        100           1
test_help---help[main]       141.6627 (1.0)      199.3219 (1.29)     146.4111 (1.0)      8.4513 (5.33)     144.3897 (1.0)      2.5768 (1.46)          6;8  6.8301 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     219.4933 (2.97)     219.4933 (2.97)     219.4933 (2.97)     0.0000 (1.0)      219.4933 (2.97)     0.0000 (1.0)           0;0  0.0046 (0.34)          1           1
test_import-import[3.10.0]     247.5349 (3.35)     247.5349 (3.35)     247.5349 (3.35)     0.0000 (1.0)      247.5349 (3.35)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      73.8566 (1.0)       73.8566 (1.0)       73.8566 (1.0)      0.0000 (1.0)       73.8566 (1.0)      0.0000 (1.0)           0;0  0.0135 (1.0)           1           1
test_import-import[main]        75.6608 (1.02)      75.6608 (1.02)      75.6608 (1.02)     0.0000 (1.0)       75.6608 (1.02)     0.0000 (1.0)           0;0  0.0132 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     146.9538 (3.22)     146.9538 (3.22)     146.9538 (3.22)     0.0000 (1.0)      146.9538 (3.22)     0.0000 (1.0)           0;0  0.0068 (0.31)          1           1
test_import_url-import-url[3.10.0]     149.7465 (3.28)     149.7465 (3.28)     149.7465 (3.28)     0.0000 (1.0)      149.7465 (3.28)     0.0000 (1.0)           0;0  0.0067 (0.30)          1           1
test_import_url-import-url[3.53.2]     112.8551 (2.47)     112.8551 (2.47)     112.8551 (2.47)     0.0000 (1.0)      112.8551 (2.47)     0.0000 (1.0)           0;0  0.0089 (0.40)          1           1
test_import_url-import-url[3.60.1]      45.6194 (1.0)       45.6194 (1.0)       45.6194 (1.0)      0.0000 (1.0)       45.6194 (1.0)      0.0000 (1.0)           0;0  0.0219 (1.0)           1           1
test_import_url-import-url[main]        46.7144 (1.02)      46.7144 (1.02)      46.7144 (1.02)     0.0000 (1.0)       46.7144 (1.02)     0.0000 (1.0)           0;0  0.0214 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     432.6455 (1.04)     601.9013 (1.35)     443.5352 (1.04)     17.2285 (3.29)     440.8048 (1.03)      7.3385 (1.24)          4;5  2.2546 (0.96)        100           1
test_init-init[3.10.0]     437.9158 (1.05)     480.2816 (1.07)     455.2240 (1.07)      8.5573 (1.63)     455.8265 (1.07)     12.7067 (2.15)         34;0  2.1967 (0.94)        100           1
test_init-init[3.53.2]     419.8081 (1.01)     453.9670 (1.01)     432.7973 (1.01)      7.8612 (1.50)     431.0503 (1.01)      9.9522 (1.69)         34;1  2.3106 (0.99)        100           1
test_init-init[3.60.1]     415.4343 (1.0)      447.3021 (1.0)      426.4308 (1.0)       5.2419 (1.0)      426.0252 (1.0)       5.9027 (1.0)          30;2  2.3450 (1.0)         100           1
test_init-init[main]       448.5020 (1.08)     529.3953 (1.18)     461.4740 (1.08)     11.5648 (2.21)     457.9065 (1.07)     10.2261 (1.73)          8;4  2.1670 (0.92)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     649.7262 (1.09)     649.7262 (1.09)     649.7262 (1.09)     0.0000 (1.0)      649.7262 (1.09)     0.0000 (1.0)           0;0  1.5391 (0.92)          1           1
test_list-list[3.10.0]     756.1016 (1.26)     756.1016 (1.26)     756.1016 (1.26)     0.0000 (1.0)      756.1016 (1.26)     0.0000 (1.0)           0;0  1.3226 (0.79)          1           1
test_list-list[3.53.2]     644.9596 (1.08)     644.9596 (1.08)     644.9596 (1.08)     0.0000 (1.0)      644.9596 (1.08)     0.0000 (1.0)           0;0  1.5505 (0.93)          1           1
test_list-list[3.60.1]     598.2689 (1.0)      598.2689 (1.0)      598.2689 (1.0)      0.0000 (1.0)      598.2689 (1.0)      0.0000 (1.0)           0;0  1.6715 (1.0)           1           1
test_list-list[main]       601.3313 (1.01)     601.3313 (1.01)     601.3313 (1.01)     0.0000 (1.0)      601.3313 (1.01)     0.0000 (1.0)           0;0  1.6630 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     459.5581 (1.08)     459.5581 (1.08)     459.5581 (1.08)     0.0000 (1.0)      459.5581 (1.08)     0.0000 (1.0)           0;0  2.1760 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     460.7815 (1.08)     460.7815 (1.08)     460.7815 (1.08)     0.0000 (1.0)      460.7815 (1.08)     0.0000 (1.0)           0;0  2.1702 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     436.5849 (1.03)     436.5849 (1.03)     436.5849 (1.03)     0.0000 (1.0)      436.5849 (1.03)     0.0000 (1.0)           0;0  2.2905 (0.97)          1           1
test_list-list-dvc-only[3.60.1]     428.6570 (1.01)     428.6570 (1.01)     428.6570 (1.01)     0.0000 (1.0)      428.6570 (1.01)     0.0000 (1.0)           0;0  2.3329 (0.99)          1           1
test_list-list-dvc-only[main]       425.5085 (1.0)      425.5085 (1.0)      425.5085 (1.0)      0.0000 (1.0)      425.5085 (1.0)      0.0000 (1.0)           0;0  2.3501 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4362 (1.0)      2.4362 (1.0)      2.4362 (1.0)      0.0000 (1.0)      2.4362 (1.0)      0.0000 (1.0)           0;0  0.4105 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5986 (1.07)     2.5986 (1.07)     2.5986 (1.07)     0.0000 (1.0)      2.5986 (1.07)     0.0000 (1.0)           0;0  0.3848 (0.94)          1           1
test_list-list-recursive[3.53.2]     2.7487 (1.13)     2.7487 (1.13)     2.7487 (1.13)     0.0000 (1.0)      2.7487 (1.13)     0.0000 (1.0)           0;0  0.3638 (0.89)          1           1
test_list-list-recursive[3.60.1]     2.6950 (1.11)     2.6950 (1.11)     2.6950 (1.11)     0.0000 (1.0)      2.6950 (1.11)     0.0000 (1.0)           0;0  0.3711 (0.90)          1           1
test_list-list-recursive[main]       2.8737 (1.18)     2.8737 (1.18)     2.8737 (1.18)     0.0000 (1.0)      2.8737 (1.18)     0.0000 (1.0)           0;0  0.3480 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     471.9943 (1.10)     471.9943 (1.10)     471.9943 (1.10)     0.0000 (1.0)      471.9943 (1.10)     0.0000 (1.0)           0;0  2.1187 (0.91)          1           1
test_list-list-shallow[3.10.0]     470.8233 (1.10)     470.8233 (1.10)     470.8233 (1.10)     0.0000 (1.0)      470.8233 (1.10)     0.0000 (1.0)           0;0  2.1239 (0.91)          1           1
test_list-list-shallow[3.53.2]     428.1080 (1.0)      428.1080 (1.0)      428.1080 (1.0)      0.0000 (1.0)      428.1080 (1.0)      0.0000 (1.0)           0;0  2.3359 (1.0)           1           1
test_list-list-shallow[3.60.1]     449.9500 (1.05)     449.9500 (1.05)     449.9500 (1.05)     0.0000 (1.0)      449.9500 (1.05)     0.0000 (1.0)           0;0  2.2225 (0.95)          1           1
test_list-list-shallow[main]       434.8720 (1.02)     434.8720 (1.02)     434.8720 (1.02)     0.0000 (1.0)      434.8720 (1.02)     0.0000 (1.0)           0;0  2.2995 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.6258 (3.70)     71.6258 (3.70)     71.6258 (3.70)     0.0000 (1.0)      71.6258 (3.70)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.10.0]     72.1747 (3.73)     72.1747 (3.73)     72.1747 (3.73)     0.0000 (1.0)      72.1747 (3.73)     0.0000 (1.0)           0;0  0.0139 (0.27)          1           1
test_partial_add-add[3.53.2]     64.8369 (3.35)     64.8369 (3.35)     64.8369 (3.35)     0.0000 (1.0)      64.8369 (3.35)     0.0000 (1.0)           0;0  0.0154 (0.30)          1           1
test_partial_add-add[3.60.1]     19.3742 (1.0)      19.3742 (1.0)      19.3742 (1.0)      0.0000 (1.0)      19.3742 (1.0)      0.0000 (1.0)           0;0  0.0516 (1.0)           1           1
test_partial_add-add[main]       20.3854 (1.05)     20.3854 (1.05)     20.3854 (1.05)     0.0000 (1.0)      20.3854 (1.05)     0.0000 (1.0)           0;0  0.0491 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     60.1754 (7.99)     60.1754 (7.99)     60.1754 (7.99)     0.0000 (1.0)      60.1754 (7.99)     0.0000 (1.0)           0;0  0.0166 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     60.4657 (8.02)     60.4657 (8.02)     60.4657 (8.02)     0.0000 (1.0)      60.4657 (8.02)     0.0000 (1.0)           0;0  0.0165 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     55.6969 (7.39)     55.6969 (7.39)     55.6969 (7.39)     0.0000 (1.0)      55.6969 (7.39)     0.0000 (1.0)           0;0  0.0180 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.5351 (1.0)       7.5351 (1.0)       7.5351 (1.0)      0.0000 (1.0)       7.5351 (1.0)      0.0000 (1.0)           0;0  0.1327 (1.0)           1           1
test_partial_add-add-partial[main]        7.7485 (1.03)      7.7485 (1.03)      7.7485 (1.03)     0.0000 (1.0)       7.7485 (1.03)     0.0000 (1.0)           0;0  0.1291 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.7559 (1.0)      4.7559 (1.0)      4.7559 (1.0)      0.0000 (1.0)      4.7559 (1.0)      0.0000 (1.0)           0;0  0.2103 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.2799 (1.32)     6.2799 (1.32)     6.2799 (1.32)     0.0000 (1.0)      6.2799 (1.32)     0.0000 (1.0)           0;0  0.1592 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1312 (1.50)     7.1312 (1.50)     7.1312 (1.50)     0.0000 (1.0)      7.1312 (1.50)     0.0000 (1.0)           0;0  0.1402 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.1950 (1.51)     7.1950 (1.51)     7.1950 (1.51)     0.0000 (1.0)      7.1950 (1.51)     0.0000 (1.0)           0;0  0.1390 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       7.1706 (1.51)     7.1706 (1.51)     7.1706 (1.51)     0.0000 (1.0)      7.1706 (1.51)     0.0000 (1.0)           0;0  0.1395 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6343 (1.0)      2.6343 (1.0)      2.6343 (1.0)      0.0000 (1.0)      2.6343 (1.0)      0.0000 (1.0)           0;0  0.3796 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.0293 (1.53)     4.0293 (1.53)     4.0293 (1.53)     0.0000 (1.0)      4.0293 (1.53)     0.0000 (1.0)           0;0  0.2482 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     4.0389 (1.53)     4.0389 (1.53)     4.0389 (1.53)     0.0000 (1.0)      4.0389 (1.53)     0.0000 (1.0)           0;0  0.2476 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     4.0758 (1.55)     4.0758 (1.55)     4.0758 (1.55)     0.0000 (1.0)      4.0758 (1.55)     0.0000 (1.0)           0;0  0.2453 (0.65)          1           1
test_partial_add-gc-noop[main]       4.0901 (1.55)     4.0901 (1.55)     4.0901 (1.55)     0.0000 (1.0)      4.0901 (1.55)     0.0000 (1.0)           0;0  0.2445 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     40.8842 (2.18)     40.8842 (2.18)     40.8842 (2.18)     0.0000 (1.0)      40.8842 (2.18)     0.0000 (1.0)           0;0  0.0245 (0.46)          1           1
test_partial_add-push[3.10.0]     35.8888 (1.91)     35.8888 (1.91)     35.8888 (1.91)     0.0000 (1.0)      35.8888 (1.91)     0.0000 (1.0)           0;0  0.0279 (0.52)          1           1
test_partial_add-push[3.53.2]     19.7442 (1.05)     19.7442 (1.05)     19.7442 (1.05)     0.0000 (1.0)      19.7442 (1.05)     0.0000 (1.0)           0;0  0.0506 (0.95)          1           1
test_partial_add-push[3.60.1]     19.2651 (1.03)     19.2651 (1.03)     19.2651 (1.03)     0.0000 (1.0)      19.2651 (1.03)     0.0000 (1.0)           0;0  0.0519 (0.98)          1           1
test_partial_add-push[main]       18.7918 (1.0)      18.7918 (1.0)      18.7918 (1.0)      0.0000 (1.0)      18.7918 (1.0)      0.0000 (1.0)           0;0  0.0532 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.9938 (1.10)     10.9938 (1.10)     10.9938 (1.10)     0.0000 (1.0)      10.9938 (1.10)     0.0000 (1.0)           0;0  0.0910 (0.91)          1           1
test_partial_add-push-partial[3.10.0]     10.0216 (1.01)     10.0216 (1.01)     10.0216 (1.01)     0.0000 (1.0)      10.0216 (1.01)     0.0000 (1.0)           0;0  0.0998 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.4876 (1.05)     10.4876 (1.05)     10.4876 (1.05)     0.0000 (1.0)      10.4876 (1.05)     0.0000 (1.0)           0;0  0.0954 (0.95)          1           1
test_partial_add-push-partial[3.60.1]     10.2496 (1.03)     10.2496 (1.03)     10.2496 (1.03)     0.0000 (1.0)      10.2496 (1.03)     0.0000 (1.0)           0;0  0.0976 (0.97)          1           1
test_partial_add-push-partial[main]        9.9666 (1.0)       9.9666 (1.0)       9.9666 (1.0)      0.0000 (1.0)       9.9666 (1.0)      0.0000 (1.0)           0;0  0.1003 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     82.0755 (3.68)     82.0755 (3.68)     82.0755 (3.68)     0.0000 (1.0)      82.0755 (3.68)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_partial_remove-add[3.10.0]     81.5619 (3.65)     81.5619 (3.65)     81.5619 (3.65)     0.0000 (1.0)      81.5619 (3.65)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_partial_remove-add[3.53.2]     73.4079 (3.29)     73.4079 (3.29)     73.4079 (3.29)     0.0000 (1.0)      73.4079 (3.29)     0.0000 (1.0)           0;0  0.0136 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.3223 (1.0)      22.3223 (1.0)      22.3223 (1.0)      0.0000 (1.0)      22.3223 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
test_partial_remove-add[main]       23.4404 (1.05)     23.4404 (1.05)     23.4404 (1.05)     0.0000 (1.0)      23.4404 (1.05)     0.0000 (1.0)           0;0  0.0427 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.3298 (7.89)     8.3298 (7.89)     8.3298 (7.89)     0.0000 (1.0)      8.3298 (7.89)     0.0000 (1.0)           0;0  0.1201 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.3493 (7.90)     8.3493 (7.90)     8.3493 (7.90)     0.0000 (1.0)      8.3493 (7.90)     0.0000 (1.0)           0;0  0.1198 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.4761 (7.08)     7.4761 (7.08)     7.4761 (7.08)     0.0000 (1.0)      7.4761 (7.08)     0.0000 (1.0)           0;0  0.1338 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0563 (1.0)      1.0563 (1.0)      1.0563 (1.0)      0.0000 (1.0)      1.0563 (1.0)      0.0000 (1.0)           0;0  0.9467 (1.0)           1           1
test_partial_remove-add-update[main]       1.3505 (1.28)     1.3505 (1.28)     1.3505 (1.28)     0.0000 (1.0)      1.3505 (1.28)     0.0000 (1.0)           0;0  0.7404 (0.78)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3319 (1.0)      3.3319 (1.0)      3.3319 (1.0)      0.0000 (1.0)      3.3319 (1.0)      0.0000 (1.0)           0;0  0.3001 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7196 (1.12)     3.7196 (1.12)     3.7196 (1.12)     0.0000 (1.0)      3.7196 (1.12)     0.0000 (1.0)           0;0  0.2688 (0.90)          1           1
test_partial_remove-gc[3.53.2]     3.7063 (1.11)     3.7063 (1.11)     3.7063 (1.11)     0.0000 (1.0)      3.7063 (1.11)     0.0000 (1.0)           0;0  0.2698 (0.90)          1           1
test_partial_remove-gc[3.60.1]     3.9429 (1.18)     3.9429 (1.18)     3.9429 (1.18)     0.0000 (1.0)      3.9429 (1.18)     0.0000 (1.0)           0;0  0.2536 (0.85)          1           1
test_partial_remove-gc[main]       3.8616 (1.16)     3.8616 (1.16)     3.8616 (1.16)     0.0000 (1.0)      3.8616 (1.16)     0.0000 (1.0)           0;0  0.2590 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.0300 (1.04)     5.0300 (1.04)     5.0300 (1.04)     0.0000 (1.0)      5.0300 (1.04)     0.0000 (1.0)           0;0  0.1988 (0.97)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.3407 (1.10)     5.3407 (1.10)     5.3407 (1.10)     0.0000 (1.0)      5.3407 (1.10)     0.0000 (1.0)           0;0  0.1872 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0004 (1.03)     5.0004 (1.03)     5.0004 (1.03)     0.0000 (1.0)      5.0004 (1.03)     0.0000 (1.0)           0;0  0.2000 (0.97)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8567 (1.0)      4.8567 (1.0)      4.8567 (1.0)      0.0000 (1.0)      4.8567 (1.0)      0.0000 (1.0)           0;0  0.2059 (1.0)           1           1
test_partial_remove-gc-cloud[main]       4.9687 (1.02)     4.9687 (1.02)     4.9687 (1.02)     0.0000 (1.0)      4.9687 (1.02)     0.0000 (1.0)           0;0  0.2013 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     48.7365 (2.20)     48.7365 (2.20)     48.7365 (2.20)     0.0000 (1.0)      48.7365 (2.20)     0.0000 (1.0)           0;0  0.0205 (0.45)          1           1
test_partial_remove-push[3.10.0]     43.0924 (1.95)     43.0924 (1.95)     43.0924 (1.95)     0.0000 (1.0)      43.0924 (1.95)     0.0000 (1.0)           0;0  0.0232 (0.51)          1           1
test_partial_remove-push[3.53.2]     22.7329 (1.03)     22.7329 (1.03)     22.7329 (1.03)     0.0000 (1.0)      22.7329 (1.03)     0.0000 (1.0)           0;0  0.0440 (0.97)          1           1
test_partial_remove-push[3.60.1]     22.1073 (1.0)      22.1073 (1.0)      22.1073 (1.0)      0.0000 (1.0)      22.1073 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_partial_remove-push[main]       22.3503 (1.01)     22.3503 (1.01)     22.3503 (1.01)     0.0000 (1.0)      22.3503 (1.01)     0.0000 (1.0)           0;0  0.0447 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8453 (1.0)      1.8453 (1.0)      1.8453 (1.0)      0.0000 (1.0)      1.8453 (1.0)      0.0000 (1.0)           0;0  0.5419 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8744 (1.02)     1.8744 (1.02)     1.8744 (1.02)     0.0000 (1.0)      1.8744 (1.02)     0.0000 (1.0)           0;0  0.5335 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     2.4927 (1.35)     2.4927 (1.35)     2.4927 (1.35)     0.0000 (1.0)      2.4927 (1.35)     0.0000 (1.0)           0;0  0.4012 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.5854 (1.40)     2.5854 (1.40)     2.5854 (1.40)     0.0000 (1.0)      2.5854 (1.40)     0.0000 (1.0)           0;0  0.3868 (0.71)          1           1
test_partial_remove-push-update[main]       2.4757 (1.34)     2.4757 (1.34)     2.4757 (1.34)     0.0000 (1.0)      2.4757 (1.34)     0.0000 (1.0)           0;0  0.4039 (0.75)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     569.9128 (1.0)      576.8463 (1.0)      574.0617 (1.0)       2.7346 (1.0)      575.3496 (1.0)       3.6549 (1.0)           2;0  1.7420 (1.0)           5           3
test_plots-plots-diff[3.10.0]     973.7558 (1.71)     986.2530 (1.71)     979.8931 (1.71)      4.8009 (1.76)     981.1658 (1.71)      6.6967 (1.83)          2;0  1.0205 (0.59)          5           3
test_plots-plots-diff[3.53.2]     908.6239 (1.59)     937.9822 (1.63)     921.0510 (1.60)     10.7479 (3.93)     919.1390 (1.60)     11.3020 (3.09)          2;0  1.0857 (0.62)          5           3
test_plots-plots-diff[3.60.1]     912.7911 (1.60)     931.7174 (1.62)     920.7353 (1.60)      6.8761 (2.51)     919.6450 (1.60)      6.3473 (1.74)          2;0  1.0861 (0.62)          5           3
test_plots-plots-diff[main]       906.4783 (1.59)     918.8149 (1.59)     912.1084 (1.59)      4.5330 (1.66)     912.5871 (1.59)      5.2264 (1.43)          2;0  1.0964 (0.63)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       589.4142 (1.0)        610.7426 (1.0)        596.2321 (1.0)       8.5619 (1.51)       595.0301 (1.0)       9.2549 (1.25)          1;0  1.6772 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,202.0230 (2.04)     1,215.5951 (1.99)     1,208.9786 (2.03)      5.6552 (1.0)      1,207.5135 (2.03)      9.3923 (1.27)          2;0  0.8271 (0.49)          5           3
test_plots-plots-diff-json[3.53.2]       985.1136 (1.67)     1,006.5276 (1.65)       998.4307 (1.67)      7.9971 (1.41)     1,000.4201 (1.68)      7.4031 (1.0)           2;0  1.0016 (0.60)          5           3
test_plots-plots-diff-json[3.60.1]     1,003.4583 (1.70)     1,028.3972 (1.68)     1,010.7855 (1.70)     10.1833 (1.80)     1,006.6515 (1.69)     10.3336 (1.40)          1;0  0.9893 (0.59)          5           3
test_plots-plots-diff-json[main]         982.8688 (1.67)     1,000.6720 (1.64)       990.1720 (1.66)      7.6587 (1.35)       988.9466 (1.66)     13.1710 (1.78)          1;0  1.0099 (0.60)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     467.0435 (1.0)      479.8445 (1.0)      473.5327 (1.0)      6.2537 (1.65)     474.0168 (1.0)      12.3370 (2.92)          2;0  2.1118 (1.0)           5           3
test_plots-plots-show[3.10.0]     781.9390 (1.67)     798.9909 (1.67)     788.8433 (1.67)     6.4383 (1.70)     788.4116 (1.66)      7.7852 (1.84)          2;0  1.2677 (0.60)          5           3
test_plots-plots-show[3.53.2]     757.9223 (1.62)     766.6811 (1.60)     762.2028 (1.61)     3.7959 (1.0)      761.6707 (1.61)      6.8029 (1.61)          2;0  1.3120 (0.62)          5           3
test_plots-plots-show[3.60.1]     769.0670 (1.65)     785.0111 (1.64)     776.0335 (1.64)     5.7126 (1.50)     775.4351 (1.64)      4.2245 (1.0)           2;1  1.2886 (0.61)          5           3
test_plots-plots-show[main]       753.2579 (1.61)     761.8873 (1.59)     758.0184 (1.60)     3.8848 (1.02)     759.8496 (1.60)      6.7734 (1.60)          1;0  1.3192 (0.62)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     479.2148 (1.0)      501.3674 (1.0)      485.5236 (1.0)      8.9604 (1.59)     482.2983 (1.0)       5.6849 (1.35)          1;1  2.0596 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     920.7668 (1.92)     942.8107 (1.88)     931.7104 (1.92)     8.7064 (1.55)     928.7633 (1.93)     12.8327 (3.04)          2;0  1.0733 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     809.3146 (1.69)     824.2898 (1.64)     817.0114 (1.68)     5.6223 (1.0)      818.5045 (1.70)      7.3281 (1.73)          2;0  1.2240 (0.59)          5           3
test_plots-plots-show-json[3.60.1]     829.7041 (1.73)     846.5801 (1.69)     833.8908 (1.72)     7.1472 (1.27)     830.9770 (1.72)      5.5917 (1.32)          1;1  1.1992 (0.58)          5           3
test_plots-plots-show-json[main]       806.6600 (1.68)     820.7813 (1.64)     810.5515 (1.67)     5.7813 (1.03)     808.6759 (1.68)      4.2242 (1.0)           1;1  1.2337 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     48.8517 (2.21)     48.8517 (2.21)     48.8517 (2.21)     0.0000 (1.0)      48.8517 (2.21)     0.0000 (1.0)           0;0  0.0205 (0.45)          1           1
test_push-push[3.10.0]     43.1115 (1.95)     43.1115 (1.95)     43.1115 (1.95)     0.0000 (1.0)      43.1115 (1.95)     0.0000 (1.0)           0;0  0.0232 (0.51)          1           1
test_push-push[3.53.2]     23.0946 (1.05)     23.0946 (1.05)     23.0946 (1.05)     0.0000 (1.0)      23.0946 (1.05)     0.0000 (1.0)           0;0  0.0433 (0.96)          1           1
test_push-push[3.60.1]     22.0559 (1.0)      22.0559 (1.0)      22.0559 (1.0)      0.0000 (1.0)      22.0559 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
test_push-push[main]       22.0911 (1.00)     22.0911 (1.00)     22.0911 (1.00)     0.0000 (1.0)      22.0911 (1.00)     0.0000 (1.0)           0;0  0.0453 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     59.7206 (2.71)     59.7206 (2.71)     59.7206 (2.71)     0.0000 (1.0)      59.7206 (2.71)     0.0000 (1.0)           0;0  0.0167 (0.37)          1           1
test_sharing-fetch[3.10.0]     64.5494 (2.93)     64.5494 (2.93)     64.5494 (2.93)     0.0000 (1.0)      64.5494 (2.93)     0.0000 (1.0)           0;0  0.0155 (0.34)          1           1
test_sharing-fetch[3.53.2]     32.8701 (1.49)     32.8701 (1.49)     32.8701 (1.49)     0.0000 (1.0)      32.8701 (1.49)     0.0000 (1.0)           0;0  0.0304 (0.67)          1           1
test_sharing-fetch[3.60.1]     22.0375 (1.0)      22.0375 (1.0)      22.0375 (1.0)      0.0000 (1.0)      22.0375 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
test_sharing-fetch[main]       22.1973 (1.01)     22.1973 (1.01)     22.1973 (1.01)     0.0000 (1.0)      22.1973 (1.01)     0.0000 (1.0)           0;0  0.0451 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2319 (1.0)      1.2319 (1.0)      1.2319 (1.0)      0.0000 (1.0)      1.2319 (1.0)      0.0000 (1.0)           0;0  0.8118 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5323 (2.87)     3.5323 (2.87)     3.5323 (2.87)     0.0000 (1.0)      3.5323 (2.87)     0.0000 (1.0)           0;0  0.2831 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.7972 (4.71)     5.7972 (4.71)     5.7972 (4.71)     0.0000 (1.0)      5.7972 (4.71)     0.0000 (1.0)           0;0  0.1725 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.9006 (4.79)     5.9006 (4.79)     5.9006 (4.79)     0.0000 (1.0)      5.9006 (4.79)     0.0000 (1.0)           0;0  0.1695 (0.21)          1           1
test_sharing-fetch-noop[main]       6.0196 (4.89)     6.0196 (4.89)     6.0196 (4.89)     0.0000 (1.0)      6.0196 (4.89)     0.0000 (1.0)           0;0  0.1661 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     47.4245 (2.18)     47.4245 (2.18)     47.4245 (2.18)     0.0000 (1.0)      47.4245 (2.18)     0.0000 (1.0)           0;0  0.0211 (0.46)          1           1
test_sharing-push[3.10.0]     42.6440 (1.96)     42.6440 (1.96)     42.6440 (1.96)     0.0000 (1.0)      42.6440 (1.96)     0.0000 (1.0)           0;0  0.0234 (0.51)          1           1
test_sharing-push[3.53.2]     22.8094 (1.05)     22.8094 (1.05)     22.8094 (1.05)     0.0000 (1.0)      22.8094 (1.05)     0.0000 (1.0)           0;0  0.0438 (0.95)          1           1
test_sharing-push[3.60.1]     21.7195 (1.0)      21.7195 (1.0)      21.7195 (1.0)      0.0000 (1.0)      21.7195 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
test_sharing-push[main]       22.0796 (1.02)     22.0796 (1.02)     22.0796 (1.02)     0.0000 (1.0)      22.0796 (1.02)     0.0000 (1.0)           0;0  0.0453 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0327 (1.0)      2.0327 (1.0)      2.0327 (1.0)      0.0000 (1.0)      2.0327 (1.0)      0.0000 (1.0)           0;0  0.4920 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0425 (1.00)     2.0425 (1.00)     2.0425 (1.00)     0.0000 (1.0)      2.0425 (1.00)     0.0000 (1.0)           0;0  0.4896 (1.00)          1           1
test_sharing-push-noop[3.53.2]     5.8164 (2.86)     5.8164 (2.86)     5.8164 (2.86)     0.0000 (1.0)      5.8164 (2.86)     0.0000 (1.0)           0;0  0.1719 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.0418 (2.97)     6.0418 (2.97)     6.0418 (2.97)     0.0000 (1.0)      6.0418 (2.97)     0.0000 (1.0)           0;0  0.1655 (0.34)          1           1
test_sharing-push-noop[main]       6.0603 (2.98)     6.0603 (2.98)     6.0603 (2.98)     0.0000 (1.0)      6.0603 (2.98)     0.0000 (1.0)           0;0  0.1650 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     230.8309 (1.04)     230.8309 (1.04)     230.8309 (1.04)     0.0000 (1.0)      230.8309 (1.04)     0.0000 (1.0)           0;0  0.0043 (0.96)          1           1
test_sharing_azure-fetch[main]       222.2344 (1.0)      222.2344 (1.0)      222.2344 (1.0)      0.0000 (1.0)      222.2344 (1.0)      0.0000 (1.0)           0;0  0.0045 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3013 (1.0)      6.3013 (1.0)      6.3013 (1.0)      0.0000 (1.0)      6.3013 (1.0)      0.0000 (1.0)           0;0  0.1587 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4930 (1.03)     6.4930 (1.03)     6.4930 (1.03)     0.0000 (1.0)      6.4930 (1.03)     0.0000 (1.0)           0;0  0.1540 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     222.3830 (1.00)     222.3830 (1.00)     222.3830 (1.00)     0.0000 (1.0)      222.3830 (1.00)     0.0000 (1.0)           0;0  0.0045 (1.00)          1           1
test_sharing_azure-push[main]       221.7392 (1.0)      221.7392 (1.0)      221.7392 (1.0)      0.0000 (1.0)      221.7392 (1.0)      0.0000 (1.0)           0;0  0.0045 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.8676 (1.0)      6.8676 (1.0)      6.8676 (1.0)      0.0000 (1.0)      6.8676 (1.0)      0.0000 (1.0)           0;0  0.1456 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.0343 (1.02)     7.0343 (1.02)     7.0343 (1.02)     0.0000 (1.0)      7.0343 (1.02)     0.0000 (1.0)           0;0  0.1422 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     289.7584 (1.01)     289.7584 (1.01)     289.7584 (1.01)     0.0000 (1.0)      289.7584 (1.01)     0.0000 (1.0)           0;0  0.0035 (0.99)          1           1
test_sharing_gs-fetch[main]       287.7718 (1.0)      287.7718 (1.0)      287.7718 (1.0)      0.0000 (1.0)      287.7718 (1.0)      0.0000 (1.0)           0;0  0.0035 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     6.7025 (1.0)      6.7025 (1.0)      6.7025 (1.0)      0.0000 (1.0)      6.7025 (1.0)      0.0000 (1.0)           0;0  0.1492 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       6.8929 (1.03)     6.8929 (1.03)     6.8929 (1.03)     0.0000 (1.0)      6.8929 (1.03)     0.0000 (1.0)           0;0  0.1451 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     563.0303 (1.0)      563.0303 (1.0)      563.0303 (1.0)      0.0000 (1.0)      563.0303 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
test_sharing_gs-push[main]       569.7145 (1.01)     569.7145 (1.01)     569.7145 (1.01)     0.0000 (1.0)      569.7145 (1.01)     0.0000 (1.0)           0;0  0.0018 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.0374 (1.0)      7.0374 (1.0)      7.0374 (1.0)      0.0000 (1.0)      7.0374 (1.0)      0.0000 (1.0)           0;0  0.1421 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.1070 (1.01)     7.1070 (1.01)     7.1070 (1.01)     0.0000 (1.0)      7.1070 (1.01)     0.0000 (1.0)           0;0  0.1407 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     268.9240 (1.03)     268.9240 (1.03)     268.9240 (1.03)     0.0000 (1.0)      268.9240 (1.03)     0.0000 (1.0)           0;0  0.0037 (0.97)          1           1
test_sharing_s3-fetch[main]       260.9778 (1.0)      260.9778 (1.0)      260.9778 (1.0)      0.0000 (1.0)      260.9778 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.1727 (1.0)      6.1727 (1.0)      6.1727 (1.0)      0.0000 (1.0)      6.1727 (1.0)      0.0000 (1.0)           0;0  0.1620 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3943 (1.04)     6.3943 (1.04)     6.3943 (1.04)     0.0000 (1.0)      6.3943 (1.04)     0.0000 (1.0)           0;0  0.1564 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     291.5322 (1.0)      291.5322 (1.0)      291.5322 (1.0)      0.0000 (1.0)      291.5322 (1.0)      0.0000 (1.0)           0;0  0.0034 (1.0)           1           1
test_sharing_s3-push[main]       293.8490 (1.01)     293.8490 (1.01)     293.8490 (1.01)     0.0000 (1.0)      293.8490 (1.01)     0.0000 (1.0)           0;0  0.0034 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.3664 (1.0)      6.3664 (1.0)      6.3664 (1.0)      0.0000 (1.0)      6.3664 (1.0)      0.0000 (1.0)           0;0  0.1571 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.4339 (1.01)     6.4339 (1.01)     6.4339 (1.01)     0.0000 (1.0)      6.4339 (1.01)     0.0000 (1.0)           0;0  0.1554 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     14.0937 (3.62)     14.0937 (3.62)     14.0937 (3.62)     0.0000 (1.0)      14.0937 (3.62)     0.0000 (1.0)           0;0  0.0710 (0.28)          1           1
test_status-status[3.10.0]     14.2938 (3.67)     14.2938 (3.67)     14.2938 (3.67)     0.0000 (1.0)      14.2938 (3.67)     0.0000 (1.0)           0;0  0.0700 (0.27)          1           1
test_status-status[3.53.2]     13.4940 (3.47)     13.4940 (3.47)     13.4940 (3.47)     0.0000 (1.0)      13.4940 (3.47)     0.0000 (1.0)           0;0  0.0741 (0.29)          1           1
test_status-status[3.60.1]      3.8936 (1.0)       3.8936 (1.0)       3.8936 (1.0)      0.0000 (1.0)       3.8936 (1.0)      0.0000 (1.0)           0;0  0.2568 (1.0)           1           1
test_status-status[main]        4.3716 (1.12)      4.3716 (1.12)      4.3716 (1.12)     0.0000 (1.0)       4.3716 (1.12)     0.0000 (1.0)           0;0  0.2288 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     3.5545 (1.44)     3.5545 (1.44)     3.5545 (1.44)     0.0000 (1.0)      3.5545 (1.44)     0.0000 (1.0)           0;0  0.2813 (0.69)          1           1
test_status-status-changed[3.10.0]     3.8566 (1.56)     3.8566 (1.56)     3.8566 (1.56)     0.0000 (1.0)      3.8566 (1.56)     0.0000 (1.0)           0;0  0.2593 (0.64)          1           1
test_status-status-changed[3.53.2]     3.6977 (1.50)     3.6977 (1.50)     3.6977 (1.50)     0.0000 (1.0)      3.6977 (1.50)     0.0000 (1.0)           0;0  0.2704 (0.67)          1           1
test_status-status-changed[3.60.1]     2.4659 (1.0)      2.4659 (1.0)      2.4659 (1.0)      0.0000 (1.0)      2.4659 (1.0)      0.0000 (1.0)           0;0  0.4055 (1.0)           1           1
test_status-status-changed[main]       2.6520 (1.08)     2.6520 (1.08)     2.6520 (1.08)     0.0000 (1.0)      2.6520 (1.08)     0.0000 (1.0)           0;0  0.3771 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     3.5425 (1.51)     3.5425 (1.51)     3.5425 (1.51)     0.0000 (1.0)      3.5425 (1.51)     0.0000 (1.0)           0;0  0.2823 (0.66)          1           1
test_status-status-changed-noop[3.10.0]     3.7203 (1.58)     3.7203 (1.58)     3.7203 (1.58)     0.0000 (1.0)      3.7203 (1.58)     0.0000 (1.0)           0;0  0.2688 (0.63)          1           1
test_status-status-changed-noop[3.53.2]     3.6519 (1.56)     3.6519 (1.56)     3.6519 (1.56)     0.0000 (1.0)      3.6519 (1.56)     0.0000 (1.0)           0;0  0.2738 (0.64)          1           1
test_status-status-changed-noop[3.60.1]     2.3476 (1.0)      2.3476 (1.0)      2.3476 (1.0)      0.0000 (1.0)      2.3476 (1.0)      0.0000 (1.0)           0;0  0.4260 (1.0)           1           1
test_status-status-changed-noop[main]       2.5323 (1.08)     2.5323 (1.08)     2.5323 (1.08)     0.0000 (1.0)      2.5323 (1.08)     0.0000 (1.0)           0;0  0.3949 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     3.5872 (1.42)     3.5872 (1.42)     3.5872 (1.42)     0.0000 (1.0)      3.5872 (1.42)     0.0000 (1.0)           0;0  0.2788 (0.70)          1           1
test_status-status-noop[3.10.0]     3.7181 (1.48)     3.7181 (1.48)     3.7181 (1.48)     0.0000 (1.0)      3.7181 (1.48)     0.0000 (1.0)           0;0  0.2690 (0.68)          1           1
test_status-status-noop[3.53.2]     3.6391 (1.44)     3.6391 (1.44)     3.6391 (1.44)     0.0000 (1.0)      3.6391 (1.44)     0.0000 (1.0)           0;0  0.2748 (0.69)          1           1
test_status-status-noop[3.60.1]     2.5364 (1.01)     2.5364 (1.01)     2.5364 (1.01)     0.0000 (1.0)      2.5364 (1.01)     0.0000 (1.0)           0;0  0.3943 (0.99)          1           1
test_status-status-noop[main]       2.5190 (1.0)      2.5190 (1.0)      2.5190 (1.0)      0.0000 (1.0)      2.5190 (1.0)      0.0000 (1.0)           0;0  0.3970 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     148.4594 (3.30)     148.4594 (3.30)     148.4594 (3.30)     0.0000 (1.0)      148.4594 (3.30)     0.0000 (1.0)           0;0  0.0067 (0.30)          1           1
test_update-import-url[3.10.0]     152.5142 (3.39)     152.5142 (3.39)     152.5142 (3.39)     0.0000 (1.0)      152.5142 (3.39)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_update-import-url[3.53.2]     115.2447 (2.56)     115.2447 (2.56)     115.2447 (2.56)     0.0000 (1.0)      115.2447 (2.56)     0.0000 (1.0)           0;0  0.0087 (0.39)          1           1
test_update-import-url[3.60.1]      45.0208 (1.0)       45.0208 (1.0)       45.0208 (1.0)      0.0000 (1.0)       45.0208 (1.0)      0.0000 (1.0)           0;0  0.0222 (1.0)           1           1
test_update-import-url[main]        46.5776 (1.03)      46.5776 (1.03)      46.5776 (1.03)     0.0000 (1.0)       46.5776 (1.03)     0.0000 (1.0)           0;0  0.0215 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     133.3814 (3.83)     133.3814 (3.83)     133.3814 (3.83)     0.0000 (1.0)      133.3814 (3.83)     0.0000 (1.0)           0;0  0.0075 (0.26)          1           1
test_update-update[3.10.0]     137.2420 (3.94)     137.2420 (3.94)     137.2420 (3.94)     0.0000 (1.0)      137.2420 (3.94)     0.0000 (1.0)           0;0  0.0073 (0.25)          1           1
test_update-update[3.53.2]     106.5357 (3.06)     106.5357 (3.06)     106.5357 (3.06)     0.0000 (1.0)      106.5357 (3.06)     0.0000 (1.0)           0;0  0.0094 (0.33)          1           1
test_update-update[3.60.1]      34.8470 (1.0)       34.8470 (1.0)       34.8470 (1.0)      0.0000 (1.0)       34.8470 (1.0)      0.0000 (1.0)           0;0  0.0287 (1.0)           1           1
test_update-update[main]        35.6650 (1.02)      35.6650 (1.02)      35.6650 (1.02)     0.0000 (1.0)       35.6650 (1.02)     0.0000 (1.0)           0;0  0.0280 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.4768 (2.14)     16.4768 (2.14)     16.4768 (2.14)     0.0000 (1.0)      16.4768 (2.14)     0.0000 (1.0)           0;0  0.0607 (0.47)          1           1
test_update-update-noop[3.10.0]     17.2912 (2.25)     17.2912 (2.25)     17.2912 (2.25)     0.0000 (1.0)      17.2912 (2.25)     0.0000 (1.0)           0;0  0.0578 (0.45)          1           1
test_update-update-noop[3.53.2]     16.4883 (2.14)     16.4883 (2.14)     16.4883 (2.14)     0.0000 (1.0)      16.4883 (2.14)     0.0000 (1.0)           0;0  0.0606 (0.47)          1           1
test_update-update-noop[3.60.1]      7.7008 (1.0)       7.7008 (1.0)       7.7008 (1.0)      0.0000 (1.0)       7.7008 (1.0)      0.0000 (1.0)           0;0  0.1299 (1.0)           1           1
test_update-update-noop[main]        8.2061 (1.07)      8.2061 (1.07)      8.2061 (1.07)     0.0000 (1.0)       8.2061 (1.07)     0.0000 (1.0)           0;0  0.1219 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean