Thu Jul 31 00:41:27 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.0022 (3.75)     85.0022 (3.75)     85.0022 (3.75)     0.0000 (1.0)      85.0022 (3.75)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.10.0]     86.5663 (3.82)     86.5663 (3.82)     86.5663 (3.82)     0.0000 (1.0)      86.5663 (3.82)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.53.2]     76.2668 (3.36)     76.2668 (3.36)     76.2668 (3.36)     0.0000 (1.0)      76.2668 (3.36)     0.0000 (1.0)           0;0  0.0131 (0.30)          1           1
test_add_copy-add[3.60.1]     22.6817 (1.0)      22.6817 (1.0)      22.6817 (1.0)      0.0000 (1.0)      22.6817 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
test_add_copy-add[main]       23.3805 (1.03)     23.3805 (1.03)     23.3805 (1.03)     0.0000 (1.0)      23.3805 (1.03)     0.0000 (1.0)           0;0  0.0428 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.4683 (6.66)     29.4683 (6.66)     29.4683 (6.66)     0.0000 (1.0)      29.4683 (6.66)     0.0000 (1.0)           0;0  0.0339 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.9054 (6.76)     29.9054 (6.76)     29.9054 (6.76)     0.0000 (1.0)      29.9054 (6.76)     0.0000 (1.0)           0;0  0.0334 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.1510 (6.36)     28.1510 (6.36)     28.1510 (6.36)     0.0000 (1.0)      28.1510 (6.36)     0.0000 (1.0)           0;0  0.0355 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4266 (1.0)       4.4266 (1.0)       4.4266 (1.0)      0.0000 (1.0)       4.4266 (1.0)      0.0000 (1.0)           0;0  0.2259 (1.0)           1           1
test_add_copy-add-noop[main]        4.5342 (1.02)      4.5342 (1.02)      4.5342 (1.02)     0.0000 (1.0)       4.5342 (1.02)     0.0000 (1.0)           0;0  0.2205 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.7936 (4.13)     66.7936 (4.13)     66.7936 (4.13)     0.0000 (1.0)      66.7936 (4.13)     0.0000 (1.0)           0;0  0.0150 (0.24)          1           1
test_add_hardlink-add[3.10.0]     67.8061 (4.20)     67.8061 (4.20)     67.8061 (4.20)     0.0000 (1.0)      67.8061 (4.20)     0.0000 (1.0)           0;0  0.0147 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.0751 (3.84)     62.0751 (3.84)     62.0751 (3.84)     0.0000 (1.0)      62.0751 (3.84)     0.0000 (1.0)           0;0  0.0161 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.1588 (1.0)      16.1588 (1.0)      16.1588 (1.0)      0.0000 (1.0)      16.1588 (1.0)      0.0000 (1.0)           0;0  0.0619 (1.0)           1           1
test_add_hardlink-add[main]       16.8066 (1.04)     16.8066 (1.04)     16.8066 (1.04)     0.0000 (1.0)      16.8066 (1.04)     0.0000 (1.0)           0;0  0.0595 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.3630 (7.78)     34.3630 (7.78)     34.3630 (7.78)     0.0000 (1.0)      34.3630 (7.78)     0.0000 (1.0)           0;0  0.0291 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     34.9399 (7.91)     34.9399 (7.91)     34.9399 (7.91)     0.0000 (1.0)      34.9399 (7.91)     0.0000 (1.0)           0;0  0.0286 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     32.7562 (7.42)     32.7562 (7.42)     32.7562 (7.42)     0.0000 (1.0)      32.7562 (7.42)     0.0000 (1.0)           0;0  0.0305 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.4360 (1.00)      4.4360 (1.00)      4.4360 (1.00)     0.0000 (1.0)       4.4360 (1.00)     0.0000 (1.0)           0;0  0.2254 (1.00)          1           1
test_add_hardlink-add-noop[main]        4.4176 (1.0)       4.4176 (1.0)       4.4176 (1.0)      0.0000 (1.0)       4.4176 (1.0)      0.0000 (1.0)           0;0  0.2264 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.3720 (1.98)     69.3720 (1.98)     69.3720 (1.98)     0.0000 (1.0)      69.3720 (1.98)     0.0000 (1.0)           0;0  0.0144 (0.50)          1           1
test_add_symlink-add[3.10.0]     69.0584 (1.97)     69.0584 (1.97)     69.0584 (1.97)     0.0000 (1.0)      69.0584 (1.97)     0.0000 (1.0)           0;0  0.0145 (0.51)          1           1
test_add_symlink-add[3.53.2]     62.8363 (1.80)     62.8363 (1.80)     62.8363 (1.80)     0.0000 (1.0)      62.8363 (1.80)     0.0000 (1.0)           0;0  0.0159 (0.56)          1           1
test_add_symlink-add[3.60.1]     35.0033 (1.0)      35.0033 (1.0)      35.0033 (1.0)      0.0000 (1.0)      35.0033 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_add_symlink-add[main]       35.3768 (1.01)     35.3768 (1.01)     35.3768 (1.01)     0.0000 (1.0)      35.3768 (1.01)     0.0000 (1.0)           0;0  0.0283 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.5175 (8.37)     48.5175 (8.37)     48.5175 (8.37)     0.0000 (1.0)      48.5175 (8.37)     0.0000 (1.0)           0;0  0.0206 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.4240 (8.18)     47.4240 (8.18)     47.4240 (8.18)     0.0000 (1.0)      47.4240 (8.18)     0.0000 (1.0)           0;0  0.0211 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     45.7815 (7.90)     45.7815 (7.90)     45.7815 (7.90)     0.0000 (1.0)      45.7815 (7.90)     0.0000 (1.0)           0;0  0.0218 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.7985 (1.0)       5.7985 (1.0)       5.7985 (1.0)      0.0000 (1.0)       5.7985 (1.0)      0.0000 (1.0)           0;0  0.1725 (1.0)           1           1
test_add_symlink-add-noop[main]        5.9838 (1.03)      5.9838 (1.03)      5.9838 (1.03)     0.0000 (1.0)       5.9838 (1.03)     0.0000 (1.0)           0;0  0.1671 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.7485 (1.94)     41.7485 (1.94)     41.7485 (1.94)     0.0000 (1.0)      41.7485 (1.94)     0.0000 (1.0)           0;0  0.0240 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     61.0683 (2.83)     61.0683 (2.83)     61.0683 (2.83)     0.0000 (1.0)      61.0683 (2.83)     0.0000 (1.0)           0;0  0.0164 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     28.6126 (1.33)     28.6126 (1.33)     28.6126 (1.33)     0.0000 (1.0)      28.6126 (1.33)     0.0000 (1.0)           0;0  0.0349 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     21.5546 (1.0)      21.5546 (1.0)      21.5546 (1.0)      0.0000 (1.0)      21.5546 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_checkout_copy-checkout[main]       21.9657 (1.02)     21.9657 (1.02)     21.9657 (1.02)     0.0000 (1.0)      21.9657 (1.02)     0.0000 (1.0)           0;0  0.0455 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6801 (1.62)     5.6801 (1.62)     5.6801 (1.62)     0.0000 (1.0)      5.6801 (1.62)     0.0000 (1.0)           0;0  0.1761 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7554 (1.64)     5.7554 (1.64)     5.7554 (1.64)     0.0000 (1.0)      5.7554 (1.64)     0.0000 (1.0)           0;0  0.1738 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5929 (1.59)     5.5929 (1.59)     5.5929 (1.59)     0.0000 (1.0)      5.5929 (1.59)     0.0000 (1.0)           0;0  0.1788 (0.63)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.5264 (1.00)     3.5264 (1.00)     3.5264 (1.00)     0.0000 (1.0)      3.5264 (1.00)     0.0000 (1.0)           0;0  0.2836 (1.00)          1           1
test_checkout_copy-checkout-noop[main]       3.5135 (1.0)      3.5135 (1.0)      3.5135 (1.0)      0.0000 (1.0)      3.5135 (1.0)      0.0000 (1.0)           0;0  0.2846 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.9522 (2.19)     8.9522 (2.19)     8.9522 (2.19)     0.0000 (1.0)      8.9522 (2.19)     0.0000 (1.0)           0;0  0.1117 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4516 (1.57)     6.4516 (1.57)     6.4516 (1.57)     0.0000 (1.0)      6.4516 (1.57)     0.0000 (1.0)           0;0  0.1550 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2654 (1.53)     6.2654 (1.53)     6.2654 (1.53)     0.0000 (1.0)      6.2654 (1.53)     0.0000 (1.0)           0;0  0.1596 (0.65)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.2191 (1.03)     4.2191 (1.03)     4.2191 (1.03)     0.0000 (1.0)      4.2191 (1.03)     0.0000 (1.0)           0;0  0.2370 (0.97)          1           1
test_checkout_copy-checkout-update[main]       4.0968 (1.0)      4.0968 (1.0)      4.0968 (1.0)      0.0000 (1.0)      4.0968 (1.0)      0.0000 (1.0)           0;0  0.2441 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.4312 (2.99)     21.4312 (2.99)     21.4312 (2.99)     0.0000 (1.0)      21.4312 (2.99)     0.0000 (1.0)           0;0  0.0467 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7563 (2.20)     15.7563 (2.20)     15.7563 (2.20)     0.0000 (1.0)      15.7563 (2.20)     0.0000 (1.0)           0;0  0.0635 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.3312 (2.00)     14.3312 (2.00)     14.3312 (2.00)     0.0000 (1.0)      14.3312 (2.00)     0.0000 (1.0)           0;0  0.0698 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.1669 (1.0)       7.1669 (1.0)       7.1669 (1.0)      0.0000 (1.0)       7.1669 (1.0)      0.0000 (1.0)           0;0  0.1395 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.7521 (1.08)      7.7521 (1.08)      7.7521 (1.08)     0.0000 (1.0)       7.7521 (1.08)     0.0000 (1.0)           0;0  0.1290 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3559 (1.65)     5.3559 (1.65)     5.3559 (1.65)     0.0000 (1.0)      5.3559 (1.65)     0.0000 (1.0)           0;0  0.1867 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5520 (1.71)     5.5520 (1.71)     5.5520 (1.71)     0.0000 (1.0)      5.5520 (1.71)     0.0000 (1.0)           0;0  0.1801 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3782 (1.66)     5.3782 (1.66)     5.3782 (1.66)     0.0000 (1.0)      5.3782 (1.66)     0.0000 (1.0)           0;0  0.1859 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2583 (1.00)     3.2583 (1.00)     3.2583 (1.00)     0.0000 (1.0)      3.2583 (1.00)     0.0000 (1.0)           0;0  0.3069 (1.00)          1           1
test_checkout_hardlink-checkout-noop[main]       3.2475 (1.0)      3.2475 (1.0)      3.2475 (1.0)      0.0000 (1.0)      3.2475 (1.0)      0.0000 (1.0)           0;0  0.3079 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.4999 (2.23)     8.4999 (2.23)     8.4999 (2.23)     0.0000 (1.0)      8.4999 (2.23)     0.0000 (1.0)           0;0  0.1176 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4512 (1.69)     6.4512 (1.69)     6.4512 (1.69)     0.0000 (1.0)      6.4512 (1.69)     0.0000 (1.0)           0;0  0.1550 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1875 (1.62)     6.1875 (1.62)     6.1875 (1.62)     0.0000 (1.0)      6.1875 (1.62)     0.0000 (1.0)           0;0  0.1616 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8771 (1.02)     3.8771 (1.02)     3.8771 (1.02)     0.0000 (1.0)      3.8771 (1.02)     0.0000 (1.0)           0;0  0.2579 (0.98)          1           1
test_checkout_hardlink-checkout-update[main]       3.8123 (1.0)      3.8123 (1.0)      3.8123 (1.0)      0.0000 (1.0)      3.8123 (1.0)      0.0000 (1.0)           0;0  0.2623 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9835 (2.52)     24.9835 (2.52)     24.9835 (2.52)     0.0000 (1.0)      24.9835 (2.52)     0.0000 (1.0)           0;0  0.0400 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     19.2093 (1.94)     19.2093 (1.94)     19.2093 (1.94)     0.0000 (1.0)      19.2093 (1.94)     0.0000 (1.0)           0;0  0.0521 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.2364 (1.74)     17.2364 (1.74)     17.2364 (1.74)     0.0000 (1.0)      17.2364 (1.74)     0.0000 (1.0)           0;0  0.0580 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]      9.9163 (1.0)       9.9163 (1.0)       9.9163 (1.0)      0.0000 (1.0)       9.9163 (1.0)      0.0000 (1.0)           0;0  0.1008 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.3722 (1.05)     10.3722 (1.05)     10.3722 (1.05)     0.0000 (1.0)      10.3722 (1.05)     0.0000 (1.0)           0;0  0.0964 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6556 (1.58)     6.6556 (1.58)     6.6556 (1.58)     0.0000 (1.0)      6.6556 (1.58)     0.0000 (1.0)           0;0  0.1502 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7440 (1.60)     6.7440 (1.60)     6.7440 (1.60)     0.0000 (1.0)      6.7440 (1.60)     0.0000 (1.0)           0;0  0.1483 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.4750 (1.54)     6.4750 (1.54)     6.4750 (1.54)     0.0000 (1.0)      6.4750 (1.54)     0.0000 (1.0)           0;0  0.1544 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2437 (1.01)     4.2437 (1.01)     4.2437 (1.01)     0.0000 (1.0)      4.2437 (1.01)     0.0000 (1.0)           0;0  0.2356 (0.99)          1           1
test_checkout_symlink-checkout-noop[main]       4.2136 (1.0)      4.2136 (1.0)      4.2136 (1.0)      0.0000 (1.0)      4.2136 (1.0)      0.0000 (1.0)           0;0  0.2373 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6879 (1.85)     10.6879 (1.85)     10.6879 (1.85)     0.0000 (1.0)      10.6879 (1.85)     0.0000 (1.0)           0;0  0.0936 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4147 (1.46)      8.4147 (1.46)      8.4147 (1.46)     0.0000 (1.0)       8.4147 (1.46)     0.0000 (1.0)           0;0  0.1188 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3258 (1.44)      8.3258 (1.44)      8.3258 (1.44)     0.0000 (1.0)       8.3258 (1.44)     0.0000 (1.0)           0;0  0.1201 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.7735 (1.0)       5.7735 (1.0)       5.7735 (1.0)      0.0000 (1.0)       5.7735 (1.0)      0.0000 (1.0)           0;0  0.1732 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.8148 (1.01)      5.8148 (1.01)      5.8148 (1.01)     0.0000 (1.0)       5.8148 (1.01)     0.0000 (1.0)           0;0  0.1720 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9893 (1.74)     3.9893 (1.74)     3.9893 (1.74)     0.0000 (1.0)      3.9893 (1.74)     0.0000 (1.0)           0;0  0.2507 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.7568 (2.07)     4.7568 (2.07)     4.7568 (2.07)     0.0000 (1.0)      4.7568 (2.07)     0.0000 (1.0)           0;0  0.2102 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.4699 (1.95)     4.4699 (1.95)     4.4699 (1.95)     0.0000 (1.0)      4.4699 (1.95)     0.0000 (1.0)           0;0  0.2237 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3326 (1.02)     2.3326 (1.02)     2.3326 (1.02)     0.0000 (1.0)      2.3326 (1.02)     0.0000 (1.0)           0;0  0.4287 (0.98)          1           1
test_data_status-data-changed[main]       2.2938 (1.0)      2.2938 (1.0)      2.2938 (1.0)      0.0000 (1.0)      2.2938 (1.0)      0.0000 (1.0)           0;0  0.4360 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9910 (1.72)     3.9910 (1.72)     3.9910 (1.72)     0.0000 (1.0)      3.9910 (1.72)     0.0000 (1.0)           0;0  0.2506 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.6422 (2.00)     4.6422 (2.00)     4.6422 (2.00)     0.0000 (1.0)      4.6422 (2.00)     0.0000 (1.0)           0;0  0.2154 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5901 (1.97)     4.5901 (1.97)     4.5901 (1.97)     0.0000 (1.0)      4.5901 (1.97)     0.0000 (1.0)           0;0  0.2179 (0.51)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3346 (1.00)     2.3346 (1.00)     2.3346 (1.00)     0.0000 (1.0)      2.3346 (1.00)     0.0000 (1.0)           0;0  0.4283 (1.00)          1           1
test_data_status-data-changed-noop[main]       2.3253 (1.0)      2.3253 (1.0)      2.3253 (1.0)      0.0000 (1.0)      2.3253 (1.0)      0.0000 (1.0)           0;0  0.4301 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.0332 (3.70)     18.0332 (3.70)     18.0332 (3.70)     0.0000 (1.0)      18.0332 (3.70)     0.0000 (1.0)           0;0  0.0555 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.1483 (3.93)     19.1483 (3.93)     19.1483 (3.93)     0.0000 (1.0)      19.1483 (3.93)     0.0000 (1.0)           0;0  0.0522 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.9101 (3.88)     18.9101 (3.88)     18.9101 (3.88)     0.0000 (1.0)      18.9101 (3.88)     0.0000 (1.0)           0;0  0.0529 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8684 (1.0)       4.8684 (1.0)       4.8684 (1.0)      0.0000 (1.0)       4.8684 (1.0)      0.0000 (1.0)           0;0  0.2054 (1.0)           1           1
test_data_status-data-new[main]        4.9747 (1.02)      4.9747 (1.02)      4.9747 (1.02)     0.0000 (1.0)       4.9747 (1.02)     0.0000 (1.0)           0;0  0.2010 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9737 (1.71)     3.9737 (1.71)     3.9737 (1.71)     0.0000 (1.0)      3.9737 (1.71)     0.0000 (1.0)           0;0  0.2517 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.6223 (1.99)     4.6223 (1.99)     4.6223 (1.99)     0.0000 (1.0)      4.6223 (1.99)     0.0000 (1.0)           0;0  0.2163 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.5363 (1.96)     4.5363 (1.96)     4.5363 (1.96)     0.0000 (1.0)      4.5363 (1.96)     0.0000 (1.0)           0;0  0.2204 (0.51)          1           1
test_data_status-data-noop[3.60.1]     2.3282 (1.00)     2.3282 (1.00)     2.3282 (1.00)     0.0000 (1.0)      2.3282 (1.00)     0.0000 (1.0)           0;0  0.4295 (1.00)          1           1
test_data_status-data-noop[main]       2.3182 (1.0)      2.3182 (1.0)      2.3182 (1.0)      0.0000 (1.0)      2.3182 (1.0)      0.0000 (1.0)           0;0  0.4314 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1498 (1.31)     7.1498 (1.31)     7.1498 (1.31)     0.0000 (1.0)      7.1498 (1.31)     0.0000 (1.0)           0;0  0.1399 (0.76)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8104 (1.43)     7.8104 (1.43)     7.8104 (1.43)     0.0000 (1.0)      7.8104 (1.43)     0.0000 (1.0)           0;0  0.1280 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5960 (1.39)     7.5960 (1.39)     7.5960 (1.39)     0.0000 (1.0)      7.5960 (1.39)     0.0000 (1.0)           0;0  0.1316 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5371 (1.01)     5.5371 (1.01)     5.5371 (1.01)     0.0000 (1.0)      5.5371 (1.01)     0.0000 (1.0)           0;0  0.1806 (0.99)          1           1
test_data_status_all_flags-data-changed[main]       5.4632 (1.0)      5.4632 (1.0)      5.4632 (1.0)      0.0000 (1.0)      5.4632 (1.0)      0.0000 (1.0)           0;0  0.1830 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1099 (1.29)     7.1099 (1.29)     7.1099 (1.29)     0.0000 (1.0)      7.1099 (1.29)     0.0000 (1.0)           0;0  0.1406 (0.77)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.7794 (1.42)     7.7794 (1.42)     7.7794 (1.42)     0.0000 (1.0)      7.7794 (1.42)     0.0000 (1.0)           0;0  0.1285 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6534 (1.39)     7.6534 (1.39)     7.6534 (1.39)     0.0000 (1.0)      7.6534 (1.39)     0.0000 (1.0)           0;0  0.1307 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6306 (1.03)     5.6306 (1.03)     5.6306 (1.03)     0.0000 (1.0)      5.6306 (1.03)     0.0000 (1.0)           0;0  0.1776 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.4912 (1.0)      5.4912 (1.0)      5.4912 (1.0)      0.0000 (1.0)      5.4912 (1.0)      0.0000 (1.0)           0;0  0.1821 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.3252 (2.69)     21.3252 (2.69)     21.3252 (2.69)     0.0000 (1.0)      21.3252 (2.69)     0.0000 (1.0)           0;0  0.0469 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.2345 (2.81)     22.2345 (2.81)     22.2345 (2.81)     0.0000 (1.0)      22.2345 (2.81)     0.0000 (1.0)           0;0  0.0450 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.3258 (2.82)     22.3258 (2.82)     22.3258 (2.82)     0.0000 (1.0)      22.3258 (2.82)     0.0000 (1.0)           0;0  0.0448 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9172 (1.0)       7.9172 (1.0)       7.9172 (1.0)      0.0000 (1.0)       7.9172 (1.0)      0.0000 (1.0)           0;0  0.1263 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1333 (1.03)      8.1333 (1.03)      8.1333 (1.03)     0.0000 (1.0)       8.1333 (1.03)     0.0000 (1.0)           0;0  0.1230 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.3854 (1.35)     6.3854 (1.35)     6.3854 (1.35)     0.0000 (1.0)      6.3854 (1.35)     0.0000 (1.0)           0;0  0.1566 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0494 (1.49)     7.0494 (1.49)     7.0494 (1.49)     0.0000 (1.0)      7.0494 (1.49)     0.0000 (1.0)           0;0  0.1419 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9669 (1.48)     6.9669 (1.48)     6.9669 (1.48)     0.0000 (1.0)      6.9669 (1.48)     0.0000 (1.0)           0;0  0.1435 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8258 (1.02)     4.8258 (1.02)     4.8258 (1.02)     0.0000 (1.0)      4.8258 (1.02)     0.0000 (1.0)           0;0  0.2072 (0.98)          1           1
test_data_status_all_flags-data-noop[main]       4.7205 (1.0)      4.7205 (1.0)      4.7205 (1.0)      0.0000 (1.0)      4.7205 (1.0)      0.0000 (1.0)           0;0  0.2118 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0391 (2.70)     18.0391 (2.70)     18.0391 (2.70)     0.0000 (1.0)      18.0391 (2.70)     0.0000 (1.0)           0;0  0.0554 (0.37)          1           1
test_diff-diff[3.10.0]     19.2209 (2.87)     19.2209 (2.87)     19.2209 (2.87)     0.0000 (1.0)      19.2209 (2.87)     0.0000 (1.0)           0;0  0.0520 (0.35)          1           1
test_diff-diff[3.53.2]     19.0418 (2.85)     19.0418 (2.85)     19.0418 (2.85)     0.0000 (1.0)      19.0418 (2.85)     0.0000 (1.0)           0;0  0.0525 (0.35)          1           1
test_diff-diff[3.60.1]      6.6865 (1.0)       6.6865 (1.0)       6.6865 (1.0)      0.0000 (1.0)       6.6865 (1.0)      0.0000 (1.0)           0;0  0.1496 (1.0)           1           1
test_diff-diff[main]        6.9740 (1.04)      6.9740 (1.04)      6.9740 (1.04)     0.0000 (1.0)       6.9740 (1.04)     0.0000 (1.0)           0;0  0.1434 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0959 (1.76)     6.0959 (1.76)     6.0959 (1.76)     0.0000 (1.0)      6.0959 (1.76)     0.0000 (1.0)           0;0  0.1640 (0.57)          1           1
test_diff-diff-changed[3.10.0]     6.6318 (1.91)     6.6318 (1.91)     6.6318 (1.91)     0.0000 (1.0)      6.6318 (1.91)     0.0000 (1.0)           0;0  0.1508 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.6473 (1.63)     5.6473 (1.63)     5.6473 (1.63)     0.0000 (1.0)      5.6473 (1.63)     0.0000 (1.0)           0;0  0.1771 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4685 (1.0)      3.4685 (1.0)      3.4685 (1.0)      0.0000 (1.0)      3.4685 (1.0)      0.0000 (1.0)           0;0  0.2883 (1.0)           1           1
test_diff-diff-changed[main]       3.5824 (1.03)     3.5824 (1.03)     3.5824 (1.03)     0.0000 (1.0)      3.5824 (1.03)     0.0000 (1.0)           0;0  0.2791 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2212 (1.52)     5.2212 (1.52)     5.2212 (1.52)     0.0000 (1.0)      5.2212 (1.52)     0.0000 (1.0)           0;0  0.1915 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7460 (1.67)     5.7460 (1.67)     5.7460 (1.67)     0.0000 (1.0)      5.7460 (1.67)     0.0000 (1.0)           0;0  0.1740 (0.60)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5718 (1.62)     5.5718 (1.62)     5.5718 (1.62)     0.0000 (1.0)      5.5718 (1.62)     0.0000 (1.0)           0;0  0.1795 (0.62)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4425 (1.00)     3.4425 (1.00)     3.4425 (1.00)     0.0000 (1.0)      3.4425 (1.00)     0.0000 (1.0)           0;0  0.2905 (1.00)          1           1
test_diff-diff-changed-noop[main]       3.4341 (1.0)      3.4341 (1.0)      3.4341 (1.0)      0.0000 (1.0)      3.4341 (1.0)      0.0000 (1.0)           0;0  0.2912 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1641 (1.23)     4.1641 (1.23)     4.1641 (1.23)     0.0000 (1.0)      4.1641 (1.23)     0.0000 (1.0)           0;0  0.2401 (0.81)          1           1
test_diff-diff-noop[3.10.0]     4.8088 (1.42)     4.8088 (1.42)     4.8088 (1.42)     0.0000 (1.0)      4.8088 (1.42)     0.0000 (1.0)           0;0  0.2080 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.5544 (1.65)     5.5544 (1.65)     5.5544 (1.65)     0.0000 (1.0)      5.5544 (1.65)     0.0000 (1.0)           0;0  0.1800 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.3749 (1.0)      3.3749 (1.0)      3.3749 (1.0)      0.0000 (1.0)      3.3749 (1.0)      0.0000 (1.0)           0;0  0.2963 (1.0)           1           1
test_diff-diff-noop[main]       3.5397 (1.05)     3.5397 (1.05)     3.5397 (1.05)     0.0000 (1.0)      3.5397 (1.05)     0.0000 (1.0)           0;0  0.2825 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        985.1514 (1.0)         985.1514 (1.0)         985.1514 (1.0)      0.0000 (1.0)         985.1514 (1.0)      0.0000 (1.0)           0;0  1.0151 (1.0)           1           1
test_exp_show-exp[3.10.0]     10,061.8052 (10.21)    10,061.8052 (10.21)    10,061.8052 (10.21)    0.0000 (1.0)      10,061.8052 (10.21)    0.0000 (1.0)           0;0  0.0994 (0.10)          1           1
test_exp_show-exp[3.53.2]      5,451.5628 (5.53)      5,451.5628 (5.53)      5,451.5628 (5.53)     0.0000 (1.0)       5,451.5628 (5.53)     0.0000 (1.0)           0;0  0.1834 (0.18)          1           1
test_exp_show-exp[3.60.1]      5,486.6568 (5.57)      5,486.6568 (5.57)      5,486.6568 (5.57)     0.0000 (1.0)       5,486.6568 (5.57)     0.0000 (1.0)           0;0  0.1823 (0.18)          1           1
test_exp_show-exp[main]        9,314.7670 (9.46)      9,314.7670 (9.46)      9,314.7670 (9.46)     0.0000 (1.0)       9,314.7670 (9.46)     0.0000 (1.0)           0;0  0.1074 (0.11)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     64.9467 (2.79)     64.9467 (2.79)     64.9467 (2.79)     0.0000 (1.0)      64.9467 (2.79)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.4906 (3.02)     70.4906 (3.02)     70.4906 (3.02)     0.0000 (1.0)      70.4906 (3.02)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.8298 (1.45)     33.8298 (1.45)     33.8298 (1.45)     0.0000 (1.0)      33.8298 (1.45)     0.0000 (1.0)           0;0  0.0296 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.5273 (1.01)     23.5273 (1.01)     23.5273 (1.01)     0.0000 (1.0)      23.5273 (1.01)     0.0000 (1.0)           0;0  0.0425 (0.99)          1           1
test_fetch-fetch[main]       23.3047 (1.0)      23.3047 (1.0)      23.3047 (1.0)      0.0000 (1.0)      23.3047 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7908 (1.0)      2.7908 (1.0)      2.7908 (1.0)      0.0000 (1.0)      2.7908 (1.0)      0.0000 (1.0)           0;0  0.3583 (1.0)           1           1
test_gc-gc[3.10.0]     2.9324 (1.05)     2.9324 (1.05)     2.9324 (1.05)     0.0000 (1.0)      2.9324 (1.05)     0.0000 (1.0)           0;0  0.3410 (0.95)          1           1
test_gc-gc[3.53.2]     2.8368 (1.02)     2.8368 (1.02)     2.8368 (1.02)     0.0000 (1.0)      2.8368 (1.02)     0.0000 (1.0)           0;0  0.3525 (0.98)          1           1
test_gc-gc[3.60.1]     2.8008 (1.00)     2.8008 (1.00)     2.8008 (1.00)     0.0000 (1.0)      2.8008 (1.00)     0.0000 (1.0)           0;0  0.3570 (1.00)          1           1
test_gc-gc[main]       2.8114 (1.01)     2.8114 (1.01)     2.8114 (1.01)     0.0000 (1.0)      2.8114 (1.01)     0.0000 (1.0)           0;0  0.3557 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     135.7009 (2.69)     135.7009 (2.69)     135.7009 (2.69)     0.0000 (1.0)      135.7009 (2.69)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     168.7703 (3.34)     168.7703 (3.34)     168.7703 (3.34)     0.0000 (1.0)      168.7703 (3.34)     0.0000 (1.0)           0;0  0.0059 (0.30)          1           1
test_get-get[3.53.2]     146.6243 (2.90)     146.6243 (2.90)     146.6243 (2.90)     0.0000 (1.0)      146.6243 (2.90)     0.0000 (1.0)           0;0  0.0068 (0.34)          1           1
test_get-get[3.60.1]      50.5118 (1.0)       50.5118 (1.0)       50.5118 (1.0)      0.0000 (1.0)       50.5118 (1.0)      0.0000 (1.0)           0;0  0.0198 (1.0)           1           1
test_get-get[main]        50.9562 (1.01)      50.9562 (1.01)      50.9562 (1.01)     0.0000 (1.0)       50.9562 (1.01)     0.0000 (1.0)           0;0  0.0196 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.4762 (2.64)     44.4762 (2.64)     44.4762 (2.64)     0.0000 (1.0)      44.4762 (2.64)     0.0000 (1.0)           0;0  0.0225 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.8018 (2.84)     47.8018 (2.84)     47.8018 (2.84)     0.0000 (1.0)      47.8018 (2.84)     0.0000 (1.0)           0;0  0.0209 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.8242 (1.0)      16.8242 (1.0)      16.8242 (1.0)      0.0000 (1.0)      16.8242 (1.0)      0.0000 (1.0)           0;0  0.0594 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.9232 (1.01)     16.9232 (1.01)     16.9232 (1.01)     0.0000 (1.0)      16.9232 (1.01)     0.0000 (1.0)           0;0  0.0591 (0.99)          1           1
test_get_url-get-url[main]       17.0260 (1.01)     17.0260 (1.01)     17.0260 (1.01)     0.0000 (1.0)      17.0260 (1.01)     0.0000 (1.0)           0;0  0.0587 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.4526 (1.01)     137.8361 (1.01)     131.1473 (1.04)     2.6278 (1.49)     130.8471 (1.04)     3.4541 (2.96)         35;0  7.6250 (0.96)        100           1
test_help---help[3.10.0]     125.5419 (1.01)     141.8596 (1.04)     130.8476 (1.03)     3.2654 (1.85)     130.4089 (1.03)     4.3656 (3.73)         29;2  7.6425 (0.97)        100           1
test_help---help[3.53.2]     124.1276 (1.0)      142.5075 (1.05)     130.2913 (1.03)     3.2978 (1.87)     130.0254 (1.03)     4.6329 (3.96)         27;2  7.6751 (0.97)        100           1
test_help---help[3.60.1]     124.5797 (1.00)     154.9855 (1.14)     127.8493 (1.01)     4.6998 (2.66)     126.2665 (1.00)     3.5049 (3.00)          8;6  7.8217 (0.99)        100           1
test_help---help[main]       124.4291 (1.00)     135.8056 (1.0)      126.4909 (1.0)      1.7671 (1.0)      126.0997 (1.0)      1.1688 (1.0)          15;9  7.9057 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     225.6737 (2.96)     225.6737 (2.96)     225.6737 (2.96)     0.0000 (1.0)      225.6737 (2.96)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     257.1699 (3.37)     257.1699 (3.37)     257.1699 (3.37)     0.0000 (1.0)      257.1699 (3.37)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      76.3352 (1.0)       76.3352 (1.0)       76.3352 (1.0)      0.0000 (1.0)       76.3352 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
test_import-import[main]        76.6071 (1.00)      76.6071 (1.00)      76.6071 (1.00)     0.0000 (1.0)       76.6071 (1.00)     0.0000 (1.0)           0;0  0.0131 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     156.0234 (3.37)     156.0234 (3.37)     156.0234 (3.37)     0.0000 (1.0)      156.0234 (3.37)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     159.0757 (3.44)     159.0757 (3.44)     159.0757 (3.44)     0.0000 (1.0)      159.0757 (3.44)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_import_url-import-url[3.53.2]     118.4708 (2.56)     118.4708 (2.56)     118.4708 (2.56)     0.0000 (1.0)      118.4708 (2.56)     0.0000 (1.0)           0;0  0.0084 (0.39)          1           1
test_import_url-import-url[3.60.1]      46.2683 (1.0)       46.2683 (1.0)       46.2683 (1.0)      0.0000 (1.0)       46.2683 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_import_url-import-url[main]        46.7335 (1.01)      46.7335 (1.01)      46.7335 (1.01)     0.0000 (1.0)       46.7335 (1.01)     0.0000 (1.0)           0;0  0.0214 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     389.4724 (1.03)     420.7147 (1.02)     397.6111 (1.01)     4.7662 (1.0)      396.9067 (1.01)     5.6997 (1.0)          26;2  2.5150 (0.99)        100           1
test_init-init[3.10.0]     395.0051 (1.04)     451.6840 (1.10)     406.8074 (1.03)     9.1076 (1.91)     404.1656 (1.03)     8.1468 (1.43)         22;9  2.4582 (0.97)        100           1
test_init-init[3.53.2]     379.2789 (1.0)      428.5120 (1.04)     394.9150 (1.00)     8.5310 (1.79)     394.0630 (1.0)      9.2328 (1.62)         24;4  2.5322 (1.00)        100           1
test_init-init[3.60.1]     383.9704 (1.01)     411.9538 (1.0)      394.8911 (1.0)      5.0784 (1.07)     394.2294 (1.00)     7.7391 (1.36)         28;1  2.5323 (1.0)         100           1
test_init-init[main]       381.2888 (1.01)     432.6337 (1.05)     395.5715 (1.00)     6.8468 (1.44)     395.4281 (1.00)     7.1714 (1.26)         22;2  2.5280 (1.00)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     592.0376 (1.15)     592.0376 (1.15)     592.0376 (1.15)     0.0000 (1.0)      592.0376 (1.15)     0.0000 (1.0)           0;0  1.6891 (0.87)          1           1
test_list-list[3.10.0]     651.3384 (1.27)     651.3384 (1.27)     651.3384 (1.27)     0.0000 (1.0)      651.3384 (1.27)     0.0000 (1.0)           0;0  1.5353 (0.79)          1           1
test_list-list[3.53.2]     545.2004 (1.06)     545.2004 (1.06)     545.2004 (1.06)     0.0000 (1.0)      545.2004 (1.06)     0.0000 (1.0)           0;0  1.8342 (0.94)          1           1
test_list-list[3.60.1]     513.1835 (1.0)      513.1835 (1.0)      513.1835 (1.0)      0.0000 (1.0)      513.1835 (1.0)      0.0000 (1.0)           0;0  1.9486 (1.0)           1           1
test_list-list[main]       519.9965 (1.01)     519.9965 (1.01)     519.9965 (1.01)     0.0000 (1.0)      519.9965 (1.01)     0.0000 (1.0)           0;0  1.9231 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     421.5618 (1.10)     421.5618 (1.10)     421.5618 (1.10)     0.0000 (1.0)      421.5618 (1.10)     0.0000 (1.0)           0;0  2.3721 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     412.2735 (1.07)     412.2735 (1.07)     412.2735 (1.07)     0.0000 (1.0)      412.2735 (1.07)     0.0000 (1.0)           0;0  2.4256 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     384.5109 (1.0)      384.5109 (1.0)      384.5109 (1.0)      0.0000 (1.0)      384.5109 (1.0)      0.0000 (1.0)           0;0  2.6007 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     386.6679 (1.01)     386.6679 (1.01)     386.6679 (1.01)     0.0000 (1.0)      386.6679 (1.01)     0.0000 (1.0)           0;0  2.5862 (0.99)          1           1
test_list-list-dvc-only[main]       391.8100 (1.02)     391.8100 (1.02)     391.8100 (1.02)     0.0000 (1.0)      391.8100 (1.02)     0.0000 (1.0)           0;0  2.5523 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8710 (1.10)     2.8710 (1.10)     2.8710 (1.10)     0.0000 (1.0)      2.8710 (1.10)     0.0000 (1.0)           0;0  0.3483 (0.91)          1           1
test_list-list-recursive[3.10.0]     2.6180 (1.0)      2.6180 (1.0)      2.6180 (1.0)      0.0000 (1.0)      2.6180 (1.0)      0.0000 (1.0)           0;0  0.3820 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.6524 (1.01)     2.6524 (1.01)     2.6524 (1.01)     0.0000 (1.0)      2.6524 (1.01)     0.0000 (1.0)           0;0  0.3770 (0.99)          1           1
test_list-list-recursive[3.60.1]     2.7440 (1.05)     2.7440 (1.05)     2.7440 (1.05)     0.0000 (1.0)      2.7440 (1.05)     0.0000 (1.0)           0;0  0.3644 (0.95)          1           1
test_list-list-recursive[main]       2.7616 (1.05)     2.7616 (1.05)     2.7616 (1.05)     0.0000 (1.0)      2.7616 (1.05)     0.0000 (1.0)           0;0  0.3621 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     434.8160 (1.12)     434.8160 (1.12)     434.8160 (1.12)     0.0000 (1.0)      434.8160 (1.12)     0.0000 (1.0)           0;0  2.2998 (0.89)          1           1
test_list-list-shallow[3.10.0]     414.1906 (1.07)     414.1906 (1.07)     414.1906 (1.07)     0.0000 (1.0)      414.1906 (1.07)     0.0000 (1.0)           0;0  2.4143 (0.93)          1           1
test_list-list-shallow[3.53.2]     387.9185 (1.00)     387.9185 (1.00)     387.9185 (1.00)     0.0000 (1.0)      387.9185 (1.00)     0.0000 (1.0)           0;0  2.5779 (1.00)          1           1
test_list-list-shallow[3.60.1]     386.6622 (1.0)      386.6622 (1.0)      386.6622 (1.0)      0.0000 (1.0)      386.6622 (1.0)      0.0000 (1.0)           0;0  2.5862 (1.0)           1           1
test_list-list-shallow[main]       390.1898 (1.01)     390.1898 (1.01)     390.1898 (1.01)     0.0000 (1.0)      390.1898 (1.01)     0.0000 (1.0)           0;0  2.5629 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     11.9722 (3.18)     11.9722 (3.18)     11.9722 (3.18)     0.0000 (1.0)      11.9722 (3.18)     0.0000 (1.0)           0;0  0.0835 (0.31)          1           1
test_partial_add-add[3.10.0]     12.4474 (3.30)     12.4474 (3.30)     12.4474 (3.30)     0.0000 (1.0)      12.4474 (3.30)     0.0000 (1.0)           0;0  0.0803 (0.30)          1           1
test_partial_add-add[3.53.2]     11.0245 (2.93)     11.0245 (2.93)     11.0245 (2.93)     0.0000 (1.0)      11.0245 (2.93)     0.0000 (1.0)           0;0  0.0907 (0.34)          1           1
test_partial_add-add[3.60.1]      3.7682 (1.0)       3.7682 (1.0)       3.7682 (1.0)      0.0000 (1.0)       3.7682 (1.0)      0.0000 (1.0)           0;0  0.2654 (1.0)           1           1
test_partial_add-add[main]        4.3890 (1.16)      4.3890 (1.16)      4.3890 (1.16)     0.0000 (1.0)       4.3890 (1.16)     0.0000 (1.0)           0;0  0.2278 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     80.5857 (4.01)     80.5857 (4.01)     80.5857 (4.01)     0.0000 (1.0)      80.5857 (4.01)     0.0000 (1.0)           0;0  0.0124 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     81.9958 (4.08)     81.9958 (4.08)     81.9958 (4.08)     0.0000 (1.0)      81.9958 (4.08)     0.0000 (1.0)           0;0  0.0122 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     73.5861 (3.66)     73.5861 (3.66)     73.5861 (3.66)     0.0000 (1.0)      73.5861 (3.66)     0.0000 (1.0)           0;0  0.0136 (0.27)          1           1
test_partial_add-add-partial[3.60.1]     20.0990 (1.0)      20.0990 (1.0)      20.0990 (1.0)      0.0000 (1.0)      20.0990 (1.0)      0.0000 (1.0)           0;0  0.0498 (1.0)           1           1
test_partial_add-add-partial[main]       20.2993 (1.01)     20.2993 (1.01)     20.2993 (1.01)     0.0000 (1.0)      20.2993 (1.01)     0.0000 (1.0)           0;0  0.0493 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5425 (1.0)      4.5425 (1.0)      4.5425 (1.0)      0.0000 (1.0)      4.5425 (1.0)      0.0000 (1.0)           0;0  0.2201 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8367 (1.28)     5.8367 (1.28)     5.8367 (1.28)     0.0000 (1.0)      5.8367 (1.28)     0.0000 (1.0)           0;0  0.1713 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7020 (1.48)     6.7020 (1.48)     6.7020 (1.48)     0.0000 (1.0)      6.7020 (1.48)     0.0000 (1.0)           0;0  0.1492 (0.68)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7849 (1.49)     6.7849 (1.49)     6.7849 (1.49)     0.0000 (1.0)      6.7849 (1.49)     0.0000 (1.0)           0;0  0.1474 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       6.9123 (1.52)     6.9123 (1.52)     6.9123 (1.52)     0.0000 (1.0)      6.9123 (1.52)     0.0000 (1.0)           0;0  0.1447 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5873 (1.0)      2.5873 (1.0)      2.5873 (1.0)      0.0000 (1.0)      2.5873 (1.0)      0.0000 (1.0)           0;0  0.3865 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7560 (1.45)     3.7560 (1.45)     3.7560 (1.45)     0.0000 (1.0)      3.7560 (1.45)     0.0000 (1.0)           0;0  0.2662 (0.69)          1           1
test_partial_add-gc-noop[3.53.2]     3.8085 (1.47)     3.8085 (1.47)     3.8085 (1.47)     0.0000 (1.0)      3.8085 (1.47)     0.0000 (1.0)           0;0  0.2626 (0.68)          1           1
test_partial_add-gc-noop[3.60.1]     3.8474 (1.49)     3.8474 (1.49)     3.8474 (1.49)     0.0000 (1.0)      3.8474 (1.49)     0.0000 (1.0)           0;0  0.2599 (0.67)          1           1
test_partial_add-gc-noop[main]       3.7811 (1.46)     3.7811 (1.46)     3.7811 (1.46)     0.0000 (1.0)      3.7811 (1.46)     0.0000 (1.0)           0;0  0.2645 (0.68)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7860 (2.19)     7.7860 (2.19)     7.7860 (2.19)     0.0000 (1.0)      7.7860 (2.19)     0.0000 (1.0)           0;0  0.1284 (0.46)          1           1
test_partial_add-push[3.10.0]     6.9767 (1.96)     6.9767 (1.96)     6.9767 (1.96)     0.0000 (1.0)      6.9767 (1.96)     0.0000 (1.0)           0;0  0.1433 (0.51)          1           1
test_partial_add-push[3.53.2]     3.6594 (1.03)     3.6594 (1.03)     3.6594 (1.03)     0.0000 (1.0)      3.6594 (1.03)     0.0000 (1.0)           0;0  0.2733 (0.97)          1           1
test_partial_add-push[3.60.1]     3.5543 (1.0)      3.5543 (1.0)      3.5543 (1.0)      0.0000 (1.0)      3.5543 (1.0)      0.0000 (1.0)           0;0  0.2814 (1.0)           1           1
test_partial_add-push[main]       3.6257 (1.02)     3.6257 (1.02)     3.6257 (1.02)     0.0000 (1.0)      3.6257 (1.02)     0.0000 (1.0)           0;0  0.2758 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.0220 (2.22)     45.0220 (2.22)     45.0220 (2.22)     0.0000 (1.0)      45.0220 (2.22)     0.0000 (1.0)           0;0  0.0222 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     40.0488 (1.98)     40.0488 (1.98)     40.0488 (1.98)     0.0000 (1.0)      40.0488 (1.98)     0.0000 (1.0)           0;0  0.0250 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.0097 (1.04)     21.0097 (1.04)     21.0097 (1.04)     0.0000 (1.0)      21.0097 (1.04)     0.0000 (1.0)           0;0  0.0476 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     20.3814 (1.01)     20.3814 (1.01)     20.3814 (1.01)     0.0000 (1.0)      20.3814 (1.01)     0.0000 (1.0)           0;0  0.0491 (0.99)          1           1
test_partial_add-push-partial[main]       20.2652 (1.0)      20.2652 (1.0)      20.2652 (1.0)      0.0000 (1.0)      20.2652 (1.0)      0.0000 (1.0)           0;0  0.0493 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.1626 (3.70)     85.1626 (3.70)     85.1626 (3.70)     0.0000 (1.0)      85.1626 (3.70)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     85.3235 (3.71)     85.3235 (3.71)     85.3235 (3.71)     0.0000 (1.0)      85.3235 (3.71)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.53.2]     77.1721 (3.36)     77.1721 (3.36)     77.1721 (3.36)     0.0000 (1.0)      77.1721 (3.36)     0.0000 (1.0)           0;0  0.0130 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.9885 (1.0)      22.9885 (1.0)      22.9885 (1.0)      0.0000 (1.0)      22.9885 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_partial_remove-add[main]       23.3877 (1.02)     23.3877 (1.02)     23.3877 (1.02)     0.0000 (1.0)      23.3877 (1.02)     0.0000 (1.0)           0;0  0.0428 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     48.6254 (12.83)    48.6254 (12.83)    48.6254 (12.83)    0.0000 (1.0)      48.6254 (12.83)    0.0000 (1.0)           0;0  0.0206 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     48.7121 (12.86)    48.7121 (12.86)    48.7121 (12.86)    0.0000 (1.0)      48.7121 (12.86)    0.0000 (1.0)           0;0  0.0205 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.8348 (11.57)    43.8348 (11.57)    43.8348 (11.57)    0.0000 (1.0)      43.8348 (11.57)    0.0000 (1.0)           0;0  0.0228 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.9096 (1.03)      3.9096 (1.03)      3.9096 (1.03)     0.0000 (1.0)       3.9096 (1.03)     0.0000 (1.0)           0;0  0.2558 (0.97)          1           1
test_partial_remove-add-update[main]        3.7888 (1.0)       3.7888 (1.0)       3.7888 (1.0)      0.0000 (1.0)       3.7888 (1.0)      0.0000 (1.0)           0;0  0.2639 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5081 (1.0)      2.5081 (1.0)      2.5081 (1.0)      0.0000 (1.0)      2.5081 (1.0)      0.0000 (1.0)           0;0  0.3987 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6229 (1.44)     3.6229 (1.44)     3.6229 (1.44)     0.0000 (1.0)      3.6229 (1.44)     0.0000 (1.0)           0;0  0.2760 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.8387 (1.53)     3.8387 (1.53)     3.8387 (1.53)     0.0000 (1.0)      3.8387 (1.53)     0.0000 (1.0)           0;0  0.2605 (0.65)          1           1
test_partial_remove-gc[3.60.1]     3.7009 (1.48)     3.7009 (1.48)     3.7009 (1.48)     0.0000 (1.0)      3.7009 (1.48)     0.0000 (1.0)           0;0  0.2702 (0.68)          1           1
test_partial_remove-gc[main]       3.6414 (1.45)     3.6414 (1.45)     3.6414 (1.45)     0.0000 (1.0)      3.6414 (1.45)     0.0000 (1.0)           0;0  0.2746 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.5720 (1.0)      4.5720 (1.0)      4.5720 (1.0)      0.0000 (1.0)      4.5720 (1.0)      0.0000 (1.0)           0;0  0.2187 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.8589 (1.28)     5.8589 (1.28)     5.8589 (1.28)     0.0000 (1.0)      5.8589 (1.28)     0.0000 (1.0)           0;0  0.1707 (0.78)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.4407 (1.41)     6.4407 (1.41)     6.4407 (1.41)     0.0000 (1.0)      6.4407 (1.41)     0.0000 (1.0)           0;0  0.1553 (0.71)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.3981 (1.40)     6.3981 (1.40)     6.3981 (1.40)     0.0000 (1.0)      6.3981 (1.40)     0.0000 (1.0)           0;0  0.1563 (0.71)          1           1
test_partial_remove-gc-cloud[main]       6.4675 (1.41)     6.4675 (1.41)     6.4675 (1.41)     0.0000 (1.0)      6.4675 (1.41)     0.0000 (1.0)           0;0  0.1546 (0.71)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.6378 (2.36)     51.6378 (2.36)     51.6378 (2.36)     0.0000 (1.0)      51.6378 (2.36)     0.0000 (1.0)           0;0  0.0194 (0.42)          1           1
test_partial_remove-push[3.10.0]     45.3236 (2.07)     45.3236 (2.07)     45.3236 (2.07)     0.0000 (1.0)      45.3236 (2.07)     0.0000 (1.0)           0;0  0.0221 (0.48)          1           1
test_partial_remove-push[3.53.2]     22.8649 (1.05)     22.8649 (1.05)     22.8649 (1.05)     0.0000 (1.0)      22.8649 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.7498 (1.04)     22.7498 (1.04)     22.7498 (1.04)     0.0000 (1.0)      22.7498 (1.04)     0.0000 (1.0)           0;0  0.0440 (0.96)          1           1
test_partial_remove-push[main]       21.8698 (1.0)      21.8698 (1.0)      21.8698 (1.0)      0.0000 (1.0)      21.8698 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8546 (1.0)      3.8546 (1.0)      3.8546 (1.0)      0.0000 (1.0)      3.8546 (1.0)      0.0000 (1.0)           0;0  0.2594 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.8732 (1.00)     3.8732 (1.00)     3.8732 (1.00)     0.0000 (1.0)      3.8732 (1.00)     0.0000 (1.0)           0;0  0.2582 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     7.0481 (1.83)     7.0481 (1.83)     7.0481 (1.83)     0.0000 (1.0)      7.0481 (1.83)     0.0000 (1.0)           0;0  0.1419 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.3345 (1.90)     7.3345 (1.90)     7.3345 (1.90)     0.0000 (1.0)      7.3345 (1.90)     0.0000 (1.0)           0;0  0.1363 (0.53)          1           1
test_partial_remove-push-update[main]       7.1801 (1.86)     7.1801 (1.86)     7.1801 (1.86)     0.0000 (1.0)      7.1801 (1.86)     0.0000 (1.0)           0;0  0.1393 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     479.9581 (1.0)      481.4618 (1.0)      480.6229 (1.0)       0.7641 (1.0)      480.2885 (1.0)       1.4705 (1.0)           2;0  2.0806 (1.0)           5           3
test_plots-plots-diff[3.10.0]     874.9927 (1.82)     915.8691 (1.90)     888.3043 (1.85)     18.0202 (23.58)    877.3891 (1.83)     26.5542 (18.06)         1;0  1.1257 (0.54)          5           3
test_plots-plots-diff[3.53.2]     792.6458 (1.65)     803.9049 (1.67)     796.6050 (1.66)      4.5199 (5.92)     794.4048 (1.65)      5.6728 (3.86)          1;0  1.2553 (0.60)          5           3
test_plots-plots-diff[3.60.1]     793.4105 (1.65)     824.3223 (1.71)     812.4341 (1.69)     12.0653 (15.79)    815.9930 (1.70)     15.9435 (10.84)         1;0  1.2309 (0.59)          5           3
test_plots-plots-diff[main]       791.3953 (1.65)     795.4979 (1.65)     793.6706 (1.65)      1.7324 (2.27)     794.1688 (1.65)      2.9346 (2.00)          2;0  1.2600 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       494.2610 (1.0)        520.2821 (1.0)        502.2740 (1.0)      10.3230 (6.68)       498.9709 (1.0)       8.7453 (6.21)          1;1  1.9909 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,114.0626 (2.25)     1,159.6743 (2.23)     1,139.2229 (2.27)     20.3649 (13.19)    1,145.8931 (2.30)     36.5295 (25.92)         2;0  0.8778 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       871.1029 (1.76)       876.3281 (1.68)       873.8627 (1.74)      1.9754 (1.28)       873.5569 (1.75)      2.6646 (1.89)          2;0  1.1443 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       875.8445 (1.77)       921.0527 (1.77)       886.1310 (1.76)     19.5999 (12.69)      876.9428 (1.76)     14.2164 (10.09)         1;1  1.1285 (0.57)          5           3
test_plots-plots-diff-json[main]         870.8857 (1.76)       874.7715 (1.68)       872.0917 (1.74)      1.5444 (1.0)        871.5131 (1.75)      1.4091 (1.0)           1;1  1.1467 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     398.0210 (1.0)      402.2112 (1.0)      399.8871 (1.0)      2.0244 (1.90)     399.1144 (1.0)      3.8261 (2.09)          1;0  2.5007 (1.0)           5           3
test_plots-plots-show[3.10.0]     705.5746 (1.77)     713.4714 (1.77)     708.5764 (1.77)     3.0579 (2.87)     707.7591 (1.77)     3.8668 (2.11)          1;0  1.4113 (0.56)          5           3
test_plots-plots-show[3.53.2]     692.4061 (1.74)     712.0668 (1.77)     703.0130 (1.76)     7.0842 (6.65)     702.9920 (1.76)     7.2933 (3.98)          2;0  1.4224 (0.57)          5           3
test_plots-plots-show[3.60.1]     680.3385 (1.71)     682.7599 (1.70)     681.4762 (1.70)     1.0659 (1.0)      681.8396 (1.71)     1.8333 (1.0)           3;0  1.4674 (0.59)          5           3
test_plots-plots-show[main]       676.1454 (1.70)     682.6865 (1.70)     678.9835 (1.70)     2.4885 (2.33)     678.5346 (1.70)     3.3828 (1.85)          2;0  1.4728 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     413.7670 (1.0)      417.3627 (1.0)      415.3046 (1.0)       1.4661 (1.0)      415.4742 (1.0)       2.2942 (1.06)          2;0  2.4079 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     842.9666 (2.04)     895.5545 (2.15)     858.4686 (2.07)     21.1619 (14.43)    851.1695 (2.05)     17.9287 (8.26)          1;1  1.1649 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     729.0708 (1.76)     735.2815 (1.76)     731.0013 (1.76)      2.4664 (1.68)     729.9529 (1.76)      2.1701 (1.0)           1;1  1.3680 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     725.4779 (1.75)     730.3887 (1.75)     727.7158 (1.75)      1.8458 (1.26)     727.5318 (1.75)      2.4873 (1.15)          2;0  1.3742 (0.57)          5           3
test_plots-plots-show-json[main]       723.0936 (1.75)     727.0296 (1.74)     725.2262 (1.75)      1.7143 (1.17)     725.7550 (1.75)      3.0121 (1.39)          2;0  1.3789 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.1855 (2.39)     52.1855 (2.39)     52.1855 (2.39)     0.0000 (1.0)      52.1855 (2.39)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_push-push[3.10.0]     46.5289 (2.13)     46.5289 (2.13)     46.5289 (2.13)     0.0000 (1.0)      46.5289 (2.13)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_push-push[3.53.2]     22.9086 (1.05)     22.9086 (1.05)     22.9086 (1.05)     0.0000 (1.0)      22.9086 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.95)          1           1
test_push-push[3.60.1]     21.8020 (1.0)      21.8020 (1.0)      21.8020 (1.0)      0.0000 (1.0)      21.8020 (1.0)      0.0000 (1.0)           0;0  0.0459 (1.0)           1           1
test_push-push[main]       22.0930 (1.01)     22.0930 (1.01)     22.0930 (1.01)     0.0000 (1.0)      22.0930 (1.01)     0.0000 (1.0)           0;0  0.0453 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.7069 (2.79)     64.7069 (2.79)     64.7069 (2.79)     0.0000 (1.0)      64.7069 (2.79)     0.0000 (1.0)           0;0  0.0155 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.0204 (3.02)     70.0204 (3.02)     70.0204 (3.02)     0.0000 (1.0)      70.0204 (3.02)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.2813 (1.43)     33.2813 (1.43)     33.2813 (1.43)     0.0000 (1.0)      33.2813 (1.43)     0.0000 (1.0)           0;0  0.0300 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.1964 (1.0)      23.1964 (1.0)      23.1964 (1.0)      0.0000 (1.0)      23.1964 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
test_sharing-fetch[main]       23.2385 (1.00)     23.2385 (1.00)     23.2385 (1.00)     0.0000 (1.0)      23.2385 (1.00)     0.0000 (1.0)           0;0  0.0430 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2244 (1.0)      1.2244 (1.0)      1.2244 (1.0)      0.0000 (1.0)      1.2244 (1.0)      0.0000 (1.0)           0;0  0.8167 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6378 (2.97)     3.6378 (2.97)     3.6378 (2.97)     0.0000 (1.0)      3.6378 (2.97)     0.0000 (1.0)           0;0  0.2749 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6837 (4.64)     5.6837 (4.64)     5.6837 (4.64)     0.0000 (1.0)      5.6837 (4.64)     0.0000 (1.0)           0;0  0.1759 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8559 (4.78)     5.8559 (4.78)     5.8559 (4.78)     0.0000 (1.0)      5.8559 (4.78)     0.0000 (1.0)           0;0  0.1708 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7737 (4.72)     5.7737 (4.72)     5.7737 (4.72)     0.0000 (1.0)      5.7737 (4.72)     0.0000 (1.0)           0;0  0.1732 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.4866 (2.38)     52.4866 (2.38)     52.4866 (2.38)     0.0000 (1.0)      52.4866 (2.38)     0.0000 (1.0)           0;0  0.0191 (0.42)          1           1
test_sharing-push[3.10.0]     46.3201 (2.10)     46.3201 (2.10)     46.3201 (2.10)     0.0000 (1.0)      46.3201 (2.10)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_sharing-push[3.53.2]     23.2890 (1.05)     23.2890 (1.05)     23.2890 (1.05)     0.0000 (1.0)      23.2890 (1.05)     0.0000 (1.0)           0;0  0.0429 (0.95)          1           1
test_sharing-push[3.60.1]     22.0938 (1.0)      22.0938 (1.0)      22.0938 (1.0)      0.0000 (1.0)      22.0938 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
test_sharing-push[main]       22.3814 (1.01)     22.3814 (1.01)     22.3814 (1.01)     0.0000 (1.0)      22.3814 (1.01)     0.0000 (1.0)           0;0  0.0447 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1229 (1.03)     2.1229 (1.03)     2.1229 (1.03)     0.0000 (1.0)      2.1229 (1.03)     0.0000 (1.0)           0;0  0.4711 (0.97)          1           1
test_sharing-push-noop[3.10.0]     2.0553 (1.0)      2.0553 (1.0)      2.0553 (1.0)      0.0000 (1.0)      2.0553 (1.0)      0.0000 (1.0)           0;0  0.4865 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9118 (2.88)     5.9118 (2.88)     5.9118 (2.88)     0.0000 (1.0)      5.9118 (2.88)     0.0000 (1.0)           0;0  0.1692 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.9284 (2.88)     5.9284 (2.88)     5.9284 (2.88)     0.0000 (1.0)      5.9284 (2.88)     0.0000 (1.0)           0;0  0.1687 (0.35)          1           1
test_sharing-push-noop[main]       5.8950 (2.87)     5.8950 (2.87)     5.8950 (2.87)     0.0000 (1.0)      5.8950 (2.87)     0.0000 (1.0)           0;0  0.1696 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.2199 (3.75)     19.2199 (3.75)     19.2199 (3.75)     0.0000 (1.0)      19.2199 (3.75)     0.0000 (1.0)           0;0  0.0520 (0.27)          1           1
test_status-status[3.10.0]     19.8845 (3.88)     19.8845 (3.88)     19.8845 (3.88)     0.0000 (1.0)      19.8845 (3.88)     0.0000 (1.0)           0;0  0.0503 (0.26)          1           1
test_status-status[3.53.2]     17.6924 (3.45)     17.6924 (3.45)     17.6924 (3.45)     0.0000 (1.0)      17.6924 (3.45)     0.0000 (1.0)           0;0  0.0565 (0.29)          1           1
test_status-status[3.60.1]      5.1210 (1.0)       5.1210 (1.0)       5.1210 (1.0)      0.0000 (1.0)       5.1210 (1.0)      0.0000 (1.0)           0;0  0.1953 (1.0)           1           1
test_status-status[main]        5.1430 (1.00)      5.1430 (1.00)      5.1430 (1.00)     0.0000 (1.0)       5.1430 (1.00)     0.0000 (1.0)           0;0  0.1944 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6205 (1.75)     4.6205 (1.75)     4.6205 (1.75)     0.0000 (1.0)      4.6205 (1.75)     0.0000 (1.0)           0;0  0.2164 (0.57)          1           1
test_status-status-changed[3.10.0]     4.9876 (1.89)     4.9876 (1.89)     4.9876 (1.89)     0.0000 (1.0)      4.9876 (1.89)     0.0000 (1.0)           0;0  0.2005 (0.53)          1           1
test_status-status-changed[3.53.2]     4.8327 (1.83)     4.8327 (1.83)     4.8327 (1.83)     0.0000 (1.0)      4.8327 (1.83)     0.0000 (1.0)           0;0  0.2069 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6405 (1.0)      2.6405 (1.0)      2.6405 (1.0)      0.0000 (1.0)      2.6405 (1.0)      0.0000 (1.0)           0;0  0.3787 (1.0)           1           1
test_status-status-changed[main]       2.6550 (1.01)     2.6550 (1.01)     2.6550 (1.01)     0.0000 (1.0)      2.6550 (1.01)     0.0000 (1.0)           0;0  0.3767 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7353 (1.86)     4.7353 (1.86)     4.7353 (1.86)     0.0000 (1.0)      4.7353 (1.86)     0.0000 (1.0)           0;0  0.2112 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.9504 (1.95)     4.9504 (1.95)     4.9504 (1.95)     0.0000 (1.0)      4.9504 (1.95)     0.0000 (1.0)           0;0  0.2020 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     4.6563 (1.83)     4.6563 (1.83)     4.6563 (1.83)     0.0000 (1.0)      4.6563 (1.83)     0.0000 (1.0)           0;0  0.2148 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.5407 (1.0)      2.5407 (1.0)      2.5407 (1.0)      0.0000 (1.0)      2.5407 (1.0)      0.0000 (1.0)           0;0  0.3936 (1.0)           1           1
test_status-status-changed-noop[main]       2.5815 (1.02)     2.5815 (1.02)     2.5815 (1.02)     0.0000 (1.0)      2.5815 (1.02)     0.0000 (1.0)           0;0  0.3874 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.6768 (1.81)     4.6768 (1.81)     4.6768 (1.81)     0.0000 (1.0)      4.6768 (1.81)     0.0000 (1.0)           0;0  0.2138 (0.55)          1           1
test_status-status-noop[3.10.0]     4.7659 (1.85)     4.7659 (1.85)     4.7659 (1.85)     0.0000 (1.0)      4.7659 (1.85)     0.0000 (1.0)           0;0  0.2098 (0.54)          1           1
test_status-status-noop[3.53.2]     4.7230 (1.83)     4.7230 (1.83)     4.7230 (1.83)     0.0000 (1.0)      4.7230 (1.83)     0.0000 (1.0)           0;0  0.2117 (0.55)          1           1
test_status-status-noop[3.60.1]     2.5800 (1.0)      2.5800 (1.0)      2.5800 (1.0)      0.0000 (1.0)      2.5800 (1.0)      0.0000 (1.0)           0;0  0.3876 (1.0)           1           1
test_status-status-noop[main]       2.5946 (1.01)     2.5946 (1.01)     2.5946 (1.01)     0.0000 (1.0)      2.5946 (1.01)     0.0000 (1.0)           0;0  0.3854 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     154.3217 (3.34)     154.3217 (3.34)     154.3217 (3.34)     0.0000 (1.0)      154.3217 (3.34)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.10.0]     156.5986 (3.39)     156.5986 (3.39)     156.5986 (3.39)     0.0000 (1.0)      156.5986 (3.39)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_update-import-url[3.53.2]     116.4302 (2.52)     116.4302 (2.52)     116.4302 (2.52)     0.0000 (1.0)      116.4302 (2.52)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.1547 (1.0)       46.1547 (1.0)       46.1547 (1.0)      0.0000 (1.0)       46.1547 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_update-import-url[main]        46.6108 (1.01)      46.6108 (1.01)      46.6108 (1.01)     0.0000 (1.0)       46.6108 (1.01)     0.0000 (1.0)           0;0  0.0215 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     139.1174 (3.92)     139.1174 (3.92)     139.1174 (3.92)     0.0000 (1.0)      139.1174 (3.92)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     142.0431 (4.00)     142.0431 (4.00)     142.0431 (4.00)     0.0000 (1.0)      142.0431 (4.00)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.53.2]     107.4470 (3.02)     107.4470 (3.02)     107.4470 (3.02)     0.0000 (1.0)      107.4470 (3.02)     0.0000 (1.0)           0;0  0.0093 (0.33)          1           1
test_update-update[3.60.1]      35.7746 (1.01)      35.7746 (1.01)      35.7746 (1.01)     0.0000 (1.0)       35.7746 (1.01)     0.0000 (1.0)           0;0  0.0280 (0.99)          1           1
test_update-update[main]        35.5214 (1.0)       35.5214 (1.0)       35.5214 (1.0)      0.0000 (1.0)       35.5214 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.7954 (2.06)     15.7954 (2.06)     15.7954 (2.06)     0.0000 (1.0)      15.7954 (2.06)     0.0000 (1.0)           0;0  0.0633 (0.49)          1           1
test_update-update-noop[3.10.0]     16.6680 (2.17)     16.6680 (2.17)     16.6680 (2.17)     0.0000 (1.0)      16.6680 (2.17)     0.0000 (1.0)           0;0  0.0600 (0.46)          1           1
test_update-update-noop[3.53.2]     15.8085 (2.06)     15.8085 (2.06)     15.8085 (2.06)     0.0000 (1.0)      15.8085 (2.06)     0.0000 (1.0)           0;0  0.0633 (0.49)          1           1
test_update-update-noop[3.60.1]      7.7817 (1.01)      7.7817 (1.01)      7.7817 (1.01)     0.0000 (1.0)       7.7817 (1.01)     0.0000 (1.0)           0;0  0.1285 (0.99)          1           1
test_update-update-noop[main]        7.6707 (1.0)       7.6707 (1.0)       7.6707 (1.0)      0.0000 (1.0)       7.6707 (1.0)      0.0000 (1.0)           0;0  0.1304 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean